2023-06-09T04:23:57.842 INFO:root:teuthology version: 0.0.1.dev120+g2ef0dcd 2023-06-09T04:23:57.844 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/xiubli-2023-06-09_04:16:27-fs:functional-wip-lxb-fscrypt-20230607-0901-distro-default-smithi/7299735 --verbose --owner scheduled_xiubli@teuthology --name xiubli-2023-06-09_04:16:27-fs:functional-wip-lxb-fscrypt-20230607-0901-distro-default-smithi --description fs:functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev} -- /home/teuthworker/archive/xiubli-2023-06-09_04:16:27-fs:functional-wip-lxb-fscrypt-20230607-0901-distro-default-smithi/7299735/orig.config.yaml 2023-06-09T04:23:57.894 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-09T04:23:57.988 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/xiubli-2023-06-09_04:16:27-fs:functional-wip-lxb-fscrypt-20230607-0901-distro-default-smithi/7299735 branch: wip-lxb-fscrypt-20230607-0901 description: fs:functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev} email: null first_in_suite: false job_id: '7299735' kernel: client: branch: testing kdb: true sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: xiubli-2023-06-09_04:16:27-fs:functional-wip-lxb-fscrypt-20230607-0901-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '20.04' overrides: admin_socket: branch: wip-lxb-fscrypt-20230607-0901 ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: a02638f808b8fe11bccdd01222c0e6e2eb71120b ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: a02638f808b8fe11bccdd01222c0e6e2eb71120b kclient: syntax: v2 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-lxb-fscrypt-20230607-0901 sha1: a02638f808b8fe11bccdd01222c0e6e2eb71120b owner: scheduled_xiubli@teuthology priority: 110 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 sha1: a02638f808b8fe11bccdd01222c0e6e2eb71120b sleep_before_teardown: 0 suite: fs:functional suite_branch: wip-lxb-fscrypt-20230607-0901 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_a02638f808b8fe11bccdd01222c0e6e2eb71120b/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: a02638f808b8fe11bccdd01222c0e6e2eb71120b syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi090.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwINnmi+N3LgR9ET61cABYBnDJDAAQE1klaPINljTOvitiIM3/5ICam+qurn41RkfyLPz4uwE1yDyHeI7QBKChMImagaJPfltOSsFsTn67ifp6uunrBJblDzycEd7/lJfdMwBn8dApfOw5SSnVdpzpaKWGNpPqshrinViULNhTz2PMAkza/R7qM6v4qqKKxQx/yVi8/Lt03nxO672k5WH/Wkz7KHX4nwyeTelksSojH9SBt4yR4WpLbMjuFX33Ag14KBWr9YQ30L5/h7VtBLQL+2c7sq3Bnll5zj8H+sIa0hOHmwR5sxs4cVs6Eb4Cblr6xTs0Q9vQefWDDYNL4qRpuj1NO+bW1xGcALK9TujCJ0/fdcMLQ0/r4QukVxSE1j6frwWwo/u8lxTTp/wbNVU14w+37ppSvzcPbOD5FNnCu4PMHgrtqp02ggncjqMYpHvxXoQ53JPn84XfXX04vWf5emRMQ76T0NvWW0jYtj7x7ex7l/iEGUGHVnaOmjLqij0= smithi174.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwINnmi+N3LgR9ET61cABYBnDJDAAQE1klaPINljTOvitiIM3/5ICam+qurn41RkfyLPz4uwE1yDyHeI7QBKChMImagaJPfltOSsFsTn67ifp6uunrBJblDzycEd7/lJfdMwBn8dApfOw5SSnVdpzpaKWGNpPqshrinViULNhTz2PMAkza/R7qM6v4qqKKxQx/yVi8/Lt03nxO672k5WH/Wkz7KHX4nwyeTelksSojH9SBt4yR4WpLbMjuFX33Ag14KBWr9YQ30L5/h7VtBLQL+2c7sq3Bnll5zj8H+sIa0hOHmwR5sxs4cVs6Eb4Cblr6xTs0Q9vQefWDDYNL4qRpuj1NO+bW1xGcALK9TujCJ0/fdcMLQ0/r4QukVxSE1j6frwWwo/u8lxTTp/wbNVU14w+37ppSvzcPbOD5FNnCu4PMHgrtqp02ggncjqMYpHvxXoQ53JPn84XfXX04vWf5emRMQ76T0NvWW0jYtj7x7ex7l/iEGUGHVnaOmjLqij0= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: null - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.tests_from_xfstests_dev teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 2ef0dcdee569e9851c9d2ffb6acfd4b80d031e61 timestamp: 2023-06-09_04:16:27 tube: smithi user: xiubli verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.23459 2023-06-09T04:23:57.989 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_a02638f808b8fe11bccdd01222c0e6e2eb71120b/qa; will attempt to use it 2023-06-09T04:23:57.990 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_a02638f808b8fe11bccdd01222c0e6e2eb71120b/qa/tasks 2023-06-09T04:23:57.990 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-06-09T04:23:57.992 INFO:teuthology.task.internal:Checking packages... 2023-06-09T04:23:58.021 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash 'a02638f808b8fe11bccdd01222c0e6e2eb71120b' 2023-06-09T04:23:58.021 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-06-09T04:23:58.022 INFO:teuthology.packaging:ref: None 2023-06-09T04:23:58.022 INFO:teuthology.packaging:tag: None 2023-06-09T04:23:58.022 INFO:teuthology.packaging:branch: wip-lxb-fscrypt-20230607-0901 2023-06-09T04:23:58.022 INFO:teuthology.packaging:sha1: a02638f808b8fe11bccdd01222c0e6e2eb71120b 2023-06-09T04:23:58.023 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=wip-lxb-fscrypt-20230607-0901 2023-06-09T04:23:58.237 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-4313-ga02638f8-1focal 2023-06-09T04:23:58.237 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-06-09T04:23:58.244 INFO:teuthology.task.internal:no buildpackages task found 2023-06-09T04:23:58.244 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-06-09T04:23:58.277 INFO:teuthology.task.internal:Saving configuration 2023-06-09T04:23:58.297 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-06-09T04:23:58.313 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-09T04:23:58.342 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi090.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/xiubli-2023-06-09_04:16:27-fs:functional-wip-lxb-fscrypt-20230607-0901-distro-default-smithi/7299735', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-09 04:16:33.424871', 'locked_by': 'scheduled_xiubli@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2023-06-09T04:23:58.364 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi174.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/xiubli-2023-06-09_04:16:27-fs:functional-wip-lxb-fscrypt-20230607-0901-distro-default-smithi/7299735', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-09 04:16:33.426417', 'locked_by': 'scheduled_xiubli@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2023-06-09T04:23:58.365 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-06-09T04:23:58.371 INFO:teuthology.task.internal:roles: ubuntu@smithi090.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-06-09T04:23:58.371 INFO:teuthology.task.internal:roles: ubuntu@smithi174.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-06-09T04:23:58.372 INFO:teuthology.run_tasks:Running task console_log... 2023-06-09T04:23:58.455 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f549e2b7f70>, signals=[15]) 2023-06-09T04:23:58.456 INFO:teuthology.run_tasks:Running task internal.connect... 2023-06-09T04:23:58.463 INFO:teuthology.task.internal:Opening connections... 2023-06-09T04:23:58.463 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi090.front.sepia.ceph.com 2023-06-09T04:23:58.465 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-09T04:23:58.514 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi174.front.sepia.ceph.com 2023-06-09T04:23:58.515 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-09T04:23:58.566 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-06-09T04:23:58.573 DEBUG:teuthology.orchestra.run.smithi090:> uname -m 2023-06-09T04:23:58.595 INFO:teuthology.orchestra.run.smithi090.stdout:x86_64 2023-06-09T04:23:58.596 DEBUG:teuthology.orchestra.run.smithi090:> cat /etc/os-release 2023-06-09T04:23:58.645 INFO:teuthology.orchestra.run.smithi090.stdout:NAME="Ubuntu" 2023-06-09T04:23:58.645 INFO:teuthology.orchestra.run.smithi090.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-06-09T04:23:58.646 INFO:teuthology.orchestra.run.smithi090.stdout:ID=ubuntu 2023-06-09T04:23:58.646 INFO:teuthology.orchestra.run.smithi090.stdout:ID_LIKE=debian 2023-06-09T04:23:58.646 INFO:teuthology.orchestra.run.smithi090.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-06-09T04:23:58.646 INFO:teuthology.orchestra.run.smithi090.stdout:VERSION_ID="20.04" 2023-06-09T04:23:58.647 INFO:teuthology.orchestra.run.smithi090.stdout:HOME_URL="https://www.ubuntu.com/" 2023-06-09T04:23:58.647 INFO:teuthology.orchestra.run.smithi090.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-06-09T04:23:58.648 INFO:teuthology.orchestra.run.smithi090.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-06-09T04:23:58.648 INFO:teuthology.orchestra.run.smithi090.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-06-09T04:23:58.648 INFO:teuthology.orchestra.run.smithi090.stdout:VERSION_CODENAME=focal 2023-06-09T04:23:58.648 INFO:teuthology.orchestra.run.smithi090.stdout:UBUNTU_CODENAME=focal 2023-06-09T04:23:58.650 INFO:teuthology.lock.ops:Updating smithi090.front.sepia.ceph.com on lock server 2023-06-09T04:23:58.676 DEBUG:teuthology.orchestra.run.smithi174:> uname -m 2023-06-09T04:23:58.683 INFO:teuthology.orchestra.run.smithi174.stdout:x86_64 2023-06-09T04:23:58.684 DEBUG:teuthology.orchestra.run.smithi174:> cat /etc/os-release 2023-06-09T04:23:58.733 INFO:teuthology.orchestra.run.smithi174.stdout:NAME="Ubuntu" 2023-06-09T04:23:58.733 INFO:teuthology.orchestra.run.smithi174.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-06-09T04:23:58.733 INFO:teuthology.orchestra.run.smithi174.stdout:ID=ubuntu 2023-06-09T04:23:58.733 INFO:teuthology.orchestra.run.smithi174.stdout:ID_LIKE=debian 2023-06-09T04:23:58.733 INFO:teuthology.orchestra.run.smithi174.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-06-09T04:23:58.733 INFO:teuthology.orchestra.run.smithi174.stdout:VERSION_ID="20.04" 2023-06-09T04:23:58.734 INFO:teuthology.orchestra.run.smithi174.stdout:HOME_URL="https://www.ubuntu.com/" 2023-06-09T04:23:58.734 INFO:teuthology.orchestra.run.smithi174.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-06-09T04:23:58.734 INFO:teuthology.orchestra.run.smithi174.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-06-09T04:23:58.734 INFO:teuthology.orchestra.run.smithi174.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-06-09T04:23:58.734 INFO:teuthology.orchestra.run.smithi174.stdout:VERSION_CODENAME=focal 2023-06-09T04:23:58.734 INFO:teuthology.orchestra.run.smithi174.stdout:UBUNTU_CODENAME=focal 2023-06-09T04:23:58.735 INFO:teuthology.lock.ops:Updating smithi174.front.sepia.ceph.com on lock server 2023-06-09T04:23:58.759 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-06-09T04:23:58.772 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-06-09T04:23:58.779 INFO:teuthology.task.internal:Checking for old test directory... 2023-06-09T04:23:58.779 DEBUG:teuthology.orchestra.run.smithi090:> test '!' -e /home/ubuntu/cephtest 2023-06-09T04:23:58.781 DEBUG:teuthology.orchestra.run.smithi174:> test '!' -e /home/ubuntu/cephtest 2023-06-09T04:23:58.787 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-06-09T04:23:58.793 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-06-09T04:23:58.793 DEBUG:teuthology.orchestra.run.smithi090:> test -z $(ls -A /var/lib/ceph) 2023-06-09T04:23:58.795 DEBUG:teuthology.orchestra.run.smithi174:> test -z $(ls -A /var/lib/ceph) 2023-06-09T04:23:58.815 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-06-09T04:23:58.913 INFO:teuthology.run_tasks:Running task kernel... 2023-06-09T04:23:58.932 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'} 2023-06-09T04:23:58.933 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}, 'client.2': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}, 'client.3': {'branch': 'testing'}} 2023-06-09T04:23:58.933 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}}, timeout 300 2023-06-09T04:23:58.934 DEBUG:teuthology.orchestra.run.smithi090:> test -f /run/.containerenv -o -f /.dockerenv 2023-06-09T04:23:58.935 DEBUG:teuthology.orchestra.run.smithi174:> test -f /run/.containerenv -o -f /.dockerenv 2023-06-09T04:23:58.940 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-09T04:23:58.941 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=testing 2023-06-09T04:23:58.943 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-09T04:23:58.944 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=testing 2023-06-09T04:23:59.108 DEBUG:teuthology.task.kernel:sha1 for client.1 is 10b2f20a4f46c803bb730efc73498f97d45082e7 2023-06-09T04:23:59.108 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "10b2f20a4f46c803bb730efc73498f97d45082e7"... 2023-06-09T04:23:59.108 DEBUG:teuthology.orchestra.run.smithi174:> uname -r 2023-06-09T04:23:59.115 INFO:teuthology.orchestra.run.smithi174.stdout:5.4.0-124-generic 2023-06-09T04:23:59.115 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-124-generic vs 10b2f20a4f46c803bb730efc73498f97d45082e7 2023-06-09T04:23:59.115 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-06-09T04:23:59.116 INFO:teuthology.task.kernel:Installing linux-firmware on client.1... 2023-06-09T04:23:59.116 DEBUG:teuthology.orchestra.run.smithi174:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2023-06-09T04:23:59.168 DEBUG:teuthology.task.kernel:sha1 for client.0 is 10b2f20a4f46c803bb730efc73498f97d45082e7 2023-06-09T04:23:59.169 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "10b2f20a4f46c803bb730efc73498f97d45082e7"... 2023-06-09T04:23:59.169 DEBUG:teuthology.orchestra.run.smithi090:> uname -r 2023-06-09T04:23:59.175 INFO:teuthology.orchestra.run.smithi090.stdout:5.4.0-124-generic 2023-06-09T04:23:59.176 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-124-generic vs 10b2f20a4f46c803bb730efc73498f97d45082e7 2023-06-09T04:23:59.176 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-06-09T04:23:59.176 INFO:teuthology.task.kernel:Installing linux-firmware on client.0... 2023-06-09T04:23:59.177 DEBUG:teuthology.orchestra.run.smithi090:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2023-06-09T04:23:59.178 INFO:teuthology.orchestra.run.smithi174.stderr:bash: line 0: cd: /lib/firmware/updates: No such file or directory 2023-06-09T04:23:59.237 INFO:teuthology.orchestra.run.smithi090.stderr:bash: line 0: cd: /lib/firmware/updates: No such file or directory 2023-06-09T04:23:59.313 INFO:teuthology.orchestra.run.smithi174.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2023-06-09T04:23:59.315 DEBUG:teuthology.orchestra.run.smithi174:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2023-06-09T04:23:59.346 DEBUG:teuthology.orchestra.run.smithi174:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2023-06-09T04:23:59.352 INFO:teuthology.orchestra.run.smithi090.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2023-06-09T04:23:59.354 DEBUG:teuthology.orchestra.run.smithi090:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2023-06-09T04:23:59.384 DEBUG:teuthology.orchestra.run.smithi090:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2023-06-09T04:23:59.397 DEBUG:teuthology.orchestra.run.smithi090:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2023-06-09T04:23:59.404 DEBUG:teuthology.orchestra.run.smithi174:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2023-06-09T04:26:12.402 INFO:teuthology.orchestra.run.smithi090.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2023-06-09T04:26:12.402 INFO:teuthology.orchestra.run.smithi090.stderr: * [new branch] main -> origin/main 2023-06-09T04:26:12.450 INFO:teuthology.orchestra.run.smithi090.stderr: * [new tag] 20190312 -> 20190312 2023-06-09T04:26:12.450 INFO:teuthology.orchestra.run.smithi090.stderr: * [new tag] 20190416 -> 20190416 2023-06-09T04:26:12.450 INFO:teuthology.orchestra.run.smithi090.stderr: * [new tag] 20190514 -> 20190514 2023-06-09T04:26:12.450 INFO:teuthology.orchestra.run.smithi090.stderr: * [new tag] 20190618 -> 20190618 2023-06-09T04:26:12.451 INFO:teuthology.orchestra.run.smithi090.stderr: * [new tag] 20190717 -> 20190717 2023-06-09T04:26:12.451 INFO:teuthology.orchestra.run.smithi090.stderr: * [new tag] 20190815 -> 20190815 2023-06-09T04:26:12.452 INFO:teuthology.orchestra.run.smithi090.stderr: * [new tag] 20190923 -> 20190923 2023-06-09T04:26:12.452 INFO:teuthology.orchestra.run.smithi090.stderr: * [new tag] 20191022 -> 20191022 2023-06-09T04:26:12.452 INFO:teuthology.orchestra.run.smithi090.stderr: * [new tag] 20191215 -> 20191215 2023-06-09T04:26:12.452 INFO:teuthology.orchestra.run.smithi090.stderr: * [new tag] 20200122 -> 20200122 2023-06-09T04:26:12.452 INFO:teuthology.orchestra.run.smithi090.stderr: * [new tag] 20200316 -> 20200316 2023-06-09T04:26:12.452 INFO:teuthology.orchestra.run.smithi090.stderr: * [new tag] 20200421 -> 20200421 2023-06-09T04:26:12.452 INFO:teuthology.orchestra.run.smithi090.stderr: * [new tag] 20200519 -> 20200519 2023-06-09T04:26:12.453 INFO:teuthology.orchestra.run.smithi090.stderr: * [new tag] 20200619 -> 20200619 2023-06-09T04:26:12.453 INFO:teuthology.orchestra.run.smithi090.stderr: * [new tag] 20200721 -> 20200721 2023-06-09T04:26:12.454 INFO:teuthology.orchestra.run.smithi090.stderr: * [new tag] 20200817 -> 20200817 2023-06-09T04:26:12.454 INFO:teuthology.orchestra.run.smithi090.stderr: * [new tag] 20200918 -> 20200918 2023-06-09T04:26:12.454 INFO:teuthology.orchestra.run.smithi090.stderr: * [new tag] 20201022 -> 20201022 2023-06-09T04:26:12.454 INFO:teuthology.orchestra.run.smithi090.stderr: * [new tag] 20201118 -> 20201118 2023-06-09T04:26:12.454 INFO:teuthology.orchestra.run.smithi090.stderr: * [new tag] 20201218 -> 20201218 2023-06-09T04:26:12.454 INFO:teuthology.orchestra.run.smithi090.stderr: * [new tag] 20210208 -> 20210208 2023-06-09T04:26:12.455 INFO:teuthology.orchestra.run.smithi090.stderr: * [new tag] 20210315 -> 20210315 2023-06-09T04:26:12.455 INFO:teuthology.orchestra.run.smithi090.stderr: * [new tag] 20210511 -> 20210511 2023-06-09T04:26:12.455 INFO:teuthology.orchestra.run.smithi090.stderr: * [new tag] 20210716 -> 20210716 2023-06-09T04:26:12.455 INFO:teuthology.orchestra.run.smithi090.stderr: * [new tag] 20210818 -> 20210818 2023-06-09T04:26:12.456 INFO:teuthology.orchestra.run.smithi090.stderr: * [new tag] 20210919 -> 20210919 2023-06-09T04:26:12.457 INFO:teuthology.orchestra.run.smithi090.stderr: * [new tag] 20211027 -> 20211027 2023-06-09T04:26:12.457 INFO:teuthology.orchestra.run.smithi090.stderr: * [new tag] 20211216 -> 20211216 2023-06-09T04:26:12.457 INFO:teuthology.orchestra.run.smithi090.stderr: * [new tag] 20220209 -> 20220209 2023-06-09T04:26:12.457 INFO:teuthology.orchestra.run.smithi090.stderr: * [new tag] 20220310 -> 20220310 2023-06-09T04:26:12.457 INFO:teuthology.orchestra.run.smithi090.stderr: * [new tag] 20220411 -> 20220411 2023-06-09T04:26:12.457 INFO:teuthology.orchestra.run.smithi090.stderr: * [new tag] 20220509 -> 20220509 2023-06-09T04:26:12.457 INFO:teuthology.orchestra.run.smithi090.stderr: * [new tag] 20220610 -> 20220610 2023-06-09T04:26:12.458 INFO:teuthology.orchestra.run.smithi090.stderr: * [new tag] 20220708 -> 20220708 2023-06-09T04:26:12.458 INFO:teuthology.orchestra.run.smithi090.stderr: * [new tag] 20220815 -> 20220815 2023-06-09T04:26:12.458 INFO:teuthology.orchestra.run.smithi090.stderr: * [new tag] 20220913 -> 20220913 2023-06-09T04:26:12.458 INFO:teuthology.orchestra.run.smithi090.stderr: * [new tag] 20221012 -> 20221012 2023-06-09T04:26:12.458 INFO:teuthology.orchestra.run.smithi090.stderr: * [new tag] 20221109 -> 20221109 2023-06-09T04:26:12.458 INFO:teuthology.orchestra.run.smithi090.stderr: * [new tag] 20221214 -> 20221214 2023-06-09T04:26:12.458 INFO:teuthology.orchestra.run.smithi090.stderr: * [new tag] 20230117 -> 20230117 2023-06-09T04:26:12.459 INFO:teuthology.orchestra.run.smithi090.stderr: * [new tag] 20230210 -> 20230210 2023-06-09T04:26:12.459 INFO:teuthology.orchestra.run.smithi090.stderr: * [new tag] 20230310 -> 20230310 2023-06-09T04:26:12.459 INFO:teuthology.orchestra.run.smithi090.stderr: * [new tag] 20230404 -> 20230404 2023-06-09T04:26:12.459 INFO:teuthology.orchestra.run.smithi090.stderr: * [new tag] 20230515 -> 20230515 2023-06-09T04:26:15.687 INFO:teuthology.orchestra.run.smithi090.stderr:Updating files: 50% (1503/2971) Updating files: 51% (1516/2971) Updating files: 52% (1545/2971) Updating files: 53% (1575/2971) Updating files: 54% (1605/2971) Updating files: 55% (1635/2971) Updating files: 56% (1664/2971) Updating files: 57% (1694/2971) Updating files: 58% (1724/2971) Updating files: 59% (1753/2971) Updating files: 60% (1783/2971) Updating files: 61% (1813/2971) Updating files: 62% (1843/2971) Updating files: 63% (1872/2971) Updating files: 64% (1902/2971) Updating files: 65% (1932/2971) Updating files: 65% (1951/2971) Updating files: 66% (1961/2971) Updating files: 67% (1991/2971) Updating files: 68% (2021/2971) Updating files: 69% (2050/2971) Updating files: 70% (2080/2971) Updating files: 71% (2110/2971) Updating files: 72% (2140/2971) Updating files: 73% (2169/2971) Updating files: 74% (2199/2971) Updating files: 75% (2229/2971) Updating files: 76% (2258/2971) Updating files: 77% (2288/2971) Updating files: 78% (2318/2971) Updating files: 79% (2348/2971) Updating files: 80% (2377/2971) Updating files: 81% (2407/2971) Updating files: 82% (2437/2971) Updating files: 82% (2444/2971) Updating files: 83% (2466/2971) Updating files: 84% (2496/2971) Updating files: 85% (2526/2971) Updating files: 86% (2556/2971) Updating files: 87% (2585/2971) Updating files: 88% (2615/2971) Updating files: 89% (2645/2971) Updating files: 90% (2674/2971) Updating files: 91% (2704/2971) Updating files: 92% (2734/2971) Updating files: 93% (2764/2971) Updating files: 94% (2793/2971) Updating files: 95% (2823/2971) Updating files: 96% (2853/2971) Updating files: 97% (2882/2971) Updating files: 98% (2912/2971) Updating files: 99% (2942/2971) Updating files: 100% (2971/2971) Updating files: 100% (2971/2971), done. 2023-06-09T04:26:15.692 INFO:teuthology.orchestra.run.smithi090.stdout:HEAD is now at fc90c59b Merge branch 'db410c' of https://github.com/lumag/linux-firmware 2023-06-09T04:26:15.706 INFO:teuthology.task.kernel:Downloading kernel 10b2f20a4f46c803bb730efc73498f97d45082e7 on client.0... 2023-06-09T04:26:15.706 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=10b2f20a4f46c803bb730efc73498f97d45082e7 2023-06-09T04:26:15.831 INFO:teuthology.orchestra.run.smithi174.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2023-06-09T04:26:15.831 INFO:teuthology.orchestra.run.smithi174.stderr: * [new branch] main -> origin/main 2023-06-09T04:26:15.883 INFO:teuthology.orchestra.run.smithi174.stderr: * [new tag] 20190312 -> 20190312 2023-06-09T04:26:15.883 INFO:teuthology.orchestra.run.smithi174.stderr: * [new tag] 20190416 -> 20190416 2023-06-09T04:26:15.883 INFO:teuthology.orchestra.run.smithi174.stderr: * [new tag] 20190514 -> 20190514 2023-06-09T04:26:15.884 INFO:teuthology.orchestra.run.smithi174.stderr: * [new tag] 20190618 -> 20190618 2023-06-09T04:26:15.884 INFO:teuthology.orchestra.run.smithi174.stderr: * [new tag] 20190717 -> 20190717 2023-06-09T04:26:15.884 INFO:teuthology.orchestra.run.smithi174.stderr: * [new tag] 20190815 -> 20190815 2023-06-09T04:26:15.885 INFO:teuthology.orchestra.run.smithi174.stderr: * [new tag] 20190923 -> 20190923 2023-06-09T04:26:15.885 INFO:teuthology.orchestra.run.smithi174.stderr: * [new tag] 20191022 -> 20191022 2023-06-09T04:26:15.885 INFO:teuthology.orchestra.run.smithi174.stderr: * [new tag] 20191215 -> 20191215 2023-06-09T04:26:15.885 INFO:teuthology.orchestra.run.smithi174.stderr: * [new tag] 20200122 -> 20200122 2023-06-09T04:26:15.885 INFO:teuthology.orchestra.run.smithi174.stderr: * [new tag] 20200316 -> 20200316 2023-06-09T04:26:15.886 INFO:teuthology.orchestra.run.smithi174.stderr: * [new tag] 20200421 -> 20200421 2023-06-09T04:26:15.886 INFO:teuthology.orchestra.run.smithi174.stderr: * [new tag] 20200519 -> 20200519 2023-06-09T04:26:15.887 INFO:teuthology.orchestra.run.smithi174.stderr: * [new tag] 20200619 -> 20200619 2023-06-09T04:26:15.887 INFO:teuthology.orchestra.run.smithi174.stderr: * [new tag] 20200721 -> 20200721 2023-06-09T04:26:15.887 INFO:teuthology.orchestra.run.smithi174.stderr: * [new tag] 20200817 -> 20200817 2023-06-09T04:26:15.887 INFO:teuthology.orchestra.run.smithi174.stderr: * [new tag] 20200918 -> 20200918 2023-06-09T04:26:15.887 INFO:teuthology.orchestra.run.smithi174.stderr: * [new tag] 20201022 -> 20201022 2023-06-09T04:26:15.887 INFO:teuthology.orchestra.run.smithi174.stderr: * [new tag] 20201118 -> 20201118 2023-06-09T04:26:15.887 INFO:teuthology.orchestra.run.smithi174.stderr: * [new tag] 20201218 -> 20201218 2023-06-09T04:26:15.888 INFO:teuthology.orchestra.run.smithi174.stderr: * [new tag] 20210208 -> 20210208 2023-06-09T04:26:15.888 INFO:teuthology.orchestra.run.smithi174.stderr: * [new tag] 20210315 -> 20210315 2023-06-09T04:26:15.888 INFO:teuthology.orchestra.run.smithi174.stderr: * [new tag] 20210511 -> 20210511 2023-06-09T04:26:15.888 INFO:teuthology.orchestra.run.smithi174.stderr: * [new tag] 20210716 -> 20210716 2023-06-09T04:26:15.888 INFO:teuthology.orchestra.run.smithi174.stderr: * [new tag] 20210818 -> 20210818 2023-06-09T04:26:15.891 INFO:teuthology.orchestra.run.smithi174.stderr: * [new tag] 20210919 -> 20210919 2023-06-09T04:26:15.892 INFO:teuthology.orchestra.run.smithi174.stderr: * [new tag] 20211027 -> 20211027 2023-06-09T04:26:15.892 INFO:teuthology.orchestra.run.smithi174.stderr: * [new tag] 20211216 -> 20211216 2023-06-09T04:26:15.892 INFO:teuthology.orchestra.run.smithi174.stderr: * [new tag] 20220209 -> 20220209 2023-06-09T04:26:15.892 INFO:teuthology.orchestra.run.smithi174.stderr: * [new tag] 20220310 -> 20220310 2023-06-09T04:26:15.892 INFO:teuthology.orchestra.run.smithi174.stderr: * [new tag] 20220411 -> 20220411 2023-06-09T04:26:15.892 INFO:teuthology.orchestra.run.smithi174.stderr: * [new tag] 20220509 -> 20220509 2023-06-09T04:26:15.893 INFO:teuthology.orchestra.run.smithi174.stderr: * [new tag] 20220610 -> 20220610 2023-06-09T04:26:15.893 INFO:teuthology.orchestra.run.smithi174.stderr: * [new tag] 20220708 -> 20220708 2023-06-09T04:26:15.893 INFO:teuthology.orchestra.run.smithi174.stderr: * [new tag] 20220815 -> 20220815 2023-06-09T04:26:15.893 INFO:teuthology.orchestra.run.smithi174.stderr: * [new tag] 20220913 -> 20220913 2023-06-09T04:26:15.893 INFO:teuthology.orchestra.run.smithi174.stderr: * [new tag] 20221012 -> 20221012 2023-06-09T04:26:15.893 INFO:teuthology.orchestra.run.smithi174.stderr: * [new tag] 20221109 -> 20221109 2023-06-09T04:26:15.893 INFO:teuthology.orchestra.run.smithi174.stderr: * [new tag] 20221214 -> 20221214 2023-06-09T04:26:15.893 INFO:teuthology.orchestra.run.smithi174.stderr: * [new tag] 20230117 -> 20230117 2023-06-09T04:26:15.894 INFO:teuthology.orchestra.run.smithi174.stderr: * [new tag] 20230210 -> 20230210 2023-06-09T04:26:15.894 INFO:teuthology.orchestra.run.smithi174.stderr: * [new tag] 20230310 -> 20230310 2023-06-09T04:26:15.894 INFO:teuthology.orchestra.run.smithi174.stderr: * [new tag] 20230404 -> 20230404 2023-06-09T04:26:15.894 INFO:teuthology.orchestra.run.smithi174.stderr: * [new tag] 20230515 -> 20230515 2023-06-09T04:26:15.957 INFO:teuthology.task.kernel:fetching, builder baseurl is https://1.chacra.ceph.com/r/kernel/testing/10b2f20a4f46c803bb730efc73498f97d45082e7/ubuntu/focal/flavors/default/pool/main/l/linux-6.4.0-rc2-g10b2f20a4f46/ 2023-06-09T04:26:15.957 DEBUG:teuthology.orchestra.run.smithi090:> rm -f /tmp/linux-image.deb && echo linux-image-6.4.0-rc2-g10b2f20a4f46_6.4.0-rc2-g10b2f20a4f46-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://1.chacra.ceph.com/r/kernel/testing/10b2f20a4f46c803bb730efc73498f97d45082e7/ubuntu/focal/flavors/default/pool/main/l/linux-6.4.0-rc2-g10b2f20a4f46/ --input-file=- 2023-06-09T04:26:15.960 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi090.front.sepia.ceph.com to complete... 2023-06-09T04:26:18.033 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09 04:26:17 URL:https://1.chacra.ceph.com/r/kernel/testing/10b2f20a4f46c803bb730efc73498f97d45082e7/ubuntu/focal/flavors/default/pool/main/l/linux-6.4.0-rc2-g10b2f20a4f46/linux-image-6.4.0-rc2-g10b2f20a4f46_6.4.0-rc2-g10b2f20a4f46-1_amd64.deb [38539740/38539740] -> "/tmp/linux-image.deb" [1] 2023-06-09T04:26:18.034 INFO:teuthology.orchestra.run.smithi090.stderr:FINISHED --2023-06-09 04:26:17-- 2023-06-09T04:26:18.034 INFO:teuthology.orchestra.run.smithi090.stderr:Total wall clock time: 2.0s 2023-06-09T04:26:18.034 INFO:teuthology.orchestra.run.smithi090.stderr:Downloaded: 1 files, 37M in 1.8s (20.1 MB/s) 2023-06-09T04:26:18.035 INFO:teuthology.task.kernel:Installing kernel 10b2f20a4f46c803bb730efc73498f97d45082e7 on client.0... 2023-06-09T04:26:18.035 DEBUG:teuthology.orchestra.run.smithi090:> sudo dpkg -i /tmp/linux-image.deb 2023-06-09T04:26:18.352 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package linux-image-6.4.0-rc2-g10b2f20a4f46. 2023-06-09T04:26:19.124 INFO:teuthology.orchestra.run.smithi174.stderr:Updating files: 50% (1503/2971) Updating files: 51% (1516/2971) Updating files: 52% (1545/2971) Updating files: 53% (1575/2971) Updating files: 54% (1605/2971) Updating files: 55% (1635/2971) Updating files: 56% (1664/2971) Updating files: 57% (1694/2971) Updating files: 58% (1724/2971) Updating files: 59% (1753/2971) Updating files: 60% (1783/2971) Updating files: 61% (1813/2971) Updating files: 62% (1843/2971) Updating files: 63% (1872/2971) Updating files: 64% (1902/2971) Updating files: 65% (1932/2971) Updating files: 65% (1951/2971) Updating files: 66% (1961/2971) Updating files: 67% (1991/2971) Updating files: 68% (2021/2971) Updating files: 69% (2050/2971) Updating files: 70% (2080/2971) Updating files: 71% (2110/2971) Updating files: 72% (2140/2971) Updating files: 73% (2169/2971) Updating files: 74% (2199/2971) Updating files: 75% (2229/2971) Updating files: 76% (2258/2971) Updating files: 77% (2288/2971) Updating files: 78% (2318/2971) Updating files: 79% (2348/2971) Updating files: 80% (2377/2971) Updating files: 81% (2407/2971) Updating files: 82% (2437/2971) Updating files: 82% (2443/2971) Updating files: 83% (2466/2971) Updating files: 84% (2496/2971) Updating files: 85% (2526/2971) Updating files: 86% (2556/2971) Updating files: 87% (2585/2971) Updating files: 88% (2615/2971) Updating files: 89% (2645/2971) Updating files: 90% (2674/2971) Updating files: 91% (2704/2971) Updating files: 92% (2734/2971) Updating files: 93% (2764/2971) Updating files: 94% (2793/2971) Updating files: 95% (2823/2971) Updating files: 96% (2853/2971) Updating files: 97% (2882/2971) Updating files: 98% (2912/2971) Updating files: 99% (2942/2971) Updating files: 100% (2971/2971) Updating files: 100% (2971/2971), done. 2023-06-09T04:26:19.128 INFO:teuthology.orchestra.run.smithi174.stdout:HEAD is now at fc90c59b Merge branch 'db410c' of https://github.com/lumag/linux-firmware 2023-06-09T04:26:19.143 INFO:teuthology.task.kernel:Downloading kernel 10b2f20a4f46c803bb730efc73498f97d45082e7 on client.1... 2023-06-09T04:26:19.143 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=10b2f20a4f46c803bb730efc73498f97d45082e7 2023-06-09T04:26:19.370 INFO:teuthology.task.kernel:fetching, builder baseurl is https://1.chacra.ceph.com/r/kernel/testing/10b2f20a4f46c803bb730efc73498f97d45082e7/ubuntu/focal/flavors/default/pool/main/l/linux-6.4.0-rc2-g10b2f20a4f46/ 2023-06-09T04:26:19.370 DEBUG:teuthology.orchestra.run.smithi174:> rm -f /tmp/linux-image.deb && echo linux-image-6.4.0-rc2-g10b2f20a4f46_6.4.0-rc2-g10b2f20a4f46-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://1.chacra.ceph.com/r/kernel/testing/10b2f20a4f46c803bb730efc73498f97d45082e7/ubuntu/focal/flavors/default/pool/main/l/linux-6.4.0-rc2-g10b2f20a4f46/ --input-file=- 2023-06-09T04:26:19.372 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi174.front.sepia.ceph.com to complete... 2023-06-09T04:26:20.633 INFO:teuthology.orchestra.run.smithi090.stdout:(Reading database ... 104373 files and directories currently installed.) 2023-06-09T04:26:20.638 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack /tmp/linux-image.deb ... 2023-06-09T04:26:20.745 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking linux-image-6.4.0-rc2-g10b2f20a4f46 (6.4.0-rc2-g10b2f20a4f46-1) ... 2023-06-09T04:26:21.068 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09 04:26:20 URL:https://1.chacra.ceph.com/r/kernel/testing/10b2f20a4f46c803bb730efc73498f97d45082e7/ubuntu/focal/flavors/default/pool/main/l/linux-6.4.0-rc2-g10b2f20a4f46/linux-image-6.4.0-rc2-g10b2f20a4f46_6.4.0-rc2-g10b2f20a4f46-1_amd64.deb [38539740/38539740] -> "/tmp/linux-image.deb" [1] 2023-06-09T04:26:21.069 INFO:teuthology.orchestra.run.smithi174.stderr:FINISHED --2023-06-09 04:26:20-- 2023-06-09T04:26:21.069 INFO:teuthology.orchestra.run.smithi174.stderr:Total wall clock time: 1.7s 2023-06-09T04:26:21.069 INFO:teuthology.orchestra.run.smithi174.stderr:Downloaded: 1 files, 37M in 1.5s (25.1 MB/s) 2023-06-09T04:26:21.070 INFO:teuthology.task.kernel:Installing kernel 10b2f20a4f46c803bb730efc73498f97d45082e7 on client.1... 2023-06-09T04:26:21.070 DEBUG:teuthology.orchestra.run.smithi174:> sudo dpkg -i /tmp/linux-image.deb 2023-06-09T04:26:21.370 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package linux-image-6.4.0-rc2-g10b2f20a4f46. 2023-06-09T04:26:23.082 INFO:teuthology.orchestra.run.smithi174.stdout:(Reading database ... 104373 files and directories currently installed.) 2023-06-09T04:26:23.087 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack /tmp/linux-image.deb ... 2023-06-09T04:26:23.287 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking linux-image-6.4.0-rc2-g10b2f20a4f46 (6.4.0-rc2-g10b2f20a4f46-1) ... 2023-06-09T04:26:24.355 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up linux-image-6.4.0-rc2-g10b2f20a4f46 (6.4.0-rc2-g10b2f20a4f46-1) ... 2023-06-09T04:26:24.469 INFO:teuthology.orchestra.run.smithi090.stderr:update-initramfs: Generating /boot/initrd.img-6.4.0-rc2-g10b2f20a4f46 2023-06-09T04:26:26.177 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up linux-image-6.4.0-rc2-g10b2f20a4f46 (6.4.0-rc2-g10b2f20a4f46-1) ... 2023-06-09T04:26:26.296 INFO:teuthology.orchestra.run.smithi174.stderr:update-initramfs: Generating /boot/initrd.img-6.4.0-rc2-g10b2f20a4f46 2023-06-09T04:26:50.717 INFO:teuthology.orchestra.run.smithi174.stderr:Sourcing file `/etc/default/grub' 2023-06-09T04:26:50.724 INFO:teuthology.orchestra.run.smithi174.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-06-09T04:26:50.751 INFO:teuthology.orchestra.run.smithi174.stderr:Generating grub configuration file ... 2023-06-09T04:26:50.893 INFO:teuthology.orchestra.run.smithi090.stderr:Sourcing file `/etc/default/grub' 2023-06-09T04:26:50.908 INFO:teuthology.orchestra.run.smithi090.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-06-09T04:26:50.931 INFO:teuthology.orchestra.run.smithi090.stderr:Generating grub configuration file ... 2023-06-09T04:26:51.169 INFO:teuthology.orchestra.run.smithi174.stderr:Found linux image: /boot/vmlinuz-6.4.0-rc2-g10b2f20a4f46 2023-06-09T04:26:51.189 INFO:teuthology.orchestra.run.smithi174.stderr:Found initrd image: /boot/initrd.img-6.4.0-rc2-g10b2f20a4f46 2023-06-09T04:26:51.540 INFO:teuthology.orchestra.run.smithi090.stderr:Found linux image: /boot/vmlinuz-6.4.0-rc2-g10b2f20a4f46 2023-06-09T04:26:51.564 INFO:teuthology.orchestra.run.smithi090.stderr:Found initrd image: /boot/initrd.img-6.4.0-rc2-g10b2f20a4f46 2023-06-09T04:26:51.591 INFO:teuthology.orchestra.run.smithi174.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-06-09T04:26:51.604 INFO:teuthology.orchestra.run.smithi174.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-06-09T04:26:52.101 INFO:teuthology.orchestra.run.smithi090.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-06-09T04:26:52.124 INFO:teuthology.orchestra.run.smithi090.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-06-09T04:26:54.056 INFO:teuthology.orchestra.run.smithi174.stderr:done 2023-06-09T04:26:54.251 DEBUG:teuthology.orchestra.run.smithi174:> dpkg-deb -c /tmp/linux-image.deb 2023-06-09T04:26:54.261 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./ 2023-06-09T04:26:54.261 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./boot/ 2023-06-09T04:26:54.261 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 4322013 2023-06-01 02:19 ./boot/System.map-6.4.0-rc2-g10b2f20a4f46 2023-06-09T04:26:54.276 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 167348 2023-06-01 02:19 ./boot/config-6.4.0-rc2-g10b2f20a4f46 2023-06-09T04:26:54.277 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 11235616 2023-06-01 02:19 ./boot/vmlinuz-6.4.0-rc2-g10b2f20a4f46 2023-06-09T04:26:54.298 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./etc/ 2023-06-09T04:26:54.298 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./etc/kernel/ 2023-06-09T04:26:54.298 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./etc/kernel/postinst.d/ 2023-06-09T04:26:54.298 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./etc/kernel/postrm.d/ 2023-06-09T04:26:54.298 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./etc/kernel/preinst.d/ 2023-06-09T04:26:54.299 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./etc/kernel/prerm.d/ 2023-06-09T04:26:54.299 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/ 2023-06-09T04:26:54.299 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/ 2023-06-09T04:26:54.299 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/ 2023-06-09T04:26:54.299 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/ 2023-06-09T04:26:54.299 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/ 2023-06-09T04:26:54.299 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/ 2023-06-09T04:26:54.299 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/ 2023-06-09T04:26:54.300 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 490273 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/aesni-intel.ko 2023-06-09T04:26:54.302 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 25225 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-06-09T04:26:54.302 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 28945 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-06-09T04:26:54.302 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 30129 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-06-09T04:26:54.302 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 92281 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-06-09T04:26:54.302 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 106625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-06-09T04:26:54.302 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 152065 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-06-09T04:26:54.303 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 12441 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-06-09T04:26:54.303 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 13601 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-06-09T04:26:54.303 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 83785 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-06-09T04:26:54.303 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 18441 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-06-09T04:26:54.303 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 46641 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-06-09T04:26:54.303 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 47097 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/serpent-avx2.ko 2023-06-09T04:26:54.303 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 51625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-06-09T04:26:54.304 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 38769 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-06-09T04:26:54.304 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 40353 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-06-09T04:26:54.304 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 58417 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-06-09T04:26:54.304 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 50329 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-06-09T04:26:54.304 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 31473 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-06-09T04:26:54.305 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 13145 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-06-09T04:26:54.305 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/kernel/ 2023-06-09T04:26:54.305 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/kernel/cpu/ 2023-06-09T04:26:54.305 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/kernel/cpu/mce/ 2023-06-09T04:26:54.306 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 40009 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-06-09T04:26:54.306 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 13105 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/kernel/cpuid.ko 2023-06-09T04:26:54.306 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 17689 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/kernel/msr.ko 2023-06-09T04:26:54.307 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/kvm/ 2023-06-09T04:26:54.307 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 346401 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/kvm/kvm-amd.ko 2023-06-09T04:26:54.307 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 972121 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/kvm/kvm-intel.ko 2023-06-09T04:26:54.320 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 2209361 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/kvm/kvm.ko 2023-06-09T04:26:54.321 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/ 2023-06-09T04:26:54.321 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 56209 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/af_alg.ko 2023-06-09T04:26:54.321 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 25153 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/algif_hash.ko 2023-06-09T04:26:54.321 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 20905 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/algif_skcipher.ko 2023-06-09T04:26:54.321 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 17097 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/ansi_cprng.ko 2023-06-09T04:26:54.321 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 19529 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/anubis.ko 2023-06-09T04:26:54.321 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 9977 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/arc4.ko 2023-06-09T04:26:54.322 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/asymmetric_keys/ 2023-06-09T04:26:54.322 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 10073 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2023-06-09T04:26:54.322 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/async_tx/ 2023-06-09T04:26:54.322 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 10849 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/async_tx/async_memcpy.ko 2023-06-09T04:26:54.322 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 18985 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/async_tx/async_pq.ko 2023-06-09T04:26:54.322 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 21057 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/async_tx/async_raid6_recov.ko 2023-06-09T04:26:54.322 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 13169 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/async_tx/async_tx.ko 2023-06-09T04:26:54.322 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 17105 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/async_tx/async_xor.ko 2023-06-09T04:26:54.323 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 17809 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/async_tx/raid6test.ko 2023-06-09T04:26:54.323 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 20073 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/authenc.ko 2023-06-09T04:26:54.323 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 22473 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/authencesn.ko 2023-06-09T04:26:54.323 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 21401 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/blake2b_generic.ko 2023-06-09T04:26:54.323 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 12329 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/blowfish_common.ko 2023-06-09T04:26:54.323 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 10353 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/blowfish_generic.ko 2023-06-09T04:26:54.323 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 38697 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/camellia_generic.ko 2023-06-09T04:26:54.324 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 26697 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/cast5_generic.ko 2023-06-09T04:26:54.324 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 17105 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/cast6_generic.ko 2023-06-09T04:26:54.324 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 9857 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/cast_common.ko 2023-06-09T04:26:54.324 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 34985 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/ccm.ko 2023-06-09T04:26:54.324 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 14217 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/cmac.ko 2023-06-09T04:26:54.324 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 9409 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/crc32_generic.ko 2023-06-09T04:26:54.324 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 45361 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/cryptd.ko 2023-06-09T04:26:54.324 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 23305 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/crypto_engine.ko 2023-06-09T04:26:54.325 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 25633 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/crypto_simd.ko 2023-06-09T04:26:54.325 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 24625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/crypto_user.ko 2023-06-09T04:26:54.325 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 17553 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/cts.ko 2023-06-09T04:26:54.325 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 10737 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/des_generic.ko 2023-06-09T04:26:54.325 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 15105 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/dh_generic.ko 2023-06-09T04:26:54.325 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 10889 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/echainiv.ko 2023-06-09T04:26:54.325 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 25145 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/essiv.ko 2023-06-09T04:26:54.326 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 17873 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/fcrypt.ko 2023-06-09T04:26:54.326 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 26713 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/khazad.ko 2023-06-09T04:26:54.326 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 15537 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/lrw.ko 2023-06-09T04:26:54.326 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 11329 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/lz4.ko 2023-06-09T04:26:54.326 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 11409 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/lz4hc.ko 2023-06-09T04:26:54.326 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 11577 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/md4.ko 2023-06-09T04:26:54.326 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 9553 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/michael_mic.ko 2023-06-09T04:26:54.326 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 10561 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/pcbc.ko 2023-06-09T04:26:54.327 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 18641 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/pcrypt.ko 2023-06-09T04:26:54.327 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 15873 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/rmd160.ko 2023-06-09T04:26:54.327 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 29273 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/seed.ko 2023-06-09T04:26:54.327 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 26369 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/serpent_generic.ko 2023-06-09T04:26:54.327 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 149081 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/tcrypt.ko 2023-06-09T04:26:54.327 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 10697 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/tea.ko 2023-06-09T04:26:54.327 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 28289 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/twofish_common.ko 2023-06-09T04:26:54.327 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 13049 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/twofish_generic.ko 2023-06-09T04:26:54.328 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 17217 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/vmac.ko 2023-06-09T04:26:54.328 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 36009 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/wp512.ko 2023-06-09T04:26:54.328 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 13993 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/xcbc.ko 2023-06-09T04:26:54.328 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 26329 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/xor.ko 2023-06-09T04:26:54.328 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 18513 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/xts.ko 2023-06-09T04:26:54.328 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 9369 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/xxhash_generic.ko 2023-06-09T04:26:54.328 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ 2023-06-09T04:26:54.329 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/acpi/ 2023-06-09T04:26:54.329 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 18129 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/acpi/acpi_extlog.ko 2023-06-09T04:26:54.329 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 26857 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/acpi/acpi_ipmi.ko 2023-06-09T04:26:54.329 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 28617 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/acpi/acpi_pad.ko 2023-06-09T04:26:54.329 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/acpi/apei/ 2023-06-09T04:26:54.329 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 31121 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/acpi/apei/einj.ko 2023-06-09T04:26:54.329 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 12697 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/acpi/ec_sys.ko 2023-06-09T04:26:54.329 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 14281 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/acpi/platform_profile.ko 2023-06-09T04:26:54.330 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 24225 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/acpi/sbs.ko 2023-06-09T04:26:54.330 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 18849 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/acpi/sbshc.ko 2023-06-09T04:26:54.330 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 98193 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/acpi/video.ko 2023-06-09T04:26:54.330 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/ 2023-06-09T04:26:54.330 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 21353 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/acard-ahci.ko 2023-06-09T04:26:54.330 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 88505 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/ahci.ko 2023-06-09T04:26:54.330 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 14001 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/ahci_platform.ko 2023-06-09T04:26:54.330 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 85073 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/libahci.ko 2023-06-09T04:26:54.331 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 32753 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/libahci_platform.ko 2023-06-09T04:26:54.331 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 16897 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_acpi.ko 2023-06-09T04:26:54.331 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 30377 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_ali.ko 2023-06-09T04:26:54.331 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 33513 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_amd.ko 2023-06-09T04:26:54.331 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 21025 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_artop.ko 2023-06-09T04:26:54.331 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 20881 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_atiixp.ko 2023-06-09T04:26:54.331 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 24689 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_atp867x.ko 2023-06-09T04:26:54.332 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 17409 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_cmd640.ko 2023-06-09T04:26:54.332 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 25065 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_cmd64x.ko 2023-06-09T04:26:54.332 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 14801 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_cypress.ko 2023-06-09T04:26:54.332 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 17609 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_efar.ko 2023-06-09T04:26:54.332 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 21705 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_hpt366.ko 2023-06-09T04:26:54.332 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 33865 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_hpt37x.ko 2023-06-09T04:26:54.332 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 22889 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_hpt3x2n.ko 2023-06-09T04:26:54.332 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 16681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_hpt3x3.ko 2023-06-09T04:26:54.333 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 16753 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_it8213.ko 2023-06-09T04:26:54.333 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 35065 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_it821x.ko 2023-06-09T04:26:54.333 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 12649 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_jmicron.ko 2023-06-09T04:26:54.333 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 51561 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_legacy.ko 2023-06-09T04:26:54.333 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 14945 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_marvell.ko 2023-06-09T04:26:54.333 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 15977 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_mpiix.ko 2023-06-09T04:26:54.333 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 12593 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_netcell.ko 2023-06-09T04:26:54.333 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 16577 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_ninja32.ko 2023-06-09T04:26:54.334 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 14793 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_ns87410.ko 2023-06-09T04:26:54.334 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 17057 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_ns87415.ko 2023-06-09T04:26:54.334 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 16265 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_oldpiix.ko 2023-06-09T04:26:54.334 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 15137 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_opti.ko 2023-06-09T04:26:54.334 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 20433 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_optidma.ko 2023-06-09T04:26:54.334 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 32337 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_pcmcia.ko 2023-06-09T04:26:54.334 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 37609 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_pdc2027x.ko 2023-06-09T04:26:54.335 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 20313 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-06-09T04:26:54.335 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 13921 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_piccolo.ko 2023-06-09T04:26:54.335 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 15209 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_radisys.ko 2023-06-09T04:26:54.335 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 19281 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_rdc.ko 2023-06-09T04:26:54.335 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 15081 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_rz1000.ko 2023-06-09T04:26:54.335 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 13697 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_sch.ko 2023-06-09T04:26:54.335 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 22833 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_serverworks.ko 2023-06-09T04:26:54.335 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 23209 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_sil680.ko 2023-06-09T04:26:54.336 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 19385 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_sl82c105.ko 2023-06-09T04:26:54.336 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 15769 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_triflex.ko 2023-06-09T04:26:54.336 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 30249 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_via.ko 2023-06-09T04:26:54.336 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 22617 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pdc_adma.ko 2023-06-09T04:26:54.336 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 28881 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/sata_inic162x.ko 2023-06-09T04:26:54.336 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 83113 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/sata_mv.ko 2023-06-09T04:26:54.336 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 70353 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/sata_nv.ko 2023-06-09T04:26:54.336 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 37257 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/sata_promise.ko 2023-06-09T04:26:54.337 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 22865 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/sata_qstor.ko 2023-06-09T04:26:54.337 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 29025 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/sata_sil.ko 2023-06-09T04:26:54.337 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 38089 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/sata_sil24.ko 2023-06-09T04:26:54.337 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 17697 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/sata_sis.ko 2023-06-09T04:26:54.337 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 20201 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/sata_svw.ko 2023-06-09T04:26:54.337 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 44545 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/sata_sx4.ko 2023-06-09T04:26:54.337 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 15361 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/sata_uli.ko 2023-06-09T04:26:54.338 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 34945 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/sata_via.ko 2023-06-09T04:26:54.338 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 19817 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/sata_vsc.ko 2023-06-09T04:26:54.338 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/auxdisplay/ 2023-06-09T04:26:54.338 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 15337 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/auxdisplay/ks0108.ko 2023-06-09T04:26:54.338 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/bcma/ 2023-06-09T04:26:54.338 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 121569 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/bcma/bcma.ko 2023-06-09T04:26:54.338 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/block/ 2023-06-09T04:26:54.338 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/block/aoe/ 2023-06-09T04:26:54.339 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 113433 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/block/aoe/aoe.ko 2023-06-09T04:26:54.339 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/block/drbd/ 2023-06-09T04:26:54.339 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 968017 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/block/drbd/drbd.ko 2023-06-09T04:26:54.339 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 173105 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/block/floppy.ko 2023-06-09T04:26:54.339 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/block/mtip32xx/ 2023-06-09T04:26:54.339 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 94185 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-06-09T04:26:54.339 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 114049 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/block/nbd.ko 2023-06-09T04:26:54.339 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/block/null_blk/ 2023-06-09T04:26:54.340 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 110145 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/block/null_blk/null_blk.ko 2023-06-09T04:26:54.340 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 81625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/block/pktcdvd.ko 2023-06-09T04:26:54.340 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 254273 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/block/rbd.ko 2023-06-09T04:26:54.340 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/block/xen-blkback/ 2023-06-09T04:26:54.340 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 98017 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-06-09T04:26:54.340 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/block/zram/ 2023-06-09T04:26:54.340 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 59985 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/block/zram/zram.ko 2023-06-09T04:26:54.341 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/ 2023-06-09T04:26:54.341 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 30737 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/applicom.ko 2023-06-09T04:26:54.341 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 11889 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/hangcheck-timer.ko 2023-06-09T04:26:54.341 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/hw_random/ 2023-06-09T04:26:54.341 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 13713 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/hw_random/amd-rng.ko 2023-06-09T04:26:54.341 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 18625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/hw_random/intel-rng.ko 2023-06-09T04:26:54.341 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 13217 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-06-09T04:26:54.341 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 10561 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/hw_random/via-rng.ko 2023-06-09T04:26:54.342 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 15409 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/hw_random/virtio-rng.ko 2023-06-09T04:26:54.342 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/ipmi/ 2023-06-09T04:26:54.342 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 30737 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-06-09T04:26:54.342 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 147521 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-06-09T04:26:54.342 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 26385 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-06-09T04:26:54.342 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 138881 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/ipmi/ipmi_si.ko 2023-06-09T04:26:54.342 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 70649 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-06-09T04:26:54.342 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 53425 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-06-09T04:26:54.343 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 36073 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/lp.ko 2023-06-09T04:26:54.343 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/mwave/ 2023-06-09T04:26:54.343 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 83945 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/mwave/mwave.ko 2023-06-09T04:26:54.343 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 25473 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/nvram.ko 2023-06-09T04:26:54.343 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 31921 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/ppdev.ko 2023-06-09T04:26:54.343 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 51001 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/tlclk.ko 2023-06-09T04:26:54.343 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/tpm/ 2023-06-09T04:26:54.344 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 16217 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/tpm/tpm_atmel.ko 2023-06-09T04:26:54.344 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 15769 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2023-06-09T04:26:54.344 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 23353 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2023-06-09T04:26:54.344 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 32801 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2023-06-09T04:26:54.344 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 30001 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/tpm/tpm_infineon.ko 2023-06-09T04:26:54.344 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 22577 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/tpm/tpm_nsc.ko 2023-06-09T04:26:54.344 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 23457 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/tpm/xen-tpmfront.ko 2023-06-09T04:26:54.344 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/xillybus/ 2023-06-09T04:26:54.345 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 16353 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/xillybus/xillybus_class.ko 2023-06-09T04:26:54.345 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 50217 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/xillybus/xillybus_core.ko 2023-06-09T04:26:54.345 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 12289 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/xillybus/xillybus_pcie.ko 2023-06-09T04:26:54.345 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/clk/ 2023-06-09T04:26:54.345 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 12377 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/clk/clk-palmas.ko 2023-06-09T04:26:54.345 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 47753 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/clk/clk-si5351.ko 2023-06-09T04:26:54.345 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 11281 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/clk/clk-twl6040.ko 2023-06-09T04:26:54.346 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 18985 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/clk/clk-wm831x.ko 2023-06-09T04:26:54.346 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/cpufreq/ 2023-06-09T04:26:54.346 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 9985 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-06-09T04:26:54.346 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 16657 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/cpufreq/p4-clockmod.ko 2023-06-09T04:26:54.346 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 24705 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/cpufreq/speedstep-lib.ko 2023-06-09T04:26:54.346 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/crypto/ 2023-06-09T04:26:54.346 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/crypto/ccp/ 2023-06-09T04:26:54.346 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 70609 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-06-09T04:26:54.347 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 231545 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/crypto/ccp/ccp.ko 2023-06-09T04:26:54.347 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/crypto/intel/ 2023-06-09T04:26:54.347 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/crypto/intel/qat/ 2023-06-09T04:26:54.347 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/crypto/intel/qat/qat_common/ 2023-06-09T04:26:54.347 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 396281 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-06-09T04:26:54.379 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2023-06-09T04:26:54.379 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 23921 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-06-09T04:26:54.379 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 19825 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/crypto/padlock-aes.ko 2023-06-09T04:26:54.379 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 21369 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/crypto/padlock-sha.ko 2023-06-09T04:26:54.379 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/crypto/virtio/ 2023-06-09T04:26:54.379 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 68441 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-06-09T04:26:54.380 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/dca/ 2023-06-09T04:26:54.380 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 28505 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/dca/dca.ko 2023-06-09T04:26:54.380 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/dma/ 2023-06-09T04:26:54.380 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/dma/dw/ 2023-06-09T04:26:54.380 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 15737 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/dma/dw/dw_dmac.ko 2023-06-09T04:26:54.380 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/dma/ioat/ 2023-06-09T04:26:54.380 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 122473 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/dma/ioat/ioatdma.ko 2023-06-09T04:26:54.381 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/edac/ 2023-06-09T04:26:54.381 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 75409 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/edac/amd64_edac.ko 2023-06-09T04:26:54.381 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 35649 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/edac/e752x_edac.ko 2023-06-09T04:26:54.381 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 63017 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/edac/edac_mce_amd.ko 2023-06-09T04:26:54.381 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 17993 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/edac/i3000_edac.ko 2023-06-09T04:26:54.381 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 17961 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/edac/i3200_edac.ko 2023-06-09T04:26:54.381 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 22425 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/edac/i5100_edac.ko 2023-06-09T04:26:54.381 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 25481 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/edac/i5400_edac.ko 2023-06-09T04:26:54.382 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 24745 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/edac/i7300_edac.ko 2023-06-09T04:26:54.382 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 51905 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/edac/i7core_edac.ko 2023-06-09T04:26:54.382 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 18321 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/edac/i82975x_edac.ko 2023-06-09T04:26:54.382 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 19841 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/edac/ie31200_edac.ko 2023-06-09T04:26:54.382 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 56689 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/edac/sb_edac.ko 2023-06-09T04:26:54.382 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 17417 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/edac/x38_edac.ko 2023-06-09T04:26:54.382 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/extcon/ 2023-06-09T04:26:54.383 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 12561 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/extcon/extcon-gpio.ko 2023-06-09T04:26:54.383 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 27017 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/extcon/extcon-max14577.ko 2023-06-09T04:26:54.383 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 29457 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/extcon/extcon-max77693.ko 2023-06-09T04:26:54.383 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 24569 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/extcon/extcon-max8997.ko 2023-06-09T04:26:54.383 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 26417 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/extcon/extcon-palmas.ko 2023-06-09T04:26:54.383 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 23601 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/extcon/extcon-rt8973a.ko 2023-06-09T04:26:54.383 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 27673 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/extcon/extcon-sm5502.ko 2023-06-09T04:26:54.383 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/firmware/ 2023-06-09T04:26:54.384 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 34777 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/firmware/dmi-sysfs.ko 2023-06-09T04:26:54.384 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/firmware/efi/ 2023-06-09T04:26:54.384 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 15353 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/firmware/efi/efi-pstore.ko 2023-06-09T04:26:54.384 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 20705 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/firmware/iscsi_ibft.ko 2023-06-09T04:26:54.384 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/ 2023-06-09T04:26:54.384 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 12201 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-adp5520.ko 2023-06-09T04:26:54.384 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 20049 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-amd8111.ko 2023-06-09T04:26:54.385 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 14881 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-arizona.ko 2023-06-09T04:26:54.385 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 13737 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-da9052.ko 2023-06-09T04:26:54.385 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 11753 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-da9055.ko 2023-06-09T04:26:54.385 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 21945 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-dln2.ko 2023-06-09T04:26:54.385 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 78249 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-f7188x.ko 2023-06-09T04:26:54.385 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 28249 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-generic.ko 2023-06-09T04:26:54.385 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 19449 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-ich.ko 2023-06-09T04:26:54.385 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 11801 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-janz-ttl.ko 2023-06-09T04:26:54.386 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 14009 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-kempld.ko 2023-06-09T04:26:54.386 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 12569 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-lp3943.ko 2023-06-09T04:26:54.386 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 9337 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-max7300.ko 2023-06-09T04:26:54.386 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 11481 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-max730x.ko 2023-06-09T04:26:54.386 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 18465 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-max732x.ko 2023-06-09T04:26:54.386 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 24969 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-ml-ioh.ko 2023-06-09T04:26:54.386 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 46641 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-pca953x.ko 2023-06-09T04:26:54.386 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 26665 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-pcf857x.ko 2023-06-09T04:26:54.387 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 14209 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-rdc321x.ko 2023-06-09T04:26:54.387 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 20417 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-sch.ko 2023-06-09T04:26:54.387 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 19969 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-sch311x.ko 2023-06-09T04:26:54.387 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 12041 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-tps65912.ko 2023-06-09T04:26:54.387 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 21873 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-twl4030.ko 2023-06-09T04:26:54.387 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 11313 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-twl6040.ko 2023-06-09T04:26:54.387 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 20425 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-viperboard.ko 2023-06-09T04:26:54.387 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 15345 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-vx855.ko 2023-06-09T04:26:54.388 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 16169 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-wm831x.ko 2023-06-09T04:26:54.388 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 11505 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-wm8350.ko 2023-06-09T04:26:54.388 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 16641 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-wm8994.ko 2023-06-09T04:26:54.388 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/ 2023-06-09T04:26:54.388 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 11473 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-a4tech.ko 2023-06-09T04:26:54.388 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 38809 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-apple.ko 2023-06-09T04:26:54.388 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 14377 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-appleir.ko 2023-06-09T04:26:54.389 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 8185 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-aureal.ko 2023-06-09T04:26:54.389 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 15001 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-axff.ko 2023-06-09T04:26:54.389 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 10945 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-belkin.ko 2023-06-09T04:26:54.389 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 10145 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-cherry.ko 2023-06-09T04:26:54.389 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 15937 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-chicony.ko 2023-06-09T04:26:54.389 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 58961 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-cp2112.ko 2023-06-09T04:26:54.389 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 10937 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-cypress.ko 2023-06-09T04:26:54.390 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 16281 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-dr.ko 2023-06-09T04:26:54.390 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 10593 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-elecom.ko 2023-06-09T04:26:54.390 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 17489 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-elo.ko 2023-06-09T04:26:54.390 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 13281 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-emsff.ko 2023-06-09T04:26:54.390 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 9929 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-ezkey.ko 2023-06-09T04:26:54.390 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 14129 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-gaff.ko 2023-06-09T04:26:54.390 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 9113 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-generic.ko 2023-06-09T04:26:54.390 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 16369 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-gt683r.ko 2023-06-09T04:26:54.391 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 12577 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-gyration.ko 2023-06-09T04:26:54.391 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 9769 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-holtek-kbd.ko 2023-06-09T04:26:54.391 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 10353 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-holtek-mouse.ko 2023-06-09T04:26:54.391 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 14337 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-holtekff.ko 2023-06-09T04:26:54.391 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 18937 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-hyperv.ko 2023-06-09T04:26:54.391 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 10321 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-icade.ko 2023-06-09T04:26:54.391 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 9137 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-kensington.ko 2023-06-09T04:26:54.391 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 8377 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-keytouch.ko 2023-06-09T04:26:54.392 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 17089 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-kye.ko 2023-06-09T04:26:54.392 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 10641 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-lcpower.ko 2023-06-09T04:26:54.392 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 20313 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-led.ko 2023-06-09T04:26:54.392 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 42177 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-lenovo.ko 2023-06-09T04:26:54.392 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 30417 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-lg-g15.ko 2023-06-09T04:26:54.392 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 57689 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-logitech-dj.ko 2023-06-09T04:26:54.392 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 100561 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-06-09T04:26:54.393 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 80889 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-logitech.ko 2023-06-09T04:26:54.393 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 30681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-magicmouse.ko 2023-06-09T04:26:54.393 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 21425 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-microsoft.ko 2023-06-09T04:26:54.393 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 10257 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-monterey.ko 2023-06-09T04:26:54.393 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 49977 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-multitouch.ko 2023-06-09T04:26:54.393 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 32473 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-ntrig.ko 2023-06-09T04:26:54.393 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 8753 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-ortek.ko 2023-06-09T04:26:54.393 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 9009 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-penmount.ko 2023-06-09T04:26:54.394 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 12185 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-petalynx.ko 2023-06-09T04:26:54.394 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 72817 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-picolcd.ko 2023-06-09T04:26:54.394 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 14121 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-pl.ko 2023-06-09T04:26:54.394 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 14929 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-plantronics.ko 2023-06-09T04:26:54.394 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 8249 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-primax.ko 2023-06-09T04:26:54.394 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 35289 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-rmi.ko 2023-06-09T04:26:54.394 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 20649 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-roccat-arvo.ko 2023-06-09T04:26:54.394 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 13129 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-roccat-common.ko 2023-06-09T04:26:54.395 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 31177 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-roccat-isku.ko 2023-06-09T04:26:54.395 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 29481 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-roccat-kone.ko 2023-06-09T04:26:54.395 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 30945 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-06-09T04:26:54.395 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 20913 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-roccat-konepure.ko 2023-06-09T04:26:54.395 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 29305 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-06-09T04:26:54.395 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 13193 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-roccat-lua.ko 2023-06-09T04:26:54.395 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 29129 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-roccat-pyra.ko 2023-06-09T04:26:54.396 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 27713 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-roccat-ryos.ko 2023-06-09T04:26:54.396 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 19297 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-roccat-savu.ko 2023-06-09T04:26:54.396 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 22761 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-roccat.ko 2023-06-09T04:26:54.396 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 13577 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-saitek.ko 2023-06-09T04:26:54.396 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 15025 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-samsung.ko 2023-06-09T04:26:54.396 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 35521 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-sensor-hub.ko 2023-06-09T04:26:54.396 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 13497 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-sjoy.ko 2023-06-09T04:26:54.396 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 51025 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-sony.ko 2023-06-09T04:26:54.397 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 8137 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-speedlink.ko 2023-06-09T04:26:54.397 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 14769 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-steelseries.ko 2023-06-09T04:26:54.397 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 9713 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-sunplus.ko 2023-06-09T04:26:54.397 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 16809 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-thrustmaster.ko 2023-06-09T04:26:54.397 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 10425 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-tivo.ko 2023-06-09T04:26:54.397 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 14913 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-tmff.ko 2023-06-09T04:26:54.397 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 14217 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-topseed.ko 2023-06-09T04:26:54.398 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 16297 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-twinhan.ko 2023-06-09T04:26:54.398 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 71337 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-uclogic.ko 2023-06-09T04:26:54.398 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 10753 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-waltop.ko 2023-06-09T04:26:54.398 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 143417 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-wiimote.ko 2023-06-09T04:26:54.398 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 8041 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-xinmo.ko 2023-06-09T04:26:54.398 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 13145 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-zpff.ko 2023-06-09T04:26:54.398 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 16553 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-zydacron.ko 2023-06-09T04:26:54.398 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 261777 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid.ko 2023-06-09T04:26:54.399 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 32209 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/uhid.ko 2023-06-09T04:26:54.399 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/usbhid/ 2023-06-09T04:26:54.399 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 125241 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/usbhid/usbhid.ko 2023-06-09T04:26:54.399 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 19025 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/usbhid/usbkbd.ko 2023-06-09T04:26:54.399 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 14849 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/usbhid/usbmouse.ko 2023-06-09T04:26:54.399 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 216833 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/wacom.ko 2023-06-09T04:26:54.399 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hv/ 2023-06-09T04:26:54.399 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 63153 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hv/hv_balloon.ko 2023-06-09T04:26:54.400 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 89497 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hv/hv_utils.ko 2023-06-09T04:26:54.400 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 292521 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hv/hv_vmbus.ko 2023-06-09T04:26:54.400 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/ 2023-06-09T04:26:54.400 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 66489 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/abituguru.ko 2023-06-09T04:26:54.400 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 61289 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/abituguru3.ko 2023-06-09T04:26:54.400 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 34625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/acpi_power_meter.ko 2023-06-09T04:26:54.400 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 17385 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/ad7414.ko 2023-06-09T04:26:54.400 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 19137 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/ad7418.ko 2023-06-09T04:26:54.401 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 25089 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/adc128d818.ko 2023-06-09T04:26:54.401 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 31617 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/adm1025.ko 2023-06-09T04:26:54.401 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 97857 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/adm1026.ko 2023-06-09T04:26:54.401 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 19633 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/adm1029.ko 2023-06-09T04:26:54.401 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 45377 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/adm1031.ko 2023-06-09T04:26:54.401 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 26177 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/adm9240.ko 2023-06-09T04:26:54.401 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 14657 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/ads7828.ko 2023-06-09T04:26:54.402 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 10657 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/adt7410.ko 2023-06-09T04:26:54.402 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 21937 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/adt7411.ko 2023-06-09T04:26:54.402 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 74329 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/adt7462.ko 2023-06-09T04:26:54.402 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 39409 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/adt7470.ko 2023-06-09T04:26:54.402 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 65145 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/adt7475.ko 2023-06-09T04:26:54.402 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 19145 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/adt7x10.ko 2023-06-09T04:26:54.402 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 38953 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/amc6821.ko 2023-06-09T04:26:54.402 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 55025 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/applesmc.ko 2023-06-09T04:26:54.403 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 49737 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/asb100.ko 2023-06-09T04:26:54.403 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 58433 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/asc7621.ko 2023-06-09T04:26:54.403 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 40697 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/asus_atk0110.ko 2023-06-09T04:26:54.403 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 17105 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/atxp1.ko 2023-06-09T04:26:54.403 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 28177 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/coretemp.ko 2023-06-09T04:26:54.403 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 24489 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/da9052-hwmon.ko 2023-06-09T04:26:54.403 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 17081 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/da9055-hwmon.ko 2023-06-09T04:26:54.403 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 44297 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-06-09T04:26:54.404 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 99481 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/dme1737.ko 2023-06-09T04:26:54.404 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 19369 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/ds1621.ko 2023-06-09T04:26:54.404 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 15153 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/ds620.ko 2023-06-09T04:26:54.404 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 29593 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/emc1403.ko 2023-06-09T04:26:54.404 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 33001 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/emc2103.ko 2023-06-09T04:26:54.404 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 30209 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/emc6w201.ko 2023-06-09T04:26:54.404 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 66801 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/f71805f.ko 2023-06-09T04:26:54.404 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 94473 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/f71882fg.ko 2023-06-09T04:26:54.405 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 41289 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/f75375s.ko 2023-06-09T04:26:54.405 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 21201 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/fam15h_power.ko 2023-06-09T04:26:54.405 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 55249 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/fschmd.ko 2023-06-09T04:26:54.405 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 14313 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/g760a.ko 2023-06-09T04:26:54.405 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 23913 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/g762.ko 2023-06-09T04:26:54.405 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 46689 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/gl518sm.ko 2023-06-09T04:26:54.405 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 45345 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/gl520sm.ko 2023-06-09T04:26:54.405 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 13097 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/hih6130.ko 2023-06-09T04:26:54.406 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 9265 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/hwmon-vid.ko 2023-06-09T04:26:54.406 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 11377 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/i5500_temp.ko 2023-06-09T04:26:54.406 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 22417 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/i5k_amb.ko 2023-06-09T04:26:54.406 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 34393 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/ibmaem.ko 2023-06-09T04:26:54.406 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 21121 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/ibmpex.ko 2023-06-09T04:26:54.406 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 24761 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/ina209.ko 2023-06-09T04:26:54.406 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 13225 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/ina2xx.ko 2023-06-09T04:26:54.407 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 128913 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/it87.ko 2023-06-09T04:26:54.407 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 18729 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/jc42.ko 2023-06-09T04:26:54.407 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 23833 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/k10temp.ko 2023-06-09T04:26:54.407 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 13441 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/k8temp.ko 2023-06-09T04:26:54.407 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 18817 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/lineage-pem.ko 2023-06-09T04:26:54.407 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 48417 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/lm63.ko 2023-06-09T04:26:54.407 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 16585 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/lm73.ko 2023-06-09T04:26:54.407 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 36593 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/lm75.ko 2023-06-09T04:26:54.408 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 19369 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/lm77.ko 2023-06-09T04:26:54.408 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 34473 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/lm78.ko 2023-06-09T04:26:54.408 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 31625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/lm80.ko 2023-06-09T04:26:54.408 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 16713 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/lm83.ko 2023-06-09T04:26:54.408 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 72657 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/lm85.ko 2023-06-09T04:26:54.408 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 45977 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/lm87.ko 2023-06-09T04:26:54.408 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 37729 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/lm90.ko 2023-06-09T04:26:54.408 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 19633 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/lm92.ko 2023-06-09T04:26:54.409 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 108721 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/lm93.ko 2023-06-09T04:26:54.409 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 33281 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/lm95234.ko 2023-06-09T04:26:54.409 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 16089 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/lm95241.ko 2023-06-09T04:26:54.409 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 17993 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/lm95245.ko 2023-06-09T04:26:54.409 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 23841 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/ltc2945.ko 2023-06-09T04:26:54.409 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 13689 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/ltc4151.ko 2023-06-09T04:26:54.409 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 15081 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/ltc4215.ko 2023-06-09T04:26:54.410 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 14769 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/ltc4222.ko 2023-06-09T04:26:54.410 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 14657 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/ltc4245.ko 2023-06-09T04:26:54.410 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 13129 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/ltc4260.ko 2023-06-09T04:26:54.410 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 14817 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/ltc4261.ko 2023-06-09T04:26:54.410 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 33377 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/max16065.ko 2023-06-09T04:26:54.410 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 18249 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/max1619.ko 2023-06-09T04:26:54.410 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 24233 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/max1668.ko 2023-06-09T04:26:54.410 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 19865 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/max197.ko 2023-06-09T04:26:54.411 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 26505 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/max6639.ko 2023-06-09T04:26:54.411 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 23201 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/max6650.ko 2023-06-09T04:26:54.411 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 35593 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/max6697.ko 2023-06-09T04:26:54.411 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 18465 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/mc13783-adc.ko 2023-06-09T04:26:54.411 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 10473 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/mcp3021.ko 2023-06-09T04:26:54.411 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 15753 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2023-06-09T04:26:54.411 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 43977 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/nct6683.ko 2023-06-09T04:26:54.411 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 114577 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/nct6775-core.ko 2023-06-09T04:26:54.412 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 60033 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/nct6775.ko 2023-06-09T04:26:54.412 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 59553 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/nct7802.ko 2023-06-09T04:26:54.412 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 82169 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/pc87360.ko 2023-06-09T04:26:54.412 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 54321 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/pc87427.ko 2023-06-09T04:26:54.412 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 18353 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/pcf8591.ko 2023-06-09T04:26:54.412 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/pmbus/ 2023-06-09T04:26:54.412 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 20809 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-06-09T04:26:54.412 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 16889 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-06-09T04:26:54.413 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 28153 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-06-09T04:26:54.413 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 9401 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/pmbus/max16064.ko 2023-06-09T04:26:54.413 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 17553 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/pmbus/max34440.ko 2023-06-09T04:26:54.413 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 10001 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/pmbus/max8688.ko 2023-06-09T04:26:54.413 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 15401 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-06-09T04:26:54.413 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 79353 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-06-09T04:26:54.413 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 8561 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-06-09T04:26:54.413 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 30617 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-06-09T04:26:54.414 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 14897 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-06-09T04:26:54.414 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 20569 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-06-09T04:26:54.414 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 12913 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/powr1220.ko 2023-06-09T04:26:54.414 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 18521 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/sch5627.ko 2023-06-09T04:26:54.414 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 28633 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/sch5636.ko 2023-06-09T04:26:54.414 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 26369 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/sch56xx-common.ko 2023-06-09T04:26:54.414 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 32017 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/sht15.ko 2023-06-09T04:26:54.415 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 13385 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/sht21.ko 2023-06-09T04:26:54.415 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 16657 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/shtc1.ko 2023-06-09T04:26:54.415 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 39937 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/sis5595.ko 2023-06-09T04:26:54.415 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 31817 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/smm665.ko 2023-06-09T04:26:54.415 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 19401 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/smsc47b397.ko 2023-06-09T04:26:54.415 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 39017 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/smsc47m1.ko 2023-06-09T04:26:54.415 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 37273 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/smsc47m192.ko 2023-06-09T04:26:54.415 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 26441 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/thmc50.ko 2023-06-09T04:26:54.416 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 16881 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/tmp102.ko 2023-06-09T04:26:54.416 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 13985 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/tmp103.ko 2023-06-09T04:26:54.416 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 21137 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/tmp401.ko 2023-06-09T04:26:54.416 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 19361 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/tmp421.ko 2023-06-09T04:26:54.416 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 19585 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/via-cputemp.ko 2023-06-09T04:26:54.416 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 41833 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/via686a.ko 2023-06-09T04:26:54.416 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 52337 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/vt1211.ko 2023-06-09T04:26:54.417 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 51441 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/vt8231.ko 2023-06-09T04:26:54.417 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 57345 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/w83627ehf.ko 2023-06-09T04:26:54.417 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 78761 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/w83627hf.ko 2023-06-09T04:26:54.417 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 71169 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/w83781d.ko 2023-06-09T04:26:54.417 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 63113 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/w83791d.ko 2023-06-09T04:26:54.417 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 71145 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/w83792d.ko 2023-06-09T04:26:54.417 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 101273 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/w83793.ko 2023-06-09T04:26:54.417 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 119329 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/w83795.ko 2023-06-09T04:26:54.418 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 17145 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/w83l785ts.ko 2023-06-09T04:26:54.418 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 35505 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/w83l786ng.ko 2023-06-09T04:26:54.418 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 13713 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/wm831x-hwmon.ko 2023-06-09T04:26:54.418 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 10521 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/wm8350-hwmon.ko 2023-06-09T04:26:54.418 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/ 2023-06-09T04:26:54.418 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/algos/ 2023-06-09T04:26:54.418 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 19481 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-06-09T04:26:54.418 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 18849 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-06-09T04:26:54.419 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/ 2023-06-09T04:26:54.419 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 27849 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-ali1535.ko 2023-06-09T04:26:54.419 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 28625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-ali1563.ko 2023-06-09T04:26:54.419 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 27601 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2023-06-09T04:26:54.419 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 17825 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-06-09T04:26:54.419 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 25857 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-06-09T04:26:54.419 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 16017 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-06-09T04:26:54.420 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 15041 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2023-06-09T04:26:54.420 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 6521 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-06-09T04:26:54.420 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 13785 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2023-06-09T04:26:54.420 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 46345 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-06-09T04:26:54.420 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 23513 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-06-09T04:26:54.420 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 19417 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-06-09T04:26:54.420 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 17161 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-06-09T04:26:54.420 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 12209 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-dln2.ko 2023-06-09T04:26:54.421 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 17473 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-gpio.ko 2023-06-09T04:26:54.421 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 62337 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-i801.ko 2023-06-09T04:26:54.421 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 22321 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-isch.ko 2023-06-09T04:26:54.421 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 47785 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-06-09T04:26:54.421 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 17185 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-kempld.ko 2023-06-09T04:26:54.421 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 17769 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-06-09T04:26:54.421 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 21937 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-06-09T04:26:54.421 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 26313 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-ocores.ko 2023-06-09T04:26:54.422 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 24945 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-parport.ko 2023-06-09T04:26:54.422 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 16393 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-06-09T04:26:54.422 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 47137 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-06-09T04:26:54.422 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 15113 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2023-06-09T04:26:54.422 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 18537 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-06-09T04:26:54.422 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 11705 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-06-09T04:26:54.422 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 22193 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-sis5595.ko 2023-06-09T04:26:54.422 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 29185 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-sis630.ko 2023-06-09T04:26:54.423 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 20217 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-06-09T04:26:54.423 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 19057 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2023-06-09T04:26:54.423 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 19737 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-06-09T04:26:54.423 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 13689 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-via.ko 2023-06-09T04:26:54.423 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 25969 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-06-09T04:26:54.423 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 18929 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-06-09T04:26:54.423 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 48201 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-xiic.ko 2023-06-09T04:26:54.424 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 21729 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/i2c-mux.ko 2023-06-09T04:26:54.424 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 18337 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/i2c-smbus.ko 2023-06-09T04:26:54.424 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 26945 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/i2c-stub.ko 2023-06-09T04:26:54.424 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/muxes/ 2023-06-09T04:26:54.424 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 14681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2023-06-09T04:26:54.424 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 13289 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2023-06-09T04:26:54.424 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 26745 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2023-06-09T04:26:54.424 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/ 2023-06-09T04:26:54.425 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/core/ 2023-06-09T04:26:54.425 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 264409 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/core/ib_cm.ko 2023-06-09T04:26:54.425 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 849113 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/core/ib_core.ko 2023-06-09T04:26:54.425 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 68489 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/core/ib_umad.ko 2023-06-09T04:26:54.425 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 320185 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-06-09T04:26:54.425 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 96801 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/core/iw_cm.ko 2023-06-09T04:26:54.425 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 272097 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/core/rdma_cm.ko 2023-06-09T04:26:54.426 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 66073 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-06-09T04:26:54.426 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/hw/ 2023-06-09T04:26:54.426 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/hw/cxgb4/ 2023-06-09T04:26:54.426 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 492377 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-06-09T04:26:54.426 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/hw/mlx4/ 2023-06-09T04:26:54.426 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 419097 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-06-09T04:26:54.426 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/hw/mlx5/ 2023-06-09T04:26:54.426 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 733385 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-06-09T04:26:54.427 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/hw/mthca/ 2023-06-09T04:26:54.427 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 296481 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-06-09T04:26:54.427 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/hw/ocrdma/ 2023-06-09T04:26:54.427 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 153561 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2023-06-09T04:26:54.427 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/hw/usnic/ 2023-06-09T04:26:54.427 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 168905 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2023-06-09T04:26:54.427 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/ulp/ 2023-06-09T04:26:54.427 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/ulp/ipoib/ 2023-06-09T04:26:54.428 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 263057 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-06-09T04:26:54.428 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/ulp/iser/ 2023-06-09T04:26:54.428 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 100041 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-06-09T04:26:54.428 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/ulp/isert/ 2023-06-09T04:26:54.428 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 111049 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-06-09T04:26:54.428 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/ulp/srp/ 2023-06-09T04:26:54.428 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 128961 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-06-09T04:26:54.429 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/ulp/srpt/ 2023-06-09T04:26:54.429 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 129385 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-06-09T04:26:54.429 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/ 2023-06-09T04:26:54.429 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 10577 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/evbug.ko 2023-06-09T04:26:54.429 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 23777 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/ff-memless.ko 2023-06-09T04:26:54.429 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/gameport/ 2023-06-09T04:26:54.429 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 11777 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-06-09T04:26:54.429 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 11977 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/gameport/fm801-gp.ko 2023-06-09T04:26:54.430 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 39505 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/gameport/gameport.ko 2023-06-09T04:26:54.430 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 12385 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/gameport/lightning.ko 2023-06-09T04:26:54.430 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 17353 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/gameport/ns558.ko 2023-06-09T04:26:54.430 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 41713 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/joydev.ko 2023-06-09T04:26:54.430 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/keyboard/ 2023-06-09T04:26:54.430 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 13209 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/keyboard/adp5520-keys.ko 2023-06-09T04:26:54.430 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 30257 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/keyboard/adp5588-keys.ko 2023-06-09T04:26:54.430 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 26729 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/keyboard/adp5589-keys.ko 2023-06-09T04:26:54.431 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 24577 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2023-06-09T04:26:54.431 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 36545 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/keyboard/gpio_keys.ko 2023-06-09T04:26:54.431 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 18097 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2023-06-09T04:26:54.431 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 21145 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/keyboard/lkkbd.ko 2023-06-09T04:26:54.431 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 27937 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/keyboard/lm8323.ko 2023-06-09T04:26:54.431 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 15001 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/keyboard/lm8333.ko 2023-06-09T04:26:54.431 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 24145 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/keyboard/matrix_keypad.ko 2023-06-09T04:26:54.431 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 18033 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/keyboard/max7359_keypad.ko 2023-06-09T04:26:54.432 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 15785 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/keyboard/mcs_touchkey.ko 2023-06-09T04:26:54.432 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 16305 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2023-06-09T04:26:54.432 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 11473 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/keyboard/newtonkbd.ko 2023-06-09T04:26:54.432 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 10897 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/keyboard/opencores-kbd.ko 2023-06-09T04:26:54.432 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 15025 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/keyboard/qt1070.ko 2023-06-09T04:26:54.432 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 20953 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/keyboard/qt2160.ko 2023-06-09T04:26:54.432 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 23633 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/keyboard/samsung-keypad.ko 2023-06-09T04:26:54.433 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 11377 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/keyboard/stowaway.ko 2023-06-09T04:26:54.433 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 18177 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/keyboard/sunkbd.ko 2023-06-09T04:26:54.433 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 20553 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/keyboard/tca6416-keypad.ko 2023-06-09T04:26:54.433 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 16009 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/keyboard/tca8418_keypad.ko 2023-06-09T04:26:54.433 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 16617 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/keyboard/twl4030_keypad.ko 2023-06-09T04:26:54.433 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 11577 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/keyboard/xtkbd.ko 2023-06-09T04:26:54.433 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 10961 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/matrix-keymap.ko 2023-06-09T04:26:54.433 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/mouse/ 2023-06-09T04:26:54.434 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 34209 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/mouse/appletouch.ko 2023-06-09T04:26:54.434 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 34001 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/mouse/bcm5974.ko 2023-06-09T04:26:54.434 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 123497 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/mouse/cyapatp.ko 2023-06-09T04:26:54.434 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 89345 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/mouse/elan_i2c.ko 2023-06-09T04:26:54.434 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 13849 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/mouse/gpio_mouse.ko 2023-06-09T04:26:54.434 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 334393 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/mouse/psmouse.ko 2023-06-09T04:26:54.434 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 14497 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/mouse/sermouse.ko 2023-06-09T04:26:54.435 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 23697 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-06-09T04:26:54.435 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 22465 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/mouse/synaptics_usb.ko 2023-06-09T04:26:54.435 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 15489 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/mouse/vsxxxaa.ko 2023-06-09T04:26:54.435 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/rmi4/ 2023-06-09T04:26:54.435 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 108097 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/rmi4/rmi_core.ko 2023-06-09T04:26:54.435 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/serio/ 2023-06-09T04:26:54.435 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 11553 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/serio/altera_ps2.ko 2023-06-09T04:26:54.435 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 16113 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/serio/arc_ps2.ko 2023-06-09T04:26:54.436 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 16257 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/serio/ct82c710.ko 2023-06-09T04:26:54.436 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 16785 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-06-09T04:26:54.436 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 15721 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/serio/parkbd.ko 2023-06-09T04:26:54.436 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 13105 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/serio/pcips2.ko 2023-06-09T04:26:54.436 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 19985 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/serio/ps2mult.ko 2023-06-09T04:26:54.436 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 24017 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/serio/serio_raw.ko 2023-06-09T04:26:54.436 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 17809 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/serio/serport.ko 2023-06-09T04:26:54.436 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 12553 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/sparse-keymap.ko 2023-06-09T04:26:54.437 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/iommu/ 2023-06-09T04:26:54.437 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/iommu/amd/ 2023-06-09T04:26:54.437 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 38001 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/iommu/amd/iommu_v2.ko 2023-06-09T04:26:54.437 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/ 2023-06-09T04:26:54.437 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 13641 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/leds-88pm860x.ko 2023-06-09T04:26:54.437 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 11209 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/leds-adp5520.ko 2023-06-09T04:26:54.437 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 59569 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/leds-bd2802.ko 2023-06-09T04:26:54.438 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 24673 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/leds-blinkm.ko 2023-06-09T04:26:54.438 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 10369 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/leds-da903x.ko 2023-06-09T04:26:54.438 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 12137 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/leds-da9052.ko 2023-06-09T04:26:54.438 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 15481 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/leds-gpio.ko 2023-06-09T04:26:54.438 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 15681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/leds-lm3530.ko 2023-06-09T04:26:54.438 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 30385 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/leds-lm3533.ko 2023-06-09T04:26:54.438 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 19169 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/leds-lm355x.ko 2023-06-09T04:26:54.438 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 19841 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/leds-lm3642.ko 2023-06-09T04:26:54.439 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 16137 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/leds-lp3944.ko 2023-06-09T04:26:54.439 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 11129 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/leds-lp8788.ko 2023-06-09T04:26:54.439 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 14817 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/leds-max8997.ko 2023-06-09T04:26:54.439 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 12393 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/leds-mc13783.ko 2023-06-09T04:26:54.439 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 13025 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/leds-menf21bmc.ko 2023-06-09T04:26:54.439 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 20609 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/leds-pca9532.ko 2023-06-09T04:26:54.439 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 20305 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/leds-pca955x.ko 2023-06-09T04:26:54.439 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 17681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/leds-pca963x.ko 2023-06-09T04:26:54.440 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 33673 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/leds-ss4200.ko 2023-06-09T04:26:54.440 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 24689 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/leds-tca6507.ko 2023-06-09T04:26:54.440 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 15489 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/leds-wm831x-status.ko 2023-06-09T04:26:54.440 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 11729 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/leds-wm8350.ko 2023-06-09T04:26:54.440 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/trigger/ 2023-06-09T04:26:54.440 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 9497 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-06-09T04:26:54.440 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 10697 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-06-09T04:26:54.441 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 8593 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-06-09T04:26:54.441 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 7441 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-06-09T04:26:54.441 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 14145 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-06-09T04:26:54.441 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 13897 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-06-09T04:26:54.441 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 11705 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-06-09T04:26:54.441 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 13905 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-06-09T04:26:54.441 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/ 2023-06-09T04:26:54.441 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/bcache/ 2023-06-09T04:26:54.442 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 631713 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/bcache/bcache.ko 2023-06-09T04:26:54.442 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 37553 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-bio-prison.ko 2023-06-09T04:26:54.442 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 86033 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-bufio.ko 2023-06-09T04:26:54.442 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 47353 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-cache-smq.ko 2023-06-09T04:26:54.442 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 154097 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-cache.ko 2023-06-09T04:26:54.442 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 105553 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-crypt.ko 2023-06-09T04:26:54.442 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 21417 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-delay.ko 2023-06-09T04:26:54.443 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 53697 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-era.ko 2023-06-09T04:26:54.443 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 20825 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-flakey.ko 2023-06-09T04:26:54.443 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 41425 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-log-userspace.ko 2023-06-09T04:26:54.443 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 32041 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-log.ko 2023-06-09T04:26:54.443 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 49377 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-mirror.ko 2023-06-09T04:26:54.443 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 77505 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-multipath.ko 2023-06-09T04:26:54.443 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 16345 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-queue-length.ko 2023-06-09T04:26:54.443 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 70657 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-raid.ko 2023-06-09T04:26:54.444 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 33881 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-region-hash.ko 2023-06-09T04:26:54.444 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 15681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-round-robin.ko 2023-06-09T04:26:54.444 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 16609 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-service-time.ko 2023-06-09T04:26:54.444 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 108801 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-snapshot.ko 2023-06-09T04:26:54.444 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 19249 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-switch.ko 2023-06-09T04:26:54.444 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 182017 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-thin-pool.ko 2023-06-09T04:26:54.444 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 51625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-verity.ko 2023-06-09T04:26:54.444 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 8273 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-zero.ko 2023-06-09T04:26:54.445 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 14921 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/faulty.ko 2023-06-09T04:26:54.445 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 19313 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/linear.ko 2023-06-09T04:26:54.445 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 32121 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/multipath.ko 2023-06-09T04:26:54.445 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/persistent-data/ 2023-06-09T04:26:54.445 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 192737 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-06-09T04:26:54.445 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 37025 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/raid0.ko 2023-06-09T04:26:54.445 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 111361 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/raid1.ko 2023-06-09T04:26:54.446 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 157873 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/raid10.ko 2023-06-09T04:26:54.446 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 392777 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/raid456.ko 2023-06-09T04:26:54.446 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/message/ 2023-06-09T04:26:54.446 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/message/fusion/ 2023-06-09T04:26:54.446 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 174329 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/message/fusion/mptbase.ko 2023-06-09T04:26:54.446 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 63273 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/message/fusion/mptctl.ko 2023-06-09T04:26:54.446 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 44465 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/message/fusion/mptfc.ko 2023-06-09T04:26:54.446 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 37049 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/message/fusion/mptlan.ko 2023-06-09T04:26:54.447 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 123185 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/message/fusion/mptsas.ko 2023-06-09T04:26:54.447 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 76009 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/message/fusion/mptscsih.ko 2023-06-09T04:26:54.447 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 52905 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/message/fusion/mptspi.ko 2023-06-09T04:26:54.447 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/ 2023-06-09T04:26:54.447 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 17193 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/88pm800.ko 2023-06-09T04:26:54.447 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 12649 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/88pm805.ko 2023-06-09T04:26:54.447 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 10489 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/88pm80x.ko 2023-06-09T04:26:54.447 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 11761 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/arizona-i2c.ko 2023-06-09T04:26:54.448 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 121721 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/arizona.ko 2023-06-09T04:26:54.448 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 11849 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/bcm590xx.ko 2023-06-09T04:26:54.448 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 17281 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/cros_ec_dev.ko 2023-06-09T04:26:54.448 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 34417 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/dln2.ko 2023-06-09T04:26:54.448 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 16577 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/janz-cmodio.ko 2023-06-09T04:26:54.448 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 52497 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/kempld-core.ko 2023-06-09T04:26:54.448 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 27041 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/lm3533-core.ko 2023-06-09T04:26:54.449 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 13969 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/lm3533-ctrlbank.ko 2023-06-09T04:26:54.449 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 12433 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/lp3943.ko 2023-06-09T04:26:54.449 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 54449 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/lpc_ich.ko 2023-06-09T04:26:54.449 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 12001 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/lpc_sch.ko 2023-06-09T04:26:54.449 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 17353 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/max8907.ko 2023-06-09T04:26:54.449 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 27865 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/mc13xxx-core.ko 2023-06-09T04:26:54.449 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 11689 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/mc13xxx-i2c.ko 2023-06-09T04:26:54.449 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 11489 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/menf21bmc.ko 2023-06-09T04:26:54.450 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 16897 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/pcf50633-adc.ko 2023-06-09T04:26:54.450 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 8329 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/pcf50633-gpio.ko 2023-06-09T04:26:54.450 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 33417 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/pcf50633.ko 2023-06-09T04:26:54.450 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 9937 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/rdc321x-southbridge.ko 2023-06-09T04:26:54.450 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 19881 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/retu-mfd.ko 2023-06-09T04:26:54.450 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 76433 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/si476x-core.ko 2023-06-09T04:26:54.450 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 47649 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/sm501.ko 2023-06-09T04:26:54.450 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 19161 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/ti_am335x_tscadc.ko 2023-06-09T04:26:54.451 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 50505 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/tps65010.ko 2023-06-09T04:26:54.451 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 10249 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/tps6507x.ko 2023-06-09T04:26:54.451 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 13217 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/viperboard.ko 2023-06-09T04:26:54.451 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 10417 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/vx855.ko 2023-06-09T04:26:54.451 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 17785 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/wl1273-core.ko 2023-06-09T04:26:54.451 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 43521 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/wm8994.ko 2023-06-09T04:26:54.451 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/ 2023-06-09T04:26:54.451 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 13721 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/ad525x_dpot-i2c.ko 2023-06-09T04:26:54.452 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 48009 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/ad525x_dpot.ko 2023-06-09T04:26:54.452 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/altera-stapl/ 2023-06-09T04:26:54.452 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 46185 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-06-09T04:26:54.452 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 18217 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/apds9802als.ko 2023-06-09T04:26:54.452 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 36625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/apds990x.ko 2023-06-09T04:26:54.452 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 45473 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/bh1770glc.ko 2023-06-09T04:26:54.452 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/c2port/ 2023-06-09T04:26:54.453 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 10969 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2023-06-09T04:26:54.453 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 34801 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/c2port/core.ko 2023-06-09T04:26:54.453 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/cb710/ 2023-06-09T04:26:54.453 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 24465 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/cb710/cb710.ko 2023-06-09T04:26:54.453 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 17617 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/ds1682.ko 2023-06-09T04:26:54.453 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 8777 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/dummy-irq.ko 2023-06-09T04:26:54.453 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/echo/ 2023-06-09T04:26:54.453 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 12729 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/echo/echo.ko 2023-06-09T04:26:54.454 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/eeprom/ 2023-06-09T04:26:54.454 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 37521 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/eeprom/at24.ko 2023-06-09T04:26:54.454 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 14145 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/eeprom/eeprom.ko 2023-06-09T04:26:54.454 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 13881 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-06-09T04:26:54.454 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 13433 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/eeprom/max6875.ko 2023-06-09T04:26:54.454 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 31913 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/enclosure.ko 2023-06-09T04:26:54.454 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/genwqe/ 2023-06-09T04:26:54.454 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 151953 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/genwqe/genwqe_card.ko 2023-06-09T04:26:54.455 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 14017 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/hmc6352.ko 2023-06-09T04:26:54.455 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 31009 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/hpilo.ko 2023-06-09T04:26:54.455 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/ibmasm/ 2023-06-09T04:26:54.455 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 72497 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/ibmasm/ibmasm.ko 2023-06-09T04:26:54.455 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 19673 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/ics932s401.ko 2023-06-09T04:26:54.455 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 21569 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/isl29003.ko 2023-06-09T04:26:54.455 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 15569 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/isl29020.ko 2023-06-09T04:26:54.455 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/lis3lv02d/ 2023-06-09T04:26:54.456 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 41465 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-06-09T04:26:54.456 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 13745 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-06-09T04:26:54.456 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/mei/ 2023-06-09T04:26:54.456 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 124401 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/mei/mei-me.ko 2023-06-09T04:26:54.456 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 56337 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/mei/mei-txe.ko 2023-06-09T04:26:54.456 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 304353 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/mei/mei.ko 2023-06-09T04:26:54.456 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 31161 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/phantom.ko 2023-06-09T04:26:54.457 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/ti-st/ 2023-06-09T04:26:54.457 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 74433 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/ti-st/st_drv.ko 2023-06-09T04:26:54.457 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 24193 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/tifm_7xx1.ko 2023-06-09T04:26:54.457 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 27305 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/tifm_core.ko 2023-06-09T04:26:54.457 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 18617 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/tsl2550.ko 2023-06-09T04:26:54.457 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 48569 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/vmw_balloon.ko 2023-06-09T04:26:54.457 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/vmw_vmci/ 2023-06-09T04:26:54.457 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 180697 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-06-09T04:26:54.458 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ 2023-06-09T04:26:54.458 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/bonding/ 2023-06-09T04:26:54.458 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 487817 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/bonding/bonding.ko 2023-06-09T04:26:54.458 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/dsa/ 2023-06-09T04:26:54.458 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/dsa/b53/ 2023-06-09T04:26:54.458 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 101961 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/dsa/b53/b53_common.ko 2023-06-09T04:26:54.458 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 40097 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/dsa/bcm-sf2.ko 2023-06-09T04:26:54.458 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 14513 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/dsa/mv88e6060.ko 2023-06-09T04:26:54.459 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/dsa/mv88e6xxx/ 2023-06-09T04:26:54.459 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 447113 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-06-09T04:26:54.459 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 16753 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/dummy.ko 2023-06-09T04:26:54.459 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 17769 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/eql.ko 2023-06-09T04:26:54.459 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/ 2023-06-09T04:26:54.459 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/3com/ 2023-06-09T04:26:54.459 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 45609 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-06-09T04:26:54.459 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 41905 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-06-09T04:26:54.460 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 130385 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-06-09T04:26:54.460 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 68681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-06-09T04:26:54.460 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/8390/ 2023-06-09T04:26:54.460 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 36345 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/8390/8390.ko 2023-06-09T04:26:54.460 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 59513 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-06-09T04:26:54.460 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 27017 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-06-09T04:26:54.460 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 98945 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-06-09T04:26:54.461 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/adaptec/ 2023-06-09T04:26:54.461 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 54353 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-06-09T04:26:54.461 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/agere/ 2023-06-09T04:26:54.461 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 69033 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/agere/et131x.ko 2023-06-09T04:26:54.461 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/alteon/ 2023-06-09T04:26:54.461 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 59401 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-06-09T04:26:54.461 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/altera/ 2023-06-09T04:26:54.461 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 40649 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-06-09T04:26:54.462 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/amd/ 2023-06-09T04:26:54.462 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 54441 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-06-09T04:26:54.462 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 49105 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-06-09T04:26:54.462 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 87177 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-06-09T04:26:54.462 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/atheros/ 2023-06-09T04:26:54.462 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/atheros/alx/ 2023-06-09T04:26:54.462 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 97217 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-06-09T04:26:54.462 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/atheros/atl1c/ 2023-06-09T04:26:54.463 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 104473 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-06-09T04:26:54.463 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/atheros/atl1e/ 2023-06-09T04:26:54.463 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 90073 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-06-09T04:26:54.463 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/atheros/atlx/ 2023-06-09T04:26:54.463 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 81329 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-06-09T04:26:54.463 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 69601 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-06-09T04:26:54.463 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/broadcom/ 2023-06-09T04:26:54.463 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 78233 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-06-09T04:26:54.464 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 176705 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-06-09T04:26:54.464 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2023-06-09T04:26:54.464 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 1422001 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-06-09T04:26:54.464 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 127881 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-06-09T04:26:54.464 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/broadcom/genet/ 2023-06-09T04:26:54.464 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 130785 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-06-09T04:26:54.464 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 311913 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-06-09T04:26:54.464 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/brocade/ 2023-06-09T04:26:54.465 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/brocade/bna/ 2023-06-09T04:26:54.465 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 323489 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-06-09T04:26:54.465 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/chelsio/ 2023-06-09T04:26:54.465 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/chelsio/cxgb/ 2023-06-09T04:26:54.465 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 193321 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-06-09T04:26:54.465 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2023-06-09T04:26:54.465 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 345761 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-06-09T04:26:54.466 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2023-06-09T04:26:54.466 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 1038865 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-06-09T04:26:54.508 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2023-06-09T04:26:54.508 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 166001 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-06-09T04:26:54.509 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2023-06-09T04:26:54.509 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 33681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-06-09T04:26:54.509 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/cisco/ 2023-06-09T04:26:54.509 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/cisco/enic/ 2023-06-09T04:26:54.509 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 203425 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-06-09T04:26:54.509 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/dec/ 2023-06-09T04:26:54.509 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/dec/tulip/ 2023-06-09T04:26:54.510 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 69281 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-06-09T04:26:54.510 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 61321 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-06-09T04:26:54.510 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 141049 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-06-09T04:26:54.510 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 51329 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-06-09T04:26:54.510 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 62689 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-06-09T04:26:54.510 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 31201 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-06-09T04:26:54.510 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/dlink/ 2023-06-09T04:26:54.511 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 60697 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-06-09T04:26:54.511 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 62721 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-06-09T04:26:54.511 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 45609 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/dnet.ko 2023-06-09T04:26:54.511 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 25057 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/ec_bhf.ko 2023-06-09T04:26:54.511 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/emulex/ 2023-06-09T04:26:54.511 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/emulex/benet/ 2023-06-09T04:26:54.511 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 280865 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-06-09T04:26:54.511 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 49321 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/ethoc.ko 2023-06-09T04:26:54.512 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 51625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/fealnx.ko 2023-06-09T04:26:54.512 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/fujitsu/ 2023-06-09T04:26:54.512 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 45161 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2023-06-09T04:26:54.512 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/intel/ 2023-06-09T04:26:54.512 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 90297 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/intel/e100.ko 2023-06-09T04:26:54.512 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/intel/e1000/ 2023-06-09T04:26:54.512 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 295609 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-06-09T04:26:54.512 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/intel/e1000e/ 2023-06-09T04:26:54.513 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 583881 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-06-09T04:26:54.513 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/intel/fm10k/ 2023-06-09T04:26:54.513 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 246201 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-06-09T04:26:54.513 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/intel/i40e/ 2023-06-09T04:26:54.513 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 922281 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-06-09T04:26:54.513 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/intel/iavf/ 2023-06-09T04:26:54.513 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 301665 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-06-09T04:26:54.514 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/intel/igb/ 2023-06-09T04:26:54.514 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 514281 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-06-09T04:26:54.514 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/intel/igbvf/ 2023-06-09T04:26:54.514 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 93481 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-06-09T04:26:54.514 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/intel/ixgbe/ 2023-06-09T04:26:54.514 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 733977 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-06-09T04:26:54.514 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/intel/ixgbevf/ 2023-06-09T04:26:54.514 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 151753 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-06-09T04:26:54.515 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 86737 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/jme.ko 2023-06-09T04:26:54.515 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/marvell/ 2023-06-09T04:26:54.515 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 20857 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-06-09T04:26:54.515 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 102273 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/marvell/skge.ko 2023-06-09T04:26:54.515 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 122577 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-06-09T04:26:54.515 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/mellanox/ 2023-06-09T04:26:54.515 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/mellanox/mlx4/ 2023-06-09T04:26:54.515 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 710297 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-06-09T04:26:54.516 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 280409 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-06-09T04:26:54.516 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/mellanox/mlx5/ 2023-06-09T04:26:54.516 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2023-06-09T04:26:54.516 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 1050633 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-06-09T04:26:54.516 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/micrel/ 2023-06-09T04:26:54.516 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 52929 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/micrel/ks8842.ko 2023-06-09T04:26:54.516 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 40345 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2023-06-09T04:26:54.517 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 19449 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2023-06-09T04:26:54.517 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 95497 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-06-09T04:26:54.517 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/myricom/ 2023-06-09T04:26:54.517 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/myricom/myri10ge/ 2023-06-09T04:26:54.517 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 108641 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-06-09T04:26:54.517 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/natsemi/ 2023-06-09T04:26:54.517 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 73273 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-06-09T04:26:54.517 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 47601 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-06-09T04:26:54.518 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/neterion/ 2023-06-09T04:26:54.518 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 150737 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-06-09T04:26:54.518 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/nvidia/ 2023-06-09T04:26:54.518 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 136609 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-06-09T04:26:54.518 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/packetengines/ 2023-06-09T04:26:54.518 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 50305 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-06-09T04:26:54.518 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 42977 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-06-09T04:26:54.518 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/qlogic/ 2023-06-09T04:26:54.519 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/qlogic/netxen/ 2023-06-09T04:26:54.519 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 226993 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-06-09T04:26:54.519 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 86913 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-06-09T04:26:54.519 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2023-06-09T04:26:54.519 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 671281 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-06-09T04:26:54.519 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/rdc/ 2023-06-09T04:26:54.519 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 42849 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-06-09T04:26:54.519 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/realtek/ 2023-06-09T04:26:54.520 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 67209 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-06-09T04:26:54.520 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 83809 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-06-09T04:26:54.520 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 29217 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/realtek/atp.ko 2023-06-09T04:26:54.520 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 189649 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-06-09T04:26:54.520 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/samsung/ 2023-06-09T04:26:54.520 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/samsung/sxgbe/ 2023-06-09T04:26:54.520 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 104065 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2023-06-09T04:26:54.521 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/sfc/ 2023-06-09T04:26:54.521 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 893521 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-06-09T04:26:54.521 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/silan/ 2023-06-09T04:26:54.521 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 47057 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-06-09T04:26:54.521 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/sis/ 2023-06-09T04:26:54.521 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 54633 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/sis/sis190.ko 2023-06-09T04:26:54.521 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 63169 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/sis/sis900.ko 2023-06-09T04:26:54.521 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/smsc/ 2023-06-09T04:26:54.522 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 61433 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-06-09T04:26:54.522 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 67009 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-06-09T04:26:54.522 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 73233 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-06-09T04:26:54.522 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 68105 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-06-09T04:26:54.522 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/stmicro/ 2023-06-09T04:26:54.522 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/stmicro/stmmac/ 2023-06-09T04:26:54.522 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 13329 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2023-06-09T04:26:54.522 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 39961 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-06-09T04:26:54.523 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 13777 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2023-06-09T04:26:54.523 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 480697 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-06-09T04:26:54.523 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/sun/ 2023-06-09T04:26:54.523 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 103273 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/sun/cassini.ko 2023-06-09T04:26:54.523 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 166001 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/sun/niu.ko 2023-06-09T04:26:54.523 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 66361 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/sun/sungem.ko 2023-06-09T04:26:54.523 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 78633 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-06-09T04:26:54.523 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/tehuti/ 2023-06-09T04:26:54.524 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 49873 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-06-09T04:26:54.524 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/ti/ 2023-06-09T04:26:54.524 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 86353 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/ti/tlan.ko 2023-06-09T04:26:54.524 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/via/ 2023-06-09T04:26:54.524 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 80153 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-06-09T04:26:54.524 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 83497 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-06-09T04:26:54.524 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/wiznet/ 2023-06-09T04:26:54.524 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 45609 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-06-09T04:26:54.525 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 30665 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-06-09T04:26:54.525 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/xircom/ 2023-06-09T04:26:54.525 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 59929 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-06-09T04:26:54.525 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/fddi/ 2023-06-09T04:26:54.525 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 40889 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/fddi/defxx.ko 2023-06-09T04:26:54.525 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/fddi/skfp/ 2023-06-09T04:26:54.525 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 216801 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/fddi/skfp/skfp.ko 2023-06-09T04:26:54.526 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 76993 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/geneve.ko 2023-06-09T04:26:54.526 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/hyperv/ 2023-06-09T04:26:54.526 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 234441 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-06-09T04:26:54.526 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ieee802154/ 2023-06-09T04:26:54.526 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 18137 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ieee802154/fakelb.ko 2023-06-09T04:26:54.526 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 24969 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ifb.ko 2023-06-09T04:26:54.526 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ipvlan/ 2023-06-09T04:26:54.526 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 82865 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ipvlan/ipvlan.ko 2023-06-09T04:26:54.527 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 61337 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/macvlan.ko 2023-06-09T04:26:54.527 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 15697 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/macvtap.ko 2023-06-09T04:26:54.527 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/mdio/ 2023-06-09T04:26:54.527 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 19697 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-06-09T04:26:54.527 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 13313 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-06-09T04:26:54.527 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 13577 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/mdio/mdio-gpio.ko 2023-06-09T04:26:54.527 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 15049 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/mdio.ko 2023-06-09T04:26:54.527 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 19225 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/mii.ko 2023-06-09T04:26:54.528 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 41585 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/netconsole.ko 2023-06-09T04:26:54.528 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 12969 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/nlmon.ko 2023-06-09T04:26:54.528 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/pcs/ 2023-06-09T04:26:54.528 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 9417 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/pcs/pcs-altera-tse.ko 2023-06-09T04:26:54.528 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 29601 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-06-09T04:26:54.528 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/ 2023-06-09T04:26:54.528 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 9561 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/amd.ko 2023-06-09T04:26:54.528 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 40329 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-06-09T04:26:54.529 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 43161 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/bcm7xxx.ko 2023-06-09T04:26:54.529 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 11353 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/bcm87xx.ko 2023-06-09T04:26:54.529 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 37921 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/broadcom.ko 2023-06-09T04:26:54.529 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 10457 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/cicada.ko 2023-06-09T04:26:54.529 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 12793 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/davicom.ko 2023-06-09T04:26:54.529 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 9273 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/et1011c.ko 2023-06-09T04:26:54.529 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 24729 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/icplus.ko 2023-06-09T04:26:54.530 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 15609 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/lxt.ko 2023-06-09T04:26:54.530 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 78001 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/marvell.ko 2023-06-09T04:26:54.530 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 75689 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/micrel.ko 2023-06-09T04:26:54.530 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 11929 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/national.ko 2023-06-09T04:26:54.530 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 92049 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/phylink.ko 2023-06-09T04:26:54.530 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 9889 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/qsemi.ko 2023-06-09T04:26:54.530 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 47505 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/realtek.ko 2023-06-09T04:26:54.530 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 24745 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/smsc.ko 2023-06-09T04:26:54.531 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 10689 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/ste10Xp.ko 2023-06-09T04:26:54.531 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 23865 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/vitesse.ko 2023-06-09T04:26:54.531 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/plip/ 2023-06-09T04:26:54.531 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 43353 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/plip/plip.ko 2023-06-09T04:26:54.531 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ppp/ 2023-06-09T04:26:54.531 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 15753 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ppp/bsd_comp.ko 2023-06-09T04:26:54.531 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 29745 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ppp/ppp_async.ko 2023-06-09T04:26:54.531 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 17489 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ppp/ppp_deflate.ko 2023-06-09T04:26:54.532 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 18513 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ppp/ppp_mppe.ko 2023-06-09T04:26:54.532 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 28769 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ppp/ppp_synctty.ko 2023-06-09T04:26:54.532 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 42425 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ppp/pppoe.ko 2023-06-09T04:26:54.532 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 12633 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ppp/pppox.ko 2023-06-09T04:26:54.532 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 31657 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ppp/pptp.ko 2023-06-09T04:26:54.532 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 28105 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/sb1000.ko 2023-06-09T04:26:54.532 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/slip/ 2023-06-09T04:26:54.532 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 42329 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/slip/slip.ko 2023-06-09T04:26:54.533 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 26529 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/sungem_phy.ko 2023-06-09T04:26:54.533 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 63785 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/tap.ko 2023-06-09T04:26:54.533 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/team/ 2023-06-09T04:26:54.533 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 104617 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/team/team.ko 2023-06-09T04:26:54.533 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 13313 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/team/team_mode_activebackup.ko 2023-06-09T04:26:54.533 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 10041 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/team/team_mode_broadcast.ko 2023-06-09T04:26:54.533 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 28825 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-06-09T04:26:54.533 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 9537 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/team/team_mode_random.ko 2023-06-09T04:26:54.534 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 9145 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-06-09T04:26:54.534 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 89249 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/veth.ko 2023-06-09T04:26:54.534 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/vmxnet3/ 2023-06-09T04:26:54.534 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 120377 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-06-09T04:26:54.534 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/vxlan/ 2023-06-09T04:26:54.534 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 290049 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/vxlan/vxlan.ko 2023-06-09T04:26:54.534 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/xen-netback/ 2023-06-09T04:26:54.535 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 143697 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/xen-netback/xen-netback.ko 2023-06-09T04:26:54.535 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ntb/ 2023-06-09T04:26:54.535 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 19425 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ntb/ntb.ko 2023-06-09T04:26:54.535 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/nvme/ 2023-06-09T04:26:54.535 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/nvme/host/ 2023-06-09T04:26:54.535 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 255881 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/nvme/host/nvme-core.ko 2023-06-09T04:26:54.535 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 101449 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/nvme/host/nvme.ko 2023-06-09T04:26:54.535 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/parport/ 2023-06-09T04:26:54.536 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 129017 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/parport/parport.ko 2023-06-09T04:26:54.536 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 14441 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/parport/parport_cs.ko 2023-06-09T04:26:54.536 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 83833 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/parport/parport_pc.ko 2023-06-09T04:26:54.536 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 25945 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/parport/parport_serial.ko 2023-06-09T04:26:54.536 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pci/ 2023-06-09T04:26:54.536 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pci/hotplug/ 2023-06-09T04:26:54.536 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 24825 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-06-09T04:26:54.536 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 17681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2023-06-09T04:26:54.537 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 19953 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2023-06-09T04:26:54.537 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 11681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pci/pci-stub.ko 2023-06-09T04:26:54.537 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 47265 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pci/xen-pcifront.ko 2023-06-09T04:26:54.537 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pcmcia/ 2023-06-09T04:26:54.537 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 26625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pcmcia/i82092.ko 2023-06-09T04:26:54.537 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 143593 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pcmcia/pcmcia.ko 2023-06-09T04:26:54.537 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 60529 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pcmcia/pcmcia_core.ko 2023-06-09T04:26:54.537 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 33761 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2023-06-09T04:26:54.538 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 34081 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pcmcia/pd6729.ko 2023-06-09T04:26:54.538 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 112801 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pcmcia/yenta_socket.ko 2023-06-09T04:26:54.538 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/phy/ 2023-06-09T04:26:54.538 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/phy/broadcom/ 2023-06-09T04:26:54.538 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 10673 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2023-06-09T04:26:54.538 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/phy/samsung/ 2023-06-09T04:26:54.538 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 8273 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2023-06-09T04:26:54.538 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pinctrl/ 2023-06-09T04:26:54.539 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pinctrl/intel/ 2023-06-09T04:26:54.539 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 70889 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-06-09T04:26:54.539 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/ 2023-06-09T04:26:54.539 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/chrome/ 2023-06-09T04:26:54.539 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 49689 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2023-06-09T04:26:54.539 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 20057 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/chrome/cros_ec.ko 2023-06-09T04:26:54.539 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 21233 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2023-06-09T04:26:54.539 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 25241 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2023-06-09T04:26:54.540 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 26049 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2023-06-09T04:26:54.540 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 18089 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2023-06-09T04:26:54.540 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 16921 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2023-06-09T04:26:54.540 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/ 2023-06-09T04:26:54.540 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 66913 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/acer-wmi.ko 2023-06-09T04:26:54.540 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 39041 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/acerhdf.ko 2023-06-09T04:26:54.540 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 36849 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/apple-gmux.ko 2023-06-09T04:26:54.540 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 59545 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/asus-laptop.ko 2023-06-09T04:26:54.541 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 30529 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-06-09T04:26:54.541 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 106217 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/asus-wmi.ko 2023-06-09T04:26:54.541 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 36745 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/classmate-laptop.ko 2023-06-09T04:26:54.541 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 48945 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-06-09T04:26:54.541 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 13841 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-06-09T04:26:54.541 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 40089 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-06-09T04:26:54.541 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 22417 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-06-09T04:26:54.542 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 36473 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/hdaps.ko 2023-06-09T04:26:54.542 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 19329 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/ibm_rtl.ko 2023-06-09T04:26:54.542 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/intel/ 2023-06-09T04:26:54.542 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 11905 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-06-09T04:26:54.542 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 8873 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2023-06-09T04:26:54.542 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 43169 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/intel_ips.ko 2023-06-09T04:26:54.542 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 20089 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/msi-wmi.ko 2023-06-09T04:26:54.542 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 9745 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/mxm-wmi.ko 2023-06-09T04:26:54.543 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 34617 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-06-09T04:26:54.543 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 42145 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/samsung-laptop.ko 2023-06-09T04:26:54.543 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 13993 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/samsung-q10.ko 2023-06-09T04:26:54.543 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 17137 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/topstar-laptop.ko 2023-06-09T04:26:54.543 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 13545 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-06-09T04:26:54.543 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 16897 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/toshiba_haps.ko 2023-06-09T04:26:54.543 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 10049 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/wmi-bmof.ko 2023-06-09T04:26:54.543 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 54713 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/wmi.ko 2023-06-09T04:26:54.544 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/ 2023-06-09T04:26:54.544 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/ 2023-06-09T04:26:54.544 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 30161 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/88pm860x_battery.ko 2023-06-09T04:26:54.544 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 33873 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/88pm860x_charger.ko 2023-06-09T04:26:54.544 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 54945 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/bq2415x_charger.ko 2023-06-09T04:26:54.544 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 53849 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/bq24190_charger.ko 2023-06-09T04:26:54.544 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 21385 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/bq24735-charger.ko 2023-06-09T04:26:54.544 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 16329 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/cros_peripheral_charger.ko 2023-06-09T04:26:54.545 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 19425 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/da9030_battery.ko 2023-06-09T04:26:54.545 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 19665 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/da9052-battery.ko 2023-06-09T04:26:54.545 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 29169 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/ds2760_battery.ko 2023-06-09T04:26:54.545 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 23097 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/ds2780_battery.ko 2023-06-09T04:26:54.545 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 23241 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/ds2781_battery.ko 2023-06-09T04:26:54.545 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 23537 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/ds2782_battery.ko 2023-06-09T04:26:54.545 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 20177 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/gpio-charger.ko 2023-06-09T04:26:54.546 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 17937 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/isp1704_charger.ko 2023-06-09T04:26:54.546 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 20097 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/lp8727_charger.ko 2023-06-09T04:26:54.546 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 12473 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/max14577_charger.ko 2023-06-09T04:26:54.546 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 25777 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/max17040_battery.ko 2023-06-09T04:26:54.546 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 30353 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/max17042_battery.ko 2023-06-09T04:26:54.546 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 18417 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/max8903_charger.ko 2023-06-09T04:26:54.546 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 23617 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/max8925_power.ko 2023-06-09T04:26:54.546 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 21057 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/pcf50633-charger.ko 2023-06-09T04:26:54.547 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 37825 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/sbs-battery.ko 2023-06-09T04:26:54.547 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 28209 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/test_power.ko 2023-06-09T04:26:54.547 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 18689 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/tps65090-charger.ko 2023-06-09T04:26:54.547 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 11865 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/wm831x_backup.ko 2023-06-09T04:26:54.547 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 24345 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/wm831x_power.ko 2023-06-09T04:26:54.547 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 22297 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/wm8350_power.ko 2023-06-09T04:26:54.547 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/powercap/ 2023-06-09T04:26:54.547 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 54041 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/powercap/intel_rapl_common.ko 2023-06-09T04:26:54.548 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 17193 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/powercap/intel_rapl_msr.ko 2023-06-09T04:26:54.548 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pps/ 2023-06-09T04:26:54.548 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pps/clients/ 2023-06-09T04:26:54.548 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 15353 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pps/clients/pps-gpio.ko 2023-06-09T04:26:54.548 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 13081 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pps/clients/pps-ldisc.ko 2023-06-09T04:26:54.548 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 15745 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pps/clients/pps_parport.ko 2023-06-09T04:26:54.548 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 41273 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pps/pps_core.ko 2023-06-09T04:26:54.548 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ptp/ 2023-06-09T04:26:54.549 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 64505 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ptp/ptp.ko 2023-06-09T04:26:54.549 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 16345 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ptp/ptp_kvm.ko 2023-06-09T04:26:54.549 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/ 2023-06-09T04:26:54.549 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 23321 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-88pm80x.ko 2023-06-09T04:26:54.549 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 24409 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-88pm860x.ko 2023-06-09T04:26:54.549 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 15273 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-bq32k.ko 2023-06-09T04:26:54.549 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 12785 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-bq4802.ko 2023-06-09T04:26:54.549 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 19993 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-da9052.ko 2023-06-09T04:26:54.550 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 18393 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-da9055.ko 2023-06-09T04:26:54.550 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 20065 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-da9063.ko 2023-06-09T04:26:54.550 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 16337 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-ds1286.ko 2023-06-09T04:26:54.550 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 68401 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-ds1307.ko 2023-06-09T04:26:54.550 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 20705 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-ds1374.ko 2023-06-09T04:26:54.550 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 18041 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-ds1511.ko 2023-06-09T04:26:54.550 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 16561 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-ds1553.ko 2023-06-09T04:26:54.550 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 13833 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-ds1672.ko 2023-06-09T04:26:54.551 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 13265 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-ds1742.ko 2023-06-09T04:26:54.551 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 17129 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-ds2404.ko 2023-06-09T04:26:54.551 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 23529 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-ds3232.ko 2023-06-09T04:26:54.551 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 10913 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-em3027.ko 2023-06-09T04:26:54.551 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 24217 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-fm3130.ko 2023-06-09T04:26:54.551 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 17593 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-isl12022.ko 2023-06-09T04:26:54.551 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 35089 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-isl1208.ko 2023-06-09T04:26:54.552 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 14561 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-lp8788.ko 2023-06-09T04:26:54.552 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 37977 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-m41t80.ko 2023-06-09T04:26:54.552 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 11921 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-m48t35.ko 2023-06-09T04:26:54.552 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 25761 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-m48t59.ko 2023-06-09T04:26:54.552 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 14065 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-m48t86.ko 2023-06-09T04:26:54.552 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 11465 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-max6900.ko 2023-06-09T04:26:54.552 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 14553 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-max8907.ko 2023-06-09T04:26:54.552 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 15225 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-max8925.ko 2023-06-09T04:26:54.553 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 25633 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-max8997.ko 2023-06-09T04:26:54.553 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 16569 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-max8998.ko 2023-06-09T04:26:54.553 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 18345 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-mc13xxx.ko 2023-06-09T04:26:54.553 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 11289 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-msm6242.ko 2023-06-09T04:26:54.553 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 19513 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-palmas.ko 2023-06-09T04:26:54.553 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 40009 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-pcf2127.ko 2023-06-09T04:26:54.553 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 17865 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-pcf50633.ko 2023-06-09T04:26:54.553 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 26633 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-pcf85063.ko 2023-06-09T04:26:54.554 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 21713 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-pcf8523.ko 2023-06-09T04:26:54.554 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 29705 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-pcf8563.ko 2023-06-09T04:26:54.554 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 12321 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-pcf8583.ko 2023-06-09T04:26:54.554 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 17849 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-rc5t583.ko 2023-06-09T04:26:54.554 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 12945 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-rp5c01.ko 2023-06-09T04:26:54.554 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 33633 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-rs5c372.ko 2023-06-09T04:26:54.554 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 27649 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-06-09T04:26:54.554 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 25153 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-rx8025.ko 2023-06-09T04:26:54.555 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 19929 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-rx8581.ko 2023-06-09T04:26:54.555 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 21497 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-s35390a.ko 2023-06-09T04:26:54.555 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 16657 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-06-09T04:26:54.555 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 17713 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-tps6586x.ko 2023-06-09T04:26:54.555 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 21425 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-tps65910.ko 2023-06-09T04:26:54.555 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 20433 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-wm831x.ko 2023-06-09T04:26:54.555 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 21169 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-wm8350.ko 2023-06-09T04:26:54.555 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 27761 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-x1205.ko 2023-06-09T04:26:54.556 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/ 2023-06-09T04:26:54.556 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 77529 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/3w-9xxx.ko 2023-06-09T04:26:54.556 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 57489 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/3w-sas.ko 2023-06-09T04:26:54.556 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 55001 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/3w-xxxx.ko 2023-06-09T04:26:54.556 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 134993 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/BusLogic.ko 2023-06-09T04:26:54.556 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 26489 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/a100u2w.ko 2023-06-09T04:26:54.556 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/aacraid/ 2023-06-09T04:26:54.556 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 271033 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/aacraid/aacraid.ko 2023-06-09T04:26:54.557 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 100513 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/advansys.ko 2023-06-09T04:26:54.557 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/aic7xxx/ 2023-06-09T04:26:54.557 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 356081 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-06-09T04:26:54.557 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 295697 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-06-09T04:26:54.557 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/aic94xx/ 2023-06-09T04:26:54.557 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 189145 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/aic94xx/aic94xx.ko 2023-06-09T04:26:54.557 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 23889 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/am53c974.ko 2023-06-09T04:26:54.557 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/arcmsr/ 2023-06-09T04:26:54.558 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 106465 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-06-09T04:26:54.558 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 38065 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/atp870u.ko 2023-06-09T04:26:54.558 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/be2iscsi/ 2023-06-09T04:26:54.558 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 246785 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-06-09T04:26:54.558 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/bfa/ 2023-06-09T04:26:54.558 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 1172073 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/bfa/bfa.ko 2023-06-09T04:26:54.558 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/bnx2fc/ 2023-06-09T04:26:54.558 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 237057 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-06-09T04:26:54.559 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/bnx2i/ 2023-06-09T04:26:54.559 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 115289 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-06-09T04:26:54.559 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 40433 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/ch.ko 2023-06-09T04:26:54.559 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/csiostor/ 2023-06-09T04:26:54.559 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 308721 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/csiostor/csiostor.ko 2023-06-09T04:26:54.559 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/cxgbi/ 2023-06-09T04:26:54.559 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/cxgbi/cxgb3i/ 2023-06-09T04:26:54.560 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 76017 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-06-09T04:26:54.560 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/cxgbi/cxgb4i/ 2023-06-09T04:26:54.560 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 101337 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-06-09T04:26:54.560 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 141697 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-06-09T04:26:54.560 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 75425 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/dc395x.ko 2023-06-09T04:26:54.560 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 37937 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/dmx3191d.ko 2023-06-09T04:26:54.560 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/esas2r/ 2023-06-09T04:26:54.560 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 212297 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/esas2r/esas2r.ko 2023-06-09T04:26:54.561 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 59825 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/esp_scsi.ko 2023-06-09T04:26:54.561 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/fcoe/ 2023-06-09T04:26:54.561 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 78105 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/fcoe/fcoe.ko 2023-06-09T04:26:54.561 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 154921 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-06-09T04:26:54.561 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 18465 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/fdomain.ko 2023-06-09T04:26:54.561 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/fnic/ 2023-06-09T04:26:54.561 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 261961 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/fnic/fnic.ko 2023-06-09T04:26:54.561 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 201689 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/hpsa.ko 2023-06-09T04:26:54.562 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 51041 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/hptiop.ko 2023-06-09T04:26:54.562 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 49041 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/hv_storvsc.ko 2023-06-09T04:26:54.562 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 35201 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/imm.ko 2023-06-09T04:26:54.562 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 43953 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/initio.ko 2023-06-09T04:26:54.562 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 266409 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/ipr.ko 2023-06-09T04:26:54.562 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 101769 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/ips.ko 2023-06-09T04:26:54.562 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/isci/ 2023-06-09T04:26:54.563 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 317137 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/isci/isci.ko 2023-06-09T04:26:54.563 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 25345 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-06-09T04:26:54.563 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 52529 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/iscsi_tcp.ko 2023-06-09T04:26:54.563 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/libfc/ 2023-06-09T04:26:54.563 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 308257 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/libfc/libfc.ko 2023-06-09T04:26:54.563 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 140057 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/libiscsi.ko 2023-06-09T04:26:54.563 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 51529 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/libiscsi_tcp.ko 2023-06-09T04:26:54.563 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/libsas/ 2023-06-09T04:26:54.564 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 212865 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/libsas/libsas.ko 2023-06-09T04:26:54.564 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/lpfc/ 2023-06-09T04:26:54.564 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 2193673 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/lpfc/lpfc.ko 2023-06-09T04:26:54.564 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/megaraid/ 2023-06-09T04:26:54.564 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 73433 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-06-09T04:26:54.564 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 32913 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-06-09T04:26:54.564 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 310561 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-06-09T04:26:54.564 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 84585 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/megaraid.ko 2023-06-09T04:26:54.565 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/mpt3sas/ 2023-06-09T04:26:54.565 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 659401 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-06-09T04:26:54.565 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/mvsas/ 2023-06-09T04:26:54.565 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 119745 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/mvsas/mvsas.ko 2023-06-09T04:26:54.565 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 77985 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/mvumi.ko 2023-06-09T04:26:54.565 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/pcmcia/ 2023-06-09T04:26:54.565 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 81433 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2023-06-09T04:26:54.565 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 11601 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2023-06-09T04:26:54.566 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 20689 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2023-06-09T04:26:54.566 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 23681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2023-06-09T04:26:54.566 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/pm8001/ 2023-06-09T04:26:54.566 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 361249 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-06-09T04:26:54.566 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 123377 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/pmcraid.ko 2023-06-09T04:26:54.566 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 33497 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/ppa.ko 2023-06-09T04:26:54.566 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 55161 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/qla1280.ko 2023-06-09T04:26:54.567 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/qla2xxx/ 2023-06-09T04:26:54.567 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 1850585 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-06-09T04:26:54.567 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 85145 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-06-09T04:26:54.567 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/qla4xxx/ 2023-06-09T04:26:54.567 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 558681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-06-09T04:26:54.567 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 17713 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/qlogicfas408.ko 2023-06-09T04:26:54.567 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 18393 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/raid_class.ko 2023-06-09T04:26:54.567 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 238633 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/scsi_debug.ko 2023-06-09T04:26:54.568 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 171753 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/scsi_transport_fc.ko 2023-06-09T04:26:54.568 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 269985 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-06-09T04:26:54.568 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 94177 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/scsi_transport_sas.ko 2023-06-09T04:26:54.568 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 72577 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/scsi_transport_spi.ko 2023-06-09T04:26:54.568 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 43425 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/scsi_transport_srp.ko 2023-06-09T04:26:54.568 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 26145 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/ses.ko 2023-06-09T04:26:54.568 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 115665 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/st.ko 2023-06-09T04:26:54.568 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 46649 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/stex.ko 2023-06-09T04:26:54.569 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/sym53c8xx_2/ 2023-06-09T04:26:54.569 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 161953 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-06-09T04:26:54.569 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 42249 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/virtio_scsi.ko 2023-06-09T04:26:54.569 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 50193 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/vmw_pvscsi.ko 2023-06-09T04:26:54.569 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 39833 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/wd719x.ko 2023-06-09T04:26:54.569 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 49921 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/xen-scsifront.ko 2023-06-09T04:26:54.569 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ssb/ 2023-06-09T04:26:54.569 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 126913 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ssb/ssb.ko 2023-06-09T04:26:54.570 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/target/ 2023-06-09T04:26:54.570 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/target/iscsi/ 2023-06-09T04:26:54.570 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 731481 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-06-09T04:26:54.570 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/target/loopback/ 2023-06-09T04:26:54.570 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 49801 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/target/loopback/tcm_loop.ko 2023-06-09T04:26:54.570 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 39465 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/target/target_core_file.ko 2023-06-09T04:26:54.570 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 38281 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/target/target_core_iblock.ko 2023-06-09T04:26:54.571 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 920681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/target/target_core_mod.ko 2023-06-09T04:26:54.571 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 44153 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/target/target_core_pscsi.ko 2023-06-09T04:26:54.571 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 122425 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/target/target_core_user.ko 2023-06-09T04:26:54.571 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/target/tcm_fc/ 2023-06-09T04:26:54.571 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 75537 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-06-09T04:26:54.571 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/thermal/ 2023-06-09T04:26:54.571 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/thermal/intel/ 2023-06-09T04:26:54.571 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/thermal/intel/int340x_thermal/ 2023-06-09T04:26:54.572 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 18929 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-06-09T04:26:54.572 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 28881 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-06-09T04:26:54.572 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 9841 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-06-09T04:26:54.572 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 10081 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-06-09T04:26:54.572 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 14905 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-06-09T04:26:54.572 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 15897 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-06-09T04:26:54.572 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 25977 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-06-09T04:26:54.572 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 20097 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-06-09T04:26:54.573 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 14745 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-06-09T04:26:54.573 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 13625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-06-09T04:26:54.573 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 12417 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-06-09T04:26:54.573 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 36561 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-06-09T04:26:54.573 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 30625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/thermal/intel/intel_powerclamp.ko 2023-06-09T04:26:54.573 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 20985 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-06-09T04:26:54.573 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 11817 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-06-09T04:26:54.573 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 26369 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-06-09T04:26:54.574 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/tty/ 2023-06-09T04:26:54.574 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/tty/ipwireless/ 2023-06-09T04:26:54.574 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 77969 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-06-09T04:26:54.574 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 57697 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/tty/moxa.ko 2023-06-09T04:26:54.574 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 50617 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/tty/mxser.ko 2023-06-09T04:26:54.574 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 107377 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/tty/n_gsm.ko 2023-06-09T04:26:54.574 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 31833 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/tty/n_hdlc.ko 2023-06-09T04:26:54.574 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 67961 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/tty/nozomi.ko 2023-06-09T04:26:54.575 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/tty/serial/ 2023-06-09T04:26:54.575 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/tty/serial/8250/ 2023-06-09T04:26:54.575 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 35561 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/tty/serial/8250/8250_dw.ko 2023-06-09T04:26:54.575 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 59385 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-06-09T04:26:54.575 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 18105 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/tty/serial/altera_jtaguart.ko 2023-06-09T04:26:54.575 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 22281 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/tty/serial/altera_uart.ko 2023-06-09T04:26:54.575 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 9321 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/tty/serial/arc_uart.ko 2023-06-09T04:26:54.575 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 70177 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/tty/serial/fsl_lpuart.ko 2023-06-09T04:26:54.576 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/tty/serial/jsm/ 2023-06-09T04:26:54.576 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 102841 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/tty/serial/jsm/jsm.ko 2023-06-09T04:26:54.576 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 28673 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/tty/serial/rp2.ko 2023-06-09T04:26:54.576 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 52025 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/tty/serial/sc16is7xx.ko 2023-06-09T04:26:54.576 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 100001 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/tty/synclink_gt.ko 2023-06-09T04:26:54.576 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ufs/ 2023-06-09T04:26:54.576 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ufs/core/ 2023-06-09T04:26:54.577 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 519233 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ufs/core/ufshcd-core.ko 2023-06-09T04:26:54.577 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ufs/host/ 2023-06-09T04:26:54.577 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 28425 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-06-09T04:26:54.577 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 14441 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2023-06-09T04:26:54.577 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/uio/ 2023-06-09T04:26:54.577 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 43857 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/uio/uio.ko 2023-06-09T04:26:54.577 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 12129 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/uio/uio_aec.ko 2023-06-09T04:26:54.577 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 11105 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/uio/uio_cif.ko 2023-06-09T04:26:54.578 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 18217 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/uio/uio_dmem_genirq.ko 2023-06-09T04:26:54.578 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 12825 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/uio/uio_mf624.ko 2023-06-09T04:26:54.578 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 12001 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/uio/uio_netx.ko 2023-06-09T04:26:54.578 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 10497 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/uio/uio_pci_generic.ko 2023-06-09T04:26:54.578 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 15873 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/uio/uio_pdrv_genirq.ko 2023-06-09T04:26:54.578 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 13529 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/uio/uio_sercos3.ko 2023-06-09T04:26:54.578 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/ 2023-06-09T04:26:54.578 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/c67x00/ 2023-06-09T04:26:54.579 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 73097 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/c67x00/c67x00.ko 2023-06-09T04:26:54.579 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/chipidea/ 2023-06-09T04:26:54.579 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 142417 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/chipidea/ci_hdrc.ko 2023-06-09T04:26:54.579 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 18385 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2023-06-09T04:26:54.579 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 12529 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2023-06-09T04:26:54.579 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 12833 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2023-06-09T04:26:54.579 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/class/ 2023-06-09T04:26:54.579 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 85345 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/class/cdc-acm.ko 2023-06-09T04:26:54.580 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 51001 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/class/cdc-wdm.ko 2023-06-09T04:26:54.580 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 47353 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/class/usblp.ko 2023-06-09T04:26:54.580 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 89729 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/class/usbtmc.ko 2023-06-09T04:26:54.580 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/common/ 2023-06-09T04:26:54.580 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 22145 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/common/ulpi.ko 2023-06-09T04:26:54.580 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/dwc2/ 2023-06-09T04:26:54.580 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 11705 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/dwc2/dwc2_pci.ko 2023-06-09T04:26:54.581 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/dwc3/ 2023-06-09T04:26:54.581 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 11977 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/dwc3/dwc3-haps.ko 2023-06-09T04:26:54.581 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 29753 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/dwc3/dwc3-pci.ko 2023-06-09T04:26:54.581 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 438457 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/dwc3/dwc3.ko 2023-06-09T04:26:54.581 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/ 2023-06-09T04:26:54.581 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/function/ 2023-06-09T04:26:54.581 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 57753 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/function/u_ether.ko 2023-06-09T04:26:54.581 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 50193 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/function/u_serial.ko 2023-06-09T04:26:54.582 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 28929 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2023-06-09T04:26:54.582 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 42473 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2023-06-09T04:26:54.582 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 27977 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2023-06-09T04:26:54.582 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 36465 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2023-06-09T04:26:54.582 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 91705 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2023-06-09T04:26:54.582 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 50865 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2023-06-09T04:26:54.582 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 117913 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2023-06-09T04:26:54.582 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 57753 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2023-06-09T04:26:54.583 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 22233 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2023-06-09T04:26:54.583 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 31153 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2023-06-09T04:26:54.583 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 57761 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2023-06-09T04:26:54.583 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 84017 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2023-06-09T04:26:54.583 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 19401 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2023-06-09T04:26:54.583 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 58321 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2023-06-09T04:26:54.583 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 67169 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2023-06-09T04:26:54.583 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/legacy/ 2023-06-09T04:26:54.584 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 21081 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2023-06-09T04:26:54.584 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 17945 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2023-06-09T04:26:54.584 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 18361 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2023-06-09T04:26:54.584 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 21473 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/legacy/g_ether.ko 2023-06-09T04:26:54.584 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 28289 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2023-06-09T04:26:54.584 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 18873 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/legacy/g_hid.ko 2023-06-09T04:26:54.584 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 20233 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2023-06-09T04:26:54.584 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 16857 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2023-06-09T04:26:54.585 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 31961 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2023-06-09T04:26:54.585 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 16609 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/legacy/g_printer.ko 2023-06-09T04:26:54.585 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 19281 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/legacy/g_serial.ko 2023-06-09T04:26:54.585 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 27017 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/legacy/g_zero.ko 2023-06-09T04:26:54.585 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 61985 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2023-06-09T04:26:54.585 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 15033 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2023-06-09T04:26:54.585 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 156905 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/libcomposite.ko 2023-06-09T04:26:54.586 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/udc/ 2023-06-09T04:26:54.586 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 16961 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2023-06-09T04:26:54.586 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/udc/bdc/ 2023-06-09T04:26:54.586 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 157545 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2023-06-09T04:26:54.586 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 35953 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/udc/goku_udc.ko 2023-06-09T04:26:54.586 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 52825 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/udc/gr_udc.ko 2023-06-09T04:26:54.586 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 69577 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2023-06-09T04:26:54.586 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 55833 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/udc/mv_udc.ko 2023-06-09T04:26:54.587 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 75865 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/udc/net2272.ko 2023-06-09T04:26:54.587 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 74913 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/udc/net2280.ko 2023-06-09T04:26:54.587 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 73041 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/udc/pch_udc.ko 2023-06-09T04:26:54.587 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 65681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2023-06-09T04:26:54.587 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 65969 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2023-06-09T04:26:54.587 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 80233 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2023-06-09T04:26:54.587 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 145081 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/udc/udc-core.ko 2023-06-09T04:26:54.587 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/host/ 2023-06-09T04:26:54.588 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 11473 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/host/bcma-hcd.ko 2023-06-09T04:26:54.588 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 79913 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/host/isp116x-hcd.ko 2023-06-09T04:26:54.588 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 87505 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/host/oxu210hp-hcd.ko 2023-06-09T04:26:54.588 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 78745 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/host/r8a66597-hcd.ko 2023-06-09T04:26:54.588 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 50969 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/host/sl811-hcd.ko 2023-06-09T04:26:54.588 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 15489 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/host/sl811_cs.ko 2023-06-09T04:26:54.588 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 13137 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/host/ssb-hcd.ko 2023-06-09T04:26:54.588 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 25441 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/host/xhci-plat-hcd.ko 2023-06-09T04:26:54.589 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/image/ 2023-06-09T04:26:54.589 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 34417 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/image/mdc800.ko 2023-06-09T04:26:54.589 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 20905 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/image/microtek.ko 2023-06-09T04:26:54.589 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/ 2023-06-09T04:26:54.589 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 41665 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/adutux.ko 2023-06-09T04:26:54.589 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 20601 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/appledisplay.ko 2023-06-09T04:26:54.589 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 17609 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/cypress_cy7c63.ko 2023-06-09T04:26:54.589 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 22929 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/cytherm.ko 2023-06-09T04:26:54.590 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 13617 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/ehset.ko 2023-06-09T04:26:54.590 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 14945 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/emi26.ko 2023-06-09T04:26:54.590 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 15881 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/emi62.ko 2023-06-09T04:26:54.590 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 10929 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/ezusb.ko 2023-06-09T04:26:54.590 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 19113 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/idmouse.ko 2023-06-09T04:26:54.590 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 36441 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/iowarrior.ko 2023-06-09T04:26:54.590 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 11417 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/isight_firmware.ko 2023-06-09T04:26:54.590 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 36409 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/ldusb.ko 2023-06-09T04:26:54.591 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 36153 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/legousbtower.ko 2023-06-09T04:26:54.591 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 27673 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/lvstest.ko 2023-06-09T04:26:54.591 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/sisusbvga/ 2023-06-09T04:26:54.591 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 64665 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-06-09T04:26:54.591 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 12825 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/trancevibrator.ko 2023-06-09T04:26:54.591 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 20289 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/usb3503.ko 2023-06-09T04:26:54.591 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 25041 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/usblcd.ko 2023-06-09T04:26:54.591 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 22569 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/usbsevseg.ko 2023-06-09T04:26:54.592 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 70697 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/usbtest.ko 2023-06-09T04:26:54.592 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 41777 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/uss720.ko 2023-06-09T04:26:54.592 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 27513 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/yurex.ko 2023-06-09T04:26:54.592 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/mon/ 2023-06-09T04:26:54.592 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 72801 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/mon/usbmon.ko 2023-06-09T04:26:54.592 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/musb/ 2023-06-09T04:26:54.592 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 294937 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/musb/musb_hdrc.ko 2023-06-09T04:26:54.593 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/phy/ 2023-06-09T04:26:54.593 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 20281 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/phy/phy-generic.ko 2023-06-09T04:26:54.593 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 20001 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2023-06-09T04:26:54.593 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 11849 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/phy/phy-isp1301.ko 2023-06-09T04:26:54.593 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 21561 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/phy/phy-tahvo.ko 2023-06-09T04:26:54.593 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/ 2023-06-09T04:26:54.593 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 13137 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/aircable.ko 2023-06-09T04:26:54.593 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 33249 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/ark3116.ko 2023-06-09T04:26:54.594 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 26369 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/belkin_sa.ko 2023-06-09T04:26:54.594 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 38081 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/ch341.ko 2023-06-09T04:26:54.594 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 69985 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/cp210x.ko 2023-06-09T04:26:54.594 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 31057 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/cyberjack.ko 2023-06-09T04:26:54.594 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 57817 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/cypress_m8.ko 2023-06-09T04:26:54.594 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 49577 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/digi_acceleport.ko 2023-06-09T04:26:54.594 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 9441 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/empeg.ko 2023-06-09T04:26:54.594 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 43777 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/f81232.ko 2023-06-09T04:26:54.595 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 174729 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/ftdi_sio.ko 2023-06-09T04:26:54.595 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 52593 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/garmin_gps.ko 2023-06-09T04:26:54.595 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 136761 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/io_edgeport.ko 2023-06-09T04:26:54.595 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 124345 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/io_ti.ko 2023-06-09T04:26:54.595 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 67649 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/ipaq.ko 2023-06-09T04:26:54.595 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 18977 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/ipw.ko 2023-06-09T04:26:54.595 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 26489 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/ir-usb.ko 2023-06-09T04:26:54.595 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 57825 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-06-09T04:26:54.596 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 107305 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/keyspan.ko 2023-06-09T04:26:54.596 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 35153 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/keyspan_pda.ko 2023-06-09T04:26:54.596 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 25329 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/kl5kusb105.ko 2023-06-09T04:26:54.596 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 33345 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/kobil_sct.ko 2023-06-09T04:26:54.596 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 32873 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/mct_u232.ko 2023-06-09T04:26:54.596 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 21817 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/metro-usb.ko 2023-06-09T04:26:54.596 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 66121 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/mos7720.ko 2023-06-09T04:26:54.597 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 77993 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/mos7840.ko 2023-06-09T04:26:54.597 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 55889 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/mxuport.ko 2023-06-09T04:26:54.597 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 13657 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/navman.ko 2023-06-09T04:26:54.597 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 11441 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/omninet.ko 2023-06-09T04:26:54.597 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 24105 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/opticon.ko 2023-06-09T04:26:54.597 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 187713 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/option.ko 2023-06-09T04:26:54.597 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 38729 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/oti6858.ko 2023-06-09T04:26:54.597 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 53953 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/pl2303.ko 2023-06-09T04:26:54.598 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 9625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/qcaux.ko 2023-06-09T04:26:54.598 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 37713 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/qcserial.ko 2023-06-09T04:26:54.598 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 34313 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/quatech2.ko 2023-06-09T04:26:54.598 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 14633 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/safe_serial.ko 2023-06-09T04:26:54.598 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 51185 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/sierra.ko 2023-06-09T04:26:54.598 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 21561 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/spcp8x5.ko 2023-06-09T04:26:54.598 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 29737 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/ssu100.ko 2023-06-09T04:26:54.598 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 16737 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/symbolserial.ko 2023-06-09T04:26:54.599 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 60833 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-06-09T04:26:54.599 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 22625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-06-09T04:26:54.599 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 10137 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/usb_debug.ko 2023-06-09T04:26:54.599 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 31881 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/usb_wwan.ko 2023-06-09T04:26:54.599 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 122737 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/usbserial.ko 2023-06-09T04:26:54.599 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 28577 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/visor.ko 2023-06-09T04:26:54.599 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 37289 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/whiteheat.ko 2023-06-09T04:26:54.599 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 10353 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/wishbone-serial.ko 2023-06-09T04:26:54.600 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 9177 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/xsens_mt.ko 2023-06-09T04:26:54.600 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/storage/ 2023-06-09T04:26:54.600 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 52737 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/storage/uas.ko 2023-06-09T04:26:54.600 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 25977 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/storage/ums-alauda.ko 2023-06-09T04:26:54.600 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 12873 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/storage/ums-cypress.ko 2023-06-09T04:26:54.600 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 21881 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/storage/ums-datafab.ko 2023-06-09T04:26:54.600 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 33377 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-06-09T04:26:54.600 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 13633 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/storage/ums-freecom.ko 2023-06-09T04:26:54.601 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 19665 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/storage/ums-isd200.ko 2023-06-09T04:26:54.601 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 19193 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-06-09T04:26:54.601 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 13537 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/storage/ums-karma.ko 2023-06-09T04:26:54.601 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 17729 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/storage/ums-onetouch.ko 2023-06-09T04:26:54.601 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 28321 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/storage/ums-realtek.ko 2023-06-09T04:26:54.601 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 28793 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/storage/ums-sddr09.ko 2023-06-09T04:26:54.601 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 19417 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/storage/ums-sddr55.ko 2023-06-09T04:26:54.602 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 35233 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/storage/ums-usbat.ko 2023-06-09T04:26:54.602 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 176713 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/storage/usb-storage.ko 2023-06-09T04:26:54.602 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/usbip/ 2023-06-09T04:26:54.602 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 65585 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/usbip/usbip-core.ko 2023-06-09T04:26:54.602 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 71329 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/usbip/usbip-host.ko 2023-06-09T04:26:54.602 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 105225 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-06-09T04:26:54.602 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/vfio/ 2023-06-09T04:26:54.602 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/vfio/pci/ 2023-06-09T04:26:54.603 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 145697 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-06-09T04:26:54.603 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 29425 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/vfio/pci/vfio-pci.ko 2023-06-09T04:26:54.603 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 97857 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/vfio/vfio.ko 2023-06-09T04:26:54.603 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 72113 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-06-09T04:26:54.603 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/vhost/ 2023-06-09T04:26:54.603 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 96865 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/vhost/vhost.ko 2023-06-09T04:26:54.603 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 15689 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/vhost/vhost_iotlb.ko 2023-06-09T04:26:54.603 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 57985 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/vhost/vhost_net.ko 2023-06-09T04:26:54.604 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 85697 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/vhost/vhost_scsi.ko 2023-06-09T04:26:54.604 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/video/ 2023-06-09T04:26:54.604 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/video/backlight/ 2023-06-09T04:26:54.604 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 15297 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/video/backlight/88pm860x_bl.ko 2023-06-09T04:26:54.604 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 12273 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/video/backlight/aat2870_bl.ko 2023-06-09T04:26:54.604 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 23201 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/video/backlight/adp5520_bl.ko 2023-06-09T04:26:54.604 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 32433 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/video/backlight/adp8860_bl.ko 2023-06-09T04:26:54.604 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 39873 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/video/backlight/adp8870_bl.ko 2023-06-09T04:26:54.605 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 16809 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/video/backlight/apple_bl.ko 2023-06-09T04:26:54.605 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 16601 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/video/backlight/as3711_bl.ko 2023-06-09T04:26:54.605 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 11913 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/video/backlight/bd6107.ko 2023-06-09T04:26:54.605 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 11297 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/video/backlight/da903x_bl.ko 2023-06-09T04:26:54.605 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 11105 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/video/backlight/da9052_bl.ko 2023-06-09T04:26:54.605 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 11769 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/video/backlight/gpio_backlight.ko 2023-06-09T04:26:54.605 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 14657 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/video/backlight/kb3886_bl.ko 2023-06-09T04:26:54.606 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 21281 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/video/backlight/lcd.ko 2023-06-09T04:26:54.606 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 23473 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/video/backlight/lm3533_bl.ko 2023-06-09T04:26:54.606 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 19225 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/video/backlight/lm3639_bl.ko 2023-06-09T04:26:54.606 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 11313 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/video/backlight/lv5207lp.ko 2023-06-09T04:26:54.606 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 14233 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/video/backlight/max8925_bl.ko 2023-06-09T04:26:54.606 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 11137 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/video/backlight/pandora_bl.ko 2023-06-09T04:26:54.606 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 10745 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/video/backlight/pcf50633-backlight.ko 2023-06-09T04:26:54.606 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 10793 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/video/backlight/platform_lcd.ko 2023-06-09T04:26:54.607 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 12609 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/video/backlight/wm831x_bl.ko 2023-06-09T04:26:54.607 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/w1/ 2023-06-09T04:26:54.607 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/w1/masters/ 2023-06-09T04:26:54.607 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 18673 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/w1/masters/ds2482.ko 2023-06-09T04:26:54.607 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 38857 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/w1/masters/ds2490.ko 2023-06-09T04:26:54.607 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 11153 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/w1/masters/matrox_w1.ko 2023-06-09T04:26:54.607 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 12241 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/w1/masters/w1-gpio.ko 2023-06-09T04:26:54.607 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/w1/slaves/ 2023-06-09T04:26:54.608 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 11929 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-06-09T04:26:54.608 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 22625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-06-09T04:26:54.608 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 14929 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-06-09T04:26:54.608 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 10649 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-06-09T04:26:54.608 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 14033 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-06-09T04:26:54.608 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 11817 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-06-09T04:26:54.608 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 13625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-06-09T04:26:54.608 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 13625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-06-09T04:26:54.609 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 17801 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-06-09T04:26:54.609 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 7209 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/w1/slaves/w1_smem.ko 2023-06-09T04:26:54.609 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 56313 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/w1/slaves/w1_therm.ko 2023-06-09T04:26:54.609 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 101401 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/w1/wire.ko 2023-06-09T04:26:54.609 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/ 2023-06-09T04:26:54.609 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 18689 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/acquirewdt.ko 2023-06-09T04:26:54.609 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 19809 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/advantechwdt.ko 2023-06-09T04:26:54.609 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 18449 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/alim1535_wdt.ko 2023-06-09T04:26:54.610 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 22857 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/alim7101_wdt.ko 2023-06-09T04:26:54.610 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 18993 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/cpu5wdt.ko 2023-06-09T04:26:54.610 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 13441 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/da9052_wdt.ko 2023-06-09T04:26:54.610 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 12665 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/da9055_wdt.ko 2023-06-09T04:26:54.610 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 17289 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/da9063_wdt.ko 2023-06-09T04:26:54.611 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 19993 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/dw_wdt.ko 2023-06-09T04:26:54.611 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 20153 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/eurotechwdt.ko 2023-06-09T04:26:54.611 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 23689 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/f71808e_wdt.ko 2023-06-09T04:26:54.611 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 27289 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/hpwdt.ko 2023-06-09T04:26:54.611 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 15393 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/i6300esb.ko 2023-06-09T04:26:54.611 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 10097 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-06-09T04:26:54.611 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 21801 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/iTCO_wdt.ko 2023-06-09T04:26:54.611 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 19137 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/ib700wdt.ko 2023-06-09T04:26:54.612 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 18569 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/ibmasr.ko 2023-06-09T04:26:54.612 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 19601 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-06-09T04:26:54.612 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 21041 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/it8712f_wdt.ko 2023-06-09T04:26:54.612 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 13729 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/it87_wdt.ko 2023-06-09T04:26:54.612 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 21313 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/kempld_wdt.ko 2023-06-09T04:26:54.612 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 18505 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/machzwd.ko 2023-06-09T04:26:54.612 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 14601 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/mena21_wdt.ko 2023-06-09T04:26:54.612 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 13097 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/menf21bmc_wdt.ko 2023-06-09T04:26:54.613 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 24497 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/nv_tco.ko 2023-06-09T04:26:54.613 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 17617 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/of_xilinx_wdt.ko 2023-06-09T04:26:54.613 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 22161 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/pc87413_wdt.ko 2023-06-09T04:26:54.613 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 38489 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/pcwd_pci.ko 2023-06-09T04:26:54.613 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 31705 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/pcwd_usb.ko 2023-06-09T04:26:54.613 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 12953 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/retu_wdt.ko 2023-06-09T04:26:54.613 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 20345 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/sbc60xxwdt.ko 2023-06-09T04:26:54.613 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 13953 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/sbc_epx_c3.ko 2023-06-09T04:26:54.614 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 17145 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-06-09T04:26:54.614 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 23641 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/sc1200wdt.ko 2023-06-09T04:26:54.614 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 23209 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/sch311x_wdt.ko 2023-06-09T04:26:54.614 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 21457 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/smsc37b787_wdt.ko 2023-06-09T04:26:54.614 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 17097 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/softdog.ko 2023-06-09T04:26:54.614 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 21921 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/sp5100_tco.ko 2023-06-09T04:26:54.614 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 12641 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/twl4030_wdt.ko 2023-06-09T04:26:54.614 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 17465 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/via_wdt.ko 2023-06-09T04:26:54.615 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 18985 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-06-09T04:26:54.615 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 20569 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/w83877f_wdt.ko 2023-06-09T04:26:54.615 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 25233 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/w83977f_wdt.ko 2023-06-09T04:26:54.615 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 18329 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/wafer5823wdt.ko 2023-06-09T04:26:54.615 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 27905 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/wdt_pci.ko 2023-06-09T04:26:54.615 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 16073 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/wm831x_wdt.ko 2023-06-09T04:26:54.615 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 13673 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/wm8350_wdt.ko 2023-06-09T04:26:54.616 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 15521 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/xen_wdt.ko 2023-06-09T04:26:54.616 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/xen/ 2023-06-09T04:26:54.616 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 24377 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/xen/xen-evtchn.ko 2023-06-09T04:26:54.616 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 26569 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/xen/xen-gntalloc.ko 2023-06-09T04:26:54.616 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 47737 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/xen/xen-gntdev.ko 2023-06-09T04:26:54.616 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/xen/xen-pciback/ 2023-06-09T04:26:54.616 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 176241 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-06-09T04:26:54.616 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 39617 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/xen/xen-privcmd.ko 2023-06-09T04:26:54.617 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 71137 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/xen/xen-scsiback.ko 2023-06-09T04:26:54.617 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/xen/xenfs/ 2023-06-09T04:26:54.617 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 19313 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/xen/xenfs/xenfs.ko 2023-06-09T04:26:54.617 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/ 2023-06-09T04:26:54.617 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/9p/ 2023-06-09T04:26:54.617 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 165401 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/9p/9p.ko 2023-06-09T04:26:54.617 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/adfs/ 2023-06-09T04:26:54.617 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 60769 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/adfs/adfs.ko 2023-06-09T04:26:54.618 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/affs/ 2023-06-09T04:26:54.618 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 162449 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/affs/affs.ko 2023-06-09T04:26:54.618 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/afs/ 2023-06-09T04:26:54.618 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 924617 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/afs/kafs.ko 2023-06-09T04:26:54.618 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/autofs/ 2023-06-09T04:26:54.618 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 100641 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/autofs/autofs4.ko 2023-06-09T04:26:54.618 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/befs/ 2023-06-09T04:26:54.618 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 64297 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/befs/befs.ko 2023-06-09T04:26:54.619 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/bfs/ 2023-06-09T04:26:54.619 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 40905 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/bfs/bfs.ko 2023-06-09T04:26:54.619 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 34401 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/binfmt_misc.ko 2023-06-09T04:26:54.619 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/btrfs/ 2023-06-09T04:26:54.619 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 3445465 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/btrfs/btrfs.ko 2023-06-09T04:26:54.619 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/cachefiles/ 2023-06-09T04:26:54.619 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 299849 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/cachefiles/cachefiles.ko 2023-06-09T04:26:54.619 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/ceph/ 2023-06-09T04:26:54.620 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 1230257 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/ceph/ceph.ko 2023-06-09T04:26:54.620 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/cifs/ 2023-06-09T04:26:54.620 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 2619753 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/cifs/cifs.ko 2023-06-09T04:26:54.620 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/coda/ 2023-06-09T04:26:54.620 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 99217 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/coda/coda.ko 2023-06-09T04:26:54.620 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/configfs/ 2023-06-09T04:26:54.620 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 105857 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/configfs/configfs.ko 2023-06-09T04:26:54.621 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/cramfs/ 2023-06-09T04:26:54.621 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 29161 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/cramfs/cramfs.ko 2023-06-09T04:26:54.621 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/dlm/ 2023-06-09T04:26:54.621 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 631321 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/dlm/dlm.ko 2023-06-09T04:26:54.621 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/efs/ 2023-06-09T04:26:54.621 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 36465 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/efs/efs.ko 2023-06-09T04:26:54.621 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/f2fs/ 2023-06-09T04:26:54.621 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 1472873 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/f2fs/f2fs.ko 2023-06-09T04:26:54.622 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/fat/ 2023-06-09T04:26:54.622 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 27681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/fat/msdos.ko 2023-06-09T04:26:54.622 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/freevxfs/ 2023-06-09T04:26:54.622 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 42281 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/freevxfs/freevxfs.ko 2023-06-09T04:26:54.622 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/fscache/ 2023-06-09T04:26:54.622 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 218609 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/fscache/fscache.ko 2023-06-09T04:26:54.622 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/fuse/ 2023-06-09T04:26:54.622 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 24401 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/fuse/cuse.ko 2023-06-09T04:26:54.623 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/gfs2/ 2023-06-09T04:26:54.623 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 1221153 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/gfs2/gfs2.ko 2023-06-09T04:26:54.623 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/hfs/ 2023-06-09T04:26:54.623 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 141129 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/hfs/hfs.ko 2023-06-09T04:26:54.623 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/hfsplus/ 2023-06-09T04:26:54.623 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 221441 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/hfsplus/hfsplus.ko 2023-06-09T04:26:54.623 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/hpfs/ 2023-06-09T04:26:54.623 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 193465 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/hpfs/hpfs.ko 2023-06-09T04:26:54.624 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/isofs/ 2023-06-09T04:26:54.624 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 74281 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/isofs/isofs.ko 2023-06-09T04:26:54.624 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/jfs/ 2023-06-09T04:26:54.624 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 420305 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/jfs/jfs.ko 2023-06-09T04:26:54.624 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/lockd/ 2023-06-09T04:26:54.624 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 276841 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/lockd/lockd.ko 2023-06-09T04:26:54.624 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/minix/ 2023-06-09T04:26:54.625 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 87801 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/minix/minix.ko 2023-06-09T04:26:54.625 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/netfs/ 2023-06-09T04:26:54.625 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 128553 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/netfs/netfs.ko 2023-06-09T04:26:54.625 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nfs/ 2023-06-09T04:26:54.625 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nfs/blocklayout/ 2023-06-09T04:26:54.625 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 81433 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-06-09T04:26:54.625 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nfs/filelayout/ 2023-06-09T04:26:54.625 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 59249 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-06-09T04:26:54.626 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nfs/flexfilelayout/ 2023-06-09T04:26:54.626 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 117529 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-06-09T04:26:54.626 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 1002305 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nfs/nfs.ko 2023-06-09T04:26:54.626 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 65985 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nfs/nfsv2.ko 2023-06-09T04:26:54.626 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 119177 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nfs/nfsv3.ko 2023-06-09T04:26:54.626 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 2003321 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nfs/nfsv4.ko 2023-06-09T04:26:54.627 INFO:teuthology.orchestra.run.smithi090.stderr:done 2023-06-09T04:26:54.652 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nfs_common/ 2023-06-09T04:26:54.652 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 16225 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nfs_common/grace.ko 2023-06-09T04:26:54.652 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 15497 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nfs_common/nfs_acl.ko 2023-06-09T04:26:54.652 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nfsd/ 2023-06-09T04:26:54.652 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 1407361 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nfsd/nfsd.ko 2023-06-09T04:26:54.652 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nilfs2/ 2023-06-09T04:26:54.653 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 587585 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nilfs2/nilfs2.ko 2023-06-09T04:26:54.653 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/ 2023-06-09T04:26:54.653 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 13617 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/mac-celtic.ko 2023-06-09T04:26:54.653 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 13001 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/mac-centeuro.ko 2023-06-09T04:26:54.653 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 13625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/mac-croatian.ko 2023-06-09T04:26:54.653 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 12689 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/mac-cyrillic.ko 2023-06-09T04:26:54.653 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 13305 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/mac-gaelic.ko 2023-06-09T04:26:54.653 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 12681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/mac-greek.ko 2023-06-09T04:26:54.654 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 13617 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/mac-iceland.ko 2023-06-09T04:26:54.654 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 12993 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/mac-inuit.ko 2023-06-09T04:26:54.654 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 13929 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/mac-roman.ko 2023-06-09T04:26:54.654 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 13625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/mac-romanian.ko 2023-06-09T04:26:54.654 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 13617 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/mac-turkish.ko 2023-06-09T04:26:54.654 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 11121 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_ascii.ko 2023-06-09T04:26:54.654 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 12369 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp1250.ko 2023-06-09T04:26:54.654 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 12057 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp1251.ko 2023-06-09T04:26:54.655 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 12809 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp1255.ko 2023-06-09T04:26:54.655 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 12369 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp737.ko 2023-06-09T04:26:54.655 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 12369 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp775.ko 2023-06-09T04:26:54.655 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 12057 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp850.ko 2023-06-09T04:26:54.655 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 12057 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp852.ko 2023-06-09T04:26:54.655 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 12057 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp855.ko 2023-06-09T04:26:54.655 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 11745 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp857.ko 2023-06-09T04:26:54.655 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 12681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp860.ko 2023-06-09T04:26:54.656 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 12985 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp861.ko 2023-06-09T04:26:54.656 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 13297 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp862.ko 2023-06-09T04:26:54.656 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 12985 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp863.ko 2023-06-09T04:26:54.656 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 12681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp864.ko 2023-06-09T04:26:54.656 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 12985 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp865.ko 2023-06-09T04:26:54.656 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 12369 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp866.ko 2023-06-09T04:26:54.656 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 12057 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp869.ko 2023-06-09T04:26:54.657 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 11881 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp874.ko 2023-06-09T04:26:54.657 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 93969 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp932.ko 2023-06-09T04:26:54.657 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 142505 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp936.ko 2023-06-09T04:26:54.657 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 165641 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp949.ko 2023-06-09T04:26:54.657 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 117945 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp950.ko 2023-06-09T04:26:54.657 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 12289 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_euc-jp.ko 2023-06-09T04:26:54.657 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 11129 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_iso8859-1.ko 2023-06-09T04:26:54.657 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 11753 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_iso8859-13.ko 2023-06-09T04:26:54.658 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 11753 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_iso8859-14.ko 2023-06-09T04:26:54.658 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 11753 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_iso8859-15.ko 2023-06-09T04:26:54.658 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 11753 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_iso8859-2.ko 2023-06-09T04:26:54.658 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 11753 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_iso8859-3.ko 2023-06-09T04:26:54.658 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 11753 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_iso8859-4.ko 2023-06-09T04:26:54.658 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 11753 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_iso8859-5.ko 2023-06-09T04:26:54.658 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 11441 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_iso8859-6.ko 2023-06-09T04:26:54.658 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 12065 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_iso8859-7.ko 2023-06-09T04:26:54.659 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 11441 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_iso8859-9.ko 2023-06-09T04:26:54.659 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 12369 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_koi8-r.ko 2023-06-09T04:26:54.659 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 7913 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_koi8-ru.ko 2023-06-09T04:26:54.659 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 12369 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_koi8-u.ko 2023-06-09T04:26:54.659 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 8169 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_utf8.ko 2023-06-09T04:26:54.659 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/ntfs/ 2023-06-09T04:26:54.659 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 218905 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/ntfs/ntfs.ko 2023-06-09T04:26:54.659 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/ocfs2/ 2023-06-09T04:26:54.660 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/ocfs2/cluster/ 2023-06-09T04:26:54.660 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 241057 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-06-09T04:26:54.660 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/ocfs2/dlm/ 2023-06-09T04:26:54.660 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 439521 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-06-09T04:26:54.660 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/ocfs2/dlmfs/ 2023-06-09T04:26:54.660 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 53697 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-06-09T04:26:54.660 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 2511193 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/ocfs2/ocfs2.ko 2023-06-09T04:26:54.661 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 17793 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-06-09T04:26:54.661 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 31473 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-06-09T04:26:54.661 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 33897 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-06-09T04:26:54.661 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/omfs/ 2023-06-09T04:26:54.661 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 52465 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/omfs/omfs.ko 2023-06-09T04:26:54.661 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/overlayfs/ 2023-06-09T04:26:54.661 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 320569 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/overlayfs/overlay.ko 2023-06-09T04:26:54.661 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/pstore/ 2023-06-09T04:26:54.662 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 54441 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/pstore/ramoops.ko 2023-06-09T04:26:54.662 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/qnx4/ 2023-06-09T04:26:54.662 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 26681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/qnx4/qnx4.ko 2023-06-09T04:26:54.662 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/qnx6/ 2023-06-09T04:26:54.662 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 46537 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/qnx6/qnx6.ko 2023-06-09T04:26:54.662 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/quota/ 2023-06-09T04:26:54.662 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 29993 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/quota/quota_tree.ko 2023-06-09T04:26:54.663 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 14177 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/quota/quota_v1.ko 2023-06-09T04:26:54.663 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 21841 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/quota/quota_v2.ko 2023-06-09T04:26:54.663 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/reiserfs/ 2023-06-09T04:26:54.663 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 530593 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/reiserfs/reiserfs.ko 2023-06-09T04:26:54.663 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/romfs/ 2023-06-09T04:26:54.663 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 28393 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/romfs/romfs.ko 2023-06-09T04:26:54.663 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/smbfs_common/ 2023-06-09T04:26:54.663 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 6681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/smbfs_common/cifs_arc4.ko 2023-06-09T04:26:54.664 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 10697 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/smbfs_common/cifs_md4.ko 2023-06-09T04:26:54.664 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/squashfs/ 2023-06-09T04:26:54.664 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 131513 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/squashfs/squashfs.ko 2023-06-09T04:26:54.664 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/sysv/ 2023-06-09T04:26:54.664 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 89537 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/sysv/sysv.ko 2023-06-09T04:26:54.664 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/udf/ 2023-06-09T04:26:54.664 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 248145 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/udf/udf.ko 2023-06-09T04:26:54.664 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/ufs/ 2023-06-09T04:26:54.665 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 160753 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/ufs/ufs.ko 2023-06-09T04:26:54.665 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/xfs/ 2023-06-09T04:26:54.665 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 3854681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/xfs/xfs.ko 2023-06-09T04:26:54.665 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/kernel/ 2023-06-09T04:26:54.665 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/kernel/locking/ 2023-06-09T04:26:54.665 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 73081 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/kernel/locking/locktorture.ko 2023-06-09T04:26:54.665 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/kernel/time/ 2023-06-09T04:26:54.665 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 13569 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/kernel/time/test_udelay.ko 2023-06-09T04:26:54.666 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 55329 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/kernel/torture.ko 2023-06-09T04:26:54.666 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/ 2023-06-09T04:26:54.666 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 6353 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/crc-itu-t.ko 2023-06-09T04:26:54.666 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 6049 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/crc7.ko 2023-06-09T04:26:54.666 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 6401 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/crc8.ko 2023-06-09T04:26:54.666 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/crypto/ 2023-06-09T04:26:54.666 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 6625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/crypto/libarc4.ko 2023-06-09T04:26:54.666 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 36217 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/crypto/libdes.ko 2023-06-09T04:26:54.667 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 13209 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/interval_tree_test.ko 2023-06-09T04:26:54.667 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 8025 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/libcrc32c.ko 2023-06-09T04:26:54.667 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 23273 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/lru_cache.ko 2023-06-09T04:26:54.667 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/lz4/ 2023-06-09T04:26:54.667 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 32913 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/lz4/lz4_compress.ko 2023-06-09T04:26:54.667 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 21913 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/lz4/lz4hc_compress.ko 2023-06-09T04:26:54.667 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/math/ 2023-06-09T04:26:54.667 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 6217 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/math/cordic.ko 2023-06-09T04:26:54.668 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 8113 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/memory-notifier-error-inject.ko 2023-06-09T04:26:54.668 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 10425 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/notifier-error-inject.ko 2023-06-09T04:26:54.668 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 13913 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/percpu_test.ko 2023-06-09T04:26:54.668 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 8185 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/pm-notifier-error-inject.ko 2023-06-09T04:26:54.668 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/raid6/ 2023-06-09T04:26:54.668 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 142193 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/raid6/raid6_pq.ko 2023-06-09T04:26:54.668 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 20993 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/rbtree_test.ko 2023-06-09T04:26:54.669 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/reed_solomon/ 2023-06-09T04:26:54.669 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 17961 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/reed_solomon/reed_solomon.ko 2023-06-09T04:26:54.669 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 38721 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/test-kstrtox.ko 2023-06-09T04:26:54.669 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 26209 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/test-string_helpers.ko 2023-06-09T04:26:54.669 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 4760649 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/test_bpf.ko 2023-06-09T04:26:54.669 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 48377 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/test_firmware.ko 2023-06-09T04:26:54.669 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 6193 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/test_module.ko 2023-06-09T04:26:54.669 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 20689 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/test_user_copy.ko 2023-06-09T04:26:54.670 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 9481 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/ts_bm.ko 2023-06-09T04:26:54.670 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 10945 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/ts_fsm.ko 2023-06-09T04:26:54.670 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 9521 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/ts_kmp.ko 2023-06-09T04:26:54.670 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/xz/ 2023-06-09T04:26:54.670 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 13425 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/xz/xz_dec_test.ko 2023-06-09T04:26:54.670 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/mm/ 2023-06-09T04:26:54.670 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 15321 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/mm/hwpoison-inject.ko 2023-06-09T04:26:54.670 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ 2023-06-09T04:26:54.671 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/6lowpan/ 2023-06-09T04:26:54.671 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 54657 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/6lowpan/6lowpan.ko 2023-06-09T04:26:54.671 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 6873 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/6lowpan/nhc_dest.ko 2023-06-09T04:26:54.671 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 6897 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/6lowpan/nhc_fragment.ko 2023-06-09T04:26:54.671 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 6873 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/6lowpan/nhc_hop.ko 2023-06-09T04:26:54.671 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 6873 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/6lowpan/nhc_ipv6.ko 2023-06-09T04:26:54.671 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 6897 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/6lowpan/nhc_mobility.ko 2023-06-09T04:26:54.671 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 6897 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/6lowpan/nhc_routing.ko 2023-06-09T04:26:54.672 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 15153 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/6lowpan/nhc_udp.ko 2023-06-09T04:26:54.672 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/802/ 2023-06-09T04:26:54.672 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 29545 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/802/garp.ko 2023-06-09T04:26:54.672 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 33977 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/802/mrp.ko 2023-06-09T04:26:54.672 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 8049 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/802/p8022.ko 2023-06-09T04:26:54.672 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 15345 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/802/psnap.ko 2023-06-09T04:26:54.672 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 11041 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/802/stp.ko 2023-06-09T04:26:54.673 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/8021q/ 2023-06-09T04:26:54.673 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 80913 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/8021q/8021q.ko 2023-06-09T04:26:54.673 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/9p/ 2023-06-09T04:26:54.673 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 191689 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/9p/9pnet.ko 2023-06-09T04:26:54.673 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 35777 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/9p/9pnet_fd.ko 2023-06-09T04:26:54.673 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 26225 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/9p/9pnet_rdma.ko 2023-06-09T04:26:54.673 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 32145 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/9p/9pnet_virtio.ko 2023-06-09T04:26:54.673 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/batman-adv/ 2023-06-09T04:26:54.674 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 652649 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/batman-adv/batman-adv.ko 2023-06-09T04:26:54.674 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/ 2023-06-09T04:26:54.674 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 63713 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/br_netfilter.ko 2023-06-09T04:26:54.674 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 769721 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/bridge.ko 2023-06-09T04:26:54.674 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ 2023-06-09T04:26:54.674 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 7553 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-06-09T04:26:54.674 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 12217 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebt_among.ko 2023-06-09T04:26:54.675 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 8993 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebt_arp.ko 2023-06-09T04:26:54.675 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 8969 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-06-09T04:26:54.675 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 9513 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-06-09T04:26:54.675 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 8569 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebt_ip.ko 2023-06-09T04:26:54.675 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 8969 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-06-09T04:26:54.675 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 9721 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebt_limit.ko 2023-06-09T04:26:54.675 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 13113 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebt_log.ko 2023-06-09T04:26:54.675 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 7473 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebt_mark.ko 2023-06-09T04:26:54.676 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 7425 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-06-09T04:26:54.676 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 8281 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-06-09T04:26:54.676 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 7433 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-06-09T04:26:54.676 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 9409 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-06-09T04:26:54.676 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 8545 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebt_snat.ko 2023-06-09T04:26:54.676 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 8713 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebt_stp.ko 2023-06-09T04:26:54.676 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 12281 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-06-09T04:26:54.676 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 11345 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-06-09T04:26:54.677 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 9713 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-06-09T04:26:54.677 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 9689 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-06-09T04:26:54.677 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 54969 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebtables.ko 2023-06-09T04:26:54.677 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 13921 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-06-09T04:26:54.677 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 13769 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-06-09T04:26:54.677 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ceph/ 2023-06-09T04:26:54.677 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 1030089 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ceph/libceph.ko 2023-06-09T04:26:54.677 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/core/ 2023-06-09T04:26:54.678 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 124617 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/core/pktgen.ko 2023-06-09T04:26:54.678 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/dccp/ 2023-06-09T04:26:54.678 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 189137 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/dccp/dccp.ko 2023-06-09T04:26:54.678 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 8545 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/dccp/dccp_diag.ko 2023-06-09T04:26:54.678 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 56089 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/dccp/dccp_ipv4.ko 2023-06-09T04:26:54.678 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 59529 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/dccp/dccp_ipv6.ko 2023-06-09T04:26:54.678 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/dsa/ 2023-06-09T04:26:54.678 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 380185 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/dsa/dsa_core.ko 2023-06-09T04:26:54.679 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 13161 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/dsa/tag_brcm.ko 2023-06-09T04:26:54.679 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 12465 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/dsa/tag_dsa.ko 2023-06-09T04:26:54.679 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 7609 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/dsa/tag_none.ko 2023-06-09T04:26:54.679 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 8785 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/dsa/tag_trailer.ko 2023-06-09T04:26:54.679 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/hsr/ 2023-06-09T04:26:54.679 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 99713 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/hsr/hsr.ko 2023-06-09T04:26:54.679 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ieee802154/ 2023-06-09T04:26:54.679 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ieee802154/6lowpan/ 2023-06-09T04:26:54.680 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 45065 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-06-09T04:26:54.680 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 245745 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ieee802154/ieee802154.ko 2023-06-09T04:26:54.680 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 47393 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ieee802154/ieee802154_socket.ko 2023-06-09T04:26:54.680 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/ 2023-06-09T04:26:54.680 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 24617 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/ah4.ko 2023-06-09T04:26:54.680 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 38297 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/esp4.ko 2023-06-09T04:26:54.680 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 47633 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/fou.ko 2023-06-09T04:26:54.681 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 17673 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/gre.ko 2023-06-09T04:26:54.681 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 47305 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/inet_diag.ko 2023-06-09T04:26:54.681 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 60121 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/ip_gre.ko 2023-06-09T04:26:54.681 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 58801 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/ip_tunnel.ko 2023-06-09T04:26:54.681 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 34257 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/ip_vti.ko 2023-06-09T04:26:54.681 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 13897 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/ipcomp.ko 2023-06-09T04:26:54.681 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 28785 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/ipip.ko 2023-06-09T04:26:54.681 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/ 2023-06-09T04:26:54.682 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 36929 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/arp_tables.ko 2023-06-09T04:26:54.682 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 8705 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-06-09T04:26:54.682 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 10233 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-06-09T04:26:54.682 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 40785 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/ip_tables.ko 2023-06-09T04:26:54.682 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 9881 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-06-09T04:26:54.682 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 9505 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2023-06-09T04:26:54.682 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 13969 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-06-09T04:26:54.682 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 11001 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-06-09T04:26:54.683 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 14825 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-06-09T04:26:54.683 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 11137 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/iptable_filter.ko 2023-06-09T04:26:54.683 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 11537 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-06-09T04:26:54.683 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 14825 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-06-09T04:26:54.683 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 11425 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-06-09T04:26:54.683 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 10305 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/iptable_security.ko 2023-06-09T04:26:54.683 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 11601 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-06-09T04:26:54.683 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 8417 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-06-09T04:26:54.684 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 27513 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-06-09T04:26:54.684 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 18049 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-06-09T04:26:54.684 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 13233 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-06-09T04:26:54.684 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 19577 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2023-06-09T04:26:54.684 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 8985 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-06-09T04:26:54.684 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 14641 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-06-09T04:26:54.684 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 9785 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-06-09T04:26:54.685 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 16673 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-06-09T04:26:54.685 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 8889 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-06-09T04:26:54.685 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 12961 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/tcp_bic.ko 2023-06-09T04:26:54.685 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 13625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/tcp_dctcp.ko 2023-06-09T04:26:54.685 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 15009 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/tcp_diag.ko 2023-06-09T04:26:54.685 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 9425 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/tcp_highspeed.ko 2023-06-09T04:26:54.685 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 12281 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/tcp_htcp.ko 2023-06-09T04:26:54.685 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 10273 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/tcp_hybla.ko 2023-06-09T04:26:54.686 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 11297 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/tcp_illinois.ko 2023-06-09T04:26:54.686 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 10313 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/tcp_lp.ko 2023-06-09T04:26:54.686 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 8225 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/tcp_scalable.ko 2023-06-09T04:26:54.686 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 13625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/tcp_vegas.ko 2023-06-09T04:26:54.686 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 9985 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/tcp_veno.ko 2023-06-09T04:26:54.686 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 10849 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/tcp_westwood.ko 2023-06-09T04:26:54.686 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 10073 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/tcp_yeah.ko 2023-06-09T04:26:54.686 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 22105 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/tunnel4.ko 2023-06-09T04:26:54.687 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 16241 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/udp_diag.ko 2023-06-09T04:26:54.687 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 40337 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/udp_tunnel.ko 2023-06-09T04:26:54.687 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 11249 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/xfrm4_tunnel.ko 2023-06-09T04:26:54.687 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/ 2023-06-09T04:26:54.687 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 26265 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/ah6.ko 2023-06-09T04:26:54.687 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 39033 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/esp6.ko 2023-06-09T04:26:54.687 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 14313 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/fou6.ko 2023-06-09T04:26:54.687 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 80681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/ip6_gre.ko 2023-06-09T04:26:54.688 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 91377 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/ip6_tunnel.ko 2023-06-09T04:26:54.688 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 10121 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-06-09T04:26:54.688 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 53889 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/ip6_vti.ko 2023-06-09T04:26:54.688 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 13681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/ipcomp6.ko 2023-06-09T04:26:54.688 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 18913 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/mip6.ko 2023-06-09T04:26:54.688 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/ 2023-06-09T04:26:54.688 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 41449 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-06-09T04:26:54.688 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 11649 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2023-06-09T04:26:54.689 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 9577 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-06-09T04:26:54.689 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 14041 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-06-09T04:26:54.689 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 14153 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-06-09T04:26:54.689 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 7689 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-06-09T04:26:54.689 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 16097 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-06-09T04:26:54.689 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 15857 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-06-09T04:26:54.689 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 8801 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-06-09T04:26:54.690 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 9713 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-06-09T04:26:54.690 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 10761 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-06-09T04:26:54.690 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 10721 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-06-09T04:26:54.690 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 11145 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-06-09T04:26:54.690 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 10953 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-06-09T04:26:54.690 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 14857 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-06-09T04:26:54.690 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 11441 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-06-09T04:26:54.690 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 10321 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-06-09T04:26:54.691 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 38249 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-06-09T04:26:54.691 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 8049 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-06-09T04:26:54.691 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 25065 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-06-09T04:26:54.691 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 9457 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-06-09T04:26:54.691 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 14857 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-06-09T04:26:54.691 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 9521 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-06-09T04:26:54.691 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 15537 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-06-09T04:26:54.691 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 8897 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-06-09T04:26:54.692 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 73041 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/sit.ko 2023-06-09T04:26:54.692 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 23697 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/tunnel6.ko 2023-06-09T04:26:54.692 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 22801 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/xfrm6_tunnel.ko 2023-06-09T04:26:54.692 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/key/ 2023-06-09T04:26:54.692 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 82825 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/key/af_key.ko 2023-06-09T04:26:54.692 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/l2tp/ 2023-06-09T04:26:54.692 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 120649 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/l2tp/l2tp_core.ko 2023-06-09T04:26:54.692 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 20161 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/l2tp/l2tp_debugfs.ko 2023-06-09T04:26:54.693 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 25681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/l2tp/l2tp_eth.ko 2023-06-09T04:26:54.693 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 35065 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/l2tp/l2tp_ip.ko 2023-06-09T04:26:54.693 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 36769 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/l2tp/l2tp_ip6.ko 2023-06-09T04:26:54.693 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 32505 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/l2tp/l2tp_netlink.ko 2023-06-09T04:26:54.693 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 53033 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/l2tp/l2tp_ppp.ko 2023-06-09T04:26:54.693 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/lapb/ 2023-06-09T04:26:54.693 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 46961 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/lapb/lapb.ko 2023-06-09T04:26:54.693 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/llc/ 2023-06-09T04:26:54.694 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 22169 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/llc/llc.ko 2023-06-09T04:26:54.694 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 267033 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/llc/llc2.ko 2023-06-09T04:26:54.694 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/mac802154/ 2023-06-09T04:26:54.694 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 280225 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/mac802154/mac802154.ko 2023-06-09T04:26:54.694 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/mpls/ 2023-06-09T04:26:54.694 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 9217 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/mpls/mpls_gso.ko 2023-06-09T04:26:54.694 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ 2023-06-09T04:26:54.694 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipset/ 2023-06-09T04:26:54.695 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 116897 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipset/ip_set.ko 2023-06-09T04:26:54.695 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 28337 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-06-09T04:26:54.695 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 26913 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-06-09T04:26:54.695 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 26345 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-06-09T04:26:54.695 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 101857 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-06-09T04:26:54.695 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 103001 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-06-09T04:26:54.695 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 104417 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-06-09T04:26:54.696 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 105017 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-06-09T04:26:54.696 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 114273 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-06-09T04:26:54.696 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 60985 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-06-09T04:26:54.696 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 111041 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-06-09T04:26:54.696 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 114561 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-06-09T04:26:54.696 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 114209 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-06-09T04:26:54.696 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 113033 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-06-09T04:26:54.696 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 116097 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-06-09T04:26:54.697 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 30033 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-06-09T04:26:54.697 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipvs/ 2023-06-09T04:26:54.697 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 410481 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipvs/ip_vs.ko 2023-06-09T04:26:54.697 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 11857 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-06-09T04:26:54.697 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 7513 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-06-09T04:26:54.697 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 17545 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-06-09T04:26:54.697 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 17729 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-06-09T04:26:54.697 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 20545 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-06-09T04:26:54.698 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 7513 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-06-09T04:26:54.698 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 7577 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-06-09T04:26:54.698 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 10505 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-06-09T04:26:54.698 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 9121 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-06-09T04:26:54.698 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 7529 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-06-09T04:26:54.698 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 13409 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-06-09T04:26:54.698 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 7593 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-06-09T04:26:54.698 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 10817 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-06-09T04:26:54.699 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 47921 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_conncount.ko 2023-06-09T04:26:54.699 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 397561 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_conntrack.ko 2023-06-09T04:26:54.699 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 15641 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-06-09T04:26:54.699 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 9825 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-06-09T04:26:54.699 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 33353 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-06-09T04:26:54.699 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 117633 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_conntrack_h323.ko 2023-06-09T04:26:54.699 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 21777 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_conntrack_irc.ko 2023-06-09T04:26:54.700 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 8697 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-06-09T04:26:54.700 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 108217 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-06-09T04:26:54.700 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 33153 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-06-09T04:26:54.700 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 17281 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_conntrack_sane.ko 2023-06-09T04:26:54.700 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 65625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_conntrack_sip.ko 2023-06-09T04:26:54.700 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 10833 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-06-09T04:26:54.700 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 18841 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-06-09T04:26:54.700 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 9529 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_dup_netdev.ko 2023-06-09T04:26:54.701 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 86713 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_flow_table.ko 2023-06-09T04:26:54.701 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 9481 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_flow_table_inet.ko 2023-06-09T04:26:54.701 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 37025 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_log_syslog.ko 2023-06-09T04:26:54.701 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 91657 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_nat.ko 2023-06-09T04:26:54.701 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 9945 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_nat_amanda.ko 2023-06-09T04:26:54.701 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 12449 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_nat_ftp.ko 2023-06-09T04:26:54.701 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 11681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_nat_irc.ko 2023-06-09T04:26:54.701 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 28817 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_nat_sip.ko 2023-06-09T04:26:54.702 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 8625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_nat_tftp.ko 2023-06-09T04:26:54.702 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 42425 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_synproxy_core.ko 2023-06-09T04:26:54.702 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 579473 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_tables.ko 2023-06-09T04:26:54.702 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 42457 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nfnetlink.ko 2023-06-09T04:26:54.702 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 29561 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nfnetlink_acct.ko 2023-06-09T04:26:54.702 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 30505 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nfnetlink_cttimeout.ko 2023-06-09T04:26:54.702 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 39729 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nfnetlink_log.ko 2023-06-09T04:26:54.703 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 22113 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nfnetlink_osf.ko 2023-06-09T04:26:54.703 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 49561 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nfnetlink_queue.ko 2023-06-09T04:26:54.703 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 10281 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nft_chain_nat.ko 2023-06-09T04:26:54.703 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 33073 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nft_compat.ko 2023-06-09T04:26:54.703 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 40537 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nft_ct.ko 2023-06-09T04:26:54.703 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 9489 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nft_dup_netdev.ko 2023-06-09T04:26:54.703 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 10481 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nft_fib.ko 2023-06-09T04:26:54.703 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 13633 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nft_fwd_netdev.ko 2023-06-09T04:26:54.704 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 14001 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nft_hash.ko 2023-06-09T04:26:54.704 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 19889 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nft_limit.ko 2023-06-09T04:26:54.704 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 15225 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nft_log.ko 2023-06-09T04:26:54.704 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 14617 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nft_masq.ko 2023-06-09T04:26:54.704 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 14257 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nft_nat.ko 2023-06-09T04:26:54.704 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 13561 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nft_numgen.ko 2023-06-09T04:26:54.704 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 11609 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nft_osf.ko 2023-06-09T04:26:54.704 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 13961 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nft_queue.ko 2023-06-09T04:26:54.705 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 14073 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nft_redir.ko 2023-06-09T04:26:54.705 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 9609 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nft_reject.ko 2023-06-09T04:26:54.705 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 9905 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nft_reject_inet.ko 2023-06-09T04:26:54.705 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 12617 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nft_socket.ko 2023-06-09T04:26:54.705 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 20225 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nft_synproxy.ko 2023-06-09T04:26:54.705 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 14737 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nft_tproxy.ko 2023-06-09T04:26:54.705 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 84993 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/x_tables.ko 2023-06-09T04:26:54.705 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 11985 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_AUDIT.ko 2023-06-09T04:26:54.706 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 9449 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_CHECKSUM.ko 2023-06-09T04:26:54.706 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 7625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_CLASSIFY.ko 2023-06-09T04:26:54.706 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 11417 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-06-09T04:26:54.706 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 18065 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_CT.ko 2023-06-09T04:26:54.706 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 10329 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_DSCP.ko 2023-06-09T04:26:54.706 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 9297 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_HL.ko 2023-06-09T04:26:54.706 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 13257 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_HMARK.ko 2023-06-09T04:26:54.707 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 38681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_IDLETIMER.ko 2023-06-09T04:26:54.707 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 13841 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_LED.ko 2023-06-09T04:26:54.707 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 11377 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_LOG.ko 2023-06-09T04:26:54.707 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 11633 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_MASQUERADE.ko 2023-06-09T04:26:54.707 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 11553 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_NETMAP.ko 2023-06-09T04:26:54.707 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 9361 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_NFLOG.ko 2023-06-09T04:26:54.707 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 13185 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_NFQUEUE.ko 2023-06-09T04:26:54.707 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 19209 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_RATEEST.ko 2023-06-09T04:26:54.708 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 10961 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_REDIRECT.ko 2023-06-09T04:26:54.708 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 14233 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_SECMARK.ko 2023-06-09T04:26:54.708 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 15953 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_TCPMSS.ko 2023-06-09T04:26:54.708 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 10257 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-06-09T04:26:54.708 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 17193 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_TEE.ko 2023-06-09T04:26:54.708 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 16673 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_TPROXY.ko 2023-06-09T04:26:54.708 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 8153 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_TRACE.ko 2023-06-09T04:26:54.708 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 13785 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_addrtype.ko 2023-06-09T04:26:54.709 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 13777 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_bpf.ko 2023-06-09T04:26:54.709 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 15401 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_cgroup.ko 2023-06-09T04:26:54.709 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 11033 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_cluster.ko 2023-06-09T04:26:54.709 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 7393 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_comment.ko 2023-06-09T04:26:54.709 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 10353 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_connbytes.ko 2023-06-09T04:26:54.709 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 10969 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_connlabel.ko 2023-06-09T04:26:54.709 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 9233 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_connlimit.ko 2023-06-09T04:26:54.709 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 13017 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_connmark.ko 2023-06-09T04:26:54.710 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 12289 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_conntrack.ko 2023-06-09T04:26:54.710 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 7713 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_cpu.ko 2023-06-09T04:26:54.710 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 10801 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_dccp.ko 2023-06-09T04:26:54.710 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 7753 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_devgroup.ko 2023-06-09T04:26:54.710 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 8625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_dscp.ko 2023-06-09T04:26:54.710 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 10553 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_ecn.ko 2023-06-09T04:26:54.710 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 11297 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_esp.ko 2023-06-09T04:26:54.710 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 43217 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_hashlimit.ko 2023-06-09T04:26:54.711 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 11209 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_helper.ko 2023-06-09T04:26:54.711 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 7753 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_hl.ko 2023-06-09T04:26:54.711 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 11809 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_ipcomp.ko 2023-06-09T04:26:54.711 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 11289 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_iprange.ko 2023-06-09T04:26:54.711 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 11609 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_ipvs.ko 2023-06-09T04:26:54.711 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 15865 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_l2tp.ko 2023-06-09T04:26:54.711 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 7825 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_length.ko 2023-06-09T04:26:54.711 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 10097 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_limit.ko 2023-06-09T04:26:54.712 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 7433 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_mac.ko 2023-06-09T04:26:54.712 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 8473 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_mark.ko 2023-06-09T04:26:54.712 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 11649 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_multiport.ko 2023-06-09T04:26:54.712 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 13705 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_nat.ko 2023-06-09T04:26:54.712 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 10001 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_nfacct.ko 2023-06-09T04:26:54.712 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 8233 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_osf.ko 2023-06-09T04:26:54.712 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 9441 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_owner.ko 2023-06-09T04:26:54.713 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 9553 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_physdev.ko 2023-06-09T04:26:54.713 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 7457 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_pkttype.ko 2023-06-09T04:26:54.713 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 11881 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_policy.ko 2023-06-09T04:26:54.713 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 9369 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_quota.ko 2023-06-09T04:26:54.713 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 10233 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_rateest.ko 2023-06-09T04:26:54.713 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 8081 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_realm.ko 2023-06-09T04:26:54.713 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 36321 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_recent.ko 2023-06-09T04:26:54.713 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 13217 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_sctp.ko 2023-06-09T04:26:54.714 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 29921 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_set.ko 2023-06-09T04:26:54.714 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 15977 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_socket.ko 2023-06-09T04:26:54.714 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 9329 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_state.ko 2023-06-09T04:26:54.714 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 9305 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_statistic.ko 2023-06-09T04:26:54.714 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 8633 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_string.ko 2023-06-09T04:26:54.714 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 8449 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_tcpmss.ko 2023-06-09T04:26:54.714 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 15665 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_tcpudp.ko 2023-06-09T04:26:54.714 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 10961 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_time.ko 2023-06-09T04:26:54.715 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 9001 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_u32.ko 2023-06-09T04:26:54.715 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netlink/ 2023-06-09T04:26:54.715 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 13737 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netlink/netlink_diag.ko 2023-06-09T04:26:54.715 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/nsh/ 2023-06-09T04:26:54.715 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 12073 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/nsh/nsh.ko 2023-06-09T04:26:54.715 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/openvswitch/ 2023-06-09T04:26:54.715 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 377897 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/openvswitch/openvswitch.ko 2023-06-09T04:26:54.715 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 10145 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/openvswitch/vport-geneve.ko 2023-06-09T04:26:54.716 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 9273 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/openvswitch/vport-gre.ko 2023-06-09T04:26:54.716 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 11681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/openvswitch/vport-vxlan.ko 2023-06-09T04:26:54.716 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/packet/ 2023-06-09T04:26:54.716 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 12945 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/packet/af_packet_diag.ko 2023-06-09T04:26:54.716 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/phonet/ 2023-06-09T04:26:54.716 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 109953 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/phonet/phonet.ko 2023-06-09T04:26:54.716 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 54737 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/phonet/pn_pep.ko 2023-06-09T04:26:54.717 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/rds/ 2023-06-09T04:26:54.717 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 248865 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/rds/rds.ko 2023-06-09T04:26:54.717 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 164961 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/rds/rds_rdma.ko 2023-06-09T04:26:54.717 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 66761 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/rds/rds_tcp.ko 2023-06-09T04:26:54.717 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/rxrpc/ 2023-06-09T04:26:54.717 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 806905 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/rxrpc/rxrpc.ko 2023-06-09T04:26:54.717 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/ 2023-06-09T04:26:54.717 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 32137 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/act_csum.ko 2023-06-09T04:26:54.718 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 23425 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/act_gact.ko 2023-06-09T04:26:54.718 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 25569 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/act_ipt.ko 2023-06-09T04:26:54.718 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 33953 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/act_mirred.ko 2023-06-09T04:26:54.718 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 23249 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/act_nat.ko 2023-06-09T04:26:54.718 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 42481 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/act_pedit.ko 2023-06-09T04:26:54.718 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 31881 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/act_police.ko 2023-06-09T04:26:54.718 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 20137 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/act_simple.ko 2023-06-09T04:26:54.718 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 36241 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/act_skbedit.ko 2023-06-09T04:26:54.719 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 35945 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/act_vlan.ko 2023-06-09T04:26:54.719 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 25273 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/cls_basic.ko 2023-06-09T04:26:54.719 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 32729 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/cls_bpf.ko 2023-06-09T04:26:54.719 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 19049 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/cls_cgroup.ko 2023-06-09T04:26:54.719 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 31273 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/cls_flow.ko 2023-06-09T04:26:54.719 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 30129 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/cls_fw.ko 2023-06-09T04:26:54.719 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 37113 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/cls_route.ko 2023-06-09T04:26:54.719 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 58305 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/cls_u32.ko 2023-06-09T04:26:54.720 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 7265 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/em_cmp.ko 2023-06-09T04:26:54.720 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 13289 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/em_ipset.ko 2023-06-09T04:26:54.720 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 33153 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/em_meta.ko 2023-06-09T04:26:54.720 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 7713 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/em_nbyte.ko 2023-06-09T04:26:54.720 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 10513 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/em_text.ko 2023-06-09T04:26:54.720 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 7073 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/em_u32.ko 2023-06-09T04:26:54.720 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 19929 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_choke.ko 2023-06-09T04:26:54.720 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 19521 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_codel.ko 2023-06-09T04:26:54.721 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 30761 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_drr.ko 2023-06-09T04:26:54.721 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 30361 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_fq.ko 2023-06-09T04:26:54.721 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 29273 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_fq_codel.ko 2023-06-09T04:26:54.721 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 32465 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_gred.ko 2023-06-09T04:26:54.721 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 44665 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_hfsc.ko 2023-06-09T04:26:54.721 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 20689 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_hhf.ko 2023-06-09T04:26:54.721 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 63641 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_htb.ko 2023-06-09T04:26:54.721 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 15569 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_ingress.ko 2023-06-09T04:26:54.722 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 28417 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_mqprio.ko 2023-06-09T04:26:54.722 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 10209 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_mqprio_lib.ko 2023-06-09T04:26:54.722 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 23761 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_multiq.ko 2023-06-09T04:26:54.722 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 33649 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_netem.ko 2023-06-09T04:26:54.722 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 23817 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_pie.ko 2023-06-09T04:26:54.722 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 10153 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_plug.ko 2023-06-09T04:26:54.722 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 23137 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_prio.ko 2023-06-09T04:26:54.722 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 44625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_qfq.ko 2023-06-09T04:26:54.723 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 29017 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_red.ko 2023-06-09T04:26:54.723 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 25201 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_sfb.ko 2023-06-09T04:26:54.723 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 28305 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_sfq.ko 2023-06-09T04:26:54.723 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 27225 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_tbf.ko 2023-06-09T04:26:54.723 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 27177 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_teql.ko 2023-06-09T04:26:54.723 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sctp/ 2023-06-09T04:26:54.723 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 929065 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sctp/sctp.ko 2023-06-09T04:26:54.723 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 18921 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sctp/sctp_diag.ko 2023-06-09T04:26:54.724 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sunrpc/ 2023-06-09T04:26:54.724 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sunrpc/auth_gss/ 2023-06-09T04:26:54.724 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 327953 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-06-09T04:26:54.724 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 61649 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-06-09T04:26:54.724 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 1427857 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sunrpc/sunrpc.ko 2023-06-09T04:26:54.724 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sunrpc/xprtrdma/ 2023-06-09T04:26:54.724 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 681617 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-06-09T04:26:54.725 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/tipc/ 2023-06-09T04:26:54.725 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 9913 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/tipc/diag.ko 2023-06-09T04:26:54.725 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 853649 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/tipc/tipc.ko 2023-06-09T04:26:54.725 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/unix/ 2023-06-09T04:26:54.725 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 15553 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/unix/unix_diag.ko 2023-06-09T04:26:54.725 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/vmw_vsock/ 2023-06-09T04:26:54.725 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 80017 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-06-09T04:26:54.725 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 67921 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-06-09T04:26:54.726 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 92577 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/vmw_vsock/vsock.ko 2023-06-09T04:26:54.726 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 10593 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/vmw_vsock/vsock_diag.ko 2023-06-09T04:26:54.726 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 17417 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/vmw_vsock/vsock_loopback.ko 2023-06-09T04:26:54.726 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/x25/ 2023-06-09T04:26:54.726 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 125049 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/x25/x25.ko 2023-06-09T04:26:54.726 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/xfrm/ 2023-06-09T04:26:54.726 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 21113 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/xfrm/xfrm_algo.ko 2023-06-09T04:26:54.726 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 20065 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/xfrm/xfrm_ipcomp.ko 2023-06-09T04:26:54.727 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 101529 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/xfrm/xfrm_user.ko 2023-06-09T04:26:54.727 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/virt/ 2023-06-09T04:26:54.727 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/virt/lib/ 2023-06-09T04:26:54.727 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 14753 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/virt/lib/irqbypass.ko 2023-06-09T04:26:54.727 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 636518 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/modules.alias 2023-06-09T04:26:54.727 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 622189 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/modules.alias.bin 2023-06-09T04:26:54.727 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 7605 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/modules.builtin 2023-06-09T04:26:54.727 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 22249 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/modules.builtin.alias.bin 2023-06-09T04:26:54.728 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 9788 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/modules.builtin.bin 2023-06-09T04:26:54.728 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 68530 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/modules.builtin.modinfo 2023-06-09T04:26:54.728 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 146382 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/modules.dep 2023-06-09T04:26:54.728 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 232620 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/modules.dep.bin 2023-06-09T04:26:54.728 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 210 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/modules.devname 2023-06-09T04:26:54.728 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 72719 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/modules.order 2023-06-09T04:26:54.728 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 879 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/modules.softdep 2023-06-09T04:26:54.728 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 251838 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/modules.symbols 2023-06-09T04:26:54.729 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 306636 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/modules.symbols.bin 2023-06-09T04:26:54.729 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./usr/ 2023-06-09T04:26:54.729 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./usr/share/ 2023-06-09T04:26:54.729 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./usr/share/doc/ 2023-06-09T04:26:54.729 INFO:teuthology.orchestra.run.smithi174.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./usr/share/doc/linux-image-6.4.0-rc2-g10b2f20a4f46/ 2023-06-09T04:26:54.729 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 173 2023-06-01 02:19 ./usr/share/doc/linux-image-6.4.0-rc2-g10b2f20a4f46/changelog.Debian.gz 2023-06-09T04:26:54.729 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r-- root/root 691 2023-06-01 02:19 ./usr/share/doc/linux-image-6.4.0-rc2-g10b2f20a4f46/copyright 2023-06-09T04:26:54.730 DEBUG:teuthology.task.kernel:get_image_version: 6.4.0-rc2-g10b2f20a4f46 2023-06-09T04:26:54.731 INFO:teuthology.task.kernel:searching for kernel 6.4.0-rc2-g10b2f20a4f46 2023-06-09T04:26:54.731 DEBUG:teuthology.orchestra.run.smithi174:> egrep '(submenu|menuentry.*6.4.0-rc2-g10b2f20a4f46).*{' /boot/grub/grub.cfg 2023-06-09T04:26:54.739 INFO:teuthology.orchestra.run.smithi174.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-1168b92c-82ac-47e1-87d9-5d77414c7738' { 2023-06-09T04:26:54.739 INFO:teuthology.orchestra.run.smithi174.stdout: menuentry 'Ubuntu, with Linux 6.4.0-rc2-g10b2f20a4f46' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.4.0-rc2-g10b2f20a4f46-advanced-1168b92c-82ac-47e1-87d9-5d77414c7738' { 2023-06-09T04:26:54.739 INFO:teuthology.orchestra.run.smithi174.stdout: menuentry 'Ubuntu, with Linux 6.4.0-rc2-g10b2f20a4f46 (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.4.0-rc2-g10b2f20a4f46-recovery-1168b92c-82ac-47e1-87d9-5d77414c7738' { 2023-06-09T04:26:54.740 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2023-06-09T04:26:54.740 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.4.0-rc2-g10b2f20a4f46 2023-06-09T04:26:54.740 DEBUG:teuthology.orchestra.run.smithi174:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2023-06-09T04:26:54.782 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi174.front.sepia.ceph.com to complete... 2023-06-09T04:26:54.822 DEBUG:teuthology.orchestra.run.smithi090:> dpkg-deb -c /tmp/linux-image.deb 2023-06-09T04:26:54.831 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./ 2023-06-09T04:26:54.832 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./boot/ 2023-06-09T04:26:54.832 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 4322013 2023-06-01 02:19 ./boot/System.map-6.4.0-rc2-g10b2f20a4f46 2023-06-09T04:26:54.847 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 167348 2023-06-01 02:19 ./boot/config-6.4.0-rc2-g10b2f20a4f46 2023-06-09T04:26:54.847 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 11235616 2023-06-01 02:19 ./boot/vmlinuz-6.4.0-rc2-g10b2f20a4f46 2023-06-09T04:26:54.868 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./etc/ 2023-06-09T04:26:54.868 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./etc/kernel/ 2023-06-09T04:26:54.868 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./etc/kernel/postinst.d/ 2023-06-09T04:26:54.868 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./etc/kernel/postrm.d/ 2023-06-09T04:26:54.868 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./etc/kernel/preinst.d/ 2023-06-09T04:26:54.869 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./etc/kernel/prerm.d/ 2023-06-09T04:26:54.869 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/ 2023-06-09T04:26:54.869 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/ 2023-06-09T04:26:54.869 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/ 2023-06-09T04:26:54.869 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/ 2023-06-09T04:26:54.869 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/ 2023-06-09T04:26:54.869 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/ 2023-06-09T04:26:54.869 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/ 2023-06-09T04:26:54.870 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 490273 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/aesni-intel.ko 2023-06-09T04:26:54.871 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 25225 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-06-09T04:26:54.872 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 28945 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-06-09T04:26:54.872 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 30129 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-06-09T04:26:54.872 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 92281 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-06-09T04:26:54.872 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 106625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-06-09T04:26:54.872 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 152065 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-06-09T04:26:54.872 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 12441 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-06-09T04:26:54.873 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13601 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-06-09T04:26:54.873 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 83785 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-06-09T04:26:54.873 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 18441 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-06-09T04:26:54.873 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 46641 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-06-09T04:26:54.873 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 47097 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/serpent-avx2.ko 2023-06-09T04:26:54.873 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 51625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-06-09T04:26:54.873 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 38769 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-06-09T04:26:54.873 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 40353 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-06-09T04:26:54.874 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 58417 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-06-09T04:26:54.874 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 50329 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-06-09T04:26:54.874 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 31473 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-06-09T04:26:54.874 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13145 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-06-09T04:26:54.874 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/kernel/ 2023-06-09T04:26:54.874 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/kernel/cpu/ 2023-06-09T04:26:54.874 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/kernel/cpu/mce/ 2023-06-09T04:26:54.875 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 40009 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-06-09T04:26:54.875 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13105 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/kernel/cpuid.ko 2023-06-09T04:26:54.875 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 17689 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/kernel/msr.ko 2023-06-09T04:26:54.875 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/kvm/ 2023-06-09T04:26:54.875 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 346401 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/kvm/kvm-amd.ko 2023-06-09T04:26:54.875 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 972121 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/kvm/kvm-intel.ko 2023-06-09T04:26:54.876 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 2209361 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/kvm/kvm.ko 2023-06-09T04:26:54.884 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/ 2023-06-09T04:26:54.884 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 56209 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/af_alg.ko 2023-06-09T04:26:54.885 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 25153 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/algif_hash.ko 2023-06-09T04:26:54.885 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 20905 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/algif_skcipher.ko 2023-06-09T04:26:54.885 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 17097 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/ansi_cprng.ko 2023-06-09T04:26:54.885 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 19529 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/anubis.ko 2023-06-09T04:26:54.885 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 9977 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/arc4.ko 2023-06-09T04:26:54.885 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/asymmetric_keys/ 2023-06-09T04:26:54.885 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 10073 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2023-06-09T04:26:54.886 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/async_tx/ 2023-06-09T04:26:54.886 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 10849 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/async_tx/async_memcpy.ko 2023-06-09T04:26:54.886 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 18985 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/async_tx/async_pq.ko 2023-06-09T04:26:54.886 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 21057 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/async_tx/async_raid6_recov.ko 2023-06-09T04:26:54.886 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13169 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/async_tx/async_tx.ko 2023-06-09T04:26:54.886 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 17105 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/async_tx/async_xor.ko 2023-06-09T04:26:54.886 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 17809 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/async_tx/raid6test.ko 2023-06-09T04:26:54.887 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 20073 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/authenc.ko 2023-06-09T04:26:54.887 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 22473 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/authencesn.ko 2023-06-09T04:26:54.887 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 21401 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/blake2b_generic.ko 2023-06-09T04:26:54.887 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 12329 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/blowfish_common.ko 2023-06-09T04:26:54.887 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 10353 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/blowfish_generic.ko 2023-06-09T04:26:54.887 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 38697 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/camellia_generic.ko 2023-06-09T04:26:54.887 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 26697 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/cast5_generic.ko 2023-06-09T04:26:54.887 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 17105 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/cast6_generic.ko 2023-06-09T04:26:54.888 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 9857 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/cast_common.ko 2023-06-09T04:26:54.888 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 34985 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/ccm.ko 2023-06-09T04:26:54.888 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 14217 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/cmac.ko 2023-06-09T04:26:54.888 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 9409 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/crc32_generic.ko 2023-06-09T04:26:54.888 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 45361 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/cryptd.ko 2023-06-09T04:26:54.888 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 23305 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/crypto_engine.ko 2023-06-09T04:26:54.888 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 25633 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/crypto_simd.ko 2023-06-09T04:26:54.888 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 24625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/crypto_user.ko 2023-06-09T04:26:54.889 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 17553 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/cts.ko 2023-06-09T04:26:54.889 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 10737 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/des_generic.ko 2023-06-09T04:26:54.889 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 15105 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/dh_generic.ko 2023-06-09T04:26:54.889 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 10889 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/echainiv.ko 2023-06-09T04:26:54.889 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 25145 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/essiv.ko 2023-06-09T04:26:54.889 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 17873 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/fcrypt.ko 2023-06-09T04:26:54.889 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 26713 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/khazad.ko 2023-06-09T04:26:54.889 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 15537 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/lrw.ko 2023-06-09T04:26:54.890 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 11329 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/lz4.ko 2023-06-09T04:26:54.890 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 11409 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/lz4hc.ko 2023-06-09T04:26:54.890 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 11577 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/md4.ko 2023-06-09T04:26:54.890 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 9553 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/michael_mic.ko 2023-06-09T04:26:54.890 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 10561 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/pcbc.ko 2023-06-09T04:26:54.890 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 18641 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/pcrypt.ko 2023-06-09T04:26:54.890 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 15873 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/rmd160.ko 2023-06-09T04:26:54.891 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 29273 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/seed.ko 2023-06-09T04:26:54.891 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 26369 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/serpent_generic.ko 2023-06-09T04:26:54.891 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 149081 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/tcrypt.ko 2023-06-09T04:26:54.891 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 10697 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/tea.ko 2023-06-09T04:26:54.891 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 28289 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/twofish_common.ko 2023-06-09T04:26:54.891 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13049 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/twofish_generic.ko 2023-06-09T04:26:54.891 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 17217 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/vmac.ko 2023-06-09T04:26:54.891 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 36009 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/wp512.ko 2023-06-09T04:26:54.892 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13993 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/xcbc.ko 2023-06-09T04:26:54.892 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 26329 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/xor.ko 2023-06-09T04:26:54.892 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 18513 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/xts.ko 2023-06-09T04:26:54.892 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 9369 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/xxhash_generic.ko 2023-06-09T04:26:54.892 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ 2023-06-09T04:26:54.892 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/acpi/ 2023-06-09T04:26:54.892 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 18129 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/acpi/acpi_extlog.ko 2023-06-09T04:26:54.892 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 26857 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/acpi/acpi_ipmi.ko 2023-06-09T04:26:54.893 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 28617 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/acpi/acpi_pad.ko 2023-06-09T04:26:54.893 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/acpi/apei/ 2023-06-09T04:26:54.893 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 31121 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/acpi/apei/einj.ko 2023-06-09T04:26:54.893 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 12697 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/acpi/ec_sys.ko 2023-06-09T04:26:54.893 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 14281 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/acpi/platform_profile.ko 2023-06-09T04:26:54.893 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 24225 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/acpi/sbs.ko 2023-06-09T04:26:54.893 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 18849 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/acpi/sbshc.ko 2023-06-09T04:26:54.893 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 98193 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/acpi/video.ko 2023-06-09T04:26:54.894 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/ 2023-06-09T04:26:54.894 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 21353 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/acard-ahci.ko 2023-06-09T04:26:54.894 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 88505 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/ahci.ko 2023-06-09T04:26:54.894 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 14001 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/ahci_platform.ko 2023-06-09T04:26:54.894 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 85073 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/libahci.ko 2023-06-09T04:26:54.894 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 32753 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/libahci_platform.ko 2023-06-09T04:26:54.894 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 16897 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_acpi.ko 2023-06-09T04:26:54.895 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 30377 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_ali.ko 2023-06-09T04:26:54.895 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 33513 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_amd.ko 2023-06-09T04:26:54.895 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 21025 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_artop.ko 2023-06-09T04:26:54.895 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 20881 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_atiixp.ko 2023-06-09T04:26:54.895 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 24689 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_atp867x.ko 2023-06-09T04:26:54.895 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 17409 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_cmd640.ko 2023-06-09T04:26:54.895 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 25065 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_cmd64x.ko 2023-06-09T04:26:54.895 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 14801 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_cypress.ko 2023-06-09T04:26:54.896 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 17609 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_efar.ko 2023-06-09T04:26:54.896 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 21705 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_hpt366.ko 2023-06-09T04:26:54.896 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 33865 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_hpt37x.ko 2023-06-09T04:26:54.896 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 22889 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_hpt3x2n.ko 2023-06-09T04:26:54.896 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 16681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_hpt3x3.ko 2023-06-09T04:26:54.896 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 16753 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_it8213.ko 2023-06-09T04:26:54.896 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 35065 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_it821x.ko 2023-06-09T04:26:54.897 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 12649 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_jmicron.ko 2023-06-09T04:26:54.897 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 51561 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_legacy.ko 2023-06-09T04:26:54.897 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 14945 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_marvell.ko 2023-06-09T04:26:54.897 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 15977 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_mpiix.ko 2023-06-09T04:26:54.897 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 12593 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_netcell.ko 2023-06-09T04:26:54.897 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 16577 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_ninja32.ko 2023-06-09T04:26:54.897 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 14793 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_ns87410.ko 2023-06-09T04:26:54.897 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 17057 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_ns87415.ko 2023-06-09T04:26:54.898 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 16265 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_oldpiix.ko 2023-06-09T04:26:54.898 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 15137 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_opti.ko 2023-06-09T04:26:54.898 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 20433 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_optidma.ko 2023-06-09T04:26:54.898 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 32337 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_pcmcia.ko 2023-06-09T04:26:54.898 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 37609 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_pdc2027x.ko 2023-06-09T04:26:54.898 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 20313 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-06-09T04:26:54.898 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13921 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_piccolo.ko 2023-06-09T04:26:54.898 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 15209 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_radisys.ko 2023-06-09T04:26:54.899 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 19281 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_rdc.ko 2023-06-09T04:26:54.899 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 15081 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_rz1000.ko 2023-06-09T04:26:54.899 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13697 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_sch.ko 2023-06-09T04:26:54.899 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 22833 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_serverworks.ko 2023-06-09T04:26:54.899 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 23209 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_sil680.ko 2023-06-09T04:26:54.899 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 19385 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_sl82c105.ko 2023-06-09T04:26:54.899 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 15769 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_triflex.ko 2023-06-09T04:26:54.899 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 30249 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_via.ko 2023-06-09T04:26:54.900 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 22617 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pdc_adma.ko 2023-06-09T04:26:54.900 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 28881 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/sata_inic162x.ko 2023-06-09T04:26:54.900 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 83113 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/sata_mv.ko 2023-06-09T04:26:54.900 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 70353 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/sata_nv.ko 2023-06-09T04:26:54.900 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 37257 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/sata_promise.ko 2023-06-09T04:26:54.900 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 22865 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/sata_qstor.ko 2023-06-09T04:26:54.900 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 29025 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/sata_sil.ko 2023-06-09T04:26:54.900 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 38089 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/sata_sil24.ko 2023-06-09T04:26:54.901 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 17697 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/sata_sis.ko 2023-06-09T04:26:54.901 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 20201 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/sata_svw.ko 2023-06-09T04:26:54.901 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 44545 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/sata_sx4.ko 2023-06-09T04:26:54.901 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 15361 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/sata_uli.ko 2023-06-09T04:26:54.901 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 34945 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/sata_via.ko 2023-06-09T04:26:54.901 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 19817 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/sata_vsc.ko 2023-06-09T04:26:54.901 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/auxdisplay/ 2023-06-09T04:26:54.902 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 15337 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/auxdisplay/ks0108.ko 2023-06-09T04:26:54.902 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/bcma/ 2023-06-09T04:26:54.902 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 121569 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/bcma/bcma.ko 2023-06-09T04:26:54.902 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/block/ 2023-06-09T04:26:54.902 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/block/aoe/ 2023-06-09T04:26:54.902 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 113433 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/block/aoe/aoe.ko 2023-06-09T04:26:54.902 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/block/drbd/ 2023-06-09T04:26:54.902 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 968017 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/block/drbd/drbd.ko 2023-06-09T04:26:54.927 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 173105 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/block/floppy.ko 2023-06-09T04:26:54.927 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/block/mtip32xx/ 2023-06-09T04:26:54.927 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 94185 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-06-09T04:26:54.927 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 114049 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/block/nbd.ko 2023-06-09T04:26:54.927 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/block/null_blk/ 2023-06-09T04:26:54.927 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 110145 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/block/null_blk/null_blk.ko 2023-06-09T04:26:54.928 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 81625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/block/pktcdvd.ko 2023-06-09T04:26:54.928 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 254273 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/block/rbd.ko 2023-06-09T04:26:54.928 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/block/xen-blkback/ 2023-06-09T04:26:54.928 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 98017 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-06-09T04:26:54.928 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/block/zram/ 2023-06-09T04:26:54.928 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 59985 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/block/zram/zram.ko 2023-06-09T04:26:54.928 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/ 2023-06-09T04:26:54.929 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 30737 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/applicom.ko 2023-06-09T04:26:54.929 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 11889 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/hangcheck-timer.ko 2023-06-09T04:26:54.929 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/hw_random/ 2023-06-09T04:26:54.929 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13713 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/hw_random/amd-rng.ko 2023-06-09T04:26:54.929 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 18625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/hw_random/intel-rng.ko 2023-06-09T04:26:54.929 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13217 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-06-09T04:26:54.929 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 10561 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/hw_random/via-rng.ko 2023-06-09T04:26:54.929 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 15409 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/hw_random/virtio-rng.ko 2023-06-09T04:26:54.930 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/ipmi/ 2023-06-09T04:26:54.930 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 30737 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-06-09T04:26:54.930 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 147521 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-06-09T04:26:54.930 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 26385 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-06-09T04:26:54.930 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 138881 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/ipmi/ipmi_si.ko 2023-06-09T04:26:54.930 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 70649 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-06-09T04:26:54.930 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 53425 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-06-09T04:26:54.931 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 36073 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/lp.ko 2023-06-09T04:26:54.931 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/mwave/ 2023-06-09T04:26:54.931 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 83945 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/mwave/mwave.ko 2023-06-09T04:26:54.931 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 25473 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/nvram.ko 2023-06-09T04:26:54.931 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 31921 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/ppdev.ko 2023-06-09T04:26:54.931 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 51001 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/tlclk.ko 2023-06-09T04:26:54.931 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/tpm/ 2023-06-09T04:26:54.931 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 16217 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/tpm/tpm_atmel.ko 2023-06-09T04:26:54.932 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 15769 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2023-06-09T04:26:54.932 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 23353 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2023-06-09T04:26:54.932 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 32801 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2023-06-09T04:26:54.932 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 30001 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/tpm/tpm_infineon.ko 2023-06-09T04:26:54.932 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 22577 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/tpm/tpm_nsc.ko 2023-06-09T04:26:54.932 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 23457 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/tpm/xen-tpmfront.ko 2023-06-09T04:26:54.932 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/xillybus/ 2023-06-09T04:26:54.932 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 16353 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/xillybus/xillybus_class.ko 2023-06-09T04:26:54.933 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 50217 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/xillybus/xillybus_core.ko 2023-06-09T04:26:54.933 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 12289 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/xillybus/xillybus_pcie.ko 2023-06-09T04:26:54.933 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/clk/ 2023-06-09T04:26:54.933 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 12377 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/clk/clk-palmas.ko 2023-06-09T04:26:54.933 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 47753 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/clk/clk-si5351.ko 2023-06-09T04:26:54.933 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 11281 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/clk/clk-twl6040.ko 2023-06-09T04:26:54.933 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 18985 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/clk/clk-wm831x.ko 2023-06-09T04:26:54.934 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/cpufreq/ 2023-06-09T04:26:54.934 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 9985 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-06-09T04:26:54.934 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 16657 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/cpufreq/p4-clockmod.ko 2023-06-09T04:26:54.934 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 24705 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/cpufreq/speedstep-lib.ko 2023-06-09T04:26:54.934 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/crypto/ 2023-06-09T04:26:54.934 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/crypto/ccp/ 2023-06-09T04:26:54.934 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 70609 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-06-09T04:26:54.934 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 231545 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/crypto/ccp/ccp.ko 2023-06-09T04:26:54.935 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/crypto/intel/ 2023-06-09T04:26:54.935 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/crypto/intel/qat/ 2023-06-09T04:26:54.935 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/crypto/intel/qat/qat_common/ 2023-06-09T04:26:54.935 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 396281 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-06-09T04:26:54.935 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2023-06-09T04:26:54.935 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 23921 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-06-09T04:26:54.935 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 19825 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/crypto/padlock-aes.ko 2023-06-09T04:26:54.935 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 21369 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/crypto/padlock-sha.ko 2023-06-09T04:26:54.936 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/crypto/virtio/ 2023-06-09T04:26:54.936 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 68441 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-06-09T04:26:54.936 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/dca/ 2023-06-09T04:26:54.936 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 28505 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/dca/dca.ko 2023-06-09T04:26:54.936 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/dma/ 2023-06-09T04:26:54.936 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/dma/dw/ 2023-06-09T04:26:54.936 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 15737 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/dma/dw/dw_dmac.ko 2023-06-09T04:26:54.937 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/dma/ioat/ 2023-06-09T04:26:54.937 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 122473 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/dma/ioat/ioatdma.ko 2023-06-09T04:26:54.937 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/edac/ 2023-06-09T04:26:54.937 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 75409 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/edac/amd64_edac.ko 2023-06-09T04:26:54.937 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 35649 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/edac/e752x_edac.ko 2023-06-09T04:26:54.937 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 63017 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/edac/edac_mce_amd.ko 2023-06-09T04:26:54.937 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 17993 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/edac/i3000_edac.ko 2023-06-09T04:26:54.937 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 17961 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/edac/i3200_edac.ko 2023-06-09T04:26:54.938 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 22425 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/edac/i5100_edac.ko 2023-06-09T04:26:54.938 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 25481 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/edac/i5400_edac.ko 2023-06-09T04:26:54.938 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 24745 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/edac/i7300_edac.ko 2023-06-09T04:26:54.938 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 51905 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/edac/i7core_edac.ko 2023-06-09T04:26:54.938 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 18321 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/edac/i82975x_edac.ko 2023-06-09T04:26:54.938 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 19841 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/edac/ie31200_edac.ko 2023-06-09T04:26:54.938 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 56689 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/edac/sb_edac.ko 2023-06-09T04:26:54.938 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 17417 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/edac/x38_edac.ko 2023-06-09T04:26:54.939 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/extcon/ 2023-06-09T04:26:54.939 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 12561 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/extcon/extcon-gpio.ko 2023-06-09T04:26:54.939 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 27017 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/extcon/extcon-max14577.ko 2023-06-09T04:26:54.939 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 29457 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/extcon/extcon-max77693.ko 2023-06-09T04:26:54.939 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 24569 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/extcon/extcon-max8997.ko 2023-06-09T04:26:54.939 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 26417 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/extcon/extcon-palmas.ko 2023-06-09T04:26:54.939 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 23601 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/extcon/extcon-rt8973a.ko 2023-06-09T04:26:54.939 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 27673 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/extcon/extcon-sm5502.ko 2023-06-09T04:26:54.940 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/firmware/ 2023-06-09T04:26:54.940 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 34777 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/firmware/dmi-sysfs.ko 2023-06-09T04:26:54.940 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/firmware/efi/ 2023-06-09T04:26:54.940 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 15353 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/firmware/efi/efi-pstore.ko 2023-06-09T04:26:54.940 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 20705 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/firmware/iscsi_ibft.ko 2023-06-09T04:26:54.940 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/ 2023-06-09T04:26:54.940 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 12201 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-adp5520.ko 2023-06-09T04:26:54.941 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 20049 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-amd8111.ko 2023-06-09T04:26:54.941 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 14881 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-arizona.ko 2023-06-09T04:26:54.941 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13737 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-da9052.ko 2023-06-09T04:26:54.941 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 11753 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-da9055.ko 2023-06-09T04:26:54.941 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 21945 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-dln2.ko 2023-06-09T04:26:54.941 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 78249 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-f7188x.ko 2023-06-09T04:26:54.941 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 28249 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-generic.ko 2023-06-09T04:26:54.941 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 19449 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-ich.ko 2023-06-09T04:26:54.942 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 11801 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-janz-ttl.ko 2023-06-09T04:26:54.942 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 14009 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-kempld.ko 2023-06-09T04:26:54.942 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 12569 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-lp3943.ko 2023-06-09T04:26:54.942 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 9337 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-max7300.ko 2023-06-09T04:26:54.942 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 11481 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-max730x.ko 2023-06-09T04:26:54.942 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 18465 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-max732x.ko 2023-06-09T04:26:54.942 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 24969 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-ml-ioh.ko 2023-06-09T04:26:54.942 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 46641 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-pca953x.ko 2023-06-09T04:26:54.943 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 26665 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-pcf857x.ko 2023-06-09T04:26:54.943 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 14209 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-rdc321x.ko 2023-06-09T04:26:54.943 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 20417 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-sch.ko 2023-06-09T04:26:54.943 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 19969 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-sch311x.ko 2023-06-09T04:26:54.943 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 12041 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-tps65912.ko 2023-06-09T04:26:54.943 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 21873 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-twl4030.ko 2023-06-09T04:26:54.943 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 11313 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-twl6040.ko 2023-06-09T04:26:54.944 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 20425 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-viperboard.ko 2023-06-09T04:26:54.944 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 15345 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-vx855.ko 2023-06-09T04:26:54.944 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 16169 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-wm831x.ko 2023-06-09T04:26:54.944 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 11505 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-wm8350.ko 2023-06-09T04:26:54.944 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 16641 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-wm8994.ko 2023-06-09T04:26:54.944 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/ 2023-06-09T04:26:54.944 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 11473 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-a4tech.ko 2023-06-09T04:26:54.944 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 38809 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-apple.ko 2023-06-09T04:26:54.945 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 14377 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-appleir.ko 2023-06-09T04:26:54.945 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 8185 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-aureal.ko 2023-06-09T04:26:54.945 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 15001 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-axff.ko 2023-06-09T04:26:54.945 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 10945 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-belkin.ko 2023-06-09T04:26:54.945 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 10145 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-cherry.ko 2023-06-09T04:26:54.945 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 15937 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-chicony.ko 2023-06-09T04:26:54.945 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 58961 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-cp2112.ko 2023-06-09T04:26:54.945 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 10937 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-cypress.ko 2023-06-09T04:26:54.946 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 16281 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-dr.ko 2023-06-09T04:26:54.946 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 10593 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-elecom.ko 2023-06-09T04:26:54.946 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 17489 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-elo.ko 2023-06-09T04:26:54.946 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13281 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-emsff.ko 2023-06-09T04:26:54.946 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 9929 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-ezkey.ko 2023-06-09T04:26:54.946 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 14129 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-gaff.ko 2023-06-09T04:26:54.946 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 9113 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-generic.ko 2023-06-09T04:26:54.947 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 16369 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-gt683r.ko 2023-06-09T04:26:54.947 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 12577 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-gyration.ko 2023-06-09T04:26:54.947 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 9769 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-holtek-kbd.ko 2023-06-09T04:26:54.947 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 10353 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-holtek-mouse.ko 2023-06-09T04:26:54.947 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 14337 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-holtekff.ko 2023-06-09T04:26:54.947 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 18937 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-hyperv.ko 2023-06-09T04:26:54.947 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 10321 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-icade.ko 2023-06-09T04:26:54.947 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 9137 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-kensington.ko 2023-06-09T04:26:54.948 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 8377 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-keytouch.ko 2023-06-09T04:26:54.948 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 17089 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-kye.ko 2023-06-09T04:26:54.948 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 10641 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-lcpower.ko 2023-06-09T04:26:54.948 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 20313 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-led.ko 2023-06-09T04:26:54.948 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 42177 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-lenovo.ko 2023-06-09T04:26:54.948 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 30417 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-lg-g15.ko 2023-06-09T04:26:54.948 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 57689 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-logitech-dj.ko 2023-06-09T04:26:54.948 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 100561 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-06-09T04:26:54.949 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 80889 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-logitech.ko 2023-06-09T04:26:54.949 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 30681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-magicmouse.ko 2023-06-09T04:26:54.949 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 21425 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-microsoft.ko 2023-06-09T04:26:54.949 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 10257 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-monterey.ko 2023-06-09T04:26:54.949 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 49977 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-multitouch.ko 2023-06-09T04:26:54.949 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 32473 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-ntrig.ko 2023-06-09T04:26:54.949 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 8753 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-ortek.ko 2023-06-09T04:26:54.949 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 9009 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-penmount.ko 2023-06-09T04:26:54.950 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 12185 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-petalynx.ko 2023-06-09T04:26:54.950 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 72817 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-picolcd.ko 2023-06-09T04:26:54.950 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 14121 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-pl.ko 2023-06-09T04:26:54.950 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 14929 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-plantronics.ko 2023-06-09T04:26:54.950 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 8249 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-primax.ko 2023-06-09T04:26:54.950 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 35289 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-rmi.ko 2023-06-09T04:26:54.950 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 20649 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-roccat-arvo.ko 2023-06-09T04:26:54.951 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13129 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-roccat-common.ko 2023-06-09T04:26:54.951 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 31177 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-roccat-isku.ko 2023-06-09T04:26:54.951 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 29481 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-roccat-kone.ko 2023-06-09T04:26:54.951 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 30945 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-06-09T04:26:54.951 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 20913 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-roccat-konepure.ko 2023-06-09T04:26:54.951 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 29305 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-06-09T04:26:54.951 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13193 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-roccat-lua.ko 2023-06-09T04:26:54.951 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 29129 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-roccat-pyra.ko 2023-06-09T04:26:54.952 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 27713 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-roccat-ryos.ko 2023-06-09T04:26:54.952 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 19297 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-roccat-savu.ko 2023-06-09T04:26:54.952 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 22761 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-roccat.ko 2023-06-09T04:26:54.952 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13577 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-saitek.ko 2023-06-09T04:26:54.952 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 15025 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-samsung.ko 2023-06-09T04:26:54.952 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 35521 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-sensor-hub.ko 2023-06-09T04:26:54.952 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13497 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-sjoy.ko 2023-06-09T04:26:54.952 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 51025 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-sony.ko 2023-06-09T04:26:54.953 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 8137 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-speedlink.ko 2023-06-09T04:26:54.953 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 14769 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-steelseries.ko 2023-06-09T04:26:54.953 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 9713 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-sunplus.ko 2023-06-09T04:26:54.953 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 16809 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-thrustmaster.ko 2023-06-09T04:26:54.953 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 10425 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-tivo.ko 2023-06-09T04:26:54.953 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 14913 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-tmff.ko 2023-06-09T04:26:54.953 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 14217 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-topseed.ko 2023-06-09T04:26:54.954 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 16297 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-twinhan.ko 2023-06-09T04:26:54.954 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 71337 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-uclogic.ko 2023-06-09T04:26:54.954 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 10753 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-waltop.ko 2023-06-09T04:26:54.954 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 143417 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-wiimote.ko 2023-06-09T04:26:54.954 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 8041 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-xinmo.ko 2023-06-09T04:26:54.954 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13145 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-zpff.ko 2023-06-09T04:26:54.954 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 16553 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-zydacron.ko 2023-06-09T04:26:54.954 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 261777 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid.ko 2023-06-09T04:26:54.955 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 32209 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/uhid.ko 2023-06-09T04:26:54.955 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/usbhid/ 2023-06-09T04:26:54.955 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 125241 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/usbhid/usbhid.ko 2023-06-09T04:26:54.955 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 19025 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/usbhid/usbkbd.ko 2023-06-09T04:26:54.955 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 14849 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/usbhid/usbmouse.ko 2023-06-09T04:26:54.955 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 216833 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/wacom.ko 2023-06-09T04:26:54.955 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hv/ 2023-06-09T04:26:54.955 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 63153 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hv/hv_balloon.ko 2023-06-09T04:26:54.956 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 89497 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hv/hv_utils.ko 2023-06-09T04:26:54.956 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 292521 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hv/hv_vmbus.ko 2023-06-09T04:26:54.956 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/ 2023-06-09T04:26:54.956 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 66489 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/abituguru.ko 2023-06-09T04:26:54.956 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 61289 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/abituguru3.ko 2023-06-09T04:26:54.956 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 34625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/acpi_power_meter.ko 2023-06-09T04:26:54.956 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 17385 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/ad7414.ko 2023-06-09T04:26:54.957 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 19137 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/ad7418.ko 2023-06-09T04:26:54.957 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 25089 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/adc128d818.ko 2023-06-09T04:26:54.957 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 31617 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/adm1025.ko 2023-06-09T04:26:54.957 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 97857 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/adm1026.ko 2023-06-09T04:26:54.957 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 19633 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/adm1029.ko 2023-06-09T04:26:54.957 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 45377 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/adm1031.ko 2023-06-09T04:26:54.957 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 26177 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/adm9240.ko 2023-06-09T04:26:54.957 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 14657 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/ads7828.ko 2023-06-09T04:26:54.958 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 10657 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/adt7410.ko 2023-06-09T04:26:54.958 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 21937 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/adt7411.ko 2023-06-09T04:26:54.958 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 74329 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/adt7462.ko 2023-06-09T04:26:54.958 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 39409 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/adt7470.ko 2023-06-09T04:26:54.958 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 65145 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/adt7475.ko 2023-06-09T04:26:54.958 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 19145 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/adt7x10.ko 2023-06-09T04:26:54.958 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 38953 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/amc6821.ko 2023-06-09T04:26:54.958 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 55025 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/applesmc.ko 2023-06-09T04:26:54.959 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 49737 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/asb100.ko 2023-06-09T04:26:54.959 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 58433 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/asc7621.ko 2023-06-09T04:26:54.959 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 40697 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/asus_atk0110.ko 2023-06-09T04:26:54.959 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 17105 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/atxp1.ko 2023-06-09T04:26:54.959 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 28177 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/coretemp.ko 2023-06-09T04:26:54.959 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 24489 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/da9052-hwmon.ko 2023-06-09T04:26:54.959 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 17081 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/da9055-hwmon.ko 2023-06-09T04:26:54.959 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 44297 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-06-09T04:26:54.960 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 99481 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/dme1737.ko 2023-06-09T04:26:54.960 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 19369 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/ds1621.ko 2023-06-09T04:26:54.960 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 15153 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/ds620.ko 2023-06-09T04:26:54.960 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 29593 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/emc1403.ko 2023-06-09T04:26:54.960 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 33001 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/emc2103.ko 2023-06-09T04:26:54.960 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 30209 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/emc6w201.ko 2023-06-09T04:26:54.960 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 66801 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/f71805f.ko 2023-06-09T04:26:54.961 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 94473 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/f71882fg.ko 2023-06-09T04:26:54.961 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 41289 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/f75375s.ko 2023-06-09T04:26:54.961 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 21201 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/fam15h_power.ko 2023-06-09T04:26:54.961 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 55249 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/fschmd.ko 2023-06-09T04:26:54.961 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 14313 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/g760a.ko 2023-06-09T04:26:54.961 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 23913 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/g762.ko 2023-06-09T04:26:54.961 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 46689 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/gl518sm.ko 2023-06-09T04:26:54.961 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 45345 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/gl520sm.ko 2023-06-09T04:26:54.962 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13097 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/hih6130.ko 2023-06-09T04:26:54.962 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 9265 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/hwmon-vid.ko 2023-06-09T04:26:54.962 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 11377 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/i5500_temp.ko 2023-06-09T04:26:54.962 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 22417 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/i5k_amb.ko 2023-06-09T04:26:54.962 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 34393 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/ibmaem.ko 2023-06-09T04:26:54.962 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 21121 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/ibmpex.ko 2023-06-09T04:26:54.962 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 24761 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/ina209.ko 2023-06-09T04:26:54.962 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13225 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/ina2xx.ko 2023-06-09T04:26:54.963 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 128913 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/it87.ko 2023-06-09T04:26:54.963 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 18729 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/jc42.ko 2023-06-09T04:26:54.963 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 23833 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/k10temp.ko 2023-06-09T04:26:54.963 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13441 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/k8temp.ko 2023-06-09T04:26:54.963 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 18817 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/lineage-pem.ko 2023-06-09T04:26:54.963 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 48417 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/lm63.ko 2023-06-09T04:26:54.963 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 16585 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/lm73.ko 2023-06-09T04:26:54.964 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 36593 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/lm75.ko 2023-06-09T04:26:54.964 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 19369 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/lm77.ko 2023-06-09T04:26:54.964 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 34473 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/lm78.ko 2023-06-09T04:26:54.964 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 31625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/lm80.ko 2023-06-09T04:26:54.964 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 16713 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/lm83.ko 2023-06-09T04:26:54.964 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 72657 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/lm85.ko 2023-06-09T04:26:54.964 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 45977 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/lm87.ko 2023-06-09T04:26:54.964 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 37729 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/lm90.ko 2023-06-09T04:26:54.965 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 19633 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/lm92.ko 2023-06-09T04:26:54.965 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 108721 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/lm93.ko 2023-06-09T04:26:54.965 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 33281 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/lm95234.ko 2023-06-09T04:26:54.965 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 16089 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/lm95241.ko 2023-06-09T04:26:54.965 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 17993 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/lm95245.ko 2023-06-09T04:26:54.965 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 23841 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/ltc2945.ko 2023-06-09T04:26:54.965 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13689 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/ltc4151.ko 2023-06-09T04:26:54.965 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 15081 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/ltc4215.ko 2023-06-09T04:26:54.966 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 14769 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/ltc4222.ko 2023-06-09T04:26:54.966 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 14657 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/ltc4245.ko 2023-06-09T04:26:54.966 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13129 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/ltc4260.ko 2023-06-09T04:26:54.966 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 14817 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/ltc4261.ko 2023-06-09T04:26:54.966 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 33377 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/max16065.ko 2023-06-09T04:26:54.966 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 18249 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/max1619.ko 2023-06-09T04:26:54.966 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 24233 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/max1668.ko 2023-06-09T04:26:54.966 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 19865 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/max197.ko 2023-06-09T04:26:54.967 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 26505 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/max6639.ko 2023-06-09T04:26:54.967 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 23201 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/max6650.ko 2023-06-09T04:26:54.967 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 35593 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/max6697.ko 2023-06-09T04:26:54.967 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 18465 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/mc13783-adc.ko 2023-06-09T04:26:54.967 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 10473 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/mcp3021.ko 2023-06-09T04:26:54.967 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 15753 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2023-06-09T04:26:54.967 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 43977 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/nct6683.ko 2023-06-09T04:26:54.967 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 114577 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/nct6775-core.ko 2023-06-09T04:26:54.968 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 60033 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/nct6775.ko 2023-06-09T04:26:54.968 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 59553 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/nct7802.ko 2023-06-09T04:26:54.968 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 82169 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/pc87360.ko 2023-06-09T04:26:54.968 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 54321 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/pc87427.ko 2023-06-09T04:26:54.968 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 18353 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/pcf8591.ko 2023-06-09T04:26:54.968 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/pmbus/ 2023-06-09T04:26:54.968 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 20809 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-06-09T04:26:54.968 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 16889 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-06-09T04:26:54.969 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 28153 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-06-09T04:26:54.969 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 9401 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/pmbus/max16064.ko 2023-06-09T04:26:54.969 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 17553 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/pmbus/max34440.ko 2023-06-09T04:26:54.969 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 10001 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/pmbus/max8688.ko 2023-06-09T04:26:54.969 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 15401 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-06-09T04:26:54.969 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 79353 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-06-09T04:26:54.969 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 8561 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-06-09T04:26:54.970 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 30617 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-06-09T04:26:54.970 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 14897 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-06-09T04:26:54.970 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 20569 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-06-09T04:26:54.970 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 12913 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/powr1220.ko 2023-06-09T04:26:54.970 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 18521 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/sch5627.ko 2023-06-09T04:26:54.970 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 28633 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/sch5636.ko 2023-06-09T04:26:54.970 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 26369 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/sch56xx-common.ko 2023-06-09T04:26:54.970 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 32017 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/sht15.ko 2023-06-09T04:26:54.971 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13385 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/sht21.ko 2023-06-09T04:26:54.971 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 16657 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/shtc1.ko 2023-06-09T04:26:54.971 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 39937 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/sis5595.ko 2023-06-09T04:26:54.971 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 31817 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/smm665.ko 2023-06-09T04:26:54.971 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 19401 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/smsc47b397.ko 2023-06-09T04:26:54.971 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 39017 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/smsc47m1.ko 2023-06-09T04:26:54.971 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 37273 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/smsc47m192.ko 2023-06-09T04:26:54.971 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 26441 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/thmc50.ko 2023-06-09T04:26:54.972 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 16881 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/tmp102.ko 2023-06-09T04:26:54.972 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13985 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/tmp103.ko 2023-06-09T04:26:54.972 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 21137 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/tmp401.ko 2023-06-09T04:26:54.972 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 19361 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/tmp421.ko 2023-06-09T04:26:54.972 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 19585 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/via-cputemp.ko 2023-06-09T04:26:54.972 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 41833 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/via686a.ko 2023-06-09T04:26:54.972 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 52337 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/vt1211.ko 2023-06-09T04:26:54.972 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 51441 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/vt8231.ko 2023-06-09T04:26:54.973 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 57345 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/w83627ehf.ko 2023-06-09T04:26:54.973 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 78761 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/w83627hf.ko 2023-06-09T04:26:54.973 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 71169 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/w83781d.ko 2023-06-09T04:26:54.973 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 63113 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/w83791d.ko 2023-06-09T04:26:54.973 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 71145 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/w83792d.ko 2023-06-09T04:26:54.973 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 101273 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/w83793.ko 2023-06-09T04:26:54.973 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 119329 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/w83795.ko 2023-06-09T04:26:54.974 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 17145 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/w83l785ts.ko 2023-06-09T04:26:54.974 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 35505 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/w83l786ng.ko 2023-06-09T04:26:54.974 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13713 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/wm831x-hwmon.ko 2023-06-09T04:26:54.974 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 10521 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/wm8350-hwmon.ko 2023-06-09T04:26:54.974 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/ 2023-06-09T04:26:54.974 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/algos/ 2023-06-09T04:26:54.974 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 19481 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-06-09T04:26:54.974 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 18849 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-06-09T04:26:54.975 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/ 2023-06-09T04:26:54.975 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 27849 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-ali1535.ko 2023-06-09T04:26:54.975 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 28625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-ali1563.ko 2023-06-09T04:26:54.975 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 27601 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2023-06-09T04:26:54.975 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 17825 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-06-09T04:26:54.975 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 25857 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-06-09T04:26:54.975 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 16017 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-06-09T04:26:54.975 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 15041 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2023-06-09T04:26:54.976 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 6521 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-06-09T04:26:54.976 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13785 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2023-06-09T04:26:54.976 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 46345 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-06-09T04:26:54.976 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 23513 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-06-09T04:26:54.976 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 19417 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-06-09T04:26:54.976 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 17161 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-06-09T04:26:54.976 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 12209 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-dln2.ko 2023-06-09T04:26:54.976 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 17473 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-gpio.ko 2023-06-09T04:26:54.977 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 62337 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-i801.ko 2023-06-09T04:26:54.977 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 22321 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-isch.ko 2023-06-09T04:26:54.977 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 47785 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-06-09T04:26:54.977 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 17185 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-kempld.ko 2023-06-09T04:26:54.977 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 17769 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-06-09T04:26:54.977 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 21937 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-06-09T04:26:54.977 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 26313 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-ocores.ko 2023-06-09T04:26:54.977 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 24945 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-parport.ko 2023-06-09T04:26:54.978 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 16393 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-06-09T04:26:54.978 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 47137 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-06-09T04:26:54.978 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 15113 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2023-06-09T04:26:54.978 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 18537 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-06-09T04:26:54.978 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 11705 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-06-09T04:26:54.978 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 22193 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-sis5595.ko 2023-06-09T04:26:54.978 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 29185 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-sis630.ko 2023-06-09T04:26:54.978 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 20217 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-06-09T04:26:54.979 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 19057 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2023-06-09T04:26:54.979 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 19737 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-06-09T04:26:54.979 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13689 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-via.ko 2023-06-09T04:26:54.979 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 25969 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-06-09T04:26:54.979 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 18929 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-06-09T04:26:54.979 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 48201 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-xiic.ko 2023-06-09T04:26:54.979 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 21729 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/i2c-mux.ko 2023-06-09T04:26:54.980 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 18337 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/i2c-smbus.ko 2023-06-09T04:26:54.980 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 26945 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/i2c-stub.ko 2023-06-09T04:26:54.980 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/muxes/ 2023-06-09T04:26:54.980 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 14681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2023-06-09T04:26:54.980 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13289 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2023-06-09T04:26:54.980 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 26745 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2023-06-09T04:26:54.980 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/ 2023-06-09T04:26:54.981 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/core/ 2023-06-09T04:26:54.981 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 264409 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/core/ib_cm.ko 2023-06-09T04:26:54.981 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 849113 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/core/ib_core.ko 2023-06-09T04:26:54.981 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 68489 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/core/ib_umad.ko 2023-06-09T04:26:54.981 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 320185 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-06-09T04:26:54.981 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 96801 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/core/iw_cm.ko 2023-06-09T04:26:54.981 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 272097 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/core/rdma_cm.ko 2023-06-09T04:26:54.981 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 66073 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-06-09T04:26:54.982 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/hw/ 2023-06-09T04:26:54.982 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/hw/cxgb4/ 2023-06-09T04:26:54.982 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 492377 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-06-09T04:26:54.982 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/hw/mlx4/ 2023-06-09T04:26:54.982 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 419097 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-06-09T04:26:54.982 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/hw/mlx5/ 2023-06-09T04:26:54.982 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 733385 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-06-09T04:26:54.982 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/hw/mthca/ 2023-06-09T04:26:54.983 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 296481 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-06-09T04:26:54.983 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/hw/ocrdma/ 2023-06-09T04:26:54.983 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 153561 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2023-06-09T04:26:54.983 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/hw/usnic/ 2023-06-09T04:26:54.983 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 168905 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2023-06-09T04:26:54.983 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/ulp/ 2023-06-09T04:26:54.983 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/ulp/ipoib/ 2023-06-09T04:26:54.983 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 263057 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-06-09T04:26:54.984 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/ulp/iser/ 2023-06-09T04:26:54.984 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 100041 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-06-09T04:26:54.984 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/ulp/isert/ 2023-06-09T04:26:54.984 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 111049 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-06-09T04:26:54.984 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/ulp/srp/ 2023-06-09T04:26:54.984 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 128961 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-06-09T04:26:54.984 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/ulp/srpt/ 2023-06-09T04:26:54.985 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 129385 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-06-09T04:26:54.985 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/ 2023-06-09T04:26:54.985 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 10577 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/evbug.ko 2023-06-09T04:26:54.985 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 23777 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/ff-memless.ko 2023-06-09T04:26:54.985 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/gameport/ 2023-06-09T04:26:54.985 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 11777 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-06-09T04:26:54.985 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 11977 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/gameport/fm801-gp.ko 2023-06-09T04:26:54.985 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 39505 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/gameport/gameport.ko 2023-06-09T04:26:54.986 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 12385 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/gameport/lightning.ko 2023-06-09T04:26:54.986 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 17353 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/gameport/ns558.ko 2023-06-09T04:26:54.986 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 41713 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/joydev.ko 2023-06-09T04:26:54.986 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/keyboard/ 2023-06-09T04:26:54.986 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13209 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/keyboard/adp5520-keys.ko 2023-06-09T04:26:54.986 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 30257 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/keyboard/adp5588-keys.ko 2023-06-09T04:26:54.986 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 26729 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/keyboard/adp5589-keys.ko 2023-06-09T04:26:54.986 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 24577 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2023-06-09T04:26:54.987 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 36545 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/keyboard/gpio_keys.ko 2023-06-09T04:26:54.987 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 18097 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2023-06-09T04:26:54.987 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 21145 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/keyboard/lkkbd.ko 2023-06-09T04:26:54.987 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 27937 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/keyboard/lm8323.ko 2023-06-09T04:26:54.987 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 15001 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/keyboard/lm8333.ko 2023-06-09T04:26:54.987 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 24145 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/keyboard/matrix_keypad.ko 2023-06-09T04:26:54.987 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 18033 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/keyboard/max7359_keypad.ko 2023-06-09T04:26:54.987 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 15785 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/keyboard/mcs_touchkey.ko 2023-06-09T04:26:54.988 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 16305 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2023-06-09T04:26:54.988 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 11473 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/keyboard/newtonkbd.ko 2023-06-09T04:26:54.988 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 10897 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/keyboard/opencores-kbd.ko 2023-06-09T04:26:54.988 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 15025 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/keyboard/qt1070.ko 2023-06-09T04:26:54.988 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 20953 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/keyboard/qt2160.ko 2023-06-09T04:26:54.988 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 23633 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/keyboard/samsung-keypad.ko 2023-06-09T04:26:54.988 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 11377 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/keyboard/stowaway.ko 2023-06-09T04:26:54.989 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 18177 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/keyboard/sunkbd.ko 2023-06-09T04:26:54.989 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 20553 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/keyboard/tca6416-keypad.ko 2023-06-09T04:26:54.989 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 16009 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/keyboard/tca8418_keypad.ko 2023-06-09T04:26:54.989 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 16617 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/keyboard/twl4030_keypad.ko 2023-06-09T04:26:54.989 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 11577 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/keyboard/xtkbd.ko 2023-06-09T04:26:54.989 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 10961 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/matrix-keymap.ko 2023-06-09T04:26:54.989 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/mouse/ 2023-06-09T04:26:54.989 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 34209 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/mouse/appletouch.ko 2023-06-09T04:26:54.990 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 34001 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/mouse/bcm5974.ko 2023-06-09T04:26:54.990 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 123497 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/mouse/cyapatp.ko 2023-06-09T04:26:54.990 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 89345 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/mouse/elan_i2c.ko 2023-06-09T04:26:55.022 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13849 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/mouse/gpio_mouse.ko 2023-06-09T04:26:55.022 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 334393 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/mouse/psmouse.ko 2023-06-09T04:26:55.022 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 14497 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/mouse/sermouse.ko 2023-06-09T04:26:55.022 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 23697 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-06-09T04:26:55.023 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 22465 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/mouse/synaptics_usb.ko 2023-06-09T04:26:55.023 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 15489 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/mouse/vsxxxaa.ko 2023-06-09T04:26:55.023 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/rmi4/ 2023-06-09T04:26:55.023 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 108097 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/rmi4/rmi_core.ko 2023-06-09T04:26:55.023 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/serio/ 2023-06-09T04:26:55.023 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 11553 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/serio/altera_ps2.ko 2023-06-09T04:26:55.023 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 16113 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/serio/arc_ps2.ko 2023-06-09T04:26:55.024 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 16257 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/serio/ct82c710.ko 2023-06-09T04:26:55.024 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 16785 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-06-09T04:26:55.024 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 15721 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/serio/parkbd.ko 2023-06-09T04:26:55.024 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13105 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/serio/pcips2.ko 2023-06-09T04:26:55.024 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 19985 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/serio/ps2mult.ko 2023-06-09T04:26:55.024 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 24017 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/serio/serio_raw.ko 2023-06-09T04:26:55.024 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 17809 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/serio/serport.ko 2023-06-09T04:26:55.024 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 12553 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/sparse-keymap.ko 2023-06-09T04:26:55.025 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/iommu/ 2023-06-09T04:26:55.025 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/iommu/amd/ 2023-06-09T04:26:55.025 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 38001 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/iommu/amd/iommu_v2.ko 2023-06-09T04:26:55.025 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/ 2023-06-09T04:26:55.025 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13641 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/leds-88pm860x.ko 2023-06-09T04:26:55.025 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 11209 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/leds-adp5520.ko 2023-06-09T04:26:55.025 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 59569 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/leds-bd2802.ko 2023-06-09T04:26:55.026 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 24673 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/leds-blinkm.ko 2023-06-09T04:26:55.026 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 10369 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/leds-da903x.ko 2023-06-09T04:26:55.026 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 12137 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/leds-da9052.ko 2023-06-09T04:26:55.026 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 15481 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/leds-gpio.ko 2023-06-09T04:26:55.026 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 15681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/leds-lm3530.ko 2023-06-09T04:26:55.026 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 30385 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/leds-lm3533.ko 2023-06-09T04:26:55.026 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 19169 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/leds-lm355x.ko 2023-06-09T04:26:55.026 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 19841 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/leds-lm3642.ko 2023-06-09T04:26:55.027 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 16137 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/leds-lp3944.ko 2023-06-09T04:26:55.027 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 11129 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/leds-lp8788.ko 2023-06-09T04:26:55.027 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 14817 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/leds-max8997.ko 2023-06-09T04:26:55.027 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 12393 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/leds-mc13783.ko 2023-06-09T04:26:55.027 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13025 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/leds-menf21bmc.ko 2023-06-09T04:26:55.027 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 20609 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/leds-pca9532.ko 2023-06-09T04:26:55.027 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 20305 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/leds-pca955x.ko 2023-06-09T04:26:55.027 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 17681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/leds-pca963x.ko 2023-06-09T04:26:55.028 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 33673 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/leds-ss4200.ko 2023-06-09T04:26:55.028 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 24689 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/leds-tca6507.ko 2023-06-09T04:26:55.028 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 15489 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/leds-wm831x-status.ko 2023-06-09T04:26:55.028 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 11729 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/leds-wm8350.ko 2023-06-09T04:26:55.028 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/trigger/ 2023-06-09T04:26:55.028 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 9497 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-06-09T04:26:55.028 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 10697 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-06-09T04:26:55.029 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 8593 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-06-09T04:26:55.029 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 7441 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-06-09T04:26:55.029 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 14145 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-06-09T04:26:55.029 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13897 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-06-09T04:26:55.029 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 11705 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-06-09T04:26:55.029 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13905 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-06-09T04:26:55.029 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/ 2023-06-09T04:26:55.029 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/bcache/ 2023-06-09T04:26:55.030 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 631713 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/bcache/bcache.ko 2023-06-09T04:26:55.030 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 37553 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-bio-prison.ko 2023-06-09T04:26:55.030 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 86033 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-bufio.ko 2023-06-09T04:26:55.030 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 47353 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-cache-smq.ko 2023-06-09T04:26:55.030 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 154097 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-cache.ko 2023-06-09T04:26:55.030 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 105553 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-crypt.ko 2023-06-09T04:26:55.030 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 21417 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-delay.ko 2023-06-09T04:26:55.030 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 53697 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-era.ko 2023-06-09T04:26:55.031 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 20825 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-flakey.ko 2023-06-09T04:26:55.031 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 41425 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-log-userspace.ko 2023-06-09T04:26:55.031 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 32041 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-log.ko 2023-06-09T04:26:55.031 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 49377 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-mirror.ko 2023-06-09T04:26:55.031 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 77505 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-multipath.ko 2023-06-09T04:26:55.031 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 16345 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-queue-length.ko 2023-06-09T04:26:55.031 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 70657 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-raid.ko 2023-06-09T04:26:55.032 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 33881 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-region-hash.ko 2023-06-09T04:26:55.032 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 15681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-round-robin.ko 2023-06-09T04:26:55.032 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 16609 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-service-time.ko 2023-06-09T04:26:55.032 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 108801 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-snapshot.ko 2023-06-09T04:26:55.032 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 19249 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-switch.ko 2023-06-09T04:26:55.032 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 182017 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-thin-pool.ko 2023-06-09T04:26:55.032 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 51625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-verity.ko 2023-06-09T04:26:55.032 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 8273 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-zero.ko 2023-06-09T04:26:55.033 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 14921 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/faulty.ko 2023-06-09T04:26:55.033 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 19313 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/linear.ko 2023-06-09T04:26:55.033 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 32121 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/multipath.ko 2023-06-09T04:26:55.033 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/persistent-data/ 2023-06-09T04:26:55.033 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 192737 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-06-09T04:26:55.033 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 37025 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/raid0.ko 2023-06-09T04:26:55.033 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 111361 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/raid1.ko 2023-06-09T04:26:55.033 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 157873 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/raid10.ko 2023-06-09T04:26:55.034 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 392777 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/raid456.ko 2023-06-09T04:26:55.034 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/message/ 2023-06-09T04:26:55.034 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/message/fusion/ 2023-06-09T04:26:55.034 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 174329 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/message/fusion/mptbase.ko 2023-06-09T04:26:55.034 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 63273 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/message/fusion/mptctl.ko 2023-06-09T04:26:55.034 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 44465 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/message/fusion/mptfc.ko 2023-06-09T04:26:55.034 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 37049 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/message/fusion/mptlan.ko 2023-06-09T04:26:55.034 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 123185 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/message/fusion/mptsas.ko 2023-06-09T04:26:55.035 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 76009 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/message/fusion/mptscsih.ko 2023-06-09T04:26:55.035 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 52905 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/message/fusion/mptspi.ko 2023-06-09T04:26:55.035 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/ 2023-06-09T04:26:55.035 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 17193 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/88pm800.ko 2023-06-09T04:26:55.035 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 12649 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/88pm805.ko 2023-06-09T04:26:55.035 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 10489 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/88pm80x.ko 2023-06-09T04:26:55.035 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 11761 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/arizona-i2c.ko 2023-06-09T04:26:55.036 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 121721 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/arizona.ko 2023-06-09T04:26:55.036 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 11849 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/bcm590xx.ko 2023-06-09T04:26:55.036 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 17281 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/cros_ec_dev.ko 2023-06-09T04:26:55.036 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 34417 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/dln2.ko 2023-06-09T04:26:55.036 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 16577 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/janz-cmodio.ko 2023-06-09T04:26:55.036 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 52497 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/kempld-core.ko 2023-06-09T04:26:55.036 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 27041 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/lm3533-core.ko 2023-06-09T04:26:55.036 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13969 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/lm3533-ctrlbank.ko 2023-06-09T04:26:55.037 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 12433 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/lp3943.ko 2023-06-09T04:26:55.037 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 54449 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/lpc_ich.ko 2023-06-09T04:26:55.037 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 12001 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/lpc_sch.ko 2023-06-09T04:26:55.037 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 17353 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/max8907.ko 2023-06-09T04:26:55.037 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 27865 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/mc13xxx-core.ko 2023-06-09T04:26:55.037 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 11689 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/mc13xxx-i2c.ko 2023-06-09T04:26:55.037 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 11489 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/menf21bmc.ko 2023-06-09T04:26:55.037 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 16897 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/pcf50633-adc.ko 2023-06-09T04:26:55.038 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 8329 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/pcf50633-gpio.ko 2023-06-09T04:26:55.038 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 33417 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/pcf50633.ko 2023-06-09T04:26:55.038 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 9937 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/rdc321x-southbridge.ko 2023-06-09T04:26:55.038 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 19881 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/retu-mfd.ko 2023-06-09T04:26:55.038 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 76433 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/si476x-core.ko 2023-06-09T04:26:55.038 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 47649 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/sm501.ko 2023-06-09T04:26:55.038 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 19161 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/ti_am335x_tscadc.ko 2023-06-09T04:26:55.038 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 50505 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/tps65010.ko 2023-06-09T04:26:55.039 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 10249 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/tps6507x.ko 2023-06-09T04:26:55.039 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13217 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/viperboard.ko 2023-06-09T04:26:55.039 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 10417 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/vx855.ko 2023-06-09T04:26:55.039 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 17785 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/wl1273-core.ko 2023-06-09T04:26:55.039 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 43521 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/wm8994.ko 2023-06-09T04:26:55.039 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/ 2023-06-09T04:26:55.039 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13721 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/ad525x_dpot-i2c.ko 2023-06-09T04:26:55.040 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 48009 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/ad525x_dpot.ko 2023-06-09T04:26:55.040 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/altera-stapl/ 2023-06-09T04:26:55.040 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 46185 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-06-09T04:26:55.040 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 18217 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/apds9802als.ko 2023-06-09T04:26:55.040 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 36625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/apds990x.ko 2023-06-09T04:26:55.040 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 45473 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/bh1770glc.ko 2023-06-09T04:26:55.040 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/c2port/ 2023-06-09T04:26:55.040 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 10969 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2023-06-09T04:26:55.041 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 34801 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/c2port/core.ko 2023-06-09T04:26:55.041 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/cb710/ 2023-06-09T04:26:55.041 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 24465 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/cb710/cb710.ko 2023-06-09T04:26:55.041 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 17617 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/ds1682.ko 2023-06-09T04:26:55.041 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 8777 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/dummy-irq.ko 2023-06-09T04:26:55.041 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/echo/ 2023-06-09T04:26:55.041 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 12729 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/echo/echo.ko 2023-06-09T04:26:55.041 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/eeprom/ 2023-06-09T04:26:55.042 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 37521 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/eeprom/at24.ko 2023-06-09T04:26:55.042 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 14145 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/eeprom/eeprom.ko 2023-06-09T04:26:55.042 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13881 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-06-09T04:26:55.042 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13433 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/eeprom/max6875.ko 2023-06-09T04:26:55.042 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 31913 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/enclosure.ko 2023-06-09T04:26:55.042 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/genwqe/ 2023-06-09T04:26:55.042 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 151953 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/genwqe/genwqe_card.ko 2023-06-09T04:26:55.043 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 14017 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/hmc6352.ko 2023-06-09T04:26:55.043 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 31009 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/hpilo.ko 2023-06-09T04:26:55.043 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/ibmasm/ 2023-06-09T04:26:55.043 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 72497 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/ibmasm/ibmasm.ko 2023-06-09T04:26:55.043 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 19673 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/ics932s401.ko 2023-06-09T04:26:55.043 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 21569 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/isl29003.ko 2023-06-09T04:26:55.043 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 15569 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/isl29020.ko 2023-06-09T04:26:55.043 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/lis3lv02d/ 2023-06-09T04:26:55.044 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 41465 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-06-09T04:26:55.044 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13745 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-06-09T04:26:55.044 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/mei/ 2023-06-09T04:26:55.044 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 124401 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/mei/mei-me.ko 2023-06-09T04:26:55.044 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 56337 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/mei/mei-txe.ko 2023-06-09T04:26:55.044 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 304353 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/mei/mei.ko 2023-06-09T04:26:55.044 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 31161 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/phantom.ko 2023-06-09T04:26:55.044 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/ti-st/ 2023-06-09T04:26:55.045 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 74433 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/ti-st/st_drv.ko 2023-06-09T04:26:55.045 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 24193 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/tifm_7xx1.ko 2023-06-09T04:26:55.045 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 27305 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/tifm_core.ko 2023-06-09T04:26:55.045 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 18617 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/tsl2550.ko 2023-06-09T04:26:55.045 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 48569 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/vmw_balloon.ko 2023-06-09T04:26:55.045 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/vmw_vmci/ 2023-06-09T04:26:55.045 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 180697 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-06-09T04:26:55.046 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ 2023-06-09T04:26:55.046 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/bonding/ 2023-06-09T04:26:55.046 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 487817 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/bonding/bonding.ko 2023-06-09T04:26:55.046 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/dsa/ 2023-06-09T04:26:55.046 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/dsa/b53/ 2023-06-09T04:26:55.046 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 101961 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/dsa/b53/b53_common.ko 2023-06-09T04:26:55.046 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 40097 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/dsa/bcm-sf2.ko 2023-06-09T04:26:55.046 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 14513 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/dsa/mv88e6060.ko 2023-06-09T04:26:55.047 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/dsa/mv88e6xxx/ 2023-06-09T04:26:55.047 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 447113 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-06-09T04:26:55.047 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 16753 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/dummy.ko 2023-06-09T04:26:55.047 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 17769 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/eql.ko 2023-06-09T04:26:55.047 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/ 2023-06-09T04:26:55.047 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/3com/ 2023-06-09T04:26:55.047 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 45609 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-06-09T04:26:55.047 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 41905 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-06-09T04:26:55.048 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 130385 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-06-09T04:26:55.048 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 68681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-06-09T04:26:55.048 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/8390/ 2023-06-09T04:26:55.048 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 36345 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/8390/8390.ko 2023-06-09T04:26:55.048 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 59513 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-06-09T04:26:55.048 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 27017 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-06-09T04:26:55.048 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 98945 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-06-09T04:26:55.048 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/adaptec/ 2023-06-09T04:26:55.049 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 54353 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-06-09T04:26:55.049 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/agere/ 2023-06-09T04:26:55.049 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 69033 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/agere/et131x.ko 2023-06-09T04:26:55.049 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/alteon/ 2023-06-09T04:26:55.049 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 59401 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-06-09T04:26:55.049 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/altera/ 2023-06-09T04:26:55.049 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 40649 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-06-09T04:26:55.050 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/amd/ 2023-06-09T04:26:55.050 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 54441 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-06-09T04:26:55.050 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 49105 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-06-09T04:26:55.050 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 87177 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-06-09T04:26:55.050 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/atheros/ 2023-06-09T04:26:55.050 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/atheros/alx/ 2023-06-09T04:26:55.050 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 97217 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-06-09T04:26:55.050 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/atheros/atl1c/ 2023-06-09T04:26:55.051 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 104473 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-06-09T04:26:55.051 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/atheros/atl1e/ 2023-06-09T04:26:55.051 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 90073 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-06-09T04:26:55.051 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/atheros/atlx/ 2023-06-09T04:26:55.051 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 81329 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-06-09T04:26:55.051 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 69601 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-06-09T04:26:55.051 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/broadcom/ 2023-06-09T04:26:55.051 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 78233 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-06-09T04:26:55.052 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 176705 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-06-09T04:26:55.052 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2023-06-09T04:26:55.052 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 1422001 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-06-09T04:26:55.052 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 127881 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-06-09T04:26:55.052 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/broadcom/genet/ 2023-06-09T04:26:55.052 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 130785 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-06-09T04:26:55.052 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 311913 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-06-09T04:26:55.053 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/brocade/ 2023-06-09T04:26:55.053 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/brocade/bna/ 2023-06-09T04:26:55.053 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 323489 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-06-09T04:26:55.053 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/chelsio/ 2023-06-09T04:26:55.053 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/chelsio/cxgb/ 2023-06-09T04:26:55.053 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 193321 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-06-09T04:26:55.053 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2023-06-09T04:26:55.053 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 345761 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-06-09T04:26:55.054 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2023-06-09T04:26:55.054 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 1038865 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-06-09T04:26:55.054 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2023-06-09T04:26:55.054 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 166001 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-06-09T04:26:55.054 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2023-06-09T04:26:55.054 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 33681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-06-09T04:26:55.054 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/cisco/ 2023-06-09T04:26:55.054 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/cisco/enic/ 2023-06-09T04:26:55.055 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 203425 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-06-09T04:26:55.055 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/dec/ 2023-06-09T04:26:55.055 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/dec/tulip/ 2023-06-09T04:26:55.055 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 69281 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-06-09T04:26:55.055 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 61321 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-06-09T04:26:55.055 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 141049 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-06-09T04:26:55.055 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 51329 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-06-09T04:26:55.055 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 62689 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-06-09T04:26:55.056 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 31201 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-06-09T04:26:55.056 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/dlink/ 2023-06-09T04:26:55.056 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 60697 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-06-09T04:26:55.056 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 62721 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-06-09T04:26:55.056 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 45609 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/dnet.ko 2023-06-09T04:26:55.056 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 25057 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/ec_bhf.ko 2023-06-09T04:26:55.056 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/emulex/ 2023-06-09T04:26:55.057 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/emulex/benet/ 2023-06-09T04:26:55.057 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 280865 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-06-09T04:26:55.057 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 49321 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/ethoc.ko 2023-06-09T04:26:55.057 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 51625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/fealnx.ko 2023-06-09T04:26:55.057 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/fujitsu/ 2023-06-09T04:26:55.057 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 45161 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2023-06-09T04:26:55.057 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/intel/ 2023-06-09T04:26:55.058 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 90297 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/intel/e100.ko 2023-06-09T04:26:55.058 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/intel/e1000/ 2023-06-09T04:26:55.058 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 295609 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-06-09T04:26:55.058 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/intel/e1000e/ 2023-06-09T04:26:55.058 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 583881 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-06-09T04:26:55.058 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/intel/fm10k/ 2023-06-09T04:26:55.058 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 246201 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-06-09T04:26:55.058 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/intel/i40e/ 2023-06-09T04:26:55.059 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 922281 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-06-09T04:26:55.059 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/intel/iavf/ 2023-06-09T04:26:55.059 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 301665 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-06-09T04:26:55.059 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/intel/igb/ 2023-06-09T04:26:55.059 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 514281 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-06-09T04:26:55.059 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/intel/igbvf/ 2023-06-09T04:26:55.059 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 93481 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-06-09T04:26:55.059 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/intel/ixgbe/ 2023-06-09T04:26:55.060 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 733977 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-06-09T04:26:55.060 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/intel/ixgbevf/ 2023-06-09T04:26:55.060 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 151753 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-06-09T04:26:55.060 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 86737 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/jme.ko 2023-06-09T04:26:55.060 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/marvell/ 2023-06-09T04:26:55.060 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 20857 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-06-09T04:26:55.060 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 102273 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/marvell/skge.ko 2023-06-09T04:26:55.060 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 122577 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-06-09T04:26:55.061 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/mellanox/ 2023-06-09T04:26:55.061 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/mellanox/mlx4/ 2023-06-09T04:26:55.061 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 710297 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-06-09T04:26:55.061 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 280409 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-06-09T04:26:55.061 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/mellanox/mlx5/ 2023-06-09T04:26:55.061 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2023-06-09T04:26:55.061 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 1050633 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-06-09T04:26:55.062 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/micrel/ 2023-06-09T04:26:55.062 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 52929 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/micrel/ks8842.ko 2023-06-09T04:26:55.062 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 40345 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2023-06-09T04:26:55.062 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 19449 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2023-06-09T04:26:55.062 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 95497 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-06-09T04:26:55.062 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/myricom/ 2023-06-09T04:26:55.062 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/myricom/myri10ge/ 2023-06-09T04:26:55.062 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 108641 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-06-09T04:26:55.063 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/natsemi/ 2023-06-09T04:26:55.063 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 73273 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-06-09T04:26:55.063 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 47601 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-06-09T04:26:55.063 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/neterion/ 2023-06-09T04:26:55.063 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 150737 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-06-09T04:26:55.063 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/nvidia/ 2023-06-09T04:26:55.063 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 136609 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-06-09T04:26:55.063 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/packetengines/ 2023-06-09T04:26:55.064 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 50305 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-06-09T04:26:55.064 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 42977 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-06-09T04:26:55.064 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/qlogic/ 2023-06-09T04:26:55.064 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/qlogic/netxen/ 2023-06-09T04:26:55.064 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 226993 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-06-09T04:26:55.064 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 86913 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-06-09T04:26:55.064 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2023-06-09T04:26:55.065 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 671281 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-06-09T04:26:55.065 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/rdc/ 2023-06-09T04:26:55.065 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 42849 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-06-09T04:26:55.065 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/realtek/ 2023-06-09T04:26:55.065 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 67209 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-06-09T04:26:55.065 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 83809 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-06-09T04:26:55.065 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 29217 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/realtek/atp.ko 2023-06-09T04:26:55.065 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 189649 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-06-09T04:26:55.066 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/samsung/ 2023-06-09T04:26:55.066 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/samsung/sxgbe/ 2023-06-09T04:26:55.066 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 104065 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2023-06-09T04:26:55.066 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/sfc/ 2023-06-09T04:26:55.066 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 893521 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-06-09T04:26:55.066 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/silan/ 2023-06-09T04:26:55.066 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 47057 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-06-09T04:26:55.066 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/sis/ 2023-06-09T04:26:55.067 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 54633 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/sis/sis190.ko 2023-06-09T04:26:55.067 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 63169 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/sis/sis900.ko 2023-06-09T04:26:55.067 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/smsc/ 2023-06-09T04:26:55.067 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 61433 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-06-09T04:26:55.067 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 67009 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-06-09T04:26:55.067 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 73233 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-06-09T04:26:55.067 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 68105 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-06-09T04:26:55.068 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/stmicro/ 2023-06-09T04:26:55.068 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/stmicro/stmmac/ 2023-06-09T04:26:55.068 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13329 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2023-06-09T04:26:55.068 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 39961 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-06-09T04:26:55.068 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13777 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2023-06-09T04:26:55.068 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 480697 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-06-09T04:26:55.068 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/sun/ 2023-06-09T04:26:55.068 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 103273 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/sun/cassini.ko 2023-06-09T04:26:55.069 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 166001 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/sun/niu.ko 2023-06-09T04:26:55.069 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 66361 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/sun/sungem.ko 2023-06-09T04:26:55.069 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 78633 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-06-09T04:26:55.069 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/tehuti/ 2023-06-09T04:26:55.069 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 49873 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-06-09T04:26:55.069 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/ti/ 2023-06-09T04:26:55.069 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 86353 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/ti/tlan.ko 2023-06-09T04:26:55.069 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/via/ 2023-06-09T04:26:55.070 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 80153 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-06-09T04:26:55.070 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 83497 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-06-09T04:26:55.070 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/wiznet/ 2023-06-09T04:26:55.070 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 45609 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-06-09T04:26:55.070 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 30665 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-06-09T04:26:55.070 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/xircom/ 2023-06-09T04:26:55.070 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 59929 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-06-09T04:26:55.070 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/fddi/ 2023-06-09T04:26:55.071 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 40889 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/fddi/defxx.ko 2023-06-09T04:26:55.071 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/fddi/skfp/ 2023-06-09T04:26:55.071 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 216801 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/fddi/skfp/skfp.ko 2023-06-09T04:26:55.071 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 76993 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/geneve.ko 2023-06-09T04:26:55.071 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/hyperv/ 2023-06-09T04:26:55.071 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 234441 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-06-09T04:26:55.071 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ieee802154/ 2023-06-09T04:26:55.072 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 18137 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ieee802154/fakelb.ko 2023-06-09T04:26:55.072 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 24969 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ifb.ko 2023-06-09T04:26:55.072 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ipvlan/ 2023-06-09T04:26:55.072 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 82865 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ipvlan/ipvlan.ko 2023-06-09T04:26:55.072 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 61337 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/macvlan.ko 2023-06-09T04:26:55.072 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 15697 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/macvtap.ko 2023-06-09T04:26:55.072 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/mdio/ 2023-06-09T04:26:55.072 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 19697 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-06-09T04:26:55.073 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13313 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-06-09T04:26:55.073 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13577 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/mdio/mdio-gpio.ko 2023-06-09T04:26:55.073 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 15049 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/mdio.ko 2023-06-09T04:26:55.073 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 19225 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/mii.ko 2023-06-09T04:26:55.073 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 41585 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/netconsole.ko 2023-06-09T04:26:55.073 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 12969 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/nlmon.ko 2023-06-09T04:26:55.073 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/pcs/ 2023-06-09T04:26:55.073 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 9417 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/pcs/pcs-altera-tse.ko 2023-06-09T04:26:55.074 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 29601 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-06-09T04:26:55.074 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/ 2023-06-09T04:26:55.074 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 9561 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/amd.ko 2023-06-09T04:26:55.074 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 40329 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-06-09T04:26:55.074 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 43161 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/bcm7xxx.ko 2023-06-09T04:26:55.074 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 11353 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/bcm87xx.ko 2023-06-09T04:26:55.074 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 37921 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/broadcom.ko 2023-06-09T04:26:55.075 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 10457 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/cicada.ko 2023-06-09T04:26:55.075 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 12793 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/davicom.ko 2023-06-09T04:26:55.075 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 9273 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/et1011c.ko 2023-06-09T04:26:55.075 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 24729 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/icplus.ko 2023-06-09T04:26:55.075 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 15609 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/lxt.ko 2023-06-09T04:26:55.075 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 78001 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/marvell.ko 2023-06-09T04:26:55.075 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 75689 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/micrel.ko 2023-06-09T04:26:55.075 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 11929 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/national.ko 2023-06-09T04:26:55.076 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 92049 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/phylink.ko 2023-06-09T04:26:55.076 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 9889 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/qsemi.ko 2023-06-09T04:26:55.076 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 47505 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/realtek.ko 2023-06-09T04:26:55.076 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 24745 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/smsc.ko 2023-06-09T04:26:55.076 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 10689 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/ste10Xp.ko 2023-06-09T04:26:55.076 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 23865 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/vitesse.ko 2023-06-09T04:26:55.076 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/plip/ 2023-06-09T04:26:55.076 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 43353 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/plip/plip.ko 2023-06-09T04:26:55.077 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ppp/ 2023-06-09T04:26:55.077 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 15753 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ppp/bsd_comp.ko 2023-06-09T04:26:55.077 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 29745 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ppp/ppp_async.ko 2023-06-09T04:26:55.077 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 17489 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ppp/ppp_deflate.ko 2023-06-09T04:26:55.077 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 18513 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ppp/ppp_mppe.ko 2023-06-09T04:26:55.077 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 28769 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ppp/ppp_synctty.ko 2023-06-09T04:26:55.077 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 42425 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ppp/pppoe.ko 2023-06-09T04:26:55.077 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 12633 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ppp/pppox.ko 2023-06-09T04:26:55.078 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 31657 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ppp/pptp.ko 2023-06-09T04:26:55.078 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 28105 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/sb1000.ko 2023-06-09T04:26:55.078 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/slip/ 2023-06-09T04:26:55.078 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 42329 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/slip/slip.ko 2023-06-09T04:26:55.078 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 26529 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/sungem_phy.ko 2023-06-09T04:26:55.078 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 63785 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/tap.ko 2023-06-09T04:26:55.078 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/team/ 2023-06-09T04:26:55.079 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 104617 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/team/team.ko 2023-06-09T04:26:55.079 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13313 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/team/team_mode_activebackup.ko 2023-06-09T04:26:55.079 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 10041 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/team/team_mode_broadcast.ko 2023-06-09T04:26:55.079 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 28825 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-06-09T04:26:55.079 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 9537 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/team/team_mode_random.ko 2023-06-09T04:26:55.079 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 9145 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-06-09T04:26:55.079 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 89249 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/veth.ko 2023-06-09T04:26:55.079 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/vmxnet3/ 2023-06-09T04:26:55.080 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 120377 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-06-09T04:26:55.080 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/vxlan/ 2023-06-09T04:26:55.080 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 290049 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/vxlan/vxlan.ko 2023-06-09T04:26:55.080 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/xen-netback/ 2023-06-09T04:26:55.080 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 143697 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/xen-netback/xen-netback.ko 2023-06-09T04:26:55.080 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ntb/ 2023-06-09T04:26:55.080 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 19425 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ntb/ntb.ko 2023-06-09T04:26:55.080 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/nvme/ 2023-06-09T04:26:55.081 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/nvme/host/ 2023-06-09T04:26:55.081 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 255881 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/nvme/host/nvme-core.ko 2023-06-09T04:26:55.081 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 101449 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/nvme/host/nvme.ko 2023-06-09T04:26:55.081 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/parport/ 2023-06-09T04:26:55.081 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 129017 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/parport/parport.ko 2023-06-09T04:26:55.081 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 14441 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/parport/parport_cs.ko 2023-06-09T04:26:55.081 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 83833 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/parport/parport_pc.ko 2023-06-09T04:26:55.081 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 25945 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/parport/parport_serial.ko 2023-06-09T04:26:55.082 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pci/ 2023-06-09T04:26:55.082 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pci/hotplug/ 2023-06-09T04:26:55.082 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 24825 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-06-09T04:26:55.082 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 17681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2023-06-09T04:26:55.082 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 19953 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2023-06-09T04:26:55.082 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 11681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pci/pci-stub.ko 2023-06-09T04:26:55.082 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 47265 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pci/xen-pcifront.ko 2023-06-09T04:26:55.083 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pcmcia/ 2023-06-09T04:26:55.083 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 26625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pcmcia/i82092.ko 2023-06-09T04:26:55.083 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 143593 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pcmcia/pcmcia.ko 2023-06-09T04:26:55.083 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 60529 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pcmcia/pcmcia_core.ko 2023-06-09T04:26:55.083 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 33761 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2023-06-09T04:26:55.083 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 34081 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pcmcia/pd6729.ko 2023-06-09T04:26:55.083 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 112801 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pcmcia/yenta_socket.ko 2023-06-09T04:26:55.083 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/phy/ 2023-06-09T04:26:55.084 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/phy/broadcom/ 2023-06-09T04:26:55.084 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 10673 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2023-06-09T04:26:55.084 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/phy/samsung/ 2023-06-09T04:26:55.084 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 8273 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2023-06-09T04:26:55.084 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pinctrl/ 2023-06-09T04:26:55.084 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pinctrl/intel/ 2023-06-09T04:26:55.084 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 70889 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-06-09T04:26:55.084 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/ 2023-06-09T04:26:55.085 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/chrome/ 2023-06-09T04:26:55.085 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 49689 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2023-06-09T04:26:55.085 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 20057 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/chrome/cros_ec.ko 2023-06-09T04:26:55.085 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 21233 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2023-06-09T04:26:55.085 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 25241 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2023-06-09T04:26:55.085 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 26049 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2023-06-09T04:26:55.085 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 18089 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2023-06-09T04:26:55.086 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 16921 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2023-06-09T04:26:55.086 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/ 2023-06-09T04:26:55.086 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 66913 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/acer-wmi.ko 2023-06-09T04:26:55.086 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 39041 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/acerhdf.ko 2023-06-09T04:26:55.086 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 36849 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/apple-gmux.ko 2023-06-09T04:26:55.086 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 59545 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/asus-laptop.ko 2023-06-09T04:26:55.086 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 30529 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-06-09T04:26:55.086 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 106217 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/asus-wmi.ko 2023-06-09T04:26:55.087 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 36745 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/classmate-laptop.ko 2023-06-09T04:26:55.087 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 48945 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-06-09T04:26:55.087 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13841 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-06-09T04:26:55.087 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 40089 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-06-09T04:26:55.087 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 22417 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-06-09T04:26:55.087 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 36473 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/hdaps.ko 2023-06-09T04:26:55.087 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 19329 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/ibm_rtl.ko 2023-06-09T04:26:55.087 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/intel/ 2023-06-09T04:26:55.088 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 11905 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-06-09T04:26:55.088 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 8873 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2023-06-09T04:26:55.088 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 43169 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/intel_ips.ko 2023-06-09T04:26:55.088 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 20089 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/msi-wmi.ko 2023-06-09T04:26:55.088 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 9745 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/mxm-wmi.ko 2023-06-09T04:26:55.088 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 34617 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-06-09T04:26:55.088 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 42145 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/samsung-laptop.ko 2023-06-09T04:26:55.088 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13993 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/samsung-q10.ko 2023-06-09T04:26:55.089 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 17137 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/topstar-laptop.ko 2023-06-09T04:26:55.089 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13545 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-06-09T04:26:55.089 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 16897 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/toshiba_haps.ko 2023-06-09T04:26:55.089 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 10049 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/wmi-bmof.ko 2023-06-09T04:26:55.089 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 54713 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/wmi.ko 2023-06-09T04:26:55.089 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/ 2023-06-09T04:26:55.089 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/ 2023-06-09T04:26:55.089 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 30161 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/88pm860x_battery.ko 2023-06-09T04:26:55.090 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 33873 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/88pm860x_charger.ko 2023-06-09T04:26:55.090 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 54945 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/bq2415x_charger.ko 2023-06-09T04:26:55.090 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 53849 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/bq24190_charger.ko 2023-06-09T04:26:55.090 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 21385 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/bq24735-charger.ko 2023-06-09T04:26:55.090 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 16329 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/cros_peripheral_charger.ko 2023-06-09T04:26:55.090 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 19425 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/da9030_battery.ko 2023-06-09T04:26:55.090 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 19665 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/da9052-battery.ko 2023-06-09T04:26:55.091 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 29169 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/ds2760_battery.ko 2023-06-09T04:26:55.091 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 23097 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/ds2780_battery.ko 2023-06-09T04:26:55.091 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 23241 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/ds2781_battery.ko 2023-06-09T04:26:55.091 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 23537 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/ds2782_battery.ko 2023-06-09T04:26:55.091 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 20177 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/gpio-charger.ko 2023-06-09T04:26:55.091 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 17937 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/isp1704_charger.ko 2023-06-09T04:26:55.091 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 20097 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/lp8727_charger.ko 2023-06-09T04:26:55.091 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 12473 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/max14577_charger.ko 2023-06-09T04:26:55.092 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 25777 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/max17040_battery.ko 2023-06-09T04:26:55.092 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 30353 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/max17042_battery.ko 2023-06-09T04:26:55.092 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 18417 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/max8903_charger.ko 2023-06-09T04:26:55.092 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 23617 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/max8925_power.ko 2023-06-09T04:26:55.092 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 21057 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/pcf50633-charger.ko 2023-06-09T04:26:55.092 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 37825 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/sbs-battery.ko 2023-06-09T04:26:55.092 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 28209 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/test_power.ko 2023-06-09T04:26:55.092 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 18689 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/tps65090-charger.ko 2023-06-09T04:26:55.093 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 11865 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/wm831x_backup.ko 2023-06-09T04:26:55.093 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 24345 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/wm831x_power.ko 2023-06-09T04:26:55.093 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 22297 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/wm8350_power.ko 2023-06-09T04:26:55.093 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/powercap/ 2023-06-09T04:26:55.093 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 54041 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/powercap/intel_rapl_common.ko 2023-06-09T04:26:55.093 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 17193 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/powercap/intel_rapl_msr.ko 2023-06-09T04:26:55.093 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pps/ 2023-06-09T04:26:55.094 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pps/clients/ 2023-06-09T04:26:55.094 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 15353 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pps/clients/pps-gpio.ko 2023-06-09T04:26:55.094 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13081 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pps/clients/pps-ldisc.ko 2023-06-09T04:26:55.094 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 15745 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pps/clients/pps_parport.ko 2023-06-09T04:26:55.094 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 41273 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pps/pps_core.ko 2023-06-09T04:26:55.094 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ptp/ 2023-06-09T04:26:55.094 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 64505 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ptp/ptp.ko 2023-06-09T04:26:55.094 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 16345 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ptp/ptp_kvm.ko 2023-06-09T04:26:55.095 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/ 2023-06-09T04:26:55.095 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 23321 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-88pm80x.ko 2023-06-09T04:26:55.095 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 24409 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-88pm860x.ko 2023-06-09T04:26:55.095 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 15273 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-bq32k.ko 2023-06-09T04:26:55.095 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 12785 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-bq4802.ko 2023-06-09T04:26:55.095 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 19993 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-da9052.ko 2023-06-09T04:26:55.095 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 18393 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-da9055.ko 2023-06-09T04:26:55.095 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 20065 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-da9063.ko 2023-06-09T04:26:55.096 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 16337 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-ds1286.ko 2023-06-09T04:26:55.096 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 68401 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-ds1307.ko 2023-06-09T04:26:55.096 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 20705 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-ds1374.ko 2023-06-09T04:26:55.096 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 18041 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-ds1511.ko 2023-06-09T04:26:55.096 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 16561 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-ds1553.ko 2023-06-09T04:26:55.096 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13833 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-ds1672.ko 2023-06-09T04:26:55.096 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13265 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-ds1742.ko 2023-06-09T04:26:55.096 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 17129 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-ds2404.ko 2023-06-09T04:26:55.097 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 23529 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-ds3232.ko 2023-06-09T04:26:55.097 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 10913 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-em3027.ko 2023-06-09T04:26:55.097 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 24217 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-fm3130.ko 2023-06-09T04:26:55.097 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 17593 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-isl12022.ko 2023-06-09T04:26:55.097 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 35089 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-isl1208.ko 2023-06-09T04:26:55.097 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 14561 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-lp8788.ko 2023-06-09T04:26:55.097 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 37977 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-m41t80.ko 2023-06-09T04:26:55.098 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 11921 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-m48t35.ko 2023-06-09T04:26:55.098 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 25761 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-m48t59.ko 2023-06-09T04:26:55.098 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 14065 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-m48t86.ko 2023-06-09T04:26:55.098 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 11465 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-max6900.ko 2023-06-09T04:26:55.098 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 14553 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-max8907.ko 2023-06-09T04:26:55.098 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 15225 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-max8925.ko 2023-06-09T04:26:55.098 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 25633 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-max8997.ko 2023-06-09T04:26:55.098 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 16569 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-max8998.ko 2023-06-09T04:26:55.099 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 18345 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-mc13xxx.ko 2023-06-09T04:26:55.099 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 11289 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-msm6242.ko 2023-06-09T04:26:55.099 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 19513 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-palmas.ko 2023-06-09T04:26:55.099 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 40009 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-pcf2127.ko 2023-06-09T04:26:55.099 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 17865 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-pcf50633.ko 2023-06-09T04:26:55.099 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 26633 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-pcf85063.ko 2023-06-09T04:26:55.099 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 21713 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-pcf8523.ko 2023-06-09T04:26:55.099 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 29705 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-pcf8563.ko 2023-06-09T04:26:55.100 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 12321 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-pcf8583.ko 2023-06-09T04:26:55.100 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 17849 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-rc5t583.ko 2023-06-09T04:26:55.100 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 12945 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-rp5c01.ko 2023-06-09T04:26:55.100 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 33633 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-rs5c372.ko 2023-06-09T04:26:55.100 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 27649 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-06-09T04:26:55.100 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 25153 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-rx8025.ko 2023-06-09T04:26:55.100 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 19929 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-rx8581.ko 2023-06-09T04:26:55.101 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 21497 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-s35390a.ko 2023-06-09T04:26:55.101 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 16657 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-06-09T04:26:55.101 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 17713 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-tps6586x.ko 2023-06-09T04:26:55.101 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 21425 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-tps65910.ko 2023-06-09T04:26:55.101 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 20433 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-wm831x.ko 2023-06-09T04:26:55.101 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 21169 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-wm8350.ko 2023-06-09T04:26:55.101 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 27761 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-x1205.ko 2023-06-09T04:26:55.101 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/ 2023-06-09T04:26:55.102 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 77529 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/3w-9xxx.ko 2023-06-09T04:26:55.102 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 57489 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/3w-sas.ko 2023-06-09T04:26:55.102 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 55001 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/3w-xxxx.ko 2023-06-09T04:26:55.102 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 134993 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/BusLogic.ko 2023-06-09T04:26:55.102 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 26489 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/a100u2w.ko 2023-06-09T04:26:55.102 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/aacraid/ 2023-06-09T04:26:55.102 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 271033 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/aacraid/aacraid.ko 2023-06-09T04:26:55.102 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 100513 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/advansys.ko 2023-06-09T04:26:55.103 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/aic7xxx/ 2023-06-09T04:26:55.103 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 356081 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-06-09T04:26:55.103 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 295697 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-06-09T04:26:55.103 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/aic94xx/ 2023-06-09T04:26:55.103 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 189145 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/aic94xx/aic94xx.ko 2023-06-09T04:26:55.103 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 23889 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/am53c974.ko 2023-06-09T04:26:55.103 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/arcmsr/ 2023-06-09T04:26:55.103 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 106465 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-06-09T04:26:55.104 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 38065 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/atp870u.ko 2023-06-09T04:26:55.104 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/be2iscsi/ 2023-06-09T04:26:55.104 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 246785 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-06-09T04:26:55.104 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/bfa/ 2023-06-09T04:26:55.104 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 1172073 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/bfa/bfa.ko 2023-06-09T04:26:55.104 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/bnx2fc/ 2023-06-09T04:26:55.104 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 237057 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-06-09T04:26:55.104 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/bnx2i/ 2023-06-09T04:26:55.105 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 115289 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-06-09T04:26:55.105 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 40433 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/ch.ko 2023-06-09T04:26:55.105 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/csiostor/ 2023-06-09T04:26:55.105 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 308721 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/csiostor/csiostor.ko 2023-06-09T04:26:55.105 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/cxgbi/ 2023-06-09T04:26:55.105 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/cxgbi/cxgb3i/ 2023-06-09T04:26:55.105 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 76017 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-06-09T04:26:55.105 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/cxgbi/cxgb4i/ 2023-06-09T04:26:55.106 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 101337 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-06-09T04:26:55.106 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 141697 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-06-09T04:26:55.106 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 75425 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/dc395x.ko 2023-06-09T04:26:55.106 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 37937 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/dmx3191d.ko 2023-06-09T04:26:55.106 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/esas2r/ 2023-06-09T04:26:55.106 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 212297 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/esas2r/esas2r.ko 2023-06-09T04:26:55.106 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 59825 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/esp_scsi.ko 2023-06-09T04:26:55.107 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/fcoe/ 2023-06-09T04:26:55.107 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 78105 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/fcoe/fcoe.ko 2023-06-09T04:26:55.107 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 154921 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-06-09T04:26:55.107 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 18465 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/fdomain.ko 2023-06-09T04:26:55.107 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/fnic/ 2023-06-09T04:26:55.107 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 261961 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/fnic/fnic.ko 2023-06-09T04:26:55.107 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 201689 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/hpsa.ko 2023-06-09T04:26:55.107 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 51041 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/hptiop.ko 2023-06-09T04:26:55.108 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 49041 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/hv_storvsc.ko 2023-06-09T04:26:55.108 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 35201 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/imm.ko 2023-06-09T04:26:55.108 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 43953 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/initio.ko 2023-06-09T04:26:55.108 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 266409 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/ipr.ko 2023-06-09T04:26:55.108 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 101769 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/ips.ko 2023-06-09T04:26:55.108 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/isci/ 2023-06-09T04:26:55.108 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 317137 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/isci/isci.ko 2023-06-09T04:26:55.108 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 25345 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-06-09T04:26:55.109 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 52529 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/iscsi_tcp.ko 2023-06-09T04:26:55.109 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/libfc/ 2023-06-09T04:26:55.109 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 308257 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/libfc/libfc.ko 2023-06-09T04:26:55.109 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 140057 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/libiscsi.ko 2023-06-09T04:26:55.109 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 51529 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/libiscsi_tcp.ko 2023-06-09T04:26:55.109 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/libsas/ 2023-06-09T04:26:55.109 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 212865 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/libsas/libsas.ko 2023-06-09T04:26:55.109 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/lpfc/ 2023-06-09T04:26:55.110 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 2193673 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/lpfc/lpfc.ko 2023-06-09T04:26:55.110 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/megaraid/ 2023-06-09T04:26:55.110 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 73433 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-06-09T04:26:55.110 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 32913 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-06-09T04:26:55.110 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 310561 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-06-09T04:26:55.110 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 84585 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/megaraid.ko 2023-06-09T04:26:55.110 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/mpt3sas/ 2023-06-09T04:26:55.111 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 659401 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-06-09T04:26:55.111 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/mvsas/ 2023-06-09T04:26:55.111 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 119745 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/mvsas/mvsas.ko 2023-06-09T04:26:55.111 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 77985 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/mvumi.ko 2023-06-09T04:26:55.111 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/pcmcia/ 2023-06-09T04:26:55.111 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 81433 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2023-06-09T04:26:55.111 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 11601 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2023-06-09T04:26:55.111 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 20689 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2023-06-09T04:26:55.112 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 23681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2023-06-09T04:26:55.112 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/pm8001/ 2023-06-09T04:26:55.112 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 361249 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-06-09T04:26:55.159 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 123377 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/pmcraid.ko 2023-06-09T04:26:55.159 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 33497 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/ppa.ko 2023-06-09T04:26:55.159 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 55161 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/qla1280.ko 2023-06-09T04:26:55.159 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/qla2xxx/ 2023-06-09T04:26:55.160 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 1850585 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-06-09T04:26:55.160 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 85145 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-06-09T04:26:55.160 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/qla4xxx/ 2023-06-09T04:26:55.160 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 558681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-06-09T04:26:55.160 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 17713 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/qlogicfas408.ko 2023-06-09T04:26:55.160 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 18393 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/raid_class.ko 2023-06-09T04:26:55.160 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 238633 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/scsi_debug.ko 2023-06-09T04:26:55.161 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 171753 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/scsi_transport_fc.ko 2023-06-09T04:26:55.161 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 269985 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-06-09T04:26:55.161 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 94177 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/scsi_transport_sas.ko 2023-06-09T04:26:55.161 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 72577 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/scsi_transport_spi.ko 2023-06-09T04:26:55.161 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 43425 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/scsi_transport_srp.ko 2023-06-09T04:26:55.161 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 26145 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/ses.ko 2023-06-09T04:26:55.161 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 115665 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/st.ko 2023-06-09T04:26:55.161 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 46649 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/stex.ko 2023-06-09T04:26:55.162 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/sym53c8xx_2/ 2023-06-09T04:26:55.162 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 161953 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-06-09T04:26:55.162 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 42249 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/virtio_scsi.ko 2023-06-09T04:26:55.162 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 50193 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/vmw_pvscsi.ko 2023-06-09T04:26:55.162 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 39833 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/wd719x.ko 2023-06-09T04:26:55.162 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 49921 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/xen-scsifront.ko 2023-06-09T04:26:55.162 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ssb/ 2023-06-09T04:26:55.163 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 126913 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ssb/ssb.ko 2023-06-09T04:26:55.163 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/target/ 2023-06-09T04:26:55.163 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/target/iscsi/ 2023-06-09T04:26:55.163 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 731481 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-06-09T04:26:55.163 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/target/loopback/ 2023-06-09T04:26:55.163 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 49801 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/target/loopback/tcm_loop.ko 2023-06-09T04:26:55.163 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 39465 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/target/target_core_file.ko 2023-06-09T04:26:55.163 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 38281 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/target/target_core_iblock.ko 2023-06-09T04:26:55.164 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 920681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/target/target_core_mod.ko 2023-06-09T04:26:55.164 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 44153 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/target/target_core_pscsi.ko 2023-06-09T04:26:55.164 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 122425 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/target/target_core_user.ko 2023-06-09T04:26:55.164 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/target/tcm_fc/ 2023-06-09T04:26:55.164 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 75537 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-06-09T04:26:55.164 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/thermal/ 2023-06-09T04:26:55.164 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/thermal/intel/ 2023-06-09T04:26:55.164 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/thermal/intel/int340x_thermal/ 2023-06-09T04:26:55.165 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 18929 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-06-09T04:26:55.165 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 28881 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-06-09T04:26:55.165 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 9841 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-06-09T04:26:55.165 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 10081 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-06-09T04:26:55.165 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 14905 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-06-09T04:26:55.165 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 15897 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-06-09T04:26:55.165 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 25977 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-06-09T04:26:55.165 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 20097 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-06-09T04:26:55.166 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 14745 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-06-09T04:26:55.166 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-06-09T04:26:55.166 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 12417 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-06-09T04:26:55.166 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 36561 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-06-09T04:26:55.166 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 30625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/thermal/intel/intel_powerclamp.ko 2023-06-09T04:26:55.166 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 20985 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-06-09T04:26:55.166 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 11817 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-06-09T04:26:55.167 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 26369 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-06-09T04:26:55.167 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/tty/ 2023-06-09T04:26:55.167 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/tty/ipwireless/ 2023-06-09T04:26:55.167 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 77969 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-06-09T04:26:55.167 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 57697 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/tty/moxa.ko 2023-06-09T04:26:55.167 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 50617 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/tty/mxser.ko 2023-06-09T04:26:55.167 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 107377 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/tty/n_gsm.ko 2023-06-09T04:26:55.167 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 31833 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/tty/n_hdlc.ko 2023-06-09T04:26:55.168 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 67961 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/tty/nozomi.ko 2023-06-09T04:26:55.168 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/tty/serial/ 2023-06-09T04:26:55.168 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/tty/serial/8250/ 2023-06-09T04:26:55.168 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 35561 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/tty/serial/8250/8250_dw.ko 2023-06-09T04:26:55.168 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 59385 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-06-09T04:26:55.168 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 18105 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/tty/serial/altera_jtaguart.ko 2023-06-09T04:26:55.168 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 22281 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/tty/serial/altera_uart.ko 2023-06-09T04:26:55.169 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 9321 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/tty/serial/arc_uart.ko 2023-06-09T04:26:55.169 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 70177 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/tty/serial/fsl_lpuart.ko 2023-06-09T04:26:55.169 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/tty/serial/jsm/ 2023-06-09T04:26:55.169 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 102841 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/tty/serial/jsm/jsm.ko 2023-06-09T04:26:55.169 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 28673 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/tty/serial/rp2.ko 2023-06-09T04:26:55.169 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 52025 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/tty/serial/sc16is7xx.ko 2023-06-09T04:26:55.169 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 100001 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/tty/synclink_gt.ko 2023-06-09T04:26:55.169 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ufs/ 2023-06-09T04:26:55.170 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ufs/core/ 2023-06-09T04:26:55.170 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 519233 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ufs/core/ufshcd-core.ko 2023-06-09T04:26:55.170 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ufs/host/ 2023-06-09T04:26:55.170 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 28425 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-06-09T04:26:55.170 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 14441 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2023-06-09T04:26:55.170 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/uio/ 2023-06-09T04:26:55.170 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 43857 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/uio/uio.ko 2023-06-09T04:26:55.170 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 12129 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/uio/uio_aec.ko 2023-06-09T04:26:55.171 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 11105 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/uio/uio_cif.ko 2023-06-09T04:26:55.171 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 18217 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/uio/uio_dmem_genirq.ko 2023-06-09T04:26:55.171 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 12825 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/uio/uio_mf624.ko 2023-06-09T04:26:55.171 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 12001 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/uio/uio_netx.ko 2023-06-09T04:26:55.171 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 10497 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/uio/uio_pci_generic.ko 2023-06-09T04:26:55.171 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 15873 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/uio/uio_pdrv_genirq.ko 2023-06-09T04:26:55.171 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13529 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/uio/uio_sercos3.ko 2023-06-09T04:26:55.171 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/ 2023-06-09T04:26:55.172 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/c67x00/ 2023-06-09T04:26:55.172 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 73097 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/c67x00/c67x00.ko 2023-06-09T04:26:55.172 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/chipidea/ 2023-06-09T04:26:55.172 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 142417 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/chipidea/ci_hdrc.ko 2023-06-09T04:26:55.172 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 18385 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2023-06-09T04:26:55.172 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 12529 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2023-06-09T04:26:55.172 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 12833 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2023-06-09T04:26:55.172 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/class/ 2023-06-09T04:26:55.173 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 85345 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/class/cdc-acm.ko 2023-06-09T04:26:55.173 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 51001 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/class/cdc-wdm.ko 2023-06-09T04:26:55.173 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 47353 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/class/usblp.ko 2023-06-09T04:26:55.173 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 89729 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/class/usbtmc.ko 2023-06-09T04:26:55.173 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/common/ 2023-06-09T04:26:55.173 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 22145 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/common/ulpi.ko 2023-06-09T04:26:55.173 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/dwc2/ 2023-06-09T04:26:55.174 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 11705 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/dwc2/dwc2_pci.ko 2023-06-09T04:26:55.174 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/dwc3/ 2023-06-09T04:26:55.174 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 11977 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/dwc3/dwc3-haps.ko 2023-06-09T04:26:55.174 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 29753 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/dwc3/dwc3-pci.ko 2023-06-09T04:26:55.174 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 438457 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/dwc3/dwc3.ko 2023-06-09T04:26:55.174 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/ 2023-06-09T04:26:55.174 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/function/ 2023-06-09T04:26:55.174 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 57753 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/function/u_ether.ko 2023-06-09T04:26:55.175 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 50193 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/function/u_serial.ko 2023-06-09T04:26:55.175 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 28929 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2023-06-09T04:26:55.175 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 42473 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2023-06-09T04:26:55.175 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 27977 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2023-06-09T04:26:55.175 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 36465 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2023-06-09T04:26:55.175 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 91705 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2023-06-09T04:26:55.175 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 50865 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2023-06-09T04:26:55.176 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 117913 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2023-06-09T04:26:55.176 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 57753 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2023-06-09T04:26:55.176 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 22233 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2023-06-09T04:26:55.176 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 31153 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2023-06-09T04:26:55.176 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 57761 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2023-06-09T04:26:55.176 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 84017 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2023-06-09T04:26:55.176 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 19401 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2023-06-09T04:26:55.176 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 58321 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2023-06-09T04:26:55.177 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 67169 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2023-06-09T04:26:55.177 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/legacy/ 2023-06-09T04:26:55.177 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 21081 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2023-06-09T04:26:55.177 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 17945 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2023-06-09T04:26:55.177 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 18361 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2023-06-09T04:26:55.177 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 21473 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/legacy/g_ether.ko 2023-06-09T04:26:55.177 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 28289 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2023-06-09T04:26:55.178 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 18873 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/legacy/g_hid.ko 2023-06-09T04:26:55.178 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 20233 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2023-06-09T04:26:55.178 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 16857 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2023-06-09T04:26:55.178 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 31961 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2023-06-09T04:26:55.178 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 16609 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/legacy/g_printer.ko 2023-06-09T04:26:55.178 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 19281 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/legacy/g_serial.ko 2023-06-09T04:26:55.178 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 27017 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/legacy/g_zero.ko 2023-06-09T04:26:55.178 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 61985 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2023-06-09T04:26:55.179 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 15033 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2023-06-09T04:26:55.179 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 156905 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/libcomposite.ko 2023-06-09T04:26:55.179 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/udc/ 2023-06-09T04:26:55.179 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 16961 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2023-06-09T04:26:55.179 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/udc/bdc/ 2023-06-09T04:26:55.179 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 157545 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2023-06-09T04:26:55.179 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 35953 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/udc/goku_udc.ko 2023-06-09T04:26:55.179 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 52825 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/udc/gr_udc.ko 2023-06-09T04:26:55.180 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 69577 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2023-06-09T04:26:55.180 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 55833 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/udc/mv_udc.ko 2023-06-09T04:26:55.180 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 75865 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/udc/net2272.ko 2023-06-09T04:26:55.180 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 74913 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/udc/net2280.ko 2023-06-09T04:26:55.180 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 73041 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/udc/pch_udc.ko 2023-06-09T04:26:55.180 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 65681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2023-06-09T04:26:55.180 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 65969 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2023-06-09T04:26:55.180 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 80233 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2023-06-09T04:26:55.181 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 145081 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/udc/udc-core.ko 2023-06-09T04:26:55.181 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/host/ 2023-06-09T04:26:55.181 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 11473 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/host/bcma-hcd.ko 2023-06-09T04:26:55.181 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 79913 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/host/isp116x-hcd.ko 2023-06-09T04:26:55.181 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 87505 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/host/oxu210hp-hcd.ko 2023-06-09T04:26:55.181 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 78745 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/host/r8a66597-hcd.ko 2023-06-09T04:26:55.181 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 50969 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/host/sl811-hcd.ko 2023-06-09T04:26:55.182 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 15489 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/host/sl811_cs.ko 2023-06-09T04:26:55.182 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13137 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/host/ssb-hcd.ko 2023-06-09T04:26:55.182 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 25441 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/host/xhci-plat-hcd.ko 2023-06-09T04:26:55.182 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/image/ 2023-06-09T04:26:55.182 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 34417 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/image/mdc800.ko 2023-06-09T04:26:55.182 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 20905 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/image/microtek.ko 2023-06-09T04:26:55.182 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/ 2023-06-09T04:26:55.182 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 41665 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/adutux.ko 2023-06-09T04:26:55.183 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 20601 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/appledisplay.ko 2023-06-09T04:26:55.183 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 17609 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/cypress_cy7c63.ko 2023-06-09T04:26:55.183 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 22929 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/cytherm.ko 2023-06-09T04:26:55.183 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13617 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/ehset.ko 2023-06-09T04:26:55.183 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 14945 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/emi26.ko 2023-06-09T04:26:55.183 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 15881 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/emi62.ko 2023-06-09T04:26:55.183 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 10929 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/ezusb.ko 2023-06-09T04:26:55.183 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 19113 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/idmouse.ko 2023-06-09T04:26:55.184 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 36441 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/iowarrior.ko 2023-06-09T04:26:55.184 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 11417 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/isight_firmware.ko 2023-06-09T04:26:55.184 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 36409 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/ldusb.ko 2023-06-09T04:26:55.184 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 36153 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/legousbtower.ko 2023-06-09T04:26:55.184 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 27673 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/lvstest.ko 2023-06-09T04:26:55.184 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/sisusbvga/ 2023-06-09T04:26:55.184 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 64665 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-06-09T04:26:55.184 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 12825 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/trancevibrator.ko 2023-06-09T04:26:55.185 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 20289 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/usb3503.ko 2023-06-09T04:26:55.185 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 25041 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/usblcd.ko 2023-06-09T04:26:55.185 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 22569 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/usbsevseg.ko 2023-06-09T04:26:55.185 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 70697 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/usbtest.ko 2023-06-09T04:26:55.185 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 41777 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/uss720.ko 2023-06-09T04:26:55.185 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 27513 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/yurex.ko 2023-06-09T04:26:55.185 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/mon/ 2023-06-09T04:26:55.186 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 72801 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/mon/usbmon.ko 2023-06-09T04:26:55.186 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/musb/ 2023-06-09T04:26:55.186 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 294937 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/musb/musb_hdrc.ko 2023-06-09T04:26:55.186 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/phy/ 2023-06-09T04:26:55.186 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 20281 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/phy/phy-generic.ko 2023-06-09T04:26:55.186 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 20001 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2023-06-09T04:26:55.186 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 11849 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/phy/phy-isp1301.ko 2023-06-09T04:26:55.186 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 21561 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/phy/phy-tahvo.ko 2023-06-09T04:26:55.187 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/ 2023-06-09T04:26:55.187 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13137 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/aircable.ko 2023-06-09T04:26:55.187 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 33249 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/ark3116.ko 2023-06-09T04:26:55.187 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 26369 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/belkin_sa.ko 2023-06-09T04:26:55.187 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 38081 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/ch341.ko 2023-06-09T04:26:55.187 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 69985 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/cp210x.ko 2023-06-09T04:26:55.187 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 31057 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/cyberjack.ko 2023-06-09T04:26:55.187 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 57817 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/cypress_m8.ko 2023-06-09T04:26:55.188 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 49577 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/digi_acceleport.ko 2023-06-09T04:26:55.188 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 9441 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/empeg.ko 2023-06-09T04:26:55.188 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 43777 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/f81232.ko 2023-06-09T04:26:55.188 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 174729 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/ftdi_sio.ko 2023-06-09T04:26:55.188 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 52593 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/garmin_gps.ko 2023-06-09T04:26:55.188 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 136761 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/io_edgeport.ko 2023-06-09T04:26:55.188 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 124345 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/io_ti.ko 2023-06-09T04:26:55.188 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 67649 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/ipaq.ko 2023-06-09T04:26:55.189 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 18977 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/ipw.ko 2023-06-09T04:26:55.189 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 26489 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/ir-usb.ko 2023-06-09T04:26:55.189 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 57825 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-06-09T04:26:55.189 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 107305 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/keyspan.ko 2023-06-09T04:26:55.189 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 35153 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/keyspan_pda.ko 2023-06-09T04:26:55.189 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 25329 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/kl5kusb105.ko 2023-06-09T04:26:55.189 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 33345 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/kobil_sct.ko 2023-06-09T04:26:55.189 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 32873 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/mct_u232.ko 2023-06-09T04:26:55.190 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 21817 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/metro-usb.ko 2023-06-09T04:26:55.190 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 66121 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/mos7720.ko 2023-06-09T04:26:55.190 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 77993 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/mos7840.ko 2023-06-09T04:26:55.190 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 55889 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/mxuport.ko 2023-06-09T04:26:55.190 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13657 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/navman.ko 2023-06-09T04:26:55.190 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 11441 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/omninet.ko 2023-06-09T04:26:55.190 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 24105 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/opticon.ko 2023-06-09T04:26:55.191 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 187713 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/option.ko 2023-06-09T04:26:55.191 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 38729 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/oti6858.ko 2023-06-09T04:26:55.191 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 53953 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/pl2303.ko 2023-06-09T04:26:55.191 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 9625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/qcaux.ko 2023-06-09T04:26:55.191 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 37713 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/qcserial.ko 2023-06-09T04:26:55.191 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 34313 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/quatech2.ko 2023-06-09T04:26:55.191 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 14633 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/safe_serial.ko 2023-06-09T04:26:55.191 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 51185 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/sierra.ko 2023-06-09T04:26:55.192 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 21561 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/spcp8x5.ko 2023-06-09T04:26:55.192 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 29737 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/ssu100.ko 2023-06-09T04:26:55.192 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 16737 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/symbolserial.ko 2023-06-09T04:26:55.192 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 60833 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-06-09T04:26:55.192 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 22625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-06-09T04:26:55.192 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 10137 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/usb_debug.ko 2023-06-09T04:26:55.192 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 31881 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/usb_wwan.ko 2023-06-09T04:26:55.192 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 122737 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/usbserial.ko 2023-06-09T04:26:55.193 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 28577 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/visor.ko 2023-06-09T04:26:55.193 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 37289 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/whiteheat.ko 2023-06-09T04:26:55.193 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 10353 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/wishbone-serial.ko 2023-06-09T04:26:55.193 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 9177 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/xsens_mt.ko 2023-06-09T04:26:55.193 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/storage/ 2023-06-09T04:26:55.193 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 52737 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/storage/uas.ko 2023-06-09T04:26:55.193 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 25977 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/storage/ums-alauda.ko 2023-06-09T04:26:55.194 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 12873 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/storage/ums-cypress.ko 2023-06-09T04:26:55.194 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 21881 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/storage/ums-datafab.ko 2023-06-09T04:26:55.194 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 33377 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-06-09T04:26:55.194 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13633 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/storage/ums-freecom.ko 2023-06-09T04:26:55.194 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 19665 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/storage/ums-isd200.ko 2023-06-09T04:26:55.194 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 19193 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-06-09T04:26:55.194 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13537 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/storage/ums-karma.ko 2023-06-09T04:26:55.194 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 17729 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/storage/ums-onetouch.ko 2023-06-09T04:26:55.195 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 28321 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/storage/ums-realtek.ko 2023-06-09T04:26:55.195 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 28793 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/storage/ums-sddr09.ko 2023-06-09T04:26:55.195 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 19417 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/storage/ums-sddr55.ko 2023-06-09T04:26:55.195 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 35233 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/storage/ums-usbat.ko 2023-06-09T04:26:55.195 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 176713 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/storage/usb-storage.ko 2023-06-09T04:26:55.195 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/usbip/ 2023-06-09T04:26:55.195 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 65585 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/usbip/usbip-core.ko 2023-06-09T04:26:55.195 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 71329 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/usbip/usbip-host.ko 2023-06-09T04:26:55.196 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 105225 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-06-09T04:26:55.196 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/vfio/ 2023-06-09T04:26:55.196 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/vfio/pci/ 2023-06-09T04:26:55.196 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 145697 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-06-09T04:26:55.196 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 29425 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/vfio/pci/vfio-pci.ko 2023-06-09T04:26:55.196 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 97857 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/vfio/vfio.ko 2023-06-09T04:26:55.196 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 72113 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-06-09T04:26:55.196 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/vhost/ 2023-06-09T04:26:55.197 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 96865 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/vhost/vhost.ko 2023-06-09T04:26:55.197 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 15689 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/vhost/vhost_iotlb.ko 2023-06-09T04:26:55.197 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 57985 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/vhost/vhost_net.ko 2023-06-09T04:26:55.197 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 85697 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/vhost/vhost_scsi.ko 2023-06-09T04:26:55.197 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/video/ 2023-06-09T04:26:55.197 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/video/backlight/ 2023-06-09T04:26:55.197 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 15297 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/video/backlight/88pm860x_bl.ko 2023-06-09T04:26:55.197 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 12273 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/video/backlight/aat2870_bl.ko 2023-06-09T04:26:55.198 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 23201 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/video/backlight/adp5520_bl.ko 2023-06-09T04:26:55.198 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 32433 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/video/backlight/adp8860_bl.ko 2023-06-09T04:26:55.198 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 39873 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/video/backlight/adp8870_bl.ko 2023-06-09T04:26:55.198 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 16809 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/video/backlight/apple_bl.ko 2023-06-09T04:26:55.198 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 16601 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/video/backlight/as3711_bl.ko 2023-06-09T04:26:55.198 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 11913 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/video/backlight/bd6107.ko 2023-06-09T04:26:55.198 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 11297 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/video/backlight/da903x_bl.ko 2023-06-09T04:26:55.199 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 11105 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/video/backlight/da9052_bl.ko 2023-06-09T04:26:55.199 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 11769 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/video/backlight/gpio_backlight.ko 2023-06-09T04:26:55.199 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 14657 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/video/backlight/kb3886_bl.ko 2023-06-09T04:26:55.199 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 21281 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/video/backlight/lcd.ko 2023-06-09T04:26:55.199 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 23473 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/video/backlight/lm3533_bl.ko 2023-06-09T04:26:55.199 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 19225 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/video/backlight/lm3639_bl.ko 2023-06-09T04:26:55.199 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 11313 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/video/backlight/lv5207lp.ko 2023-06-09T04:26:55.199 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 14233 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/video/backlight/max8925_bl.ko 2023-06-09T04:26:55.200 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 11137 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/video/backlight/pandora_bl.ko 2023-06-09T04:26:55.200 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 10745 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/video/backlight/pcf50633-backlight.ko 2023-06-09T04:26:55.200 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 10793 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/video/backlight/platform_lcd.ko 2023-06-09T04:26:55.200 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 12609 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/video/backlight/wm831x_bl.ko 2023-06-09T04:26:55.200 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/w1/ 2023-06-09T04:26:55.200 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/w1/masters/ 2023-06-09T04:26:55.200 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 18673 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/w1/masters/ds2482.ko 2023-06-09T04:26:55.200 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 38857 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/w1/masters/ds2490.ko 2023-06-09T04:26:55.201 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 11153 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/w1/masters/matrox_w1.ko 2023-06-09T04:26:55.201 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 12241 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/w1/masters/w1-gpio.ko 2023-06-09T04:26:55.201 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/w1/slaves/ 2023-06-09T04:26:55.201 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 11929 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-06-09T04:26:55.201 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 22625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-06-09T04:26:55.201 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 14929 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-06-09T04:26:55.201 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 10649 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-06-09T04:26:55.201 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 14033 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-06-09T04:26:55.202 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 11817 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-06-09T04:26:55.202 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-06-09T04:26:55.202 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-06-09T04:26:55.202 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 17801 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-06-09T04:26:55.202 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 7209 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/w1/slaves/w1_smem.ko 2023-06-09T04:26:55.202 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 56313 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/w1/slaves/w1_therm.ko 2023-06-09T04:26:55.203 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 101401 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/w1/wire.ko 2023-06-09T04:26:55.203 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/ 2023-06-09T04:26:55.203 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 18689 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/acquirewdt.ko 2023-06-09T04:26:55.203 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 19809 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/advantechwdt.ko 2023-06-09T04:26:55.203 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 18449 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/alim1535_wdt.ko 2023-06-09T04:26:55.203 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 22857 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/alim7101_wdt.ko 2023-06-09T04:26:55.203 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 18993 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/cpu5wdt.ko 2023-06-09T04:26:55.204 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13441 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/da9052_wdt.ko 2023-06-09T04:26:55.204 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 12665 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/da9055_wdt.ko 2023-06-09T04:26:55.204 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 17289 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/da9063_wdt.ko 2023-06-09T04:26:55.204 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 19993 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/dw_wdt.ko 2023-06-09T04:26:55.204 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 20153 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/eurotechwdt.ko 2023-06-09T04:26:55.204 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 23689 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/f71808e_wdt.ko 2023-06-09T04:26:55.204 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 27289 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/hpwdt.ko 2023-06-09T04:26:55.204 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 15393 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/i6300esb.ko 2023-06-09T04:26:55.205 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 10097 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-06-09T04:26:55.205 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 21801 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/iTCO_wdt.ko 2023-06-09T04:26:55.205 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 19137 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/ib700wdt.ko 2023-06-09T04:26:55.205 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 18569 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/ibmasr.ko 2023-06-09T04:26:55.205 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 19601 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-06-09T04:26:55.205 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 21041 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/it8712f_wdt.ko 2023-06-09T04:26:55.205 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13729 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/it87_wdt.ko 2023-06-09T04:26:55.205 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 21313 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/kempld_wdt.ko 2023-06-09T04:26:55.206 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 18505 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/machzwd.ko 2023-06-09T04:26:55.206 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 14601 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/mena21_wdt.ko 2023-06-09T04:26:55.206 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13097 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/menf21bmc_wdt.ko 2023-06-09T04:26:55.206 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 24497 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/nv_tco.ko 2023-06-09T04:26:55.206 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 17617 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/of_xilinx_wdt.ko 2023-06-09T04:26:55.206 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 22161 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/pc87413_wdt.ko 2023-06-09T04:26:55.206 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 38489 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/pcwd_pci.ko 2023-06-09T04:26:55.206 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 31705 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/pcwd_usb.ko 2023-06-09T04:26:55.207 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 12953 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/retu_wdt.ko 2023-06-09T04:26:55.207 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 20345 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/sbc60xxwdt.ko 2023-06-09T04:26:55.207 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13953 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/sbc_epx_c3.ko 2023-06-09T04:26:55.207 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 17145 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-06-09T04:26:55.207 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 23641 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/sc1200wdt.ko 2023-06-09T04:26:55.207 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 23209 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/sch311x_wdt.ko 2023-06-09T04:26:55.207 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 21457 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/smsc37b787_wdt.ko 2023-06-09T04:26:55.207 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 17097 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/softdog.ko 2023-06-09T04:26:55.208 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 21921 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/sp5100_tco.ko 2023-06-09T04:26:55.208 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 12641 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/twl4030_wdt.ko 2023-06-09T04:26:55.208 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 17465 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/via_wdt.ko 2023-06-09T04:26:55.208 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 18985 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-06-09T04:26:55.208 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 20569 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/w83877f_wdt.ko 2023-06-09T04:26:55.208 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 25233 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/w83977f_wdt.ko 2023-06-09T04:26:55.208 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 18329 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/wafer5823wdt.ko 2023-06-09T04:26:55.209 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 27905 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/wdt_pci.ko 2023-06-09T04:26:55.209 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 16073 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/wm831x_wdt.ko 2023-06-09T04:26:55.209 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13673 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/wm8350_wdt.ko 2023-06-09T04:26:55.209 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 15521 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/xen_wdt.ko 2023-06-09T04:26:55.209 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/xen/ 2023-06-09T04:26:55.209 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 24377 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/xen/xen-evtchn.ko 2023-06-09T04:26:55.209 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 26569 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/xen/xen-gntalloc.ko 2023-06-09T04:26:55.209 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 47737 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/xen/xen-gntdev.ko 2023-06-09T04:26:55.210 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/xen/xen-pciback/ 2023-06-09T04:26:55.210 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 176241 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-06-09T04:26:55.210 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 39617 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/xen/xen-privcmd.ko 2023-06-09T04:26:55.210 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 71137 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/xen/xen-scsiback.ko 2023-06-09T04:26:55.210 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/xen/xenfs/ 2023-06-09T04:26:55.210 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 19313 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/xen/xenfs/xenfs.ko 2023-06-09T04:26:55.210 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/ 2023-06-09T04:26:55.210 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/9p/ 2023-06-09T04:26:55.211 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 165401 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/9p/9p.ko 2023-06-09T04:26:55.211 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/adfs/ 2023-06-09T04:26:55.211 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 60769 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/adfs/adfs.ko 2023-06-09T04:26:55.211 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/affs/ 2023-06-09T04:26:55.211 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 162449 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/affs/affs.ko 2023-06-09T04:26:55.211 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/afs/ 2023-06-09T04:26:55.211 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 924617 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/afs/kafs.ko 2023-06-09T04:26:55.211 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/autofs/ 2023-06-09T04:26:55.212 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 100641 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/autofs/autofs4.ko 2023-06-09T04:26:55.212 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/befs/ 2023-06-09T04:26:55.212 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 64297 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/befs/befs.ko 2023-06-09T04:26:55.212 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/bfs/ 2023-06-09T04:26:55.212 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 40905 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/bfs/bfs.ko 2023-06-09T04:26:55.212 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 34401 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/binfmt_misc.ko 2023-06-09T04:26:55.212 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/btrfs/ 2023-06-09T04:26:55.213 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 3445465 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/btrfs/btrfs.ko 2023-06-09T04:26:55.213 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/cachefiles/ 2023-06-09T04:26:55.213 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 299849 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/cachefiles/cachefiles.ko 2023-06-09T04:26:55.213 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/ceph/ 2023-06-09T04:26:55.213 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 1230257 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/ceph/ceph.ko 2023-06-09T04:26:55.213 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/cifs/ 2023-06-09T04:26:55.213 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 2619753 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/cifs/cifs.ko 2023-06-09T04:26:55.213 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/coda/ 2023-06-09T04:26:55.214 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 99217 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/coda/coda.ko 2023-06-09T04:26:55.214 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/configfs/ 2023-06-09T04:26:55.214 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 105857 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/configfs/configfs.ko 2023-06-09T04:26:55.214 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/cramfs/ 2023-06-09T04:26:55.214 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 29161 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/cramfs/cramfs.ko 2023-06-09T04:26:55.214 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/dlm/ 2023-06-09T04:26:55.214 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 631321 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/dlm/dlm.ko 2023-06-09T04:26:55.214 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/efs/ 2023-06-09T04:26:55.215 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 36465 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/efs/efs.ko 2023-06-09T04:26:55.215 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/f2fs/ 2023-06-09T04:26:55.215 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 1472873 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/f2fs/f2fs.ko 2023-06-09T04:26:55.215 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/fat/ 2023-06-09T04:26:55.215 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 27681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/fat/msdos.ko 2023-06-09T04:26:55.215 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/freevxfs/ 2023-06-09T04:26:55.215 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 42281 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/freevxfs/freevxfs.ko 2023-06-09T04:26:55.215 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/fscache/ 2023-06-09T04:26:55.216 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 218609 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/fscache/fscache.ko 2023-06-09T04:26:55.216 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/fuse/ 2023-06-09T04:26:55.216 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 24401 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/fuse/cuse.ko 2023-06-09T04:26:55.216 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/gfs2/ 2023-06-09T04:26:55.216 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 1221153 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/gfs2/gfs2.ko 2023-06-09T04:26:55.216 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/hfs/ 2023-06-09T04:26:55.216 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 141129 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/hfs/hfs.ko 2023-06-09T04:26:55.216 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/hfsplus/ 2023-06-09T04:26:55.217 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 221441 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/hfsplus/hfsplus.ko 2023-06-09T04:26:55.217 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/hpfs/ 2023-06-09T04:26:55.217 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 193465 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/hpfs/hpfs.ko 2023-06-09T04:26:55.217 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/isofs/ 2023-06-09T04:26:55.217 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 74281 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/isofs/isofs.ko 2023-06-09T04:26:55.217 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/jfs/ 2023-06-09T04:26:55.217 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 420305 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/jfs/jfs.ko 2023-06-09T04:26:55.217 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/lockd/ 2023-06-09T04:26:55.218 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 276841 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/lockd/lockd.ko 2023-06-09T04:26:55.218 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/minix/ 2023-06-09T04:26:55.218 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 87801 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/minix/minix.ko 2023-06-09T04:26:55.218 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/netfs/ 2023-06-09T04:26:55.218 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 128553 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/netfs/netfs.ko 2023-06-09T04:26:55.218 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nfs/ 2023-06-09T04:26:55.218 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nfs/blocklayout/ 2023-06-09T04:26:55.219 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 81433 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-06-09T04:26:55.219 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nfs/filelayout/ 2023-06-09T04:26:55.219 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 59249 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-06-09T04:26:55.219 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nfs/flexfilelayout/ 2023-06-09T04:26:55.219 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 117529 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-06-09T04:26:55.219 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 1002305 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nfs/nfs.ko 2023-06-09T04:26:55.219 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 65985 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nfs/nfsv2.ko 2023-06-09T04:26:55.219 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 119177 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nfs/nfsv3.ko 2023-06-09T04:26:55.220 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 2003321 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nfs/nfsv4.ko 2023-06-09T04:26:55.220 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nfs_common/ 2023-06-09T04:26:55.220 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 16225 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nfs_common/grace.ko 2023-06-09T04:26:55.220 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 15497 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nfs_common/nfs_acl.ko 2023-06-09T04:26:55.220 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nfsd/ 2023-06-09T04:26:55.220 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 1407361 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nfsd/nfsd.ko 2023-06-09T04:26:55.220 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nilfs2/ 2023-06-09T04:26:55.220 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 587585 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nilfs2/nilfs2.ko 2023-06-09T04:26:55.221 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/ 2023-06-09T04:26:55.221 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13617 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/mac-celtic.ko 2023-06-09T04:26:55.221 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13001 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/mac-centeuro.ko 2023-06-09T04:26:55.221 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/mac-croatian.ko 2023-06-09T04:26:55.221 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 12689 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/mac-cyrillic.ko 2023-06-09T04:26:55.221 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13305 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/mac-gaelic.ko 2023-06-09T04:26:55.221 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 12681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/mac-greek.ko 2023-06-09T04:26:55.221 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13617 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/mac-iceland.ko 2023-06-09T04:26:55.222 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 12993 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/mac-inuit.ko 2023-06-09T04:26:55.222 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13929 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/mac-roman.ko 2023-06-09T04:26:55.222 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/mac-romanian.ko 2023-06-09T04:26:55.222 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13617 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/mac-turkish.ko 2023-06-09T04:26:55.222 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 11121 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_ascii.ko 2023-06-09T04:26:55.222 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 12369 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp1250.ko 2023-06-09T04:26:55.222 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 12057 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp1251.ko 2023-06-09T04:26:55.222 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 12809 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp1255.ko 2023-06-09T04:26:55.223 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 12369 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp737.ko 2023-06-09T04:26:55.223 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 12369 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp775.ko 2023-06-09T04:26:55.223 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 12057 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp850.ko 2023-06-09T04:26:55.223 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 12057 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp852.ko 2023-06-09T04:26:55.223 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 12057 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp855.ko 2023-06-09T04:26:55.223 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 11745 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp857.ko 2023-06-09T04:26:55.223 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 12681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp860.ko 2023-06-09T04:26:55.224 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 12985 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp861.ko 2023-06-09T04:26:55.224 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13297 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp862.ko 2023-06-09T04:26:55.224 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 12985 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp863.ko 2023-06-09T04:26:55.224 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 12681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp864.ko 2023-06-09T04:26:55.224 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 12985 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp865.ko 2023-06-09T04:26:55.224 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 12369 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp866.ko 2023-06-09T04:26:55.224 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 12057 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp869.ko 2023-06-09T04:26:55.224 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 11881 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp874.ko 2023-06-09T04:26:55.225 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 93969 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp932.ko 2023-06-09T04:26:55.225 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 142505 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp936.ko 2023-06-09T04:26:55.225 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 165641 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp949.ko 2023-06-09T04:26:55.225 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 117945 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp950.ko 2023-06-09T04:26:55.225 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 12289 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_euc-jp.ko 2023-06-09T04:26:55.225 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 11129 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_iso8859-1.ko 2023-06-09T04:26:55.225 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 11753 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_iso8859-13.ko 2023-06-09T04:26:55.225 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 11753 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_iso8859-14.ko 2023-06-09T04:26:55.226 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 11753 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_iso8859-15.ko 2023-06-09T04:26:55.226 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 11753 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_iso8859-2.ko 2023-06-09T04:26:55.226 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 11753 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_iso8859-3.ko 2023-06-09T04:26:55.226 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 11753 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_iso8859-4.ko 2023-06-09T04:26:55.226 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 11753 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_iso8859-5.ko 2023-06-09T04:26:55.226 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 11441 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_iso8859-6.ko 2023-06-09T04:26:55.226 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 12065 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_iso8859-7.ko 2023-06-09T04:26:55.226 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 11441 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_iso8859-9.ko 2023-06-09T04:26:55.227 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 12369 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_koi8-r.ko 2023-06-09T04:26:55.227 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 7913 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_koi8-ru.ko 2023-06-09T04:26:55.227 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 12369 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_koi8-u.ko 2023-06-09T04:26:55.227 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 8169 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_utf8.ko 2023-06-09T04:26:55.227 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/ntfs/ 2023-06-09T04:26:55.227 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 218905 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/ntfs/ntfs.ko 2023-06-09T04:26:55.227 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/ocfs2/ 2023-06-09T04:26:55.227 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/ocfs2/cluster/ 2023-06-09T04:26:55.228 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 241057 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-06-09T04:26:55.228 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/ocfs2/dlm/ 2023-06-09T04:26:55.228 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 439521 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-06-09T04:26:55.228 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/ocfs2/dlmfs/ 2023-06-09T04:26:55.228 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 53697 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-06-09T04:26:55.228 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 2511193 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/ocfs2/ocfs2.ko 2023-06-09T04:26:55.228 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 17793 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-06-09T04:26:55.229 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 31473 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-06-09T04:26:55.229 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 33897 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-06-09T04:26:55.229 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/omfs/ 2023-06-09T04:26:55.229 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 52465 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/omfs/omfs.ko 2023-06-09T04:26:55.229 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/overlayfs/ 2023-06-09T04:26:55.229 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 320569 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/overlayfs/overlay.ko 2023-06-09T04:26:55.229 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/pstore/ 2023-06-09T04:26:55.229 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 54441 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/pstore/ramoops.ko 2023-06-09T04:26:55.230 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/qnx4/ 2023-06-09T04:26:55.230 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 26681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/qnx4/qnx4.ko 2023-06-09T04:26:55.230 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/qnx6/ 2023-06-09T04:26:55.230 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 46537 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/qnx6/qnx6.ko 2023-06-09T04:26:55.230 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/quota/ 2023-06-09T04:26:55.230 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 29993 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/quota/quota_tree.ko 2023-06-09T04:26:55.230 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 14177 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/quota/quota_v1.ko 2023-06-09T04:26:55.230 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 21841 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/quota/quota_v2.ko 2023-06-09T04:26:55.231 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/reiserfs/ 2023-06-09T04:26:55.231 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 530593 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/reiserfs/reiserfs.ko 2023-06-09T04:26:55.231 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/romfs/ 2023-06-09T04:26:55.231 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 28393 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/romfs/romfs.ko 2023-06-09T04:26:55.231 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/smbfs_common/ 2023-06-09T04:26:55.231 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 6681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/smbfs_common/cifs_arc4.ko 2023-06-09T04:26:55.231 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 10697 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/smbfs_common/cifs_md4.ko 2023-06-09T04:26:55.231 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/squashfs/ 2023-06-09T04:26:55.232 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 131513 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/squashfs/squashfs.ko 2023-06-09T04:26:55.232 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/sysv/ 2023-06-09T04:26:55.232 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 89537 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/sysv/sysv.ko 2023-06-09T04:26:55.232 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/udf/ 2023-06-09T04:26:55.232 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 248145 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/udf/udf.ko 2023-06-09T04:26:55.232 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/ufs/ 2023-06-09T04:26:55.232 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 160753 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/ufs/ufs.ko 2023-06-09T04:26:55.233 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/xfs/ 2023-06-09T04:26:55.233 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 3854681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/xfs/xfs.ko 2023-06-09T04:26:55.233 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/kernel/ 2023-06-09T04:26:55.233 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/kernel/locking/ 2023-06-09T04:26:55.233 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 73081 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/kernel/locking/locktorture.ko 2023-06-09T04:26:55.233 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/kernel/time/ 2023-06-09T04:26:55.233 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13569 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/kernel/time/test_udelay.ko 2023-06-09T04:26:55.233 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 55329 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/kernel/torture.ko 2023-06-09T04:26:55.234 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/ 2023-06-09T04:26:55.234 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 6353 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/crc-itu-t.ko 2023-06-09T04:26:55.234 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 6049 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/crc7.ko 2023-06-09T04:26:55.234 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 6401 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/crc8.ko 2023-06-09T04:26:55.234 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/crypto/ 2023-06-09T04:26:55.234 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 6625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/crypto/libarc4.ko 2023-06-09T04:26:55.234 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 36217 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/crypto/libdes.ko 2023-06-09T04:26:55.234 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13209 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/interval_tree_test.ko 2023-06-09T04:26:55.235 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 8025 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/libcrc32c.ko 2023-06-09T04:26:55.235 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 23273 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/lru_cache.ko 2023-06-09T04:26:55.235 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/lz4/ 2023-06-09T04:26:55.235 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 32913 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/lz4/lz4_compress.ko 2023-06-09T04:26:55.235 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 21913 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/lz4/lz4hc_compress.ko 2023-06-09T04:26:55.235 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/math/ 2023-06-09T04:26:55.235 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 6217 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/math/cordic.ko 2023-06-09T04:26:55.235 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 8113 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/memory-notifier-error-inject.ko 2023-06-09T04:26:55.236 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 10425 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/notifier-error-inject.ko 2023-06-09T04:26:55.236 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13913 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/percpu_test.ko 2023-06-09T04:26:55.236 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 8185 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/pm-notifier-error-inject.ko 2023-06-09T04:26:55.236 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/raid6/ 2023-06-09T04:26:55.236 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 142193 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/raid6/raid6_pq.ko 2023-06-09T04:26:55.236 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 20993 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/rbtree_test.ko 2023-06-09T04:26:55.236 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/reed_solomon/ 2023-06-09T04:26:55.236 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 17961 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/reed_solomon/reed_solomon.ko 2023-06-09T04:26:55.237 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 38721 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/test-kstrtox.ko 2023-06-09T04:26:55.237 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 26209 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/test-string_helpers.ko 2023-06-09T04:26:55.237 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 4760649 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/test_bpf.ko 2023-06-09T04:26:55.237 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 48377 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/test_firmware.ko 2023-06-09T04:26:55.237 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 6193 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/test_module.ko 2023-06-09T04:26:55.237 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 20689 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/test_user_copy.ko 2023-06-09T04:26:55.237 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 9481 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/ts_bm.ko 2023-06-09T04:26:55.237 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 10945 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/ts_fsm.ko 2023-06-09T04:26:55.238 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 9521 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/ts_kmp.ko 2023-06-09T04:26:55.238 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/xz/ 2023-06-09T04:26:55.238 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13425 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/xz/xz_dec_test.ko 2023-06-09T04:26:55.238 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/mm/ 2023-06-09T04:26:55.238 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 15321 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/mm/hwpoison-inject.ko 2023-06-09T04:26:55.238 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ 2023-06-09T04:26:55.238 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/6lowpan/ 2023-06-09T04:26:55.238 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 54657 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/6lowpan/6lowpan.ko 2023-06-09T04:26:55.239 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 6873 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/6lowpan/nhc_dest.ko 2023-06-09T04:26:55.239 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 6897 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/6lowpan/nhc_fragment.ko 2023-06-09T04:26:55.239 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 6873 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/6lowpan/nhc_hop.ko 2023-06-09T04:26:55.239 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 6873 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/6lowpan/nhc_ipv6.ko 2023-06-09T04:26:55.239 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 6897 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/6lowpan/nhc_mobility.ko 2023-06-09T04:26:55.239 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 6897 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/6lowpan/nhc_routing.ko 2023-06-09T04:26:55.239 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 15153 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/6lowpan/nhc_udp.ko 2023-06-09T04:26:55.240 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/802/ 2023-06-09T04:26:55.240 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 29545 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/802/garp.ko 2023-06-09T04:26:55.240 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 33977 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/802/mrp.ko 2023-06-09T04:26:55.240 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 8049 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/802/p8022.ko 2023-06-09T04:26:55.240 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 15345 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/802/psnap.ko 2023-06-09T04:26:55.240 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 11041 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/802/stp.ko 2023-06-09T04:26:55.240 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/8021q/ 2023-06-09T04:26:55.240 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 80913 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/8021q/8021q.ko 2023-06-09T04:26:55.241 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/9p/ 2023-06-09T04:26:55.241 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 191689 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/9p/9pnet.ko 2023-06-09T04:26:55.241 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 35777 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/9p/9pnet_fd.ko 2023-06-09T04:26:55.241 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 26225 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/9p/9pnet_rdma.ko 2023-06-09T04:26:55.241 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 32145 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/9p/9pnet_virtio.ko 2023-06-09T04:26:55.241 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/batman-adv/ 2023-06-09T04:26:55.241 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 652649 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/batman-adv/batman-adv.ko 2023-06-09T04:26:55.241 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/ 2023-06-09T04:26:55.242 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 63713 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/br_netfilter.ko 2023-06-09T04:26:55.242 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 769721 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/bridge.ko 2023-06-09T04:26:55.242 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ 2023-06-09T04:26:55.242 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 7553 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-06-09T04:26:55.242 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 12217 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebt_among.ko 2023-06-09T04:26:55.242 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 8993 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebt_arp.ko 2023-06-09T04:26:55.242 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 8969 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-06-09T04:26:55.242 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 9513 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-06-09T04:26:55.243 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 8569 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebt_ip.ko 2023-06-09T04:26:55.243 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 8969 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-06-09T04:26:55.243 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 9721 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebt_limit.ko 2023-06-09T04:26:55.243 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13113 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebt_log.ko 2023-06-09T04:26:55.243 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 7473 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebt_mark.ko 2023-06-09T04:26:55.243 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 7425 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-06-09T04:26:55.243 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 8281 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-06-09T04:26:55.243 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 7433 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-06-09T04:26:55.244 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 9409 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-06-09T04:26:55.244 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 8545 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebt_snat.ko 2023-06-09T04:26:55.244 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 8713 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebt_stp.ko 2023-06-09T04:26:55.244 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 12281 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-06-09T04:26:55.244 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 11345 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-06-09T04:26:55.244 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 9713 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-06-09T04:26:55.244 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 9689 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-06-09T04:26:55.245 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 54969 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebtables.ko 2023-06-09T04:26:55.245 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13921 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-06-09T04:26:55.245 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13769 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-06-09T04:26:55.245 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ceph/ 2023-06-09T04:26:55.245 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 1030089 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ceph/libceph.ko 2023-06-09T04:26:55.245 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/core/ 2023-06-09T04:26:55.245 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 124617 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/core/pktgen.ko 2023-06-09T04:26:55.245 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/dccp/ 2023-06-09T04:26:55.246 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 189137 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/dccp/dccp.ko 2023-06-09T04:26:55.246 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 8545 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/dccp/dccp_diag.ko 2023-06-09T04:26:55.246 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 56089 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/dccp/dccp_ipv4.ko 2023-06-09T04:26:55.246 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 59529 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/dccp/dccp_ipv6.ko 2023-06-09T04:26:55.246 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/dsa/ 2023-06-09T04:26:55.246 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 380185 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/dsa/dsa_core.ko 2023-06-09T04:26:55.246 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13161 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/dsa/tag_brcm.ko 2023-06-09T04:26:55.246 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 12465 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/dsa/tag_dsa.ko 2023-06-09T04:26:55.247 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 7609 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/dsa/tag_none.ko 2023-06-09T04:26:55.247 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 8785 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/dsa/tag_trailer.ko 2023-06-09T04:26:55.247 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/hsr/ 2023-06-09T04:26:55.247 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 99713 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/hsr/hsr.ko 2023-06-09T04:26:55.247 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ieee802154/ 2023-06-09T04:26:55.247 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ieee802154/6lowpan/ 2023-06-09T04:26:55.247 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 45065 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-06-09T04:26:55.247 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 245745 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ieee802154/ieee802154.ko 2023-06-09T04:26:55.248 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 47393 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ieee802154/ieee802154_socket.ko 2023-06-09T04:26:55.248 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/ 2023-06-09T04:26:55.248 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 24617 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/ah4.ko 2023-06-09T04:26:55.248 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 38297 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/esp4.ko 2023-06-09T04:26:55.248 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 47633 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/fou.ko 2023-06-09T04:26:55.248 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 17673 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/gre.ko 2023-06-09T04:26:55.248 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 47305 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/inet_diag.ko 2023-06-09T04:26:55.248 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 60121 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/ip_gre.ko 2023-06-09T04:26:55.249 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 58801 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/ip_tunnel.ko 2023-06-09T04:26:55.249 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 34257 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/ip_vti.ko 2023-06-09T04:26:55.249 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13897 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/ipcomp.ko 2023-06-09T04:26:55.249 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 28785 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/ipip.ko 2023-06-09T04:26:55.249 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/ 2023-06-09T04:26:55.249 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 36929 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/arp_tables.ko 2023-06-09T04:26:55.249 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 8705 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-06-09T04:26:55.250 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 10233 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-06-09T04:26:55.250 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 40785 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/ip_tables.ko 2023-06-09T04:26:55.250 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 9881 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-06-09T04:26:55.250 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 9505 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2023-06-09T04:26:55.250 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13969 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-06-09T04:26:55.250 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 11001 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-06-09T04:26:55.250 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 14825 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-06-09T04:26:55.250 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 11137 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/iptable_filter.ko 2023-06-09T04:26:55.251 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 11537 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-06-09T04:26:55.251 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 14825 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-06-09T04:26:55.251 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 11425 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-06-09T04:26:55.251 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 10305 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/iptable_security.ko 2023-06-09T04:26:55.251 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 11601 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-06-09T04:26:55.251 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 8417 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-06-09T04:26:55.251 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 27513 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-06-09T04:26:55.251 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 18049 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-06-09T04:26:55.252 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13233 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-06-09T04:26:55.252 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 19577 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2023-06-09T04:26:55.252 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 8985 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-06-09T04:26:55.252 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 14641 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-06-09T04:26:55.252 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 9785 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-06-09T04:26:55.252 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 16673 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-06-09T04:26:55.252 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 8889 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-06-09T04:26:55.252 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 12961 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/tcp_bic.ko 2023-06-09T04:26:55.253 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/tcp_dctcp.ko 2023-06-09T04:26:55.253 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 15009 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/tcp_diag.ko 2023-06-09T04:26:55.253 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 9425 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/tcp_highspeed.ko 2023-06-09T04:26:55.253 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 12281 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/tcp_htcp.ko 2023-06-09T04:26:55.253 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 10273 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/tcp_hybla.ko 2023-06-09T04:26:55.253 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 11297 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/tcp_illinois.ko 2023-06-09T04:26:55.253 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 10313 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/tcp_lp.ko 2023-06-09T04:26:55.253 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 8225 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/tcp_scalable.ko 2023-06-09T04:26:55.254 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/tcp_vegas.ko 2023-06-09T04:26:55.254 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 9985 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/tcp_veno.ko 2023-06-09T04:26:55.254 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 10849 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/tcp_westwood.ko 2023-06-09T04:26:55.254 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 10073 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/tcp_yeah.ko 2023-06-09T04:26:55.254 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 22105 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/tunnel4.ko 2023-06-09T04:26:55.254 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 16241 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/udp_diag.ko 2023-06-09T04:26:55.254 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 40337 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/udp_tunnel.ko 2023-06-09T04:26:55.255 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 11249 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/xfrm4_tunnel.ko 2023-06-09T04:26:55.255 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/ 2023-06-09T04:26:55.255 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 26265 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/ah6.ko 2023-06-09T04:26:55.255 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 39033 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/esp6.ko 2023-06-09T04:26:55.255 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 14313 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/fou6.ko 2023-06-09T04:26:55.255 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 80681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/ip6_gre.ko 2023-06-09T04:26:55.255 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 91377 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/ip6_tunnel.ko 2023-06-09T04:26:55.255 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 10121 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-06-09T04:26:55.256 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 53889 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/ip6_vti.ko 2023-06-09T04:26:55.256 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/ipcomp6.ko 2023-06-09T04:26:55.256 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 18913 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/mip6.ko 2023-06-09T04:26:55.256 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/ 2023-06-09T04:26:55.256 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 41449 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-06-09T04:26:55.256 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 11649 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2023-06-09T04:26:55.256 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 9577 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-06-09T04:26:55.256 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 14041 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-06-09T04:26:55.257 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 14153 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-06-09T04:26:55.257 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 7689 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-06-09T04:26:55.257 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 16097 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-06-09T04:26:55.257 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 15857 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-06-09T04:26:55.257 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 8801 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-06-09T04:26:55.257 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 9713 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-06-09T04:26:55.257 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 10761 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-06-09T04:26:55.257 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 10721 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-06-09T04:26:55.258 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 11145 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-06-09T04:26:55.258 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 10953 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-06-09T04:26:55.258 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 14857 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-06-09T04:26:55.258 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 11441 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-06-09T04:26:55.258 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 10321 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-06-09T04:26:55.258 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 38249 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-06-09T04:26:55.258 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 8049 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-06-09T04:26:55.259 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 25065 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-06-09T04:26:55.259 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 9457 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-06-09T04:26:55.259 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 14857 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-06-09T04:26:55.259 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 9521 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-06-09T04:26:55.259 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 15537 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-06-09T04:26:55.259 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 8897 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-06-09T04:26:55.259 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 73041 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/sit.ko 2023-06-09T04:26:55.259 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 23697 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/tunnel6.ko 2023-06-09T04:26:55.260 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 22801 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/xfrm6_tunnel.ko 2023-06-09T04:26:55.260 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/key/ 2023-06-09T04:26:55.260 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 82825 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/key/af_key.ko 2023-06-09T04:26:55.260 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/l2tp/ 2023-06-09T04:26:55.260 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 120649 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/l2tp/l2tp_core.ko 2023-06-09T04:26:55.260 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 20161 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/l2tp/l2tp_debugfs.ko 2023-06-09T04:26:55.260 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 25681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/l2tp/l2tp_eth.ko 2023-06-09T04:26:55.260 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 35065 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/l2tp/l2tp_ip.ko 2023-06-09T04:26:55.261 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 36769 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/l2tp/l2tp_ip6.ko 2023-06-09T04:26:55.261 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 32505 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/l2tp/l2tp_netlink.ko 2023-06-09T04:26:55.261 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 53033 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/l2tp/l2tp_ppp.ko 2023-06-09T04:26:55.261 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/lapb/ 2023-06-09T04:26:55.261 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 46961 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/lapb/lapb.ko 2023-06-09T04:26:55.261 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/llc/ 2023-06-09T04:26:55.261 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 22169 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/llc/llc.ko 2023-06-09T04:26:55.262 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 267033 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/llc/llc2.ko 2023-06-09T04:26:55.262 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/mac802154/ 2023-06-09T04:26:55.262 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 280225 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/mac802154/mac802154.ko 2023-06-09T04:26:55.262 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/mpls/ 2023-06-09T04:26:55.262 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 9217 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/mpls/mpls_gso.ko 2023-06-09T04:26:55.262 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ 2023-06-09T04:26:55.262 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipset/ 2023-06-09T04:26:55.262 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 116897 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipset/ip_set.ko 2023-06-09T04:26:55.263 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 28337 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-06-09T04:26:55.263 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 26913 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-06-09T04:26:55.263 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 26345 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-06-09T04:26:55.263 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 101857 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-06-09T04:26:55.263 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 103001 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-06-09T04:26:55.263 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 104417 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-06-09T04:26:55.263 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 105017 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-06-09T04:26:55.263 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 114273 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-06-09T04:26:55.264 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 60985 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-06-09T04:26:55.264 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 111041 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-06-09T04:26:55.264 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 114561 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-06-09T04:26:55.264 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 114209 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-06-09T04:26:55.264 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 113033 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-06-09T04:26:55.264 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 116097 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-06-09T04:26:55.264 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 30033 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-06-09T04:26:55.264 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipvs/ 2023-06-09T04:26:55.265 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 410481 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipvs/ip_vs.ko 2023-06-09T04:26:55.265 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 11857 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-06-09T04:26:55.265 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 7513 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-06-09T04:26:55.265 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 17545 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-06-09T04:26:55.265 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 17729 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-06-09T04:26:55.265 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 20545 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-06-09T04:26:55.265 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 7513 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-06-09T04:26:55.266 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 7577 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-06-09T04:26:55.266 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 10505 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-06-09T04:26:55.266 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 9121 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-06-09T04:26:55.266 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 7529 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-06-09T04:26:55.266 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13409 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-06-09T04:26:55.266 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 7593 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-06-09T04:26:55.266 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 10817 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-06-09T04:26:55.266 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 47921 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_conncount.ko 2023-06-09T04:26:55.267 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 397561 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_conntrack.ko 2023-06-09T04:26:55.267 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 15641 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-06-09T04:26:55.267 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 9825 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-06-09T04:26:55.267 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 33353 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-06-09T04:26:55.267 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 117633 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_conntrack_h323.ko 2023-06-09T04:26:55.267 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 21777 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_conntrack_irc.ko 2023-06-09T04:26:55.267 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 8697 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-06-09T04:26:55.267 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 108217 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-06-09T04:26:55.268 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 33153 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-06-09T04:26:55.268 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 17281 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_conntrack_sane.ko 2023-06-09T04:26:55.268 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 65625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_conntrack_sip.ko 2023-06-09T04:26:55.268 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 10833 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-06-09T04:26:55.268 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 18841 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-06-09T04:26:55.268 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 9529 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_dup_netdev.ko 2023-06-09T04:26:55.268 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 86713 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_flow_table.ko 2023-06-09T04:26:55.268 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 9481 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_flow_table_inet.ko 2023-06-09T04:26:55.269 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 37025 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_log_syslog.ko 2023-06-09T04:26:55.269 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 91657 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_nat.ko 2023-06-09T04:26:55.269 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 9945 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_nat_amanda.ko 2023-06-09T04:26:55.269 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 12449 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_nat_ftp.ko 2023-06-09T04:26:55.269 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 11681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_nat_irc.ko 2023-06-09T04:26:55.269 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 28817 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_nat_sip.ko 2023-06-09T04:26:55.269 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 8625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_nat_tftp.ko 2023-06-09T04:26:55.270 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 42425 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_synproxy_core.ko 2023-06-09T04:26:55.270 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 579473 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_tables.ko 2023-06-09T04:26:55.270 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 42457 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nfnetlink.ko 2023-06-09T04:26:55.270 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 29561 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nfnetlink_acct.ko 2023-06-09T04:26:55.270 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 30505 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nfnetlink_cttimeout.ko 2023-06-09T04:26:55.270 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 39729 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nfnetlink_log.ko 2023-06-09T04:26:55.270 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 22113 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nfnetlink_osf.ko 2023-06-09T04:26:55.270 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 49561 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nfnetlink_queue.ko 2023-06-09T04:26:55.271 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 10281 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nft_chain_nat.ko 2023-06-09T04:26:55.271 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 33073 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nft_compat.ko 2023-06-09T04:26:55.271 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 40537 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nft_ct.ko 2023-06-09T04:26:55.271 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 9489 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nft_dup_netdev.ko 2023-06-09T04:26:55.271 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 10481 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nft_fib.ko 2023-06-09T04:26:55.271 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13633 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nft_fwd_netdev.ko 2023-06-09T04:26:55.271 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 14001 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nft_hash.ko 2023-06-09T04:26:55.271 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 19889 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nft_limit.ko 2023-06-09T04:26:55.272 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 15225 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nft_log.ko 2023-06-09T04:26:55.272 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 14617 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nft_masq.ko 2023-06-09T04:26:55.272 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 14257 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nft_nat.ko 2023-06-09T04:26:55.272 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13561 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nft_numgen.ko 2023-06-09T04:26:55.272 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 11609 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nft_osf.ko 2023-06-09T04:26:55.272 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13961 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nft_queue.ko 2023-06-09T04:26:55.272 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 14073 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nft_redir.ko 2023-06-09T04:26:55.272 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 9609 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nft_reject.ko 2023-06-09T04:26:55.273 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 9905 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nft_reject_inet.ko 2023-06-09T04:26:55.273 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 12617 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nft_socket.ko 2023-06-09T04:26:55.273 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 20225 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nft_synproxy.ko 2023-06-09T04:26:55.273 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 14737 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nft_tproxy.ko 2023-06-09T04:26:55.273 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 84993 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/x_tables.ko 2023-06-09T04:26:55.273 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 11985 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_AUDIT.ko 2023-06-09T04:26:55.273 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 9449 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_CHECKSUM.ko 2023-06-09T04:26:55.273 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 7625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_CLASSIFY.ko 2023-06-09T04:26:55.274 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 11417 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-06-09T04:26:55.274 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 18065 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_CT.ko 2023-06-09T04:26:55.274 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 10329 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_DSCP.ko 2023-06-09T04:26:55.274 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 9297 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_HL.ko 2023-06-09T04:26:55.274 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13257 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_HMARK.ko 2023-06-09T04:26:55.274 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 38681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_IDLETIMER.ko 2023-06-09T04:26:55.274 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13841 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_LED.ko 2023-06-09T04:26:55.275 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 11377 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_LOG.ko 2023-06-09T04:26:55.275 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 11633 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_MASQUERADE.ko 2023-06-09T04:26:55.275 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 11553 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_NETMAP.ko 2023-06-09T04:26:55.275 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 9361 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_NFLOG.ko 2023-06-09T04:26:55.275 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13185 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_NFQUEUE.ko 2023-06-09T04:26:55.275 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 19209 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_RATEEST.ko 2023-06-09T04:26:55.275 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 10961 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_REDIRECT.ko 2023-06-09T04:26:55.275 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 14233 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_SECMARK.ko 2023-06-09T04:26:55.276 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 15953 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_TCPMSS.ko 2023-06-09T04:26:55.276 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 10257 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-06-09T04:26:55.276 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 17193 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_TEE.ko 2023-06-09T04:26:55.276 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 16673 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_TPROXY.ko 2023-06-09T04:26:55.276 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 8153 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_TRACE.ko 2023-06-09T04:26:55.276 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13785 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_addrtype.ko 2023-06-09T04:26:55.276 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13777 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_bpf.ko 2023-06-09T04:26:55.276 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 15401 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_cgroup.ko 2023-06-09T04:26:55.277 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 11033 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_cluster.ko 2023-06-09T04:26:55.277 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 7393 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_comment.ko 2023-06-09T04:26:55.277 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 10353 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_connbytes.ko 2023-06-09T04:26:55.277 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 10969 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_connlabel.ko 2023-06-09T04:26:55.277 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 9233 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_connlimit.ko 2023-06-09T04:26:55.277 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13017 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_connmark.ko 2023-06-09T04:26:55.277 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 12289 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_conntrack.ko 2023-06-09T04:26:55.277 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 7713 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_cpu.ko 2023-06-09T04:26:55.278 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 10801 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_dccp.ko 2023-06-09T04:26:55.278 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 7753 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_devgroup.ko 2023-06-09T04:26:55.278 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 8625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_dscp.ko 2023-06-09T04:26:55.278 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 10553 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_ecn.ko 2023-06-09T04:26:55.278 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 11297 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_esp.ko 2023-06-09T04:26:55.278 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 43217 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_hashlimit.ko 2023-06-09T04:26:55.278 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 11209 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_helper.ko 2023-06-09T04:26:55.279 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 7753 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_hl.ko 2023-06-09T04:26:55.279 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 11809 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_ipcomp.ko 2023-06-09T04:26:55.279 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 11289 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_iprange.ko 2023-06-09T04:26:55.279 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 11609 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_ipvs.ko 2023-06-09T04:26:55.279 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 15865 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_l2tp.ko 2023-06-09T04:26:55.279 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 7825 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_length.ko 2023-06-09T04:26:55.279 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 10097 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_limit.ko 2023-06-09T04:26:55.279 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 7433 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_mac.ko 2023-06-09T04:26:55.280 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 8473 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_mark.ko 2023-06-09T04:26:55.280 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 11649 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_multiport.ko 2023-06-09T04:26:55.280 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13705 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_nat.ko 2023-06-09T04:26:55.280 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 10001 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_nfacct.ko 2023-06-09T04:26:55.280 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 8233 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_osf.ko 2023-06-09T04:26:55.280 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 9441 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_owner.ko 2023-06-09T04:26:55.280 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 9553 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_physdev.ko 2023-06-09T04:26:55.280 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 7457 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_pkttype.ko 2023-06-09T04:26:55.281 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 11881 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_policy.ko 2023-06-09T04:26:55.281 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 9369 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_quota.ko 2023-06-09T04:26:55.281 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 10233 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_rateest.ko 2023-06-09T04:26:55.281 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 8081 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_realm.ko 2023-06-09T04:26:55.281 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 36321 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_recent.ko 2023-06-09T04:26:55.281 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13217 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_sctp.ko 2023-06-09T04:26:55.281 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 29921 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_set.ko 2023-06-09T04:26:55.281 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 15977 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_socket.ko 2023-06-09T04:26:55.282 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 9329 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_state.ko 2023-06-09T04:26:55.282 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 9305 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_statistic.ko 2023-06-09T04:26:55.282 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 8633 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_string.ko 2023-06-09T04:26:55.282 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 8449 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_tcpmss.ko 2023-06-09T04:26:55.282 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 15665 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_tcpudp.ko 2023-06-09T04:26:55.282 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 10961 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_time.ko 2023-06-09T04:26:55.282 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 9001 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_u32.ko 2023-06-09T04:26:55.282 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netlink/ 2023-06-09T04:26:55.283 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13737 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netlink/netlink_diag.ko 2023-06-09T04:26:55.283 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/nsh/ 2023-06-09T04:26:55.283 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 12073 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/nsh/nsh.ko 2023-06-09T04:26:55.283 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/openvswitch/ 2023-06-09T04:26:55.283 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 377897 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/openvswitch/openvswitch.ko 2023-06-09T04:26:55.283 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 10145 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/openvswitch/vport-geneve.ko 2023-06-09T04:26:55.283 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 9273 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/openvswitch/vport-gre.ko 2023-06-09T04:26:55.284 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 11681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/openvswitch/vport-vxlan.ko 2023-06-09T04:26:55.284 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/packet/ 2023-06-09T04:26:55.284 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 12945 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/packet/af_packet_diag.ko 2023-06-09T04:26:55.284 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/phonet/ 2023-06-09T04:26:55.284 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 109953 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/phonet/phonet.ko 2023-06-09T04:26:55.284 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 54737 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/phonet/pn_pep.ko 2023-06-09T04:26:55.284 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/rds/ 2023-06-09T04:26:55.284 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 248865 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/rds/rds.ko 2023-06-09T04:26:55.285 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 164961 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/rds/rds_rdma.ko 2023-06-09T04:26:55.285 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 66761 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/rds/rds_tcp.ko 2023-06-09T04:26:55.285 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/rxrpc/ 2023-06-09T04:26:55.285 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 806905 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/rxrpc/rxrpc.ko 2023-06-09T04:26:55.285 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/ 2023-06-09T04:26:55.285 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 32137 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/act_csum.ko 2023-06-09T04:26:55.285 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 23425 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/act_gact.ko 2023-06-09T04:26:55.285 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 25569 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/act_ipt.ko 2023-06-09T04:26:55.286 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 33953 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/act_mirred.ko 2023-06-09T04:26:55.286 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 23249 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/act_nat.ko 2023-06-09T04:26:55.286 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 42481 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/act_pedit.ko 2023-06-09T04:26:55.286 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 31881 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/act_police.ko 2023-06-09T04:26:55.286 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 20137 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/act_simple.ko 2023-06-09T04:26:55.286 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 36241 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/act_skbedit.ko 2023-06-09T04:26:55.286 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 35945 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/act_vlan.ko 2023-06-09T04:26:55.286 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 25273 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/cls_basic.ko 2023-06-09T04:26:55.287 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 32729 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/cls_bpf.ko 2023-06-09T04:26:55.287 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 19049 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/cls_cgroup.ko 2023-06-09T04:26:55.287 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 31273 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/cls_flow.ko 2023-06-09T04:26:55.287 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 30129 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/cls_fw.ko 2023-06-09T04:26:55.287 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 37113 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/cls_route.ko 2023-06-09T04:26:55.287 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 58305 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/cls_u32.ko 2023-06-09T04:26:55.287 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 7265 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/em_cmp.ko 2023-06-09T04:26:55.288 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 13289 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/em_ipset.ko 2023-06-09T04:26:55.288 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 33153 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/em_meta.ko 2023-06-09T04:26:55.288 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 7713 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/em_nbyte.ko 2023-06-09T04:26:55.288 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 10513 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/em_text.ko 2023-06-09T04:26:55.288 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 7073 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/em_u32.ko 2023-06-09T04:26:55.288 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 19929 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_choke.ko 2023-06-09T04:26:55.288 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 19521 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_codel.ko 2023-06-09T04:26:55.288 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 30761 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_drr.ko 2023-06-09T04:26:55.289 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 30361 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_fq.ko 2023-06-09T04:26:55.289 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 29273 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_fq_codel.ko 2023-06-09T04:26:55.289 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 32465 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_gred.ko 2023-06-09T04:26:55.289 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 44665 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_hfsc.ko 2023-06-09T04:26:55.289 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 20689 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_hhf.ko 2023-06-09T04:26:55.289 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 63641 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_htb.ko 2023-06-09T04:26:55.289 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 15569 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_ingress.ko 2023-06-09T04:26:55.289 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 28417 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_mqprio.ko 2023-06-09T04:26:55.290 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 10209 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_mqprio_lib.ko 2023-06-09T04:26:55.290 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 23761 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_multiq.ko 2023-06-09T04:26:55.290 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 33649 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_netem.ko 2023-06-09T04:26:55.290 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 23817 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_pie.ko 2023-06-09T04:26:55.290 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 10153 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_plug.ko 2023-06-09T04:26:55.290 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 23137 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_prio.ko 2023-06-09T04:26:55.290 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 44625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_qfq.ko 2023-06-09T04:26:55.290 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 29017 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_red.ko 2023-06-09T04:26:55.291 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 25201 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_sfb.ko 2023-06-09T04:26:55.291 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 28305 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_sfq.ko 2023-06-09T04:26:55.291 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 27225 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_tbf.ko 2023-06-09T04:26:55.291 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 27177 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_teql.ko 2023-06-09T04:26:55.291 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sctp/ 2023-06-09T04:26:55.291 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 929065 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sctp/sctp.ko 2023-06-09T04:26:55.291 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 18921 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sctp/sctp_diag.ko 2023-06-09T04:26:55.291 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sunrpc/ 2023-06-09T04:26:55.292 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sunrpc/auth_gss/ 2023-06-09T04:26:55.292 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 327953 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-06-09T04:26:55.292 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 61649 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-06-09T04:26:55.292 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 1427857 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sunrpc/sunrpc.ko 2023-06-09T04:26:55.292 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sunrpc/xprtrdma/ 2023-06-09T04:26:55.292 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 681617 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-06-09T04:26:55.292 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/tipc/ 2023-06-09T04:26:55.293 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 9913 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/tipc/diag.ko 2023-06-09T04:26:55.293 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 853649 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/tipc/tipc.ko 2023-06-09T04:26:55.293 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/unix/ 2023-06-09T04:26:55.293 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 15553 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/unix/unix_diag.ko 2023-06-09T04:26:55.293 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/vmw_vsock/ 2023-06-09T04:26:55.293 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 80017 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-06-09T04:26:55.293 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 67921 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-06-09T04:26:55.293 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 92577 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/vmw_vsock/vsock.ko 2023-06-09T04:26:55.294 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 10593 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/vmw_vsock/vsock_diag.ko 2023-06-09T04:26:55.294 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 17417 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/vmw_vsock/vsock_loopback.ko 2023-06-09T04:26:55.294 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/x25/ 2023-06-09T04:26:55.294 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 125049 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/x25/x25.ko 2023-06-09T04:26:55.294 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/xfrm/ 2023-06-09T04:26:55.294 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 21113 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/xfrm/xfrm_algo.ko 2023-06-09T04:26:55.294 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 20065 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/xfrm/xfrm_ipcomp.ko 2023-06-09T04:26:55.294 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 101529 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/xfrm/xfrm_user.ko 2023-06-09T04:26:55.295 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/virt/ 2023-06-09T04:26:55.295 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/virt/lib/ 2023-06-09T04:26:55.295 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 14753 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/virt/lib/irqbypass.ko 2023-06-09T04:26:55.295 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 636518 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/modules.alias 2023-06-09T04:26:55.295 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 622189 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/modules.alias.bin 2023-06-09T04:26:55.295 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 7605 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/modules.builtin 2023-06-09T04:26:55.295 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 22249 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/modules.builtin.alias.bin 2023-06-09T04:26:55.295 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 9788 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/modules.builtin.bin 2023-06-09T04:26:55.296 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 68530 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/modules.builtin.modinfo 2023-06-09T04:26:55.296 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 146382 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/modules.dep 2023-06-09T04:26:55.296 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 232620 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/modules.dep.bin 2023-06-09T04:26:55.296 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 210 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/modules.devname 2023-06-09T04:26:55.296 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 72719 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/modules.order 2023-06-09T04:26:55.296 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 879 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/modules.softdep 2023-06-09T04:26:55.296 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 251838 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/modules.symbols 2023-06-09T04:26:55.297 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 306636 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/modules.symbols.bin 2023-06-09T04:26:55.298 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./usr/ 2023-06-09T04:26:55.298 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./usr/share/ 2023-06-09T04:26:55.298 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./usr/share/doc/ 2023-06-09T04:26:55.298 INFO:teuthology.orchestra.run.smithi090.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./usr/share/doc/linux-image-6.4.0-rc2-g10b2f20a4f46/ 2023-06-09T04:26:55.298 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 173 2023-06-01 02:19 ./usr/share/doc/linux-image-6.4.0-rc2-g10b2f20a4f46/changelog.Debian.gz 2023-06-09T04:26:55.298 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r-- root/root 691 2023-06-01 02:19 ./usr/share/doc/linux-image-6.4.0-rc2-g10b2f20a4f46/copyright 2023-06-09T04:26:55.299 DEBUG:teuthology.task.kernel:get_image_version: 6.4.0-rc2-g10b2f20a4f46 2023-06-09T04:26:55.299 INFO:teuthology.task.kernel:searching for kernel 6.4.0-rc2-g10b2f20a4f46 2023-06-09T04:26:55.299 DEBUG:teuthology.orchestra.run.smithi090:> egrep '(submenu|menuentry.*6.4.0-rc2-g10b2f20a4f46).*{' /boot/grub/grub.cfg 2023-06-09T04:26:55.308 INFO:teuthology.orchestra.run.smithi090.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-1168b92c-82ac-47e1-87d9-5d77414c7738' { 2023-06-09T04:26:55.308 INFO:teuthology.orchestra.run.smithi090.stdout: menuentry 'Ubuntu, with Linux 6.4.0-rc2-g10b2f20a4f46' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.4.0-rc2-g10b2f20a4f46-advanced-1168b92c-82ac-47e1-87d9-5d77414c7738' { 2023-06-09T04:26:55.308 INFO:teuthology.orchestra.run.smithi090.stdout: menuentry 'Ubuntu, with Linux 6.4.0-rc2-g10b2f20a4f46 (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.4.0-rc2-g10b2f20a4f46-recovery-1168b92c-82ac-47e1-87d9-5d77414c7738' { 2023-06-09T04:26:55.309 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2023-06-09T04:26:55.309 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.4.0-rc2-g10b2f20a4f46 2023-06-09T04:26:55.309 DEBUG:teuthology.orchestra.run.smithi090:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2023-06-09T04:26:55.311 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi090.front.sepia.ceph.com to complete... 2023-06-09T04:26:55.504 INFO:teuthology.orchestra.run.smithi174.stderr:Sourcing file `/etc/default/grub' 2023-06-09T04:26:55.510 INFO:teuthology.orchestra.run.smithi174.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-06-09T04:26:55.525 INFO:teuthology.orchestra.run.smithi174.stderr:Generating grub configuration file ... 2023-06-09T04:26:55.755 INFO:teuthology.orchestra.run.smithi174.stderr:Found linux image: /boot/vmlinuz-6.4.0-rc2-g10b2f20a4f46 2023-06-09T04:26:55.767 INFO:teuthology.orchestra.run.smithi174.stderr:Found initrd image: /boot/initrd.img-6.4.0-rc2-g10b2f20a4f46 2023-06-09T04:26:56.155 INFO:teuthology.orchestra.run.smithi174.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-06-09T04:26:56.161 INFO:teuthology.orchestra.run.smithi090.stderr:Sourcing file `/etc/default/grub' 2023-06-09T04:26:56.166 INFO:teuthology.orchestra.run.smithi090.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-06-09T04:26:56.167 INFO:teuthology.orchestra.run.smithi174.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-06-09T04:26:56.181 INFO:teuthology.orchestra.run.smithi090.stderr:Generating grub configuration file ... 2023-06-09T04:26:56.598 INFO:teuthology.orchestra.run.smithi090.stderr:Found linux image: /boot/vmlinuz-6.4.0-rc2-g10b2f20a4f46 2023-06-09T04:26:56.609 INFO:teuthology.orchestra.run.smithi090.stderr:Found initrd image: /boot/initrd.img-6.4.0-rc2-g10b2f20a4f46 2023-06-09T04:26:57.108 INFO:teuthology.orchestra.run.smithi090.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-06-09T04:26:57.119 INFO:teuthology.orchestra.run.smithi090.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-06-09T04:26:57.619 INFO:teuthology.orchestra.run.smithi174.stderr:done 2023-06-09T04:26:58.388 INFO:teuthology.orchestra.run.smithi090.stderr:done 2023-06-09T04:27:28.780 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2023-06-09T04:27:28.781 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi174.front.sepia.ceph.com' 2023-06-09T04:27:28.782 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-09T04:27:29.625 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2023-06-09T04:27:29.626 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi090.front.sepia.ceph.com' 2023-06-09T04:27:29.626 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-09T04:27:47.184 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.174 2023-06-09T04:27:47.952 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.90 2023-06-09T04:28:17.212 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi174.front.sepia.ceph.com' 2023-06-09T04:28:17.213 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-09T04:28:17.953 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi090.front.sepia.ceph.com' 2023-06-09T04:28:17.954 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-09T04:28:32.497 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.174 2023-06-09T04:29:02.524 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi174.front.sepia.ceph.com' 2023-06-09T04:29:02.525 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-09T04:29:02.837 DEBUG:teuthology.orchestra.run.smithi174:> true 2023-06-09T04:29:03.490 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi174.front.sepia.ceph.com' 2023-06-09T04:29:03.490 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.4.0-rc2-g10b2f20a4f46"... 2023-06-09T04:29:03.490 DEBUG:teuthology.orchestra.run.smithi174:> uname -r 2023-06-09T04:29:03.553 INFO:teuthology.orchestra.run.smithi174.stdout:6.4.0-rc2-g10b2f20a4f46 2023-06-09T04:29:03.554 DEBUG:teuthology.task.kernel:current kernel version is 6.4.0-rc2-g10b2f20a4f46 vs 6.4.0-rc2-g10b2f20a4f46 2023-06-09T04:29:03.554 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-06-09T04:29:03.554 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-06-09T04:29:04.556 DEBUG:teuthology.parallel:result is None 2023-06-09T04:29:17.955 DEBUG:teuthology.orchestra.remote:timed out 2023-06-09T04:29:47.958 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi090.front.sepia.ceph.com' 2023-06-09T04:29:47.959 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-09T04:29:48.211 DEBUG:teuthology.orchestra.run.smithi090:> true 2023-06-09T04:29:49.012 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi090.front.sepia.ceph.com' 2023-06-09T04:29:49.013 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.4.0-rc2-g10b2f20a4f46"... 2023-06-09T04:29:49.013 DEBUG:teuthology.orchestra.run.smithi090:> uname -r 2023-06-09T04:29:49.071 INFO:teuthology.orchestra.run.smithi090.stdout:6.4.0-rc2-g10b2f20a4f46 2023-06-09T04:29:49.071 DEBUG:teuthology.task.kernel:current kernel version is 6.4.0-rc2-g10b2f20a4f46 vs 6.4.0-rc2-g10b2f20a4f46 2023-06-09T04:29:49.072 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-06-09T04:29:49.072 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-06-09T04:29:50.072 DEBUG:teuthology.parallel:result is None 2023-06-09T04:29:50.073 INFO:teuthology.run_tasks:Running task internal.base... 2023-06-09T04:29:50.080 INFO:teuthology.task.internal:Creating test directory... 2023-06-09T04:29:50.081 DEBUG:teuthology.orchestra.run.smithi090:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-06-09T04:29:50.087 DEBUG:teuthology.orchestra.run.smithi174:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-06-09T04:29:50.109 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-06-09T04:29:50.117 INFO:teuthology.run_tasks:Running task internal.archive... 2023-06-09T04:29:50.145 INFO:teuthology.task.internal:Creating archive directory... 2023-06-09T04:29:50.146 DEBUG:teuthology.orchestra.run.smithi090:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-06-09T04:29:50.153 DEBUG:teuthology.orchestra.run.smithi174:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-06-09T04:29:50.223 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-06-09T04:29:50.231 INFO:teuthology.task.internal:Enabling coredump saving... 2023-06-09T04:29:50.231 DEBUG:teuthology.orchestra.run.smithi090:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-06-09T04:29:50.238 DEBUG:teuthology.orchestra.run.smithi174:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-06-09T04:29:50.341 INFO:teuthology.orchestra.run.smithi090.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-06-09T04:29:50.344 INFO:teuthology.orchestra.run.smithi174.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-06-09T04:29:50.369 INFO:teuthology.orchestra.run.smithi174.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-06-09T04:29:50.374 INFO:teuthology.orchestra.run.smithi090.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-06-09T04:29:50.378 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-06-09T04:29:50.385 INFO:teuthology.task.internal:Configuring sudo... 2023-06-09T04:29:50.385 DEBUG:teuthology.orchestra.run.smithi090:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-06-09T04:29:50.392 DEBUG:teuthology.orchestra.run.smithi174:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-06-09T04:29:50.428 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-06-09T04:29:50.437 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-06-09T04:29:50.438 DEBUG:teuthology.orchestra.run.smithi090:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-06-09T04:29:50.475 DEBUG:teuthology.orchestra.run.smithi174:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-06-09T04:29:50.494 DEBUG:teuthology.orchestra.run.smithi090:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-06-09T04:29:50.552 DEBUG:teuthology.orchestra.run.smithi090:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-06-09T04:29:50.612 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2023-06-09T04:29:50.613 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-06-09T04:29:50.695 DEBUG:teuthology.orchestra.run.smithi174:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-06-09T04:29:50.714 DEBUG:teuthology.orchestra.run.smithi174:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-06-09T04:29:50.774 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2023-06-09T04:29:50.774 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-06-09T04:29:50.867 DEBUG:teuthology.orchestra.run.smithi090:> sudo service rsyslog restart 2023-06-09T04:29:50.874 DEBUG:teuthology.orchestra.run.smithi174:> sudo service rsyslog restart 2023-06-09T04:29:51.040 INFO:teuthology.run_tasks:Running task internal.timer... 2023-06-09T04:29:51.048 INFO:teuthology.task.internal:Starting timer... 2023-06-09T04:29:51.048 INFO:teuthology.run_tasks:Running task pcp... 2023-06-09T04:29:51.065 INFO:teuthology.run_tasks:Running task selinux... 2023-06-09T04:29:51.080 DEBUG:teuthology.task.selinux:Excluding smithi090: OS 'ubuntu' does not support SELinux 2023-06-09T04:29:51.081 DEBUG:teuthology.task.selinux:Excluding smithi174: OS 'ubuntu' does not support SELinux 2023-06-09T04:29:51.081 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-06-09T04:29:51.081 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2023-06-09T04:29:51.081 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-06-09T04:29:51.082 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-06-09T04:29:51.093 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-06-09T04:29:51.094 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-06-09T04:29:51.116 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-06-09T04:29:51.118 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi090.front.sepia.ceph.com,smithi174.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-06-09T04:37:21.693 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi090.front.sepia.ceph.com'), Remote(name='ubuntu@smithi174.front.sepia.ceph.com')] 2023-06-09T04:37:21.695 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi090.front.sepia.ceph.com' 2023-06-09T04:37:21.696 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-09T04:37:21.798 DEBUG:teuthology.orchestra.run.smithi090:> true 2023-06-09T04:37:22.012 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi174.front.sepia.ceph.com' 2023-06-09T04:37:22.013 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-09T04:37:22.117 DEBUG:teuthology.orchestra.run.smithi174:> true 2023-06-09T04:37:22.336 INFO:teuthology.run_tasks:Running task clock... 2023-06-09T04:37:22.346 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-06-09T04:37:22.347 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-06-09T04:37:22.348 DEBUG:teuthology.orchestra.run.smithi090:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-06-09T04:37:22.355 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-06-09T04:37:22.356 DEBUG:teuthology.orchestra.run.smithi174:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-06-09T04:37:22.430 INFO:teuthology.orchestra.run.smithi090.stdout: 9 Jun 04:37:22 ntpd[22043]: ntpd 4.2.8p12@1.3728-o (1): Starting 2023-06-09T04:37:22.430 INFO:teuthology.orchestra.run.smithi090.stdout: 9 Jun 04:37:22 ntpd[22043]: Command line: ntpd -gq 2023-06-09T04:37:22.432 INFO:teuthology.orchestra.run.smithi090.stdout: 9 Jun 04:37:22 ntpd[22043]: proto: precision = 0.072 usec (-24) 2023-06-09T04:37:22.432 INFO:teuthology.orchestra.run.smithi090.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-06-09T04:37:22.432 INFO:teuthology.orchestra.run.smithi090.stderr:restrict ::: KOD does nothing without LIMITED. 2023-06-09T04:37:22.433 INFO:teuthology.orchestra.run.smithi090.stdout: 9 Jun 04:37:22 ntpd[22043]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-06-09T04:37:22.433 INFO:teuthology.orchestra.run.smithi090.stdout: 9 Jun 04:37:22 ntpd[22043]: restrict ::: KOD does nothing without LIMITED. 2023-06-09T04:37:22.434 INFO:teuthology.orchestra.run.smithi090.stdout: 9 Jun 04:37:22 ntpd[22043]: Listen and drop on 0 v6wildcard [::]:123 2023-06-09T04:37:22.434 INFO:teuthology.orchestra.run.smithi090.stdout: 9 Jun 04:37:22 ntpd[22043]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-06-09T04:37:22.434 INFO:teuthology.orchestra.run.smithi090.stdout: 9 Jun 04:37:22 ntpd[22043]: Listen normally on 2 lo 127.0.0.1:123 2023-06-09T04:37:22.434 INFO:teuthology.orchestra.run.smithi090.stdout: 9 Jun 04:37:22 ntpd[22043]: Listen normally on 3 enp3s0f1 172.21.15.90:123 2023-06-09T04:37:22.434 INFO:teuthology.orchestra.run.smithi090.stdout: 9 Jun 04:37:22 ntpd[22043]: Listen normally on 4 lo [::1]:123 2023-06-09T04:37:22.434 INFO:teuthology.orchestra.run.smithi090.stdout: 9 Jun 04:37:22 ntpd[22043]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d767%5]:123 2023-06-09T04:37:22.434 INFO:teuthology.orchestra.run.smithi090.stdout: 9 Jun 04:37:22 ntpd[22043]: Listening on routing socket on fd #22 for interface updates 2023-06-09T04:37:22.458 INFO:teuthology.orchestra.run.smithi174.stdout: 9 Jun 04:37:22 ntpd[22052]: ntpd 4.2.8p12@1.3728-o (1): Starting 2023-06-09T04:37:22.458 INFO:teuthology.orchestra.run.smithi174.stdout: 9 Jun 04:37:22 ntpd[22052]: Command line: ntpd -gq 2023-06-09T04:37:22.459 INFO:teuthology.orchestra.run.smithi174.stdout: 9 Jun 04:37:22 ntpd[22052]: proto: precision = 0.044 usec (-24) 2023-06-09T04:37:22.459 INFO:teuthology.orchestra.run.smithi174.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-06-09T04:37:22.460 INFO:teuthology.orchestra.run.smithi174.stdout: 9 Jun 04:37:22 ntpd[22052]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-06-09T04:37:22.460 INFO:teuthology.orchestra.run.smithi174.stderr:restrict ::: KOD does nothing without LIMITED. 2023-06-09T04:37:22.461 INFO:teuthology.orchestra.run.smithi174.stdout: 9 Jun 04:37:22 ntpd[22052]: restrict ::: KOD does nothing without LIMITED. 2023-06-09T04:37:22.461 INFO:teuthology.orchestra.run.smithi174.stdout: 9 Jun 04:37:22 ntpd[22052]: Listen and drop on 0 v6wildcard [::]:123 2023-06-09T04:37:22.461 INFO:teuthology.orchestra.run.smithi174.stdout: 9 Jun 04:37:22 ntpd[22052]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-06-09T04:37:22.461 INFO:teuthology.orchestra.run.smithi174.stdout: 9 Jun 04:37:22 ntpd[22052]: Listen normally on 2 lo 127.0.0.1:123 2023-06-09T04:37:22.462 INFO:teuthology.orchestra.run.smithi174.stdout: 9 Jun 04:37:22 ntpd[22052]: Listen normally on 3 enp3s0f1 172.21.15.174:123 2023-06-09T04:37:22.462 INFO:teuthology.orchestra.run.smithi174.stdout: 9 Jun 04:37:22 ntpd[22052]: Listen normally on 4 lo [::1]:123 2023-06-09T04:37:22.462 INFO:teuthology.orchestra.run.smithi174.stdout: 9 Jun 04:37:22 ntpd[22052]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:771b%5]:123 2023-06-09T04:37:22.462 INFO:teuthology.orchestra.run.smithi174.stdout: 9 Jun 04:37:22 ntpd[22052]: Listening on routing socket on fd #22 for interface updates 2023-06-09T04:37:23.431 INFO:teuthology.orchestra.run.smithi090.stderr: 9 Jun 04:37:23 ntpd[22043]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-09T04:37:23.431 INFO:teuthology.orchestra.run.smithi090.stderr: 9 Jun 04:37:23 ntpd[22043]: can't open /var/log/ntpstats/rawstats.20230609: Permission denied 2023-06-09T04:37:23.431 INFO:teuthology.orchestra.run.smithi090.stderr: 9 Jun 04:37:23 ntpd[22043]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-09T04:37:23.431 INFO:teuthology.orchestra.run.smithi090.stderr: 9 Jun 04:37:23 ntpd[22043]: can't open /var/log/ntpstats/rawstats.20230609: Permission denied 2023-06-09T04:37:23.432 INFO:teuthology.orchestra.run.smithi090.stderr: 9 Jun 04:37:23 ntpd[22043]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-09T04:37:23.432 INFO:teuthology.orchestra.run.smithi090.stderr: 9 Jun 04:37:23 ntpd[22043]: can't open /var/log/ntpstats/rawstats.20230609: Permission denied 2023-06-09T04:37:23.432 INFO:teuthology.orchestra.run.smithi090.stderr: 9 Jun 04:37:23 ntpd[22043]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-09T04:37:23.433 INFO:teuthology.orchestra.run.smithi090.stderr: 9 Jun 04:37:23 ntpd[22043]: can't open /var/log/ntpstats/peerstats.20230609: Permission denied 2023-06-09T04:37:23.458 INFO:teuthology.orchestra.run.smithi174.stderr: 9 Jun 04:37:23 ntpd[22052]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-09T04:37:23.459 INFO:teuthology.orchestra.run.smithi174.stderr: 9 Jun 04:37:23 ntpd[22052]: can't open /var/log/ntpstats/rawstats.20230609: Permission denied 2023-06-09T04:37:23.459 INFO:teuthology.orchestra.run.smithi174.stderr: 9 Jun 04:37:23 ntpd[22052]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-09T04:37:23.459 INFO:teuthology.orchestra.run.smithi174.stderr: 9 Jun 04:37:23 ntpd[22052]: can't open /var/log/ntpstats/rawstats.20230609: Permission denied 2023-06-09T04:37:23.460 INFO:teuthology.orchestra.run.smithi174.stderr: 9 Jun 04:37:23 ntpd[22052]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-09T04:37:23.460 INFO:teuthology.orchestra.run.smithi174.stderr: 9 Jun 04:37:23 ntpd[22052]: can't open /var/log/ntpstats/rawstats.20230609: Permission denied 2023-06-09T04:37:23.460 INFO:teuthology.orchestra.run.smithi174.stderr: 9 Jun 04:37:23 ntpd[22052]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-09T04:37:23.460 INFO:teuthology.orchestra.run.smithi174.stderr: 9 Jun 04:37:23 ntpd[22052]: can't open /var/log/ntpstats/peerstats.20230609: Permission denied 2023-06-09T04:37:25.431 INFO:teuthology.orchestra.run.smithi090.stderr: 9 Jun 04:37:25 ntpd[22043]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-09T04:37:25.431 INFO:teuthology.orchestra.run.smithi090.stderr: 9 Jun 04:37:25 ntpd[22043]: can't open /var/log/ntpstats/rawstats.20230609: Permission denied 2023-06-09T04:37:25.431 INFO:teuthology.orchestra.run.smithi090.stderr: 9 Jun 04:37:25 ntpd[22043]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-09T04:37:25.432 INFO:teuthology.orchestra.run.smithi090.stderr: 9 Jun 04:37:25 ntpd[22043]: can't open /var/log/ntpstats/rawstats.20230609: Permission denied 2023-06-09T04:37:25.432 INFO:teuthology.orchestra.run.smithi090.stderr: 9 Jun 04:37:25 ntpd[22043]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-09T04:37:25.432 INFO:teuthology.orchestra.run.smithi090.stderr: 9 Jun 04:37:25 ntpd[22043]: can't open /var/log/ntpstats/peerstats.20230609: Permission denied 2023-06-09T04:37:25.459 INFO:teuthology.orchestra.run.smithi174.stderr: 9 Jun 04:37:25 ntpd[22052]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-09T04:37:25.459 INFO:teuthology.orchestra.run.smithi174.stderr: 9 Jun 04:37:25 ntpd[22052]: can't open /var/log/ntpstats/rawstats.20230609: Permission denied 2023-06-09T04:37:25.460 INFO:teuthology.orchestra.run.smithi174.stderr: 9 Jun 04:37:25 ntpd[22052]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-09T04:37:25.460 INFO:teuthology.orchestra.run.smithi174.stderr: 9 Jun 04:37:25 ntpd[22052]: can't open /var/log/ntpstats/rawstats.20230609: Permission denied 2023-06-09T04:37:25.460 INFO:teuthology.orchestra.run.smithi174.stderr: 9 Jun 04:37:25 ntpd[22052]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-09T04:37:25.460 INFO:teuthology.orchestra.run.smithi174.stderr: 9 Jun 04:37:25 ntpd[22052]: can't open /var/log/ntpstats/rawstats.20230609: Permission denied 2023-06-09T04:37:25.460 INFO:teuthology.orchestra.run.smithi174.stderr: 9 Jun 04:37:25 ntpd[22052]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-09T04:37:25.460 INFO:teuthology.orchestra.run.smithi174.stderr: 9 Jun 04:37:25 ntpd[22052]: can't open /var/log/ntpstats/peerstats.20230609: Permission denied 2023-06-09T04:37:25.460 INFO:teuthology.orchestra.run.smithi174.stderr: 9 Jun 04:37:25 ntpd[22052]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-09T04:37:25.460 INFO:teuthology.orchestra.run.smithi174.stderr: 9 Jun 04:37:25 ntpd[22052]: can't open /var/log/ntpstats/rawstats.20230609: Permission denied 2023-06-09T04:37:25.461 INFO:teuthology.orchestra.run.smithi174.stderr: 9 Jun 04:37:25 ntpd[22052]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-09T04:37:25.461 INFO:teuthology.orchestra.run.smithi174.stderr: 9 Jun 04:37:25 ntpd[22052]: can't open /var/log/ntpstats/peerstats.20230609: Permission denied 2023-06-09T04:37:26.431 INFO:teuthology.orchestra.run.smithi090.stderr: 9 Jun 04:37:26 ntpd[22043]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-09T04:37:26.431 INFO:teuthology.orchestra.run.smithi090.stderr: 9 Jun 04:37:26 ntpd[22043]: can't open /var/log/ntpstats/rawstats.20230609: Permission denied 2023-06-09T04:37:26.432 INFO:teuthology.orchestra.run.smithi090.stderr: 9 Jun 04:37:26 ntpd[22043]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-09T04:37:26.432 INFO:teuthology.orchestra.run.smithi090.stderr: 9 Jun 04:37:26 ntpd[22043]: can't open /var/log/ntpstats/rawstats.20230609: Permission denied 2023-06-09T04:37:26.432 INFO:teuthology.orchestra.run.smithi090.stderr: 9 Jun 04:37:26 ntpd[22043]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-09T04:37:26.432 INFO:teuthology.orchestra.run.smithi090.stderr: 9 Jun 04:37:26 ntpd[22043]: can't open /var/log/ntpstats/peerstats.20230609: Permission denied 2023-06-09T04:37:26.459 INFO:teuthology.orchestra.run.smithi174.stderr: 9 Jun 04:37:26 ntpd[22052]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-09T04:37:26.459 INFO:teuthology.orchestra.run.smithi174.stderr: 9 Jun 04:37:26 ntpd[22052]: can't open /var/log/ntpstats/rawstats.20230609: Permission denied 2023-06-09T04:37:26.459 INFO:teuthology.orchestra.run.smithi174.stderr: 9 Jun 04:37:26 ntpd[22052]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-09T04:37:26.459 INFO:teuthology.orchestra.run.smithi174.stderr: 9 Jun 04:37:26 ntpd[22052]: can't open /var/log/ntpstats/rawstats.20230609: Permission denied 2023-06-09T04:37:26.460 INFO:teuthology.orchestra.run.smithi174.stderr: 9 Jun 04:37:26 ntpd[22052]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-09T04:37:26.460 INFO:teuthology.orchestra.run.smithi174.stderr: 9 Jun 04:37:26 ntpd[22052]: can't open /var/log/ntpstats/peerstats.20230609: Permission denied 2023-06-09T04:37:27.431 INFO:teuthology.orchestra.run.smithi090.stderr: 9 Jun 04:37:27 ntpd[22043]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-09T04:37:27.432 INFO:teuthology.orchestra.run.smithi090.stderr: 9 Jun 04:37:27 ntpd[22043]: can't open /var/log/ntpstats/rawstats.20230609: Permission denied 2023-06-09T04:37:27.432 INFO:teuthology.orchestra.run.smithi090.stderr: 9 Jun 04:37:27 ntpd[22043]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-09T04:37:27.432 INFO:teuthology.orchestra.run.smithi090.stderr: 9 Jun 04:37:27 ntpd[22043]: can't open /var/log/ntpstats/rawstats.20230609: Permission denied 2023-06-09T04:37:27.432 INFO:teuthology.orchestra.run.smithi090.stderr: 9 Jun 04:37:27 ntpd[22043]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-09T04:37:27.432 INFO:teuthology.orchestra.run.smithi090.stderr: 9 Jun 04:37:27 ntpd[22043]: can't open /var/log/ntpstats/rawstats.20230609: Permission denied 2023-06-09T04:37:27.432 INFO:teuthology.orchestra.run.smithi090.stderr: 9 Jun 04:37:27 ntpd[22043]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-09T04:37:27.433 INFO:teuthology.orchestra.run.smithi090.stderr: 9 Jun 04:37:27 ntpd[22043]: can't open /var/log/ntpstats/peerstats.20230609: Permission denied 2023-06-09T04:37:27.433 INFO:teuthology.orchestra.run.smithi090.stderr: 9 Jun 04:37:27 ntpd[22043]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-09T04:37:27.433 INFO:teuthology.orchestra.run.smithi090.stderr: 9 Jun 04:37:27 ntpd[22043]: can't open /var/log/ntpstats/rawstats.20230609: Permission denied 2023-06-09T04:37:27.433 INFO:teuthology.orchestra.run.smithi090.stderr: 9 Jun 04:37:27 ntpd[22043]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-09T04:37:27.433 INFO:teuthology.orchestra.run.smithi090.stderr: 9 Jun 04:37:27 ntpd[22043]: can't open /var/log/ntpstats/peerstats.20230609: Permission denied 2023-06-09T04:37:27.459 INFO:teuthology.orchestra.run.smithi174.stderr: 9 Jun 04:37:27 ntpd[22052]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-09T04:37:27.459 INFO:teuthology.orchestra.run.smithi174.stderr: 9 Jun 04:37:27 ntpd[22052]: can't open /var/log/ntpstats/rawstats.20230609: Permission denied 2023-06-09T04:37:27.460 INFO:teuthology.orchestra.run.smithi174.stderr: 9 Jun 04:37:27 ntpd[22052]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-09T04:37:27.460 INFO:teuthology.orchestra.run.smithi174.stderr: 9 Jun 04:37:27 ntpd[22052]: can't open /var/log/ntpstats/rawstats.20230609: Permission denied 2023-06-09T04:37:27.460 INFO:teuthology.orchestra.run.smithi174.stderr: 9 Jun 04:37:27 ntpd[22052]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-09T04:37:27.460 INFO:teuthology.orchestra.run.smithi174.stderr: 9 Jun 04:37:27 ntpd[22052]: can't open /var/log/ntpstats/rawstats.20230609: Permission denied 2023-06-09T04:37:27.460 INFO:teuthology.orchestra.run.smithi174.stderr: 9 Jun 04:37:27 ntpd[22052]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-09T04:37:27.460 INFO:teuthology.orchestra.run.smithi174.stderr: 9 Jun 04:37:27 ntpd[22052]: can't open /var/log/ntpstats/peerstats.20230609: Permission denied 2023-06-09T04:37:27.460 INFO:teuthology.orchestra.run.smithi174.stderr: 9 Jun 04:37:27 ntpd[22052]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-09T04:37:27.460 INFO:teuthology.orchestra.run.smithi174.stderr: 9 Jun 04:37:27 ntpd[22052]: can't open /var/log/ntpstats/rawstats.20230609: Permission denied 2023-06-09T04:37:27.461 INFO:teuthology.orchestra.run.smithi174.stderr: 9 Jun 04:37:27 ntpd[22052]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-09T04:37:27.461 INFO:teuthology.orchestra.run.smithi174.stderr: 9 Jun 04:37:27 ntpd[22052]: can't open /var/log/ntpstats/peerstats.20230609: Permission denied 2023-06-09T04:37:28.431 INFO:teuthology.orchestra.run.smithi090.stderr: 9 Jun 04:37:28 ntpd[22043]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-09T04:37:28.431 INFO:teuthology.orchestra.run.smithi090.stderr: 9 Jun 04:37:28 ntpd[22043]: can't open /var/log/ntpstats/rawstats.20230609: Permission denied 2023-06-09T04:37:28.432 INFO:teuthology.orchestra.run.smithi090.stderr: 9 Jun 04:37:28 ntpd[22043]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-09T04:37:28.432 INFO:teuthology.orchestra.run.smithi090.stderr: 9 Jun 04:37:28 ntpd[22043]: can't open /var/log/ntpstats/rawstats.20230609: Permission denied 2023-06-09T04:37:28.432 INFO:teuthology.orchestra.run.smithi090.stderr: 9 Jun 04:37:28 ntpd[22043]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-09T04:37:28.432 INFO:teuthology.orchestra.run.smithi090.stderr: 9 Jun 04:37:28 ntpd[22043]: can't open /var/log/ntpstats/peerstats.20230609: Permission denied 2023-06-09T04:37:28.459 INFO:teuthology.orchestra.run.smithi174.stderr: 9 Jun 04:37:28 ntpd[22052]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-09T04:37:28.459 INFO:teuthology.orchestra.run.smithi174.stderr: 9 Jun 04:37:28 ntpd[22052]: can't open /var/log/ntpstats/rawstats.20230609: Permission denied 2023-06-09T04:37:28.459 INFO:teuthology.orchestra.run.smithi174.stderr: 9 Jun 04:37:28 ntpd[22052]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-09T04:37:28.459 INFO:teuthology.orchestra.run.smithi174.stderr: 9 Jun 04:37:28 ntpd[22052]: can't open /var/log/ntpstats/rawstats.20230609: Permission denied 2023-06-09T04:37:28.459 INFO:teuthology.orchestra.run.smithi174.stderr: 9 Jun 04:37:28 ntpd[22052]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-09T04:37:28.460 INFO:teuthology.orchestra.run.smithi174.stderr: 9 Jun 04:37:28 ntpd[22052]: can't open /var/log/ntpstats/peerstats.20230609: Permission denied 2023-06-09T04:37:29.431 INFO:teuthology.orchestra.run.smithi090.stderr: 9 Jun 04:37:29 ntpd[22043]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-09T04:37:29.432 INFO:teuthology.orchestra.run.smithi090.stderr: 9 Jun 04:37:29 ntpd[22043]: can't open /var/log/ntpstats/rawstats.20230609: Permission denied 2023-06-09T04:37:29.432 INFO:teuthology.orchestra.run.smithi090.stderr: 9 Jun 04:37:29 ntpd[22043]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-09T04:37:29.432 INFO:teuthology.orchestra.run.smithi090.stderr: 9 Jun 04:37:29 ntpd[22043]: can't open /var/log/ntpstats/rawstats.20230609: Permission denied 2023-06-09T04:37:29.432 INFO:teuthology.orchestra.run.smithi090.stderr: 9 Jun 04:37:29 ntpd[22043]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-09T04:37:29.432 INFO:teuthology.orchestra.run.smithi090.stderr: 9 Jun 04:37:29 ntpd[22043]: can't open /var/log/ntpstats/rawstats.20230609: Permission denied 2023-06-09T04:37:29.433 INFO:teuthology.orchestra.run.smithi090.stderr: 9 Jun 04:37:29 ntpd[22043]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-09T04:37:29.433 INFO:teuthology.orchestra.run.smithi090.stderr: 9 Jun 04:37:29 ntpd[22043]: can't open /var/log/ntpstats/peerstats.20230609: Permission denied 2023-06-09T04:37:29.433 INFO:teuthology.orchestra.run.smithi090.stderr: 9 Jun 04:37:29 ntpd[22043]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-09T04:37:29.433 INFO:teuthology.orchestra.run.smithi090.stderr: 9 Jun 04:37:29 ntpd[22043]: can't open /var/log/ntpstats/rawstats.20230609: Permission denied 2023-06-09T04:37:29.433 INFO:teuthology.orchestra.run.smithi090.stderr: 9 Jun 04:37:29 ntpd[22043]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-09T04:37:29.433 INFO:teuthology.orchestra.run.smithi090.stderr: 9 Jun 04:37:29 ntpd[22043]: can't open /var/log/ntpstats/peerstats.20230609: Permission denied 2023-06-09T04:37:29.434 INFO:teuthology.orchestra.run.smithi090.stdout: 9 Jun 04:37:29 ntpd[22043]: ntpd: time slew -0.001431 s 2023-06-09T04:37:29.434 INFO:teuthology.orchestra.run.smithi090.stdout:ntpd: time slew -0.001431s 2023-06-09T04:37:29.434 INFO:teuthology.orchestra.run.smithi090.stderr: 9 Jun 04:37:29 ntpd[22043]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-06-09T04:37:29.434 INFO:teuthology.orchestra.run.smithi090.stderr: 9 Jun 04:37:29 ntpd[22043]: can't open /var/log/ntpstats/loopstats.20230609: Permission denied 2023-06-09T04:37:29.459 INFO:teuthology.orchestra.run.smithi174.stderr: 9 Jun 04:37:29 ntpd[22052]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-09T04:37:29.459 INFO:teuthology.orchestra.run.smithi174.stderr: 9 Jun 04:37:29 ntpd[22052]: can't open /var/log/ntpstats/rawstats.20230609: Permission denied 2023-06-09T04:37:29.460 INFO:teuthology.orchestra.run.smithi174.stderr: 9 Jun 04:37:29 ntpd[22052]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-09T04:37:29.460 INFO:teuthology.orchestra.run.smithi174.stderr: 9 Jun 04:37:29 ntpd[22052]: can't open /var/log/ntpstats/rawstats.20230609: Permission denied 2023-06-09T04:37:29.460 INFO:teuthology.orchestra.run.smithi174.stderr: 9 Jun 04:37:29 ntpd[22052]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-09T04:37:29.460 INFO:teuthology.orchestra.run.smithi174.stderr: 9 Jun 04:37:29 ntpd[22052]: can't open /var/log/ntpstats/rawstats.20230609: Permission denied 2023-06-09T04:37:29.460 INFO:teuthology.orchestra.run.smithi174.stderr: 9 Jun 04:37:29 ntpd[22052]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-09T04:37:29.460 INFO:teuthology.orchestra.run.smithi174.stderr: 9 Jun 04:37:29 ntpd[22052]: can't open /var/log/ntpstats/peerstats.20230609: Permission denied 2023-06-09T04:37:29.460 INFO:teuthology.orchestra.run.smithi174.stderr: 9 Jun 04:37:29 ntpd[22052]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-09T04:37:29.461 INFO:teuthology.orchestra.run.smithi174.stderr: 9 Jun 04:37:29 ntpd[22052]: can't open /var/log/ntpstats/rawstats.20230609: Permission denied 2023-06-09T04:37:29.461 INFO:teuthology.orchestra.run.smithi174.stderr: 9 Jun 04:37:29 ntpd[22052]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-09T04:37:29.461 INFO:teuthology.orchestra.run.smithi174.stderr: 9 Jun 04:37:29 ntpd[22052]: can't open /var/log/ntpstats/peerstats.20230609: Permission denied 2023-06-09T04:37:29.461 INFO:teuthology.orchestra.run.smithi174.stdout: 9 Jun 04:37:29 ntpd[22052]: ntpd: time slew +0.001409 s 2023-06-09T04:37:29.461 INFO:teuthology.orchestra.run.smithi174.stdout:ntpd: time slew +0.001409s 2023-06-09T04:37:29.462 INFO:teuthology.orchestra.run.smithi174.stderr: 9 Jun 04:37:29 ntpd[22052]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-06-09T04:37:29.462 INFO:teuthology.orchestra.run.smithi174.stderr: 9 Jun 04:37:29 ntpd[22052]: can't open /var/log/ntpstats/loopstats.20230609: Permission denied 2023-06-09T04:37:29.588 INFO:teuthology.orchestra.run.smithi090.stdout: remote refid st t when poll reach delay offset jitter 2023-06-09T04:37:29.588 INFO:teuthology.orchestra.run.smithi090.stdout:============================================================================== 2023-06-09T04:37:29.589 INFO:teuthology.orchestra.run.smithi090.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-06-09T04:37:29.589 INFO:teuthology.orchestra.run.smithi090.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-06-09T04:37:29.589 INFO:teuthology.orchestra.run.smithi090.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-06-09T04:37:29.589 INFO:teuthology.orchestra.run.smithi090.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-06-09T04:37:29.603 INFO:teuthology.orchestra.run.smithi174.stdout: remote refid st t when poll reach delay offset jitter 2023-06-09T04:37:29.604 INFO:teuthology.orchestra.run.smithi174.stdout:============================================================================== 2023-06-09T04:37:29.604 INFO:teuthology.orchestra.run.smithi174.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-06-09T04:37:29.604 INFO:teuthology.orchestra.run.smithi174.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-06-09T04:37:29.604 INFO:teuthology.orchestra.run.smithi174.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-06-09T04:37:29.604 INFO:teuthology.orchestra.run.smithi174.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-06-09T04:37:29.605 INFO:teuthology.run_tasks:Running task install... 2023-06-09T04:37:29.614 DEBUG:teuthology.task.install:project ceph 2023-06-09T04:37:29.614 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'a02638f808b8fe11bccdd01222c0e6e2eb71120b'}} 2023-06-09T04:37:29.615 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'a02638f808b8fe11bccdd01222c0e6e2eb71120b'} 2023-06-09T04:37:29.615 INFO:teuthology.task.install:Using flavor: default 2023-06-09T04:37:29.620 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-06-09T04:37:29.621 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-06-09T04:37:29.621 DEBUG:teuthology.orchestra.run.smithi090:> sudo apt-key list | grep Ceph 2023-06-09T04:37:29.622 DEBUG:teuthology.orchestra.run.smithi174:> sudo apt-key list | grep Ceph 2023-06-09T04:37:29.844 INFO:teuthology.orchestra.run.smithi174.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2023-06-09T04:37:29.868 INFO:teuthology.orchestra.run.smithi090.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2023-06-09T04:37:29.973 INFO:teuthology.orchestra.run.smithi174.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-06-09T04:37:29.973 INFO:teuthology.orchestra.run.smithi174.stdout:uid [ unknown] Ceph.com (release key) 2023-06-09T04:37:29.975 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-06-09T04:37:29.975 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-06-09T04:37:29.975 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=a02638f808b8fe11bccdd01222c0e6e2eb71120b 2023-06-09T04:37:30.001 INFO:teuthology.orchestra.run.smithi090.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-06-09T04:37:30.002 INFO:teuthology.orchestra.run.smithi090.stdout:uid [ unknown] Ceph.com (release key) 2023-06-09T04:37:30.003 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-06-09T04:37:30.003 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-06-09T04:37:30.003 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=a02638f808b8fe11bccdd01222c0e6e2eb71120b 2023-06-09T04:37:30.259 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/focal/flavors/default/ 2023-06-09T04:37:30.259 INFO:teuthology.task.install.deb:Package version is 18.0.0-4313-ga02638f8-1focal 2023-06-09T04:37:30.279 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/focal/flavors/default/ 2023-06-09T04:37:30.280 INFO:teuthology.task.install.deb:Package version is 18.0.0-4313-ga02638f8-1focal 2023-06-09T04:37:30.475 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2023-06-09T04:37:30.475 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-06-09T04:37:30.498 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2023-06-09T04:37:30.498 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-06-09T04:37:30.510 DEBUG:teuthology.orchestra.run.smithi174:> sudo apt-get update 2023-06-09T04:37:30.532 DEBUG:teuthology.orchestra.run.smithi090:> sudo apt-get update 2023-06-09T04:37:30.808 INFO:teuthology.orchestra.run.smithi174.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2023-06-09T04:37:30.818 INFO:teuthology.orchestra.run.smithi090.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2023-06-09T04:37:30.818 INFO:teuthology.orchestra.run.smithi090.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2023-06-09T04:37:30.819 INFO:teuthology.orchestra.run.smithi090.stdout:Hit:3 http://security.ubuntu.com/ubuntu focal-security InRelease 2023-06-09T04:37:30.827 INFO:teuthology.orchestra.run.smithi090.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2023-06-09T04:37:30.848 INFO:teuthology.orchestra.run.smithi174.stdout:Ign:2 https://3.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/focal/flavors/default focal InRelease 2023-06-09T04:37:30.865 INFO:teuthology.orchestra.run.smithi090.stdout:Ign:5 https://3.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/focal/flavors/default focal InRelease 2023-06-09T04:37:30.870 INFO:teuthology.orchestra.run.smithi174.stdout:Get:3 https://3.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/focal/flavors/default focal Release [7,662 B] 2023-06-09T04:37:30.887 INFO:teuthology.orchestra.run.smithi090.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/focal/flavors/default focal Release [7,662 B] 2023-06-09T04:37:30.894 INFO:teuthology.orchestra.run.smithi174.stdout:Ign:4 https://3.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/focal/flavors/default focal Release.gpg 2023-06-09T04:37:30.904 INFO:teuthology.orchestra.run.smithi174.stdout:Hit:5 http://archive.ubuntu.com/ubuntu focal InRelease 2023-06-09T04:37:30.911 INFO:teuthology.orchestra.run.smithi090.stdout:Ign:7 https://3.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/focal/flavors/default focal Release.gpg 2023-06-09T04:37:30.916 INFO:teuthology.orchestra.run.smithi174.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/focal/flavors/default focal/main amd64 Packages [17.3 kB] 2023-06-09T04:37:30.934 INFO:teuthology.orchestra.run.smithi090.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/focal/flavors/default focal/main amd64 Packages [17.3 kB] 2023-06-09T04:37:30.959 INFO:teuthology.orchestra.run.smithi174.stdout:Get:7 https://3.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/focal/flavors/default focal/main i386 Packages [3,425 B] 2023-06-09T04:37:30.983 INFO:teuthology.orchestra.run.smithi090.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/focal/flavors/default focal/main i386 Packages [3,425 B] 2023-06-09T04:37:30.986 INFO:teuthology.orchestra.run.smithi174.stdout:Hit:8 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2023-06-09T04:37:31.067 INFO:teuthology.orchestra.run.smithi174.stdout:Hit:9 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2023-06-09T04:37:32.217 INFO:teuthology.orchestra.run.smithi090.stdout:Fetched 28.4 kB in 1s (21.0 kB/s) 2023-06-09T04:37:32.225 INFO:teuthology.orchestra.run.smithi174.stdout:Fetched 28.4 kB in 1s (20.7 kB/s) 2023-06-09T04:37:33.414 INFO:teuthology.orchestra.run.smithi090.stdout:Reading package lists... 2023-06-09T04:37:33.421 INFO:teuthology.orchestra.run.smithi174.stdout:Reading package lists... 2023-06-09T04:37:33.449 DEBUG:teuthology.orchestra.run.smithi090:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-4313-ga02638f8-1focal cephadm=18.0.0-4313-ga02638f8-1focal ceph-mds=18.0.0-4313-ga02638f8-1focal ceph-mgr=18.0.0-4313-ga02638f8-1focal ceph-common=18.0.0-4313-ga02638f8-1focal ceph-fuse=18.0.0-4313-ga02638f8-1focal ceph-test=18.0.0-4313-ga02638f8-1focal ceph-volume=18.0.0-4313-ga02638f8-1focal radosgw=18.0.0-4313-ga02638f8-1focal python3-rados=18.0.0-4313-ga02638f8-1focal python3-rgw=18.0.0-4313-ga02638f8-1focal python3-cephfs=18.0.0-4313-ga02638f8-1focal python3-rbd=18.0.0-4313-ga02638f8-1focal libcephfs2=18.0.0-4313-ga02638f8-1focal libcephfs-dev=18.0.0-4313-ga02638f8-1focal librados2=18.0.0-4313-ga02638f8-1focal librbd1=18.0.0-4313-ga02638f8-1focal rbd-fuse=18.0.0-4313-ga02638f8-1focal python3-cephfs=18.0.0-4313-ga02638f8-1focal cephfs-shell=18.0.0-4313-ga02638f8-1focal cephfs-top=18.0.0-4313-ga02638f8-1focal cephfs-mirror=18.0.0-4313-ga02638f8-1focal 2023-06-09T04:37:33.459 DEBUG:teuthology.orchestra.run.smithi174:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-4313-ga02638f8-1focal cephadm=18.0.0-4313-ga02638f8-1focal ceph-mds=18.0.0-4313-ga02638f8-1focal ceph-mgr=18.0.0-4313-ga02638f8-1focal ceph-common=18.0.0-4313-ga02638f8-1focal ceph-fuse=18.0.0-4313-ga02638f8-1focal ceph-test=18.0.0-4313-ga02638f8-1focal ceph-volume=18.0.0-4313-ga02638f8-1focal radosgw=18.0.0-4313-ga02638f8-1focal python3-rados=18.0.0-4313-ga02638f8-1focal python3-rgw=18.0.0-4313-ga02638f8-1focal python3-cephfs=18.0.0-4313-ga02638f8-1focal python3-rbd=18.0.0-4313-ga02638f8-1focal libcephfs2=18.0.0-4313-ga02638f8-1focal libcephfs-dev=18.0.0-4313-ga02638f8-1focal librados2=18.0.0-4313-ga02638f8-1focal librbd1=18.0.0-4313-ga02638f8-1focal rbd-fuse=18.0.0-4313-ga02638f8-1focal python3-cephfs=18.0.0-4313-ga02638f8-1focal cephfs-shell=18.0.0-4313-ga02638f8-1focal cephfs-top=18.0.0-4313-ga02638f8-1focal cephfs-mirror=18.0.0-4313-ga02638f8-1focal 2023-06-09T04:37:33.568 INFO:teuthology.orchestra.run.smithi090.stdout:Reading package lists... 2023-06-09T04:37:33.579 INFO:teuthology.orchestra.run.smithi174.stdout:Reading package lists... 2023-06-09T04:37:33.755 INFO:teuthology.orchestra.run.smithi174.stdout:Building dependency tree... 2023-06-09T04:37:33.756 INFO:teuthology.orchestra.run.smithi174.stdout:Reading state information... 2023-06-09T04:37:33.765 INFO:teuthology.orchestra.run.smithi090.stdout:Building dependency tree... 2023-06-09T04:37:33.766 INFO:teuthology.orchestra.run.smithi090.stdout:Reading state information... 2023-06-09T04:37:33.920 INFO:teuthology.orchestra.run.smithi174.stdout:The following packages were automatically installed and are no longer required: 2023-06-09T04:37:33.920 INFO:teuthology.orchestra.run.smithi174.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-06-09T04:37:33.921 INFO:teuthology.orchestra.run.smithi174.stdout:Use 'sudo apt autoremove' to remove them. 2023-06-09T04:37:33.921 INFO:teuthology.orchestra.run.smithi174.stdout:The following additional packages will be installed: 2023-06-09T04:37:33.921 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-06-09T04:37:33.922 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd fonts-mathjax jq 2023-06-09T04:37:33.922 INFO:teuthology.orchestra.run.smithi174.stdout: libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2023-06-09T04:37:33.922 INFO:teuthology.orchestra.run.smithi174.stdout: liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 libpcre2-16-0 2023-06-09T04:37:33.922 INFO:teuthology.orchestra.run.smithi174.stdout: libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 libradosstriper1 2023-06-09T04:37:33.922 INFO:teuthology.orchestra.run.smithi174.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli 2023-06-09T04:37:33.922 INFO:teuthology.orchestra.run.smithi174.stdout: python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2023-06-09T04:37:33.923 INFO:teuthology.orchestra.run.smithi174.stdout: python3-asyncssh python3-atomicwrites python3-attr python3-bcrypt 2023-06-09T04:37:33.923 INFO:teuthology.orchestra.run.smithi174.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2023-06-09T04:37:33.923 INFO:teuthology.orchestra.run.smithi174.stdout: python3-ceph-common python3-cherrypy3 python3-cmd2 python3-colorama 2023-06-09T04:37:33.923 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cryptography python3-decorator python3-google-auth python3-html5lib 2023-06-09T04:37:33.923 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jinja2 python3-joblib python3-jwt python3-kubernetes 2023-06-09T04:37:33.923 INFO:teuthology.orchestra.run.smithi174.stdout: python3-logutils python3-lxml python3-mako python3-markupsafe 2023-06-09T04:37:33.923 INFO:teuthology.orchestra.run.smithi174.stdout: python3-natsort python3-oauthlib python3-openssl python3-packaging 2023-06-09T04:37:33.923 INFO:teuthology.orchestra.run.smithi174.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-06-09T04:37:33.924 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pluggy python3-prettytable python3-psutil python3-py python3-pyasn1 2023-06-09T04:37:33.924 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pyasn1-modules python3-pyinotify python3-pyperclip python3-pytest 2023-06-09T04:37:33.924 INFO:teuthology.orchestra.run.smithi174.stdout: python3-repoze.lru python3-requests-oauthlib python3-routes python3-rsa 2023-06-09T04:37:33.924 INFO:teuthology.orchestra.run.smithi174.stdout: python3-scipy python3-simplegeneric python3-simplejson 2023-06-09T04:37:33.924 INFO:teuthology.orchestra.run.smithi174.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-06-09T04:37:33.924 INFO:teuthology.orchestra.run.smithi174.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-06-09T04:37:33.924 INFO:teuthology.orchestra.run.smithi174.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-06-09T04:37:33.925 INFO:teuthology.orchestra.run.smithi174.stdout: qttranslations5-l10n socat xmlstarlet 2023-06-09T04:37:33.925 INFO:teuthology.orchestra.run.smithi174.stdout:Suggested packages: 2023-06-09T04:37:33.925 INFO:teuthology.orchestra.run.smithi174.stdout: python3-influxdb fonts-mathjax-extras fonts-stix libjs-mathjax-doc 2023-06-09T04:37:33.925 INFO:teuthology.orchestra.run.smithi174.stdout: python-attr-doc python-blinker-doc python-cryptography-doc 2023-06-09T04:37:33.925 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2023-06-09T04:37:33.925 INFO:teuthology.orchestra.run.smithi174.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2023-06-09T04:37:33.926 INFO:teuthology.orchestra.run.smithi174.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2023-06-09T04:37:33.926 INFO:teuthology.orchestra.run.smithi174.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2023-06-09T04:37:33.926 INFO:teuthology.orchestra.run.smithi174.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2023-06-09T04:37:33.926 INFO:teuthology.orchestra.run.smithi174.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2023-06-09T04:37:33.926 INFO:teuthology.orchestra.run.smithi174.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2023-06-09T04:37:33.926 INFO:teuthology.orchestra.run.smithi174.stdout:Recommended packages: 2023-06-09T04:37:33.926 INFO:teuthology.orchestra.run.smithi174.stdout: btrfs-tools 2023-06-09T04:37:33.934 INFO:teuthology.orchestra.run.smithi090.stdout:The following packages were automatically installed and are no longer required: 2023-06-09T04:37:33.935 INFO:teuthology.orchestra.run.smithi090.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-06-09T04:37:33.935 INFO:teuthology.orchestra.run.smithi090.stdout:Use 'sudo apt autoremove' to remove them. 2023-06-09T04:37:33.935 INFO:teuthology.orchestra.run.smithi090.stdout:The following additional packages will be installed: 2023-06-09T04:37:33.935 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-06-09T04:37:33.935 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd fonts-mathjax jq 2023-06-09T04:37:33.936 INFO:teuthology.orchestra.run.smithi090.stdout: libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2023-06-09T04:37:33.936 INFO:teuthology.orchestra.run.smithi090.stdout: liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 libpcre2-16-0 2023-06-09T04:37:33.936 INFO:teuthology.orchestra.run.smithi090.stdout: libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 libradosstriper1 2023-06-09T04:37:33.937 INFO:teuthology.orchestra.run.smithi090.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli 2023-06-09T04:37:33.937 INFO:teuthology.orchestra.run.smithi090.stdout: python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2023-06-09T04:37:33.937 INFO:teuthology.orchestra.run.smithi090.stdout: python3-asyncssh python3-atomicwrites python3-attr python3-bcrypt 2023-06-09T04:37:33.937 INFO:teuthology.orchestra.run.smithi090.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2023-06-09T04:37:33.937 INFO:teuthology.orchestra.run.smithi090.stdout: python3-ceph-common python3-cherrypy3 python3-cmd2 python3-colorama 2023-06-09T04:37:33.937 INFO:teuthology.orchestra.run.smithi090.stdout: python3-cryptography python3-decorator python3-google-auth python3-html5lib 2023-06-09T04:37:33.937 INFO:teuthology.orchestra.run.smithi090.stdout: python3-jinja2 python3-joblib python3-jwt python3-kubernetes 2023-06-09T04:37:33.937 INFO:teuthology.orchestra.run.smithi090.stdout: python3-logutils python3-lxml python3-mako python3-markupsafe 2023-06-09T04:37:33.938 INFO:teuthology.orchestra.run.smithi090.stdout: python3-natsort python3-oauthlib python3-openssl python3-packaging 2023-06-09T04:37:33.938 INFO:teuthology.orchestra.run.smithi090.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-06-09T04:37:33.938 INFO:teuthology.orchestra.run.smithi090.stdout: python3-pluggy python3-prettytable python3-psutil python3-py python3-pyasn1 2023-06-09T04:37:33.938 INFO:teuthology.orchestra.run.smithi090.stdout: python3-pyasn1-modules python3-pyinotify python3-pyperclip python3-pytest 2023-06-09T04:37:33.938 INFO:teuthology.orchestra.run.smithi090.stdout: python3-repoze.lru python3-requests-oauthlib python3-routes python3-rsa 2023-06-09T04:37:33.938 INFO:teuthology.orchestra.run.smithi090.stdout: python3-scipy python3-simplegeneric python3-simplejson 2023-06-09T04:37:33.938 INFO:teuthology.orchestra.run.smithi090.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-06-09T04:37:33.938 INFO:teuthology.orchestra.run.smithi090.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-06-09T04:37:33.939 INFO:teuthology.orchestra.run.smithi090.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-06-09T04:37:33.939 INFO:teuthology.orchestra.run.smithi090.stdout: qttranslations5-l10n socat xmlstarlet 2023-06-09T04:37:33.939 INFO:teuthology.orchestra.run.smithi090.stdout:Suggested packages: 2023-06-09T04:37:33.939 INFO:teuthology.orchestra.run.smithi090.stdout: python3-influxdb fonts-mathjax-extras fonts-stix libjs-mathjax-doc 2023-06-09T04:37:33.939 INFO:teuthology.orchestra.run.smithi090.stdout: python-attr-doc python-blinker-doc python-cryptography-doc 2023-06-09T04:37:33.939 INFO:teuthology.orchestra.run.smithi090.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2023-06-09T04:37:33.940 INFO:teuthology.orchestra.run.smithi090.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2023-06-09T04:37:33.940 INFO:teuthology.orchestra.run.smithi090.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2023-06-09T04:37:33.940 INFO:teuthology.orchestra.run.smithi090.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2023-06-09T04:37:33.940 INFO:teuthology.orchestra.run.smithi090.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2023-06-09T04:37:33.940 INFO:teuthology.orchestra.run.smithi090.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2023-06-09T04:37:33.940 INFO:teuthology.orchestra.run.smithi090.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2023-06-09T04:37:33.940 INFO:teuthology.orchestra.run.smithi090.stdout:Recommended packages: 2023-06-09T04:37:33.941 INFO:teuthology.orchestra.run.smithi090.stdout: btrfs-tools 2023-06-09T04:37:34.126 INFO:teuthology.orchestra.run.smithi174.stdout:The following NEW packages will be installed: 2023-06-09T04:37:34.126 INFO:teuthology.orchestra.run.smithi174.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-06-09T04:37:34.126 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-06-09T04:37:34.126 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-06-09T04:37:34.126 INFO:teuthology.orchestra.run.smithi174.stdout: cephfs-mirror cephfs-shell cephfs-top fonts-mathjax jq libcephfs-dev 2023-06-09T04:37:34.127 INFO:teuthology.orchestra.run.smithi174.stdout: libcephfs2 libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc 2023-06-09T04:37:34.127 INFO:teuthology.orchestra.run.smithi174.stdout: libjs-underscore liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 2023-06-09T04:37:34.127 INFO:teuthology.orchestra.run.smithi174.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 2023-06-09T04:37:34.128 INFO:teuthology.orchestra.run.smithi174.stdout: libradosstriper1 librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 2023-06-09T04:37:34.128 INFO:teuthology.orchestra.run.smithi174.stdout: nvme-cli python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2023-06-09T04:37:34.128 INFO:teuthology.orchestra.run.smithi174.stdout: python3-asyncssh python3-atomicwrites python3-attr python3-bcrypt 2023-06-09T04:37:34.128 INFO:teuthology.orchestra.run.smithi174.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2023-06-09T04:37:34.128 INFO:teuthology.orchestra.run.smithi174.stdout: python3-ceph-common python3-cephfs python3-cherrypy3 python3-cmd2 2023-06-09T04:37:34.128 INFO:teuthology.orchestra.run.smithi174.stdout: python3-colorama python3-cryptography python3-decorator python3-google-auth 2023-06-09T04:37:34.128 INFO:teuthology.orchestra.run.smithi174.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2023-06-09T04:37:34.129 INFO:teuthology.orchestra.run.smithi174.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2023-06-09T04:37:34.129 INFO:teuthology.orchestra.run.smithi174.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2023-06-09T04:37:34.129 INFO:teuthology.orchestra.run.smithi174.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2023-06-09T04:37:34.129 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2023-06-09T04:37:34.129 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2023-06-09T04:37:34.129 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru 2023-06-09T04:37:34.129 INFO:teuthology.orchestra.run.smithi174.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-06-09T04:37:34.129 INFO:teuthology.orchestra.run.smithi174.stdout: python3-scipy python3-simplegeneric python3-simplejson 2023-06-09T04:37:34.130 INFO:teuthology.orchestra.run.smithi174.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-06-09T04:37:34.130 INFO:teuthology.orchestra.run.smithi174.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-06-09T04:37:34.130 INFO:teuthology.orchestra.run.smithi174.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-06-09T04:37:34.130 INFO:teuthology.orchestra.run.smithi174.stdout: qttranslations5-l10n radosgw rbd-fuse socat xmlstarlet 2023-06-09T04:37:34.130 INFO:teuthology.orchestra.run.smithi174.stdout:The following packages will be upgraded: 2023-06-09T04:37:34.131 INFO:teuthology.orchestra.run.smithi174.stdout: librados2 librbd1 2023-06-09T04:37:34.136 INFO:teuthology.orchestra.run.smithi090.stdout:The following NEW packages will be installed: 2023-06-09T04:37:34.136 INFO:teuthology.orchestra.run.smithi090.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-06-09T04:37:34.136 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-06-09T04:37:34.136 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-06-09T04:37:34.137 INFO:teuthology.orchestra.run.smithi090.stdout: cephfs-mirror cephfs-shell cephfs-top fonts-mathjax jq libcephfs-dev 2023-06-09T04:37:34.137 INFO:teuthology.orchestra.run.smithi090.stdout: libcephfs2 libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc 2023-06-09T04:37:34.137 INFO:teuthology.orchestra.run.smithi090.stdout: libjs-underscore liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 2023-06-09T04:37:34.137 INFO:teuthology.orchestra.run.smithi090.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 2023-06-09T04:37:34.138 INFO:teuthology.orchestra.run.smithi090.stdout: libradosstriper1 librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 2023-06-09T04:37:34.138 INFO:teuthology.orchestra.run.smithi090.stdout: nvme-cli python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2023-06-09T04:37:34.138 INFO:teuthology.orchestra.run.smithi090.stdout: python3-asyncssh python3-atomicwrites python3-attr python3-bcrypt 2023-06-09T04:37:34.138 INFO:teuthology.orchestra.run.smithi090.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2023-06-09T04:37:34.138 INFO:teuthology.orchestra.run.smithi090.stdout: python3-ceph-common python3-cephfs python3-cherrypy3 python3-cmd2 2023-06-09T04:37:34.138 INFO:teuthology.orchestra.run.smithi090.stdout: python3-colorama python3-cryptography python3-decorator python3-google-auth 2023-06-09T04:37:34.138 INFO:teuthology.orchestra.run.smithi090.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2023-06-09T04:37:34.138 INFO:teuthology.orchestra.run.smithi090.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2023-06-09T04:37:34.139 INFO:teuthology.orchestra.run.smithi090.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2023-06-09T04:37:34.139 INFO:teuthology.orchestra.run.smithi090.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2023-06-09T04:37:34.139 INFO:teuthology.orchestra.run.smithi090.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2023-06-09T04:37:34.139 INFO:teuthology.orchestra.run.smithi090.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2023-06-09T04:37:34.139 INFO:teuthology.orchestra.run.smithi090.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru 2023-06-09T04:37:34.139 INFO:teuthology.orchestra.run.smithi090.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-06-09T04:37:34.139 INFO:teuthology.orchestra.run.smithi090.stdout: python3-scipy python3-simplegeneric python3-simplejson 2023-06-09T04:37:34.139 INFO:teuthology.orchestra.run.smithi090.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-06-09T04:37:34.140 INFO:teuthology.orchestra.run.smithi090.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-06-09T04:37:34.140 INFO:teuthology.orchestra.run.smithi090.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-06-09T04:37:34.140 INFO:teuthology.orchestra.run.smithi090.stdout: qttranslations5-l10n radosgw rbd-fuse socat xmlstarlet 2023-06-09T04:37:34.140 INFO:teuthology.orchestra.run.smithi090.stdout:The following packages will be upgraded: 2023-06-09T04:37:34.141 INFO:teuthology.orchestra.run.smithi090.stdout: librados2 librbd1 2023-06-09T04:37:34.228 INFO:teuthology.orchestra.run.smithi090.stdout:2 upgraded, 116 newly installed, 0 to remove and 186 not upgraded. 2023-06-09T04:37:34.228 INFO:teuthology.orchestra.run.smithi090.stdout:Need to get 201 MB of archives. 2023-06-09T04:37:34.228 INFO:teuthology.orchestra.run.smithi090.stdout:After this operation, 1,004 MB of additional disk space will be used. 2023-06-09T04:37:34.228 INFO:teuthology.orchestra.run.smithi090.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyperclip all 1.7.0-1 [10.5 kB] 2023-06-09T04:37:34.248 INFO:teuthology.orchestra.run.smithi090.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2023-06-09T04:37:34.255 INFO:teuthology.orchestra.run.smithi090.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cmd2 all 0.8.5-2.1 [49.6 kB] 2023-06-09T04:37:34.281 INFO:teuthology.orchestra.run.smithi090.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2023-06-09T04:37:34.307 INFO:teuthology.orchestra.run.smithi174.stdout:2 upgraded, 116 newly installed, 0 to remove and 186 not upgraded. 2023-06-09T04:37:34.308 INFO:teuthology.orchestra.run.smithi174.stdout:Need to get 201 MB of archives. 2023-06-09T04:37:34.308 INFO:teuthology.orchestra.run.smithi174.stdout:After this operation, 1,004 MB of additional disk space will be used. 2023-06-09T04:37:34.308 INFO:teuthology.orchestra.run.smithi174.stdout:Get:1 https://3.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 18.0.0-4313-ga02638f8-1focal [3,429 kB] 2023-06-09T04:37:34.310 INFO:teuthology.orchestra.run.smithi090.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/universe amd64 libdouble-conversion3 amd64 3.1.5-4ubuntu1 [37.9 kB] 2023-06-09T04:37:34.314 INFO:teuthology.orchestra.run.smithi090.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpcre2-16-0 amd64 10.34-7ubuntu0.1 [181 kB] 2023-06-09T04:37:34.319 INFO:teuthology.orchestra.run.smithi090.stdout:Get:7 https://3.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 18.0.0-4313-ga02638f8-1focal [3,429 kB] 2023-06-09T04:37:34.327 INFO:teuthology.orchestra.run.smithi090.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5core5a amd64 5.12.8+dfsg-0ubuntu2.1 [2,006 kB] 2023-06-09T04:37:34.346 INFO:teuthology.orchestra.run.smithi174.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyperclip all 1.7.0-1 [10.5 kB] 2023-06-09T04:37:34.370 INFO:teuthology.orchestra.run.smithi090.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5dbus5 amd64 5.12.8+dfsg-0ubuntu2.1 [208 kB] 2023-06-09T04:37:34.372 INFO:teuthology.orchestra.run.smithi090.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5network5 amd64 5.12.8+dfsg-0ubuntu2.1 [673 kB] 2023-06-09T04:37:34.380 INFO:teuthology.orchestra.run.smithi090.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal/universe amd64 libthrift-0.13.0 amd64 0.13.0-2build2 [249 kB] 2023-06-09T04:37:34.382 INFO:teuthology.orchestra.run.smithi090.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2023-06-09T04:37:34.418 INFO:teuthology.orchestra.run.smithi090.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2023-06-09T04:37:34.431 INFO:teuthology.orchestra.run.smithi174.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2023-06-09T04:37:34.466 INFO:teuthology.orchestra.run.smithi174.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cmd2 all 0.8.5-2.1 [49.6 kB] 2023-06-09T04:37:34.493 INFO:teuthology.orchestra.run.smithi090.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2023-06-09T04:37:34.497 INFO:teuthology.orchestra.run.smithi090.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2023-06-09T04:37:34.534 INFO:teuthology.orchestra.run.smithi090.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2023-06-09T04:37:34.535 INFO:teuthology.orchestra.run.smithi090.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2023-06-09T04:37:34.542 INFO:teuthology.orchestra.run.smithi090.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-natsort all 7.0.1-1 [29.2 kB] 2023-06-09T04:37:34.543 INFO:teuthology.orchestra.run.smithi090.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2023-06-09T04:37:34.544 INFO:teuthology.orchestra.run.smithi090.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2023-06-09T04:37:34.545 INFO:teuthology.orchestra.run.smithi090.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2023-06-09T04:37:34.547 INFO:teuthology.orchestra.run.smithi090.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-06-09T04:37:34.548 INFO:teuthology.orchestra.run.smithi090.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2023-06-09T04:37:34.580 INFO:teuthology.orchestra.run.smithi174.stdout:Get:5 https://3.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 18.0.0-4313-ga02638f8-1focal [3,984 kB] 2023-06-09T04:37:34.583 INFO:teuthology.orchestra.run.smithi090.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2023-06-09T04:37:34.590 INFO:teuthology.orchestra.run.smithi174.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2023-06-09T04:37:34.619 INFO:teuthology.orchestra.run.smithi090.stdout:Get:25 https://3.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 18.0.0-4313-ga02638f8-1focal [3,984 kB] 2023-06-09T04:37:34.650 INFO:teuthology.orchestra.run.smithi090.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2023-06-09T04:37:34.654 INFO:teuthology.orchestra.run.smithi090.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2023-06-09T04:37:34.668 INFO:teuthology.orchestra.run.smithi090.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2023-06-09T04:37:34.681 INFO:teuthology.orchestra.run.smithi090.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2023-06-09T04:37:34.683 INFO:teuthology.orchestra.run.smithi090.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2023-06-09T04:37:34.708 INFO:teuthology.orchestra.run.smithi090.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2023-06-09T04:37:34.708 INFO:teuthology.orchestra.run.smithi090.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2023-06-09T04:37:34.709 INFO:teuthology.orchestra.run.smithi090.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2023-06-09T04:37:34.710 INFO:teuthology.orchestra.run.smithi090.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2023-06-09T04:37:34.712 INFO:teuthology.orchestra.run.smithi090.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-werkzeug all 0.16.1+dfsg1-2ubuntu0.1 [183 kB] 2023-06-09T04:37:34.729 INFO:teuthology.orchestra.run.smithi174.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/universe amd64 libdouble-conversion3 amd64 3.1.5-4ubuntu1 [37.9 kB] 2023-06-09T04:37:34.746 INFO:teuthology.orchestra.run.smithi174.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpcre2-16-0 amd64 10.34-7ubuntu0.1 [181 kB] 2023-06-09T04:37:34.751 INFO:teuthology.orchestra.run.smithi090.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.1 [211 kB] 2023-06-09T04:37:34.809 INFO:teuthology.orchestra.run.smithi174.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5core5a amd64 5.12.8+dfsg-0ubuntu2.1 [2,006 kB] 2023-06-09T04:37:34.832 INFO:teuthology.orchestra.run.smithi174.stdout:Get:10 https://3.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 18.0.0-4313-ga02638f8-1focal [724 kB] 2023-06-09T04:37:34.842 INFO:teuthology.orchestra.run.smithi090.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2023-06-09T04:37:34.845 INFO:teuthology.orchestra.run.smithi090.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-asyncssh all 1.12.2-1 [152 kB] 2023-06-09T04:37:34.854 INFO:teuthology.orchestra.run.smithi090.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2023-06-09T04:37:34.863 INFO:teuthology.orchestra.run.smithi090.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2023-06-09T04:37:34.863 INFO:teuthology.orchestra.run.smithi090.stdout:Get:41 https://3.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 18.0.0-4313-ga02638f8-1focal [724 kB] 2023-06-09T04:37:34.864 INFO:teuthology.orchestra.run.smithi090.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2023-06-09T04:37:34.865 INFO:teuthology.orchestra.run.smithi090.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-06-09T04:37:34.866 INFO:teuthology.orchestra.run.smithi090.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2023-06-09T04:37:34.872 INFO:teuthology.orchestra.run.smithi090.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2023-06-09T04:37:34.876 INFO:teuthology.orchestra.run.smithi090.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2023-06-09T04:37:34.879 INFO:teuthology.orchestra.run.smithi090.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2023-06-09T04:37:34.897 INFO:teuthology.orchestra.run.smithi174.stdout:Get:11 https://3.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 18.0.0-4313-ga02638f8-1focal [377 kB] 2023-06-09T04:37:34.915 INFO:teuthology.orchestra.run.smithi090.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2023-06-09T04:37:34.956 INFO:teuthology.orchestra.run.smithi090.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2023-06-09T04:37:34.958 INFO:teuthology.orchestra.run.smithi090.stdout:Get:50 https://3.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 18.0.0-4313-ga02638f8-1focal [377 kB] 2023-06-09T04:37:34.965 INFO:teuthology.orchestra.run.smithi090.stdout:Get:51 https://3.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 18.0.0-4313-ga02638f8-1focal [22.5 kB] 2023-06-09T04:37:34.965 INFO:teuthology.orchestra.run.smithi090.stdout:Get:52 https://3.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 18.0.0-4313-ga02638f8-1focal [191 kB] 2023-06-09T04:37:34.968 INFO:teuthology.orchestra.run.smithi090.stdout:Get:53 https://3.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 18.0.0-4313-ga02638f8-1focal [48.4 kB] 2023-06-09T04:37:34.969 INFO:teuthology.orchestra.run.smithi090.stdout:Get:54 https://3.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 18.0.0-4313-ga02638f8-1focal [354 kB] 2023-06-09T04:37:34.979 INFO:teuthology.orchestra.run.smithi174.stdout:Get:12 https://3.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 18.0.0-4313-ga02638f8-1focal [22.5 kB] 2023-06-09T04:37:34.981 INFO:teuthology.orchestra.run.smithi174.stdout:Get:13 https://3.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 18.0.0-4313-ga02638f8-1focal [191 kB] 2023-06-09T04:37:34.983 INFO:teuthology.orchestra.run.smithi174.stdout:Get:14 https://3.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 18.0.0-4313-ga02638f8-1focal [48.4 kB] 2023-06-09T04:37:34.984 INFO:teuthology.orchestra.run.smithi174.stdout:Get:15 https://3.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 18.0.0-4313-ga02638f8-1focal [354 kB] 2023-06-09T04:37:34.988 INFO:teuthology.orchestra.run.smithi174.stdout:Get:16 https://3.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 18.0.0-4313-ga02638f8-1focal [6,565 kB] 2023-06-09T04:37:35.008 INFO:teuthology.orchestra.run.smithi174.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5dbus5 amd64 5.12.8+dfsg-0ubuntu2.1 [208 kB] 2023-06-09T04:37:35.011 INFO:teuthology.orchestra.run.smithi090.stdout:Get:55 https://3.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 18.0.0-4313-ga02638f8-1focal [6,565 kB] 2023-06-09T04:37:35.017 INFO:teuthology.orchestra.run.smithi174.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5network5 amd64 5.12.8+dfsg-0ubuntu2.1 [673 kB] 2023-06-09T04:37:35.044 INFO:teuthology.orchestra.run.smithi174.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/universe amd64 libthrift-0.13.0 amd64 0.13.0-2build2 [249 kB] 2023-06-09T04:37:35.052 INFO:teuthology.orchestra.run.smithi174.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2023-06-09T04:37:35.140 INFO:teuthology.orchestra.run.smithi090.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2023-06-09T04:37:35.160 INFO:teuthology.orchestra.run.smithi090.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2023-06-09T04:37:35.162 INFO:teuthology.orchestra.run.smithi090.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2023-06-09T04:37:35.177 INFO:teuthology.orchestra.run.smithi090.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2023-06-09T04:37:35.178 INFO:teuthology.orchestra.run.smithi090.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2023-06-09T04:37:35.178 INFO:teuthology.orchestra.run.smithi090.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2023-06-09T04:37:35.179 INFO:teuthology.orchestra.run.smithi090.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2023-06-09T04:37:35.179 INFO:teuthology.orchestra.run.smithi090.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2023-06-09T04:37:35.180 INFO:teuthology.orchestra.run.smithi090.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2023-06-09T04:37:35.215 INFO:teuthology.orchestra.run.smithi090.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2023-06-09T04:37:35.216 INFO:teuthology.orchestra.run.smithi174.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2023-06-09T04:37:35.282 INFO:teuthology.orchestra.run.smithi090.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2023-06-09T04:37:35.285 INFO:teuthology.orchestra.run.smithi090.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2023-06-09T04:37:35.290 INFO:teuthology.orchestra.run.smithi090.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2023-06-09T04:37:35.323 INFO:teuthology.orchestra.run.smithi090.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2023-06-09T04:37:35.331 INFO:teuthology.orchestra.run.smithi090.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2023-06-09T04:37:35.337 INFO:teuthology.orchestra.run.smithi090.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2023-06-09T04:37:35.338 INFO:teuthology.orchestra.run.smithi090.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2023-06-09T04:37:35.348 INFO:teuthology.orchestra.run.smithi090.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2023-06-09T04:37:35.354 INFO:teuthology.orchestra.run.smithi090.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-colorama all 0.4.3-1build1 [23.9 kB] 2023-06-09T04:37:35.354 INFO:teuthology.orchestra.run.smithi090.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/universe amd64 fonts-mathjax all 2.7.4+dfsg-1 [2,208 kB] 2023-06-09T04:37:35.359 INFO:teuthology.orchestra.run.smithi090.stdout:Get:76 https://3.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 18.0.0-4313-ga02638f8-1focal [104 kB] 2023-06-09T04:37:35.361 INFO:teuthology.orchestra.run.smithi090.stdout:Get:77 https://3.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 18.0.0-4313-ga02638f8-1focal [466 kB] 2023-06-09T04:37:35.402 INFO:teuthology.orchestra.run.smithi090.stdout:Get:78 https://3.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 18.0.0-4313-ga02638f8-1focal [25.1 MB] 2023-06-09T04:37:35.416 INFO:teuthology.orchestra.run.smithi090.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2023-06-09T04:37:35.442 INFO:teuthology.orchestra.run.smithi174.stdout:Get:22 https://3.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 18.0.0-4313-ga02638f8-1focal [104 kB] 2023-06-09T04:37:35.445 INFO:teuthology.orchestra.run.smithi174.stdout:Get:23 https://3.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 18.0.0-4313-ga02638f8-1focal [466 kB] 2023-06-09T04:37:35.453 INFO:teuthology.orchestra.run.smithi174.stdout:Get:24 https://3.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 18.0.0-4313-ga02638f8-1focal [25.1 MB] 2023-06-09T04:37:35.513 INFO:teuthology.orchestra.run.smithi090.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-asyncssh-doc all 1.12.2-1 [258 kB] 2023-06-09T04:37:35.526 INFO:teuthology.orchestra.run.smithi090.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal/universe amd64 libjs-mathjax all 2.7.4+dfsg-1 [5,654 kB] 2023-06-09T04:37:35.574 INFO:teuthology.orchestra.run.smithi174.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2023-06-09T04:37:35.592 INFO:teuthology.orchestra.run.smithi174.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2023-06-09T04:37:35.610 INFO:teuthology.orchestra.run.smithi090.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-natsort-doc all 7.0.1-1 [103 kB] 2023-06-09T04:37:35.611 INFO:teuthology.orchestra.run.smithi090.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2023-06-09T04:37:35.611 INFO:teuthology.orchestra.run.smithi090.stdout:Get:84 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2023-06-09T04:37:35.612 INFO:teuthology.orchestra.run.smithi090.stdout:Get:85 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2023-06-09T04:37:35.612 INFO:teuthology.orchestra.run.smithi090.stdout:Get:86 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2023-06-09T04:37:35.614 INFO:teuthology.orchestra.run.smithi090.stdout:Get:87 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2023-06-09T04:37:35.628 INFO:teuthology.orchestra.run.smithi090.stdout:Get:88 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2023-06-09T04:37:35.628 INFO:teuthology.orchestra.run.smithi090.stdout:Get:89 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-06-09T04:37:35.664 INFO:teuthology.orchestra.run.smithi090.stdout:Get:90 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2023-06-09T04:37:35.700 INFO:teuthology.orchestra.run.smithi090.stdout:Get:91 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2023-06-09T04:37:35.743 INFO:teuthology.orchestra.run.smithi090.stdout:Get:92 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2023-06-09T04:37:35.753 INFO:teuthology.orchestra.run.smithi090.stdout:Get:93 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2023-06-09T04:37:35.755 INFO:teuthology.orchestra.run.smithi090.stdout:Get:94 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2023-06-09T04:37:35.769 INFO:teuthology.orchestra.run.smithi090.stdout:Get:95 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2023-06-09T04:37:35.770 INFO:teuthology.orchestra.run.smithi174.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2023-06-09T04:37:35.772 INFO:teuthology.orchestra.run.smithi090.stdout:Get:96 http://archive.ubuntu.com/ubuntu focal/universe amd64 qttranslations5-l10n all 5.12.8-0ubuntu1 [1,486 kB] 2023-06-09T04:37:35.779 INFO:teuthology.orchestra.run.smithi174.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2023-06-09T04:37:35.814 INFO:teuthology.orchestra.run.smithi174.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-natsort all 7.0.1-1 [29.2 kB] 2023-06-09T04:37:35.819 INFO:teuthology.orchestra.run.smithi174.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2023-06-09T04:37:35.822 INFO:teuthology.orchestra.run.smithi174.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2023-06-09T04:37:35.824 INFO:teuthology.orchestra.run.smithi174.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2023-06-09T04:37:35.834 INFO:teuthology.orchestra.run.smithi174.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-06-09T04:37:35.835 INFO:teuthology.orchestra.run.smithi174.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2023-06-09T04:37:36.000 INFO:teuthology.orchestra.run.smithi174.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2023-06-09T04:37:36.317 INFO:teuthology.orchestra.run.smithi174.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2023-06-09T04:37:36.340 INFO:teuthology.orchestra.run.smithi174.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2023-06-09T04:37:36.411 INFO:teuthology.orchestra.run.smithi174.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2023-06-09T04:37:36.473 INFO:teuthology.orchestra.run.smithi174.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2023-06-09T04:37:36.481 INFO:teuthology.orchestra.run.smithi174.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2023-06-09T04:37:36.603 INFO:teuthology.orchestra.run.smithi174.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2023-06-09T04:37:36.603 INFO:teuthology.orchestra.run.smithi174.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2023-06-09T04:37:36.606 INFO:teuthology.orchestra.run.smithi174.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2023-06-09T04:37:36.610 INFO:teuthology.orchestra.run.smithi174.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2023-06-09T04:37:36.622 INFO:teuthology.orchestra.run.smithi174.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-werkzeug all 0.16.1+dfsg1-2ubuntu0.1 [183 kB] 2023-06-09T04:37:36.808 INFO:teuthology.orchestra.run.smithi174.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.1 [211 kB] 2023-06-09T04:37:36.981 INFO:teuthology.orchestra.run.smithi090.stdout:Get:97 https://3.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 18.0.0-4313-ga02638f8-1focal [11.0 MB] 2023-06-09T04:37:37.195 INFO:teuthology.orchestra.run.smithi174.stdout:Get:47 https://3.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 18.0.0-4313-ga02638f8-1focal [11.0 MB] 2023-06-09T04:37:37.245 INFO:teuthology.orchestra.run.smithi174.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2023-06-09T04:37:37.257 INFO:teuthology.orchestra.run.smithi174.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-asyncssh all 1.12.2-1 [152 kB] 2023-06-09T04:37:37.302 INFO:teuthology.orchestra.run.smithi174.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2023-06-09T04:37:37.345 INFO:teuthology.orchestra.run.smithi174.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2023-06-09T04:37:37.354 INFO:teuthology.orchestra.run.smithi174.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2023-06-09T04:37:37.359 INFO:teuthology.orchestra.run.smithi174.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-06-09T04:37:37.363 INFO:teuthology.orchestra.run.smithi174.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2023-06-09T04:37:37.389 INFO:teuthology.orchestra.run.smithi174.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2023-06-09T04:37:37.411 INFO:teuthology.orchestra.run.smithi174.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2023-06-09T04:37:37.422 INFO:teuthology.orchestra.run.smithi174.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2023-06-09T04:37:37.587 INFO:teuthology.orchestra.run.smithi174.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2023-06-09T04:37:37.696 INFO:teuthology.orchestra.run.smithi090.stdout:Get:98 https://3.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 18.0.0-4313-ga02638f8-1focal [223 kB] 2023-06-09T04:37:37.699 INFO:teuthology.orchestra.run.smithi090.stdout:Get:99 https://3.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 18.0.0-4313-ga02638f8-1focal [133 kB] 2023-06-09T04:37:37.702 INFO:teuthology.orchestra.run.smithi090.stdout:Get:100 https://3.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 18.0.0-4313-ga02638f8-1focal [1,550 kB] 2023-06-09T04:37:37.777 INFO:teuthology.orchestra.run.smithi174.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2023-06-09T04:37:37.819 INFO:teuthology.orchestra.run.smithi090.stdout:Get:101 https://3.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 18.0.0-4313-ga02638f8-1focal [9,386 kB] 2023-06-09T04:37:37.898 INFO:teuthology.orchestra.run.smithi174.stdout:Get:60 https://3.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 18.0.0-4313-ga02638f8-1focal [223 kB] 2023-06-09T04:37:37.911 INFO:teuthology.orchestra.run.smithi174.stdout:Get:61 https://3.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 18.0.0-4313-ga02638f8-1focal [133 kB] 2023-06-09T04:37:37.915 INFO:teuthology.orchestra.run.smithi174.stdout:Get:62 https://3.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 18.0.0-4313-ga02638f8-1focal [1,550 kB] 2023-06-09T04:37:37.999 INFO:teuthology.orchestra.run.smithi174.stdout:Get:63 https://3.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 18.0.0-4313-ga02638f8-1focal [9,386 kB] 2023-06-09T04:37:38.442 INFO:teuthology.orchestra.run.smithi090.stdout:Get:102 https://3.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 18.0.0-4313-ga02638f8-1focal [31.3 MB] 2023-06-09T04:37:38.568 INFO:teuthology.orchestra.run.smithi174.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2023-06-09T04:37:38.607 INFO:teuthology.orchestra.run.smithi174.stdout:Get:65 https://3.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 18.0.0-4313-ga02638f8-1focal [31.3 MB] 2023-06-09T04:37:38.614 INFO:teuthology.orchestra.run.smithi174.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2023-06-09T04:37:38.616 INFO:teuthology.orchestra.run.smithi174.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2023-06-09T04:37:38.689 INFO:teuthology.orchestra.run.smithi174.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2023-06-09T04:37:38.689 INFO:teuthology.orchestra.run.smithi174.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2023-06-09T04:37:38.690 INFO:teuthology.orchestra.run.smithi174.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2023-06-09T04:37:38.691 INFO:teuthology.orchestra.run.smithi174.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2023-06-09T04:37:38.691 INFO:teuthology.orchestra.run.smithi174.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2023-06-09T04:37:38.692 INFO:teuthology.orchestra.run.smithi174.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2023-06-09T04:37:38.857 INFO:teuthology.orchestra.run.smithi174.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2023-06-09T04:37:39.175 INFO:teuthology.orchestra.run.smithi174.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2023-06-09T04:37:39.189 INFO:teuthology.orchestra.run.smithi174.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2023-06-09T04:37:39.215 INFO:teuthology.orchestra.run.smithi174.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2023-06-09T04:37:39.372 INFO:teuthology.orchestra.run.smithi174.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2023-06-09T04:37:39.416 INFO:teuthology.orchestra.run.smithi174.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2023-06-09T04:37:39.444 INFO:teuthology.orchestra.run.smithi174.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2023-06-09T04:37:39.453 INFO:teuthology.orchestra.run.smithi174.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2023-06-09T04:37:39.495 INFO:teuthology.orchestra.run.smithi174.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2023-06-09T04:37:39.526 INFO:teuthology.orchestra.run.smithi174.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-colorama all 0.4.3-1build1 [23.9 kB] 2023-06-09T04:37:39.528 INFO:teuthology.orchestra.run.smithi174.stdout:Get:84 http://archive.ubuntu.com/ubuntu focal/universe amd64 fonts-mathjax all 2.7.4+dfsg-1 [2,208 kB] 2023-06-09T04:37:39.812 INFO:teuthology.orchestra.run.smithi174.stdout:Get:85 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2023-06-09T04:37:40.279 INFO:teuthology.orchestra.run.smithi174.stdout:Get:86 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-asyncssh-doc all 1.12.2-1 [258 kB] 2023-06-09T04:37:40.335 INFO:teuthology.orchestra.run.smithi174.stdout:Get:87 http://archive.ubuntu.com/ubuntu focal/universe amd64 libjs-mathjax all 2.7.4+dfsg-1 [5,654 kB] 2023-06-09T04:37:40.582 INFO:teuthology.orchestra.run.smithi090.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 18.0.0-4313-ga02638f8-1focal [3,812 B] 2023-06-09T04:37:40.582 INFO:teuthology.orchestra.run.smithi090.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 18.0.0-4313-ga02638f8-1focal [832 kB] 2023-06-09T04:37:40.622 INFO:teuthology.orchestra.run.smithi174.stdout:Get:88 https://3.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 18.0.0-4313-ga02638f8-1focal [3,812 B] 2023-06-09T04:37:40.623 INFO:teuthology.orchestra.run.smithi174.stdout:Get:89 https://3.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 18.0.0-4313-ga02638f8-1focal [832 kB] 2023-06-09T04:37:40.635 INFO:teuthology.orchestra.run.smithi090.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 18.0.0-4313-ga02638f8-1focal [2,295 kB] 2023-06-09T04:37:40.672 INFO:teuthology.orchestra.run.smithi174.stdout:Get:90 https://3.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 18.0.0-4313-ga02638f8-1focal [2,295 kB] 2023-06-09T04:37:40.686 INFO:teuthology.orchestra.run.smithi174.stdout:Get:91 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-natsort-doc all 7.0.1-1 [103 kB] 2023-06-09T04:37:40.688 INFO:teuthology.orchestra.run.smithi174.stdout:Get:92 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2023-06-09T04:37:40.689 INFO:teuthology.orchestra.run.smithi174.stdout:Get:93 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2023-06-09T04:37:40.691 INFO:teuthology.orchestra.run.smithi174.stdout:Get:94 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2023-06-09T04:37:40.692 INFO:teuthology.orchestra.run.smithi174.stdout:Get:95 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2023-06-09T04:37:40.694 INFO:teuthology.orchestra.run.smithi174.stdout:Get:96 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2023-06-09T04:37:40.730 INFO:teuthology.orchestra.run.smithi174.stdout:Get:97 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2023-06-09T04:37:40.730 INFO:teuthology.orchestra.run.smithi174.stdout:Get:98 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-06-09T04:37:40.783 INFO:teuthology.orchestra.run.smithi090.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 18.0.0-4313-ga02638f8-1focal [211 kB] 2023-06-09T04:37:40.793 INFO:teuthology.orchestra.run.smithi090.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 18.0.0-4313-ga02638f8-1focal [123 kB] 2023-06-09T04:37:40.797 INFO:teuthology.orchestra.run.smithi090.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 18.0.0-4313-ga02638f8-1focal [1,774 kB] 2023-06-09T04:37:40.817 INFO:teuthology.orchestra.run.smithi174.stdout:Get:99 https://3.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 18.0.0-4313-ga02638f8-1focal [211 kB] 2023-06-09T04:37:40.823 INFO:teuthology.orchestra.run.smithi174.stdout:Get:100 https://3.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 18.0.0-4313-ga02638f8-1focal [123 kB] 2023-06-09T04:37:40.826 INFO:teuthology.orchestra.run.smithi174.stdout:Get:101 https://3.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 18.0.0-4313-ga02638f8-1focal [1,774 kB] 2023-06-09T04:37:40.896 INFO:teuthology.orchestra.run.smithi174.stdout:Get:102 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2023-06-09T04:37:40.926 INFO:teuthology.orchestra.run.smithi090.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 18.0.0-4313-ga02638f8-1focal [7,894 kB] 2023-06-09T04:37:40.950 INFO:teuthology.orchestra.run.smithi174.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 18.0.0-4313-ga02638f8-1focal [7,894 kB] 2023-06-09T04:37:41.064 INFO:teuthology.orchestra.run.smithi174.stdout:Get:104 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2023-06-09T04:37:41.277 INFO:teuthology.orchestra.run.smithi174.stdout:Get:105 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2023-06-09T04:37:41.325 INFO:teuthology.orchestra.run.smithi174.stdout:Get:106 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2023-06-09T04:37:41.338 INFO:teuthology.orchestra.run.smithi174.stdout:Get:107 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2023-06-09T04:37:41.401 INFO:teuthology.orchestra.run.smithi174.stdout:Get:108 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2023-06-09T04:37:41.415 INFO:teuthology.orchestra.run.smithi174.stdout:Get:109 http://archive.ubuntu.com/ubuntu focal/universe amd64 qttranslations5-l10n all 5.12.8-0ubuntu1 [1,486 kB] 2023-06-09T04:37:41.453 INFO:teuthology.orchestra.run.smithi090.stdout:Get:110 https://3.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 18.0.0-4313-ga02638f8-1focal [3,932 B] 2023-06-09T04:37:41.453 INFO:teuthology.orchestra.run.smithi090.stdout:Get:111 https://3.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 18.0.0-4313-ga02638f8-1focal [43.8 MB] 2023-06-09T04:37:41.466 INFO:teuthology.orchestra.run.smithi174.stdout:Get:110 https://3.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 18.0.0-4313-ga02638f8-1focal [3,932 B] 2023-06-09T04:37:41.467 INFO:teuthology.orchestra.run.smithi174.stdout:Get:111 https://3.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 18.0.0-4313-ga02638f8-1focal [43.8 MB] 2023-06-09T04:37:44.335 INFO:teuthology.orchestra.run.smithi174.stdout:Get:112 https://3.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/focal/flavors/default focal/main amd64 ceph-volume all 18.0.0-4313-ga02638f8-1focal [220 kB] 2023-06-09T04:37:44.337 INFO:teuthology.orchestra.run.smithi174.stdout:Get:113 https://3.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/focal/flavors/default focal/main amd64 cephfs-mirror amd64 18.0.0-4313-ga02638f8-1focal [253 kB] 2023-06-09T04:37:44.342 INFO:teuthology.orchestra.run.smithi090.stdout:Get:112 https://3.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/focal/flavors/default focal/main amd64 ceph-volume all 18.0.0-4313-ga02638f8-1focal [220 kB] 2023-06-09T04:37:44.345 INFO:teuthology.orchestra.run.smithi090.stdout:Get:113 https://3.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/focal/flavors/default focal/main amd64 cephfs-mirror amd64 18.0.0-4313-ga02638f8-1focal [253 kB] 2023-06-09T04:37:44.347 INFO:teuthology.orchestra.run.smithi090.stdout:Get:114 https://3.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/focal/flavors/default focal/main amd64 cephfs-shell all 18.0.0-4313-ga02638f8-1focal [23.3 kB] 2023-06-09T04:37:44.348 INFO:teuthology.orchestra.run.smithi090.stdout:Get:115 https://3.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/focal/flavors/default focal/main amd64 cephfs-top all 18.0.0-4313-ga02638f8-1focal [12.9 kB] 2023-06-09T04:37:44.348 INFO:teuthology.orchestra.run.smithi090.stdout:Get:116 https://3.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 18.0.0-4313-ga02638f8-1focal [28.0 kB] 2023-06-09T04:37:44.348 INFO:teuthology.orchestra.run.smithi090.stdout:Get:117 https://3.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 18.0.0-4313-ga02638f8-1focal [13.4 MB] 2023-06-09T04:37:44.365 INFO:teuthology.orchestra.run.smithi174.stdout:Get:114 https://3.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/focal/flavors/default focal/main amd64 cephfs-shell all 18.0.0-4313-ga02638f8-1focal [23.3 kB] 2023-06-09T04:37:44.366 INFO:teuthology.orchestra.run.smithi174.stdout:Get:115 https://3.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/focal/flavors/default focal/main amd64 cephfs-top all 18.0.0-4313-ga02638f8-1focal [12.9 kB] 2023-06-09T04:37:44.367 INFO:teuthology.orchestra.run.smithi174.stdout:Get:116 https://3.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 18.0.0-4313-ga02638f8-1focal [28.0 kB] 2023-06-09T04:37:44.368 INFO:teuthology.orchestra.run.smithi174.stdout:Get:117 https://3.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 18.0.0-4313-ga02638f8-1focal [13.4 MB] 2023-06-09T04:37:45.220 INFO:teuthology.orchestra.run.smithi174.stdout:Get:118 https://3.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 18.0.0-4313-ga02638f8-1focal [97.4 kB] 2023-06-09T04:37:45.241 INFO:teuthology.orchestra.run.smithi090.stdout:Get:118 https://3.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 18.0.0-4313-ga02638f8-1focal [97.4 kB] 2023-06-09T04:37:46.118 INFO:teuthology.orchestra.run.smithi090.stdout:Fetched 201 MB in 11s (18.2 MB/s) 2023-06-09T04:37:46.138 INFO:teuthology.orchestra.run.smithi174.stdout:Fetched 201 MB in 11s (18.2 MB/s) 2023-06-09T04:37:46.278 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-pyperclip. 2023-06-09T04:37:46.309 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-pyperclip. 2023-06-09T04:37:46.349 INFO:teuthology.orchestra.run.smithi090.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 107756 files and directories currently installed.) 2023-06-09T04:37:46.352 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../000-python3-pyperclip_1.7.0-1_all.deb ... 2023-06-09T04:37:46.380 INFO:teuthology.orchestra.run.smithi174.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 107756 files and directories currently installed.) 2023-06-09T04:37:46.384 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../000-python3-pyperclip_1.7.0-1_all.deb ... 2023-06-09T04:37:46.391 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-pyperclip (1.7.0-1) ... 2023-06-09T04:37:46.422 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-pyperclip (1.7.0-1) ... 2023-06-09T04:37:46.685 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-wcwidth. 2023-06-09T04:37:46.697 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../001-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2023-06-09T04:37:46.734 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2023-06-09T04:37:46.741 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-wcwidth. 2023-06-09T04:37:46.761 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../001-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2023-06-09T04:37:46.799 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2023-06-09T04:37:47.063 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-cmd2. 2023-06-09T04:37:47.081 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../002-python3-cmd2_0.8.5-2.1_all.deb ... 2023-06-09T04:37:47.121 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-cmd2 (0.8.5-2.1) ... 2023-06-09T04:37:47.304 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-cmd2. 2023-06-09T04:37:47.321 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../002-python3-cmd2_0.8.5-2.1_all.deb ... 2023-06-09T04:37:47.362 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-cmd2 (0.8.5-2.1) ... 2023-06-09T04:37:47.501 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2023-06-09T04:37:47.519 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../003-liblttng-ust0_2.11.0-1_amd64.deb ... 2023-06-09T04:37:47.601 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2023-06-09T04:37:47.715 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2023-06-09T04:37:47.733 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../003-liblttng-ust0_2.11.0-1_amd64.deb ... 2023-06-09T04:37:47.815 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2023-06-09T04:37:47.963 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-06-09T04:37:47.981 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.5-4ubuntu1_amd64.deb ... 2023-06-09T04:37:48.021 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-06-09T04:37:48.212 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-06-09T04:37:48.230 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.5-4ubuntu1_amd64.deb ... 2023-06-09T04:37:48.270 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-06-09T04:37:48.361 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-06-09T04:37:48.379 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../005-libpcre2-16-0_10.34-7ubuntu0.1_amd64.deb ... 2023-06-09T04:37:48.419 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-06-09T04:37:48.648 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-06-09T04:37:48.660 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../005-libpcre2-16-0_10.34-7ubuntu0.1_amd64.deb ... 2023-06-09T04:37:48.698 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-06-09T04:37:48.881 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-06-09T04:37:48.900 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../006-libqt5core5a_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-06-09T04:37:48.959 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-06-09T04:37:49.185 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-06-09T04:37:49.204 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../006-libqt5core5a_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-06-09T04:37:49.264 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-06-09T04:37:49.706 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-06-09T04:37:49.724 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../007-libqt5dbus5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-06-09T04:37:49.763 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-06-09T04:37:49.805 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-06-09T04:37:49.823 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../007-libqt5dbus5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-06-09T04:37:49.863 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-06-09T04:37:50.153 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-06-09T04:37:50.172 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../008-libqt5network5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-06-09T04:37:50.219 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-06-09T04:37:50.241 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-06-09T04:37:50.258 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../008-libqt5network5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-06-09T04:37:50.299 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-06-09T04:37:50.631 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package libthrift-0.13.0. 2023-06-09T04:37:50.649 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../009-libthrift-0.13.0_0.13.0-2build2_amd64.deb ... 2023-06-09T04:37:50.689 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking libthrift-0.13.0 (0.13.0-2build2) ... 2023-06-09T04:37:50.702 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package libthrift-0.13.0. 2023-06-09T04:37:50.720 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../009-libthrift-0.13.0_0.13.0-2build2_amd64.deb ... 2023-06-09T04:37:50.769 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking libthrift-0.13.0 (0.13.0-2build2) ... 2023-06-09T04:37:51.079 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../010-librbd1_18.0.0-4313-ga02638f8-1focal_amd64.deb ... 2023-06-09T04:37:51.141 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../010-librbd1_18.0.0-4313-ga02638f8-1focal_amd64.deb ... 2023-06-09T04:37:51.192 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking librbd1 (18.0.0-4313-ga02638f8-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-06-09T04:37:51.238 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking librbd1 (18.0.0-4313-ga02638f8-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-06-09T04:37:51.925 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../011-librados2_18.0.0-4313-ga02638f8-1focal_amd64.deb ... 2023-06-09T04:37:51.969 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../011-librados2_18.0.0-4313-ga02638f8-1focal_amd64.deb ... 2023-06-09T04:37:52.048 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking librados2 (18.0.0-4313-ga02638f8-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-06-09T04:37:52.092 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking librados2 (18.0.0-4313-ga02638f8-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-06-09T04:37:52.805 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package libcephfs2. 2023-06-09T04:37:52.823 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../012-libcephfs2_18.0.0-4313-ga02638f8-1focal_amd64.deb ... 2023-06-09T04:37:52.845 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package libcephfs2. 2023-06-09T04:37:52.854 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking libcephfs2 (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:37:52.864 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../012-libcephfs2_18.0.0-4313-ga02638f8-1focal_amd64.deb ... 2023-06-09T04:37:52.912 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking libcephfs2 (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:37:53.215 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-rados. 2023-06-09T04:37:53.234 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../013-python3-rados_18.0.0-4313-ga02638f8-1focal_amd64.deb ... 2023-06-09T04:37:53.273 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-rados (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:37:53.282 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-rados. 2023-06-09T04:37:53.294 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../013-python3-rados_18.0.0-4313-ga02638f8-1focal_amd64.deb ... 2023-06-09T04:37:53.340 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-rados (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:37:53.651 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-06-09T04:37:53.670 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../014-python3-ceph-argparse_18.0.0-4313-ga02638f8-1focal_all.deb ... 2023-06-09T04:37:53.702 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-06-09T04:37:53.709 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-ceph-argparse (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:37:53.714 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../014-python3-ceph-argparse_18.0.0-4313-ga02638f8-1focal_all.deb ... 2023-06-09T04:37:53.751 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-ceph-argparse (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:37:54.004 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-cephfs. 2023-06-09T04:37:54.022 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../015-python3-cephfs_18.0.0-4313-ga02638f8-1focal_amd64.deb ... 2023-06-09T04:37:54.022 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-cephfs. 2023-06-09T04:37:54.040 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../015-python3-cephfs_18.0.0-4313-ga02638f8-1focal_amd64.deb ... 2023-06-09T04:37:54.061 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-cephfs (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:37:54.080 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-cephfs (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:37:54.372 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-ceph-common. 2023-06-09T04:37:54.391 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../016-python3-ceph-common_18.0.0-4313-ga02638f8-1focal_all.deb ... 2023-06-09T04:37:54.422 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-ceph-common (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:37:54.442 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-ceph-common. 2023-06-09T04:37:54.460 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../016-python3-ceph-common_18.0.0-4313-ga02638f8-1focal_all.deb ... 2023-06-09T04:37:54.500 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-ceph-common (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:37:54.798 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-prettytable. 2023-06-09T04:37:54.816 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../017-python3-prettytable_0.7.2-5_all.deb ... 2023-06-09T04:37:54.837 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-prettytable. 2023-06-09T04:37:54.856 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../017-python3-prettytable_0.7.2-5_all.deb ... 2023-06-09T04:37:54.858 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2023-06-09T04:37:54.895 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2023-06-09T04:37:55.121 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-rbd. 2023-06-09T04:37:55.139 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../018-python3-rbd_18.0.0-4313-ga02638f8-1focal_amd64.deb ... 2023-06-09T04:37:55.174 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-rbd. 2023-06-09T04:37:55.178 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-rbd (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:37:55.193 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../018-python3-rbd_18.0.0-4313-ga02638f8-1focal_amd64.deb ... 2023-06-09T04:37:55.232 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-rbd (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:37:55.555 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2023-06-09T04:37:55.573 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../019-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2023-06-09T04:37:55.611 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2023-06-09T04:37:55.613 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-06-09T04:37:55.629 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../019-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2023-06-09T04:37:55.677 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-06-09T04:37:55.991 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package librabbitmq4:amd64. 2023-06-09T04:37:56.010 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../020-librabbitmq4_0.10.0-1_amd64.deb ... 2023-06-09T04:37:56.049 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2023-06-09T04:37:56.059 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package librabbitmq4:amd64. 2023-06-09T04:37:56.077 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../020-librabbitmq4_0.10.0-1_amd64.deb ... 2023-06-09T04:37:56.120 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2023-06-09T04:37:56.419 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-06-09T04:37:56.438 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../021-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2023-06-09T04:37:56.477 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-06-09T04:37:56.497 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-06-09T04:37:56.515 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../021-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2023-06-09T04:37:56.555 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-06-09T04:37:56.839 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package librgw2. 2023-06-09T04:37:56.858 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../022-librgw2_18.0.0-4313-ga02638f8-1focal_amd64.deb ... 2023-06-09T04:37:56.895 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package librgw2. 2023-06-09T04:37:56.897 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking librgw2 (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:37:56.912 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../022-librgw2_18.0.0-4313-ga02638f8-1focal_amd64.deb ... 2023-06-09T04:37:56.953 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking librgw2 (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:37:57.783 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-rgw. 2023-06-09T04:37:57.801 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../023-python3-rgw_18.0.0-4313-ga02638f8-1focal_amd64.deb ... 2023-06-09T04:37:57.840 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-rgw (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:37:57.903 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-rgw. 2023-06-09T04:37:57.922 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../023-python3-rgw_18.0.0-4313-ga02638f8-1focal_amd64.deb ... 2023-06-09T04:37:57.970 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-rgw (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:37:58.202 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package liboath0. 2023-06-09T04:37:58.221 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../024-liboath0_2.6.1-1.3_amd64.deb ... 2023-06-09T04:37:58.259 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2023-06-09T04:37:58.332 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package liboath0. 2023-06-09T04:37:58.351 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../024-liboath0_2.6.1-1.3_amd64.deb ... 2023-06-09T04:37:58.389 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2023-06-09T04:37:58.596 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package libradosstriper1. 2023-06-09T04:37:58.614 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../025-libradosstriper1_18.0.0-4313-ga02638f8-1focal_amd64.deb ... 2023-06-09T04:37:58.654 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking libradosstriper1 (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:37:58.752 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package libradosstriper1. 2023-06-09T04:37:58.770 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../025-libradosstriper1_18.0.0-4313-ga02638f8-1focal_amd64.deb ... 2023-06-09T04:37:58.818 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking libradosstriper1 (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:37:59.141 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package ceph-common. 2023-06-09T04:37:59.160 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../026-ceph-common_18.0.0-4313-ga02638f8-1focal_amd64.deb ... 2023-06-09T04:37:59.199 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking ceph-common (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:37:59.290 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package ceph-common. 2023-06-09T04:37:59.308 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../026-ceph-common_18.0.0-4313-ga02638f8-1focal_amd64.deb ... 2023-06-09T04:37:59.348 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking ceph-common (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:38:01.737 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package ceph-base. 2023-06-09T04:38:01.756 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../027-ceph-base_18.0.0-4313-ga02638f8-1focal_amd64.deb ... 2023-06-09T04:38:01.817 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking ceph-base (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:38:01.863 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package ceph-base. 2023-06-09T04:38:01.880 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../027-ceph-base_18.0.0-4313-ga02638f8-1focal_amd64.deb ... 2023-06-09T04:38:01.953 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking ceph-base (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:38:03.508 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-cherrypy3. 2023-06-09T04:38:03.511 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-cherrypy3. 2023-06-09T04:38:03.527 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../028-python3-cherrypy3_8.9.1-6_all.deb ... 2023-06-09T04:38:03.530 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../028-python3-cherrypy3_8.9.1-6_all.deb ... 2023-06-09T04:38:03.566 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2023-06-09T04:38:03.577 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2023-06-09T04:38:03.945 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-natsort. 2023-06-09T04:38:03.949 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-natsort. 2023-06-09T04:38:03.962 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../029-python3-natsort_7.0.1-1_all.deb ... 2023-06-09T04:38:03.968 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../029-python3-natsort_7.0.1-1_all.deb ... 2023-06-09T04:38:04.002 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-natsort (7.0.1-1) ... 2023-06-09T04:38:04.015 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-natsort (7.0.1-1) ... 2023-06-09T04:38:04.357 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-logutils. 2023-06-09T04:38:04.375 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../030-python3-logutils_0.3.3-7_all.deb ... 2023-06-09T04:38:04.377 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-logutils. 2023-06-09T04:38:04.389 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../030-python3-logutils_0.3.3-7_all.deb ... 2023-06-09T04:38:04.414 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-logutils (0.3.3-7) ... 2023-06-09T04:38:04.435 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-logutils (0.3.3-7) ... 2023-06-09T04:38:04.759 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-markupsafe. 2023-06-09T04:38:04.763 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-markupsafe. 2023-06-09T04:38:04.776 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../031-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2023-06-09T04:38:04.777 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../031-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2023-06-09T04:38:04.817 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2023-06-09T04:38:04.822 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2023-06-09T04:38:05.153 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-mako. 2023-06-09T04:38:05.172 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../032-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2023-06-09T04:38:05.211 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-06-09T04:38:05.582 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-simplegeneric. 2023-06-09T04:38:05.600 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../033-python3-simplegeneric_0.8.1-3_all.deb ... 2023-06-09T04:38:05.639 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-06-09T04:38:05.959 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-singledispatch. 2023-06-09T04:38:05.972 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../034-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2023-06-09T04:38:06.016 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2023-06-09T04:38:06.027 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-mako. 2023-06-09T04:38:06.045 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../032-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2023-06-09T04:38:06.085 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-06-09T04:38:06.353 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-webob. 2023-06-09T04:38:06.371 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../035-python3-webob_1%3a1.8.5-2_all.deb ... 2023-06-09T04:38:06.410 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2023-06-09T04:38:06.415 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-simplegeneric. 2023-06-09T04:38:06.433 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../033-python3-simplegeneric_0.8.1-3_all.deb ... 2023-06-09T04:38:06.473 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-06-09T04:38:06.786 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-singledispatch. 2023-06-09T04:38:06.789 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-soupsieve. 2023-06-09T04:38:06.804 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../034-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2023-06-09T04:38:06.807 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../036-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2023-06-09T04:38:06.844 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2023-06-09T04:38:06.846 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2023-06-09T04:38:07.158 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-bs4. 2023-06-09T04:38:07.177 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../037-python3-bs4_4.8.2-1_all.deb ... 2023-06-09T04:38:07.181 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-webob. 2023-06-09T04:38:07.199 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../035-python3-webob_1%3a1.8.5-2_all.deb ... 2023-06-09T04:38:07.216 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2023-06-09T04:38:07.247 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2023-06-09T04:38:07.618 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-soupsieve. 2023-06-09T04:38:07.636 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../036-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2023-06-09T04:38:07.685 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2023-06-09T04:38:08.047 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-bs4. 2023-06-09T04:38:08.065 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../037-python3-bs4_4.8.2-1_all.deb ... 2023-06-09T04:38:08.105 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2023-06-09T04:38:08.170 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-waitress. 2023-06-09T04:38:08.189 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../038-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2023-06-09T04:38:08.234 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2023-06-09T04:38:08.508 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-waitress. 2023-06-09T04:38:08.528 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../038-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2023-06-09T04:38:08.581 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2023-06-09T04:38:08.606 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-tempita. 2023-06-09T04:38:08.625 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../039-python3-tempita_0.5.2-6_all.deb ... 2023-06-09T04:38:08.664 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-tempita (0.5.2-6) ... 2023-06-09T04:38:08.955 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-tempita. 2023-06-09T04:38:08.972 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../039-python3-tempita_0.5.2-6_all.deb ... 2023-06-09T04:38:09.000 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-paste. 2023-06-09T04:38:09.013 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-tempita (0.5.2-6) ... 2023-06-09T04:38:09.018 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../040-python3-paste_3.4.0+dfsg1-1_all.deb ... 2023-06-09T04:38:09.057 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2023-06-09T04:38:09.383 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-paste. 2023-06-09T04:38:09.401 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../040-python3-paste_3.4.0+dfsg1-1_all.deb ... 2023-06-09T04:38:09.402 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-06-09T04:38:09.421 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../041-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2023-06-09T04:38:09.440 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2023-06-09T04:38:09.460 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2023-06-09T04:38:09.788 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-06-09T04:38:09.797 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-pastedeploy. 2023-06-09T04:38:09.806 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../041-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2023-06-09T04:38:09.816 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../042-python3-pastedeploy_2.1.0-1_all.deb ... 2023-06-09T04:38:09.846 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2023-06-09T04:38:09.855 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2023-06-09T04:38:10.191 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-pastedeploy. 2023-06-09T04:38:10.199 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-webtest. 2023-06-09T04:38:10.210 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../042-python3-pastedeploy_2.1.0-1_all.deb ... 2023-06-09T04:38:10.218 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../043-python3-webtest_2.0.32-2_all.deb ... 2023-06-09T04:38:10.257 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2023-06-09T04:38:10.274 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-webtest (2.0.32-2) ... 2023-06-09T04:38:10.611 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-webtest. 2023-06-09T04:38:10.629 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../043-python3-webtest_2.0.32-2_all.deb ... 2023-06-09T04:38:10.635 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-pecan. 2023-06-09T04:38:10.654 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../044-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2023-06-09T04:38:10.669 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-webtest (2.0.32-2) ... 2023-06-09T04:38:10.693 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2023-06-09T04:38:11.007 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-pecan. 2023-06-09T04:38:11.025 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../044-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2023-06-09T04:38:11.065 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2023-06-09T04:38:11.106 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-werkzeug. 2023-06-09T04:38:11.124 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../045-python3-werkzeug_0.16.1+dfsg1-2ubuntu0.1_all.deb ... 2023-06-09T04:38:11.164 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-06-09T04:38:11.462 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-werkzeug. 2023-06-09T04:38:11.480 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../045-python3-werkzeug_0.16.1+dfsg1-2ubuntu0.1_all.deb ... 2023-06-09T04:38:11.484 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-06-09T04:38:11.502 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../046-ceph-mgr-modules-core_18.0.0-4313-ga02638f8-1focal_all.deb ... 2023-06-09T04:38:11.520 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-06-09T04:38:11.542 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking ceph-mgr-modules-core (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:38:11.850 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-06-09T04:38:11.869 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../046-ceph-mgr-modules-core_18.0.0-4313-ga02638f8-1focal_all.deb ... 2023-06-09T04:38:11.908 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking ceph-mgr-modules-core (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:38:11.997 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-06-09T04:38:12.015 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../047-libsqlite3-mod-ceph_18.0.0-4313-ga02638f8-1focal_amd64.deb ... 2023-06-09T04:38:12.054 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking libsqlite3-mod-ceph (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:38:12.330 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-06-09T04:38:12.348 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../047-libsqlite3-mod-ceph_18.0.0-4313-ga02638f8-1focal_amd64.deb ... 2023-06-09T04:38:12.388 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking libsqlite3-mod-ceph (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:38:12.408 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-cryptography. 2023-06-09T04:38:12.426 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../048-python3-cryptography_2.8-3ubuntu0.1_amd64.deb ... 2023-06-09T04:38:12.465 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.1) ... 2023-06-09T04:38:12.735 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-cryptography. 2023-06-09T04:38:12.753 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../048-python3-cryptography_2.8-3ubuntu0.1_amd64.deb ... 2023-06-09T04:38:12.792 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.1) ... 2023-06-09T04:38:12.877 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-openssl. 2023-06-09T04:38:12.897 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../049-python3-openssl_19.0.0-1build1_all.deb ... 2023-06-09T04:38:12.935 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2023-06-09T04:38:13.164 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-openssl. 2023-06-09T04:38:13.181 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../049-python3-openssl_19.0.0-1build1_all.deb ... 2023-06-09T04:38:13.221 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2023-06-09T04:38:13.314 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package ceph-mgr. 2023-06-09T04:38:13.334 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../050-ceph-mgr_18.0.0-4313-ga02638f8-1focal_amd64.deb ... 2023-06-09T04:38:13.371 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking ceph-mgr (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:38:13.608 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package ceph-mgr. 2023-06-09T04:38:13.625 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../050-ceph-mgr_18.0.0-4313-ga02638f8-1focal_amd64.deb ... 2023-06-09T04:38:13.667 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking ceph-mgr (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:38:13.875 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package ceph-mon. 2023-06-09T04:38:13.894 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../051-ceph-mon_18.0.0-4313-ga02638f8-1focal_amd64.deb ... 2023-06-09T04:38:13.933 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking ceph-mon (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:38:14.196 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package ceph-mon. 2023-06-09T04:38:14.215 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../051-ceph-mon_18.0.0-4313-ga02638f8-1focal_amd64.deb ... 2023-06-09T04:38:14.262 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking ceph-mon (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:38:15.177 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package ceph-osd. 2023-06-09T04:38:15.190 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../052-ceph-osd_18.0.0-4313-ga02638f8-1focal_amd64.deb ... 2023-06-09T04:38:15.235 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking ceph-osd (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:38:15.591 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package ceph-osd. 2023-06-09T04:38:15.603 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../052-ceph-osd_18.0.0-4313-ga02638f8-1focal_amd64.deb ... 2023-06-09T04:38:15.641 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking ceph-osd (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:38:17.963 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package ceph. 2023-06-09T04:38:17.976 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../053-ceph_18.0.0-4313-ga02638f8-1focal_amd64.deb ... 2023-06-09T04:38:18.012 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking ceph (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:38:18.357 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package ceph-fuse. 2023-06-09T04:38:18.370 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../054-ceph-fuse_18.0.0-4313-ga02638f8-1focal_amd64.deb ... 2023-06-09T04:38:18.406 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking ceph-fuse (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:38:18.496 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package ceph. 2023-06-09T04:38:18.514 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../053-ceph_18.0.0-4313-ga02638f8-1focal_amd64.deb ... 2023-06-09T04:38:18.562 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking ceph (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:38:18.843 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package ceph-mds. 2023-06-09T04:38:18.856 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../055-ceph-mds_18.0.0-4313-ga02638f8-1focal_amd64.deb ... 2023-06-09T04:38:18.893 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking ceph-mds (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:38:18.924 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package ceph-fuse. 2023-06-09T04:38:18.942 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../054-ceph-fuse_18.0.0-4313-ga02638f8-1focal_amd64.deb ... 2023-06-09T04:38:18.981 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking ceph-fuse (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:38:19.435 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package ceph-mds. 2023-06-09T04:38:19.454 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package cephadm. 2023-06-09T04:38:19.454 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../055-ceph-mds_18.0.0-4313-ga02638f8-1focal_amd64.deb ... 2023-06-09T04:38:19.467 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../056-cephadm_18.0.0-4313-ga02638f8-1focal_amd64.deb ... 2023-06-09T04:38:19.494 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking ceph-mds (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:38:19.504 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking cephadm (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:38:19.848 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-asyncssh. 2023-06-09T04:38:19.867 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../057-python3-asyncssh_1.12.2-1_all.deb ... 2023-06-09T04:38:19.906 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-asyncssh (1.12.2-1) ... 2023-06-09T04:38:20.048 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package cephadm. 2023-06-09T04:38:20.065 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../056-cephadm_18.0.0-4313-ga02638f8-1focal_amd64.deb ... 2023-06-09T04:38:20.114 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking cephadm (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:38:20.293 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-jinja2. 2023-06-09T04:38:20.311 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../058-python3-jinja2_2.10.1-2_all.deb ... 2023-06-09T04:38:20.350 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2023-06-09T04:38:20.459 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-asyncssh. 2023-06-09T04:38:20.478 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../057-python3-asyncssh_1.12.2-1_all.deb ... 2023-06-09T04:38:20.517 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-asyncssh (1.12.2-1) ... 2023-06-09T04:38:20.695 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-06-09T04:38:20.713 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../059-ceph-mgr-cephadm_18.0.0-4313-ga02638f8-1focal_all.deb ... 2023-06-09T04:38:20.752 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking ceph-mgr-cephadm (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:38:21.139 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-bcrypt. 2023-06-09T04:38:21.158 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../060-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2023-06-09T04:38:21.197 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2023-06-09T04:38:21.230 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-jinja2. 2023-06-09T04:38:21.248 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../058-python3-jinja2_2.10.1-2_all.deb ... 2023-06-09T04:38:21.288 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2023-06-09T04:38:21.533 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-jwt. 2023-06-09T04:38:21.552 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../061-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2023-06-09T04:38:21.591 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2023-06-09T04:38:21.633 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-06-09T04:38:21.651 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../059-ceph-mgr-cephadm_18.0.0-4313-ga02638f8-1focal_all.deb ... 2023-06-09T04:38:21.691 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking ceph-mgr-cephadm (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:38:21.944 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-repoze.lru. 2023-06-09T04:38:21.963 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../062-python3-repoze.lru_0.7-2_all.deb ... 2023-06-09T04:38:22.002 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-06-09T04:38:22.062 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-bcrypt. 2023-06-09T04:38:22.080 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../060-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2023-06-09T04:38:22.120 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2023-06-09T04:38:22.289 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package libjs-underscore. 2023-06-09T04:38:22.307 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../063-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2023-06-09T04:38:22.346 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-06-09T04:38:22.424 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-jwt. 2023-06-09T04:38:22.442 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../061-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2023-06-09T04:38:22.482 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2023-06-09T04:38:22.657 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package libjs-sphinxdoc. 2023-06-09T04:38:22.675 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../064-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2023-06-09T04:38:22.715 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-06-09T04:38:22.819 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-repoze.lru. 2023-06-09T04:38:22.838 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../062-python3-repoze.lru_0.7-2_all.deb ... 2023-06-09T04:38:22.877 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-06-09T04:38:23.084 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-routes. 2023-06-09T04:38:23.102 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../065-python3-routes_2.4.1-2_all.deb ... 2023-06-09T04:38:23.142 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-routes (2.4.1-2) ... 2023-06-09T04:38:23.147 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package libjs-underscore. 2023-06-09T04:38:23.165 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../063-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2023-06-09T04:38:23.206 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-06-09T04:38:23.504 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-06-09T04:38:23.522 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../066-ceph-mgr-dashboard_18.0.0-4313-ga02638f8-1focal_all.deb ... 2023-06-09T04:38:23.534 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package libjs-sphinxdoc. 2023-06-09T04:38:23.552 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../064-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2023-06-09T04:38:23.561 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking ceph-mgr-dashboard (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:38:23.592 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-06-09T04:38:23.929 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-routes. 2023-06-09T04:38:23.946 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../065-python3-routes_2.4.1-2_all.deb ... 2023-06-09T04:38:23.995 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-routes (2.4.1-2) ... 2023-06-09T04:38:24.099 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-decorator. 2023-06-09T04:38:24.117 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../067-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2023-06-09T04:38:24.156 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2023-06-09T04:38:24.333 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-06-09T04:38:24.352 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../066-ceph-mgr-dashboard_18.0.0-4313-ga02638f8-1focal_all.deb ... 2023-06-09T04:38:24.391 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking ceph-mgr-dashboard (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:38:24.493 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2023-06-09T04:38:24.511 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../068-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2023-06-09T04:38:24.550 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-06-09T04:38:24.895 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-scipy. 2023-06-09T04:38:24.914 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../069-python3-scipy_1.3.3-3build1_amd64.deb ... 2023-06-09T04:38:24.928 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-decorator. 2023-06-09T04:38:24.949 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../067-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2023-06-09T04:38:24.952 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2023-06-09T04:38:24.995 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2023-06-09T04:38:25.331 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2023-06-09T04:38:25.350 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../068-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2023-06-09T04:38:25.397 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-06-09T04:38:25.736 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-scipy. 2023-06-09T04:38:25.754 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../069-python3-scipy_1.3.3-3build1_amd64.deb ... 2023-06-09T04:38:25.801 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2023-06-09T04:38:26.286 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-sklearn-lib. 2023-06-09T04:38:26.306 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../070-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2023-06-09T04:38:26.344 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-06-09T04:38:27.096 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-sklearn-lib. 2023-06-09T04:38:27.115 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../070-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2023-06-09T04:38:27.131 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-joblib. 2023-06-09T04:38:27.150 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../071-python3-joblib_0.14.0-3_all.deb ... 2023-06-09T04:38:27.162 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-06-09T04:38:27.189 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-joblib (0.14.0-3) ... 2023-06-09T04:38:27.584 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-sklearn. 2023-06-09T04:38:27.603 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../072-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2023-06-09T04:38:27.642 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-06-09T04:38:27.708 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-joblib. 2023-06-09T04:38:27.721 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../071-python3-joblib_0.14.0-3_all.deb ... 2023-06-09T04:38:27.765 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-joblib (0.14.0-3) ... 2023-06-09T04:38:28.171 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-sklearn. 2023-06-09T04:38:28.190 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../072-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2023-06-09T04:38:28.229 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-06-09T04:38:28.358 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-06-09T04:38:28.378 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../073-ceph-mgr-diskprediction-local_18.0.0-4313-ga02638f8-1focal_all.deb ... 2023-06-09T04:38:28.416 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking ceph-mgr-diskprediction-local (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:38:28.940 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-06-09T04:38:28.958 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../073-ceph-mgr-diskprediction-local_18.0.0-4313-ga02638f8-1focal_all.deb ... 2023-06-09T04:38:28.997 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking ceph-mgr-diskprediction-local (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:38:29.644 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-cachetools. 2023-06-09T04:38:29.662 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../074-python3-cachetools_4.0.0-1_all.deb ... 2023-06-09T04:38:29.701 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2023-06-09T04:38:30.030 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-pyasn1. 2023-06-09T04:38:30.049 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../075-python3-pyasn1_0.4.2-3build1_all.deb ... 2023-06-09T04:38:30.095 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2023-06-09T04:38:30.301 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-cachetools. 2023-06-09T04:38:30.320 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../074-python3-cachetools_4.0.0-1_all.deb ... 2023-06-09T04:38:30.359 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2023-06-09T04:38:30.449 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-06-09T04:38:30.467 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../076-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2023-06-09T04:38:30.506 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-06-09T04:38:30.679 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-pyasn1. 2023-06-09T04:38:30.699 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../075-python3-pyasn1_0.4.2-3build1_all.deb ... 2023-06-09T04:38:30.738 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2023-06-09T04:38:30.884 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-rsa. 2023-06-09T04:38:30.903 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../077-python3-rsa_4.0-3_all.deb ... 2023-06-09T04:38:30.942 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-rsa (4.0-3) ... 2023-06-09T04:38:31.117 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-06-09T04:38:31.136 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../076-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2023-06-09T04:38:31.183 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-06-09T04:38:31.295 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-google-auth. 2023-06-09T04:38:31.314 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../078-python3-google-auth_1.5.1-2_all.deb ... 2023-06-09T04:38:31.353 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2023-06-09T04:38:31.529 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-rsa. 2023-06-09T04:38:31.549 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../077-python3-rsa_4.0-3_all.deb ... 2023-06-09T04:38:31.586 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-rsa (4.0-3) ... 2023-06-09T04:38:31.699 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-blinker. 2023-06-09T04:38:31.718 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../079-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2023-06-09T04:38:31.756 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-06-09T04:38:31.925 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-google-auth. 2023-06-09T04:38:31.944 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../078-python3-google-auth_1.5.1-2_all.deb ... 2023-06-09T04:38:31.982 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2023-06-09T04:38:32.109 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-oauthlib. 2023-06-09T04:38:32.128 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../080-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2023-06-09T04:38:32.183 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2023-06-09T04:38:32.320 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-blinker. 2023-06-09T04:38:32.339 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../079-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2023-06-09T04:38:32.386 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-06-09T04:38:32.648 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-06-09T04:38:32.666 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../081-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2023-06-09T04:38:32.705 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-06-09T04:38:32.722 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-oauthlib. 2023-06-09T04:38:32.742 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../080-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2023-06-09T04:38:32.788 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2023-06-09T04:38:33.059 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-websocket. 2023-06-09T04:38:33.078 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../082-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2023-06-09T04:38:33.116 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2023-06-09T04:38:33.255 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-06-09T04:38:33.273 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../081-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2023-06-09T04:38:33.321 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-06-09T04:38:33.479 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-kubernetes. 2023-06-09T04:38:33.498 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../083-python3-kubernetes_7.0.0~a1-2_all.deb ... 2023-06-09T04:38:33.536 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2023-06-09T04:38:33.643 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-websocket. 2023-06-09T04:38:33.661 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../082-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2023-06-09T04:38:33.701 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2023-06-09T04:38:34.047 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-kubernetes. 2023-06-09T04:38:34.065 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../083-python3-kubernetes_7.0.0~a1-2_all.deb ... 2023-06-09T04:38:34.113 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2023-06-09T04:38:34.150 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-06-09T04:38:34.170 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../084-ceph-mgr-k8sevents_18.0.0-4313-ga02638f8-1focal_all.deb ... 2023-06-09T04:38:34.207 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking ceph-mgr-k8sevents (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:38:34.561 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package libonig5:amd64. 2023-06-09T04:38:34.580 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../085-libonig5_6.9.4-1_amd64.deb ... 2023-06-09T04:38:34.618 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2023-06-09T04:38:34.679 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-06-09T04:38:34.698 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../084-ceph-mgr-k8sevents_18.0.0-4313-ga02638f8-1focal_all.deb ... 2023-06-09T04:38:34.736 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking ceph-mgr-k8sevents (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:38:35.005 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package libjq1:amd64. 2023-06-09T04:38:35.024 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../086-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-06-09T04:38:35.063 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-06-09T04:38:35.082 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package libonig5:amd64. 2023-06-09T04:38:35.101 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../085-libonig5_6.9.4-1_amd64.deb ... 2023-06-09T04:38:35.139 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2023-06-09T04:38:35.366 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package jq. 2023-06-09T04:38:35.386 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../087-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-06-09T04:38:35.423 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2023-06-09T04:38:35.535 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package libjq1:amd64. 2023-06-09T04:38:35.554 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../086-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-06-09T04:38:35.601 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-06-09T04:38:35.710 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package socat. 2023-06-09T04:38:35.728 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../088-socat_1.7.3.3-2_amd64.deb ... 2023-06-09T04:38:35.767 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking socat (1.7.3.3-2) ... 2023-06-09T04:38:35.922 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package jq. 2023-06-09T04:38:35.941 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../087-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-06-09T04:38:35.980 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2023-06-09T04:38:36.113 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package xmlstarlet. 2023-06-09T04:38:36.131 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../089-xmlstarlet_1.6.1-2build1_amd64.deb ... 2023-06-09T04:38:36.170 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2023-06-09T04:38:36.250 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package socat. 2023-06-09T04:38:36.269 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../088-socat_1.7.3.3-2_amd64.deb ... 2023-06-09T04:38:36.316 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking socat (1.7.3.3-2) ... 2023-06-09T04:38:36.550 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package ceph-test. 2023-06-09T04:38:36.570 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../090-ceph-test_18.0.0-4313-ga02638f8-1focal_amd64.deb ... 2023-06-09T04:38:36.607 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking ceph-test (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:38:36.672 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package xmlstarlet. 2023-06-09T04:38:36.690 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../089-xmlstarlet_1.6.1-2build1_amd64.deb ... 2023-06-09T04:38:36.737 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2023-06-09T04:38:37.134 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package ceph-test. 2023-06-09T04:38:37.153 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../090-ceph-test_18.0.0-4313-ga02638f8-1focal_amd64.deb ... 2023-06-09T04:38:37.200 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking ceph-test (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:38:40.378 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package ceph-volume. 2023-06-09T04:38:40.397 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../091-ceph-volume_18.0.0-4313-ga02638f8-1focal_all.deb ... 2023-06-09T04:38:40.435 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking ceph-volume (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:38:40.800 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package cephfs-mirror. 2023-06-09T04:38:40.819 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../092-cephfs-mirror_18.0.0-4313-ga02638f8-1focal_amd64.deb ... 2023-06-09T04:38:40.857 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking cephfs-mirror (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:38:40.957 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package ceph-volume. 2023-06-09T04:38:40.976 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../091-ceph-volume_18.0.0-4313-ga02638f8-1focal_all.deb ... 2023-06-09T04:38:41.023 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking ceph-volume (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:38:41.226 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-colorama. 2023-06-09T04:38:41.246 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../093-python3-colorama_0.4.3-1build1_all.deb ... 2023-06-09T04:38:41.284 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-colorama (0.4.3-1build1) ... 2023-06-09T04:38:41.387 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package cephfs-mirror. 2023-06-09T04:38:41.405 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../092-cephfs-mirror_18.0.0-4313-ga02638f8-1focal_amd64.deb ... 2023-06-09T04:38:41.453 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking cephfs-mirror (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:38:41.595 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package cephfs-shell. 2023-06-09T04:38:41.614 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../094-cephfs-shell_18.0.0-4313-ga02638f8-1focal_all.deb ... 2023-06-09T04:38:41.658 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking cephfs-shell (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:38:41.791 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-colorama. 2023-06-09T04:38:41.809 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../093-python3-colorama_0.4.3-1build1_all.deb ... 2023-06-09T04:38:41.848 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-colorama (0.4.3-1build1) ... 2023-06-09T04:38:41.953 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package cephfs-top. 2023-06-09T04:38:41.973 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../095-cephfs-top_18.0.0-4313-ga02638f8-1focal_all.deb ... 2023-06-09T04:38:42.011 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking cephfs-top (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:38:42.135 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package cephfs-shell. 2023-06-09T04:38:42.153 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../094-cephfs-shell_18.0.0-4313-ga02638f8-1focal_all.deb ... 2023-06-09T04:38:42.201 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking cephfs-shell (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:38:42.305 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package fonts-mathjax. 2023-06-09T04:38:42.325 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../096-fonts-mathjax_2.7.4+dfsg-1_all.deb ... 2023-06-09T04:38:42.363 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking fonts-mathjax (2.7.4+dfsg-1) ... 2023-06-09T04:38:42.513 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package cephfs-top. 2023-06-09T04:38:42.530 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../095-cephfs-top_18.0.0-4313-ga02638f8-1focal_all.deb ... 2023-06-09T04:38:42.570 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking cephfs-top (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:38:42.841 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package fonts-mathjax. 2023-06-09T04:38:42.854 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../096-fonts-mathjax_2.7.4+dfsg-1_all.deb ... 2023-06-09T04:38:42.899 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking fonts-mathjax (2.7.4+dfsg-1) ... 2023-06-09T04:38:42.900 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package libcephfs-dev. 2023-06-09T04:38:42.919 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../097-libcephfs-dev_18.0.0-4313-ga02638f8-1focal_amd64.deb ... 2023-06-09T04:38:42.958 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking libcephfs-dev (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:38:43.386 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package nvme-cli. 2023-06-09T04:38:43.406 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../098-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2023-06-09T04:38:43.462 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package libcephfs-dev. 2023-06-09T04:38:43.479 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2023-06-09T04:38:43.480 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../097-libcephfs-dev_18.0.0-4313-ga02638f8-1focal_amd64.deb ... 2023-06-09T04:38:43.533 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking libcephfs-dev (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:38:43.824 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-06-09T04:38:43.843 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../099-python-asyncssh-doc_1.12.2-1_all.deb ... 2023-06-09T04:38:43.881 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python-asyncssh-doc (1.12.2-1) ... 2023-06-09T04:38:43.971 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package nvme-cli. 2023-06-09T04:38:43.990 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../098-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2023-06-09T04:38:44.071 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2023-06-09T04:38:44.302 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package libjs-mathjax. 2023-06-09T04:38:44.319 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../100-libjs-mathjax_2.7.4+dfsg-1_all.deb ... 2023-06-09T04:38:44.359 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking libjs-mathjax (2.7.4+dfsg-1) ... 2023-06-09T04:38:44.410 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-06-09T04:38:44.429 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../099-python-asyncssh-doc_1.12.2-1_all.deb ... 2023-06-09T04:38:44.476 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python-asyncssh-doc (1.12.2-1) ... 2023-06-09T04:38:44.905 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package libjs-mathjax. 2023-06-09T04:38:44.925 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../100-libjs-mathjax_2.7.4+dfsg-1_all.deb ... 2023-06-09T04:38:44.971 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking libjs-mathjax (2.7.4+dfsg-1) ... 2023-06-09T04:38:46.278 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python-natsort-doc. 2023-06-09T04:38:46.299 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../101-python-natsort-doc_7.0.1-1_all.deb ... 2023-06-09T04:38:46.343 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python-natsort-doc (7.0.1-1) ... 2023-06-09T04:38:46.705 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-atomicwrites. 2023-06-09T04:38:46.725 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../102-python3-atomicwrites_1.1.5-2build1_all.deb ... 2023-06-09T04:38:46.762 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2023-06-09T04:38:46.993 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python-natsort-doc. 2023-06-09T04:38:47.008 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../101-python-natsort-doc_7.0.1-1_all.deb ... 2023-06-09T04:38:47.051 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python-natsort-doc (7.0.1-1) ... 2023-06-09T04:38:47.099 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-attr. 2023-06-09T04:38:47.119 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../103-python3-attr_19.3.0-2_all.deb ... 2023-06-09T04:38:47.156 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-attr (19.3.0-2) ... 2023-06-09T04:38:47.381 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-atomicwrites. 2023-06-09T04:38:47.402 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../102-python3-atomicwrites_1.1.5-2build1_all.deb ... 2023-06-09T04:38:47.439 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2023-06-09T04:38:47.526 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-webencodings. 2023-06-09T04:38:47.546 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../104-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2023-06-09T04:38:47.584 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2023-06-09T04:38:47.759 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-attr. 2023-06-09T04:38:47.779 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../103-python3-attr_19.3.0-2_all.deb ... 2023-06-09T04:38:47.816 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-attr (19.3.0-2) ... 2023-06-09T04:38:47.904 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-html5lib. 2023-06-09T04:38:47.923 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../105-python3-html5lib_1.0.1-2_all.deb ... 2023-06-09T04:38:47.961 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2023-06-09T04:38:48.170 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-webencodings. 2023-06-09T04:38:48.190 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../104-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2023-06-09T04:38:48.237 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2023-06-09T04:38:48.339 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-lxml:amd64. 2023-06-09T04:38:48.359 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../106-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2023-06-09T04:38:48.397 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-06-09T04:38:48.583 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-html5lib. 2023-06-09T04:38:48.602 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../105-python3-html5lib_1.0.1-2_all.deb ... 2023-06-09T04:38:48.640 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2023-06-09T04:38:48.909 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-packaging. 2023-06-09T04:38:48.922 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../107-python3-packaging_20.3-1_all.deb ... 2023-06-09T04:38:48.966 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-packaging (20.3-1) ... 2023-06-09T04:38:49.002 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-lxml:amd64. 2023-06-09T04:38:49.022 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../106-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2023-06-09T04:38:49.068 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-06-09T04:38:49.287 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-pastescript. 2023-06-09T04:38:49.307 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../108-python3-pastescript_2.0.2-4_all.deb ... 2023-06-09T04:38:49.344 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-06-09T04:38:49.540 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-packaging. 2023-06-09T04:38:49.560 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../107-python3-packaging_20.3-1_all.deb ... 2023-06-09T04:38:49.606 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-packaging (20.3-1) ... 2023-06-09T04:38:49.714 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-pluggy. 2023-06-09T04:38:49.735 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../109-python3-pluggy_0.13.0-2_all.deb ... 2023-06-09T04:38:49.772 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2023-06-09T04:38:49.935 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-pastescript. 2023-06-09T04:38:49.955 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../108-python3-pastescript_2.0.2-4_all.deb ... 2023-06-09T04:38:50.001 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-06-09T04:38:50.133 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-psutil. 2023-06-09T04:38:50.153 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../110-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2023-06-09T04:38:50.191 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2023-06-09T04:38:50.363 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-pluggy. 2023-06-09T04:38:50.383 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../109-python3-pluggy_0.13.0-2_all.deb ... 2023-06-09T04:38:50.421 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2023-06-09T04:38:50.553 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-py. 2023-06-09T04:38:50.573 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../111-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2023-06-09T04:38:50.610 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2023-06-09T04:38:50.759 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-psutil. 2023-06-09T04:38:50.778 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../110-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2023-06-09T04:38:50.817 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2023-06-09T04:38:50.973 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-pyinotify. 2023-06-09T04:38:50.992 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../112-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2023-06-09T04:38:51.030 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-06-09T04:38:51.179 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-py. 2023-06-09T04:38:51.199 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../111-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2023-06-09T04:38:51.236 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2023-06-09T04:38:51.367 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-pytest. 2023-06-09T04:38:51.386 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../113-python3-pytest_4.6.9-1_all.deb ... 2023-06-09T04:38:51.424 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-pytest (4.6.9-1) ... 2023-06-09T04:38:51.778 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package python3-simplejson. 2023-06-09T04:38:51.798 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../114-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2023-06-09T04:38:51.836 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2023-06-09T04:38:52.017 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-pyinotify. 2023-06-09T04:38:52.037 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../112-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2023-06-09T04:38:52.083 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-06-09T04:38:52.130 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-06-09T04:38:52.150 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.12.8-0ubuntu1_all.deb ... 2023-06-09T04:38:52.188 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-06-09T04:38:52.420 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-pytest. 2023-06-09T04:38:52.439 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../113-python3-pytest_4.6.9-1_all.deb ... 2023-06-09T04:38:52.486 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-pytest (4.6.9-1) ... 2023-06-09T04:38:52.848 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-simplejson. 2023-06-09T04:38:52.868 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../114-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2023-06-09T04:38:52.909 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package radosgw. 2023-06-09T04:38:52.914 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2023-06-09T04:38:52.927 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../116-radosgw_18.0.0-4313-ga02638f8-1focal_amd64.deb ... 2023-06-09T04:38:52.967 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking radosgw (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:38:53.203 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-06-09T04:38:53.222 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.12.8-0ubuntu1_all.deb ... 2023-06-09T04:38:53.269 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-06-09T04:38:53.932 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package radosgw. 2023-06-09T04:38:53.952 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../116-radosgw_18.0.0-4313-ga02638f8-1focal_amd64.deb ... 2023-06-09T04:38:53.990 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking radosgw (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:38:54.295 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package rbd-fuse. 2023-06-09T04:38:54.315 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../117-rbd-fuse_18.0.0-4313-ga02638f8-1focal_amd64.deb ... 2023-06-09T04:38:54.353 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking rbd-fuse (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:38:54.691 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-attr (19.3.0-2) ... 2023-06-09T04:38:55.052 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2023-06-09T04:38:55.161 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-06-09T04:38:55.262 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2023-06-09T04:38:55.420 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package rbd-fuse. 2023-06-09T04:38:55.439 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../117-rbd-fuse_18.0.0-4313-ga02638f8-1focal_amd64.deb ... 2023-06-09T04:38:55.455 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up cephadm (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:38:55.478 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking rbd-fuse (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:38:55.844 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-attr (19.3.0-2) ... 2023-06-09T04:38:56.172 INFO:teuthology.orchestra.run.smithi174.stdout:Adding system user cephadm....done 2023-06-09T04:38:56.217 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2023-06-09T04:38:56.353 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-06-09T04:38:56.369 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up fonts-mathjax (2.7.4+dfsg-1) ... 2023-06-09T04:38:56.470 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2023-06-09T04:38:56.479 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2023-06-09T04:38:56.698 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up cephadm (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:38:56.888 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-06-09T04:38:57.232 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up libjs-mathjax (2.7.4+dfsg-1) ... 2023-06-09T04:38:57.357 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up liboath0 (2.6.1-1.3) ... 2023-06-09T04:38:57.401 INFO:teuthology.orchestra.run.smithi090.stdout:Adding system user cephadm....done 2023-06-09T04:38:57.483 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2023-06-09T04:38:57.593 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up fonts-mathjax (2.7.4+dfsg-1) ... 2023-06-09T04:38:57.719 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2023-06-09T04:38:57.885 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-joblib (0.14.0-3) ... 2023-06-09T04:38:58.147 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-06-09T04:38:58.373 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2023-06-09T04:38:58.490 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up libjs-mathjax (2.7.4+dfsg-1) ... 2023-06-09T04:38:58.616 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up liboath0 (2.6.1-1.3) ... 2023-06-09T04:38:58.724 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-cachetools (4.0.0-1) ... 2023-06-09T04:38:58.743 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2023-06-09T04:38:59.075 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-colorama (0.4.3-1build1) ... 2023-06-09T04:38:59.128 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-joblib (0.14.0-3) ... 2023-06-09T04:38:59.435 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2023-06-09T04:38:59.598 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2023-06-09T04:38:59.770 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-06-09T04:38:59.950 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-cachetools (4.0.0-1) ... 2023-06-09T04:39:00.129 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-ceph-argparse (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:39:00.301 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-colorama (0.4.3-1build1) ... 2023-06-09T04:39:00.490 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-06-09T04:39:00.622 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-pyperclip (1.7.0-1) ... 2023-06-09T04:39:00.653 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2023-06-09T04:39:00.966 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2023-06-09T04:39:00.995 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-06-09T04:39:01.309 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2023-06-09T04:39:01.347 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-ceph-argparse (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:39:01.660 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-06-09T04:39:01.705 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-06-09T04:39:01.786 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2023-06-09T04:39:01.831 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-pyperclip (1.7.0-1) ... 2023-06-09T04:39:02.166 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2023-06-09T04:39:02.245 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-natsort (7.0.1-1) ... 2023-06-09T04:39:02.511 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2023-06-09T04:39:02.588 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2023-06-09T04:39:02.862 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-06-09T04:39:02.922 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2023-06-09T04:39:02.988 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2023-06-09T04:39:03.315 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2023-06-09T04:39:03.441 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-natsort (7.0.1-1) ... 2023-06-09T04:39:03.649 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2023-06-09T04:39:03.801 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2023-06-09T04:39:04.058 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-tempita (0.5.2-6) ... 2023-06-09T04:39:04.136 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2023-06-09T04:39:04.410 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-packaging (20.3-1) ... 2023-06-09T04:39:04.557 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2023-06-09T04:39:04.769 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2023-06-09T04:39:04.895 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-06-09T04:39:04.900 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2023-06-09T04:39:05.021 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2023-06-09T04:39:05.302 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-tempita (0.5.2-6) ... 2023-06-09T04:39:05.371 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2023-06-09T04:39:05.670 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-packaging (20.3-1) ... 2023-06-09T04:39:05.831 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-cmd2 (0.8.5-2.1) ... 2023-06-09T04:39:06.022 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2023-06-09T04:39:06.148 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-06-09T04:39:06.190 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-06-09T04:39:06.274 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2023-06-09T04:39:06.626 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2023-06-09T04:39:06.633 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-cryptography (2.8-3ubuntu0.1) ... 2023-06-09T04:39:07.069 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up socat (1.7.3.3-2) ... 2023-06-09T04:39:07.086 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-cmd2 (0.8.5-2.1) ... 2023-06-09T04:39:07.194 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-ceph-common (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:39:07.454 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-06-09T04:39:07.587 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-06-09T04:39:07.730 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-html5lib (1.0.1-2) ... 2023-06-09T04:39:07.890 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-cryptography (2.8-3ubuntu0.1) ... 2023-06-09T04:39:08.157 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-06-09T04:39:08.282 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2023-06-09T04:39:08.325 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up socat (1.7.3.3-2) ... 2023-06-09T04:39:08.425 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-pluggy (0.13.0-2) ... 2023-06-09T04:39:08.451 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-ceph-common (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:39:08.778 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-06-09T04:39:08.845 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-06-09T04:39:08.987 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-html5lib (1.0.1-2) ... 2023-06-09T04:39:09.163 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-06-09T04:39:09.289 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-06-09T04:39:09.406 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-06-09T04:39:09.415 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2023-06-09T04:39:09.533 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2023-06-09T04:39:09.659 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-pluggy (0.13.0-2) ... 2023-06-09T04:39:09.808 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2023-06-09T04:39:10.019 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-06-09T04:39:10.161 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-logutils (0.3.3-7) ... 2023-06-09T04:39:10.387 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-06-09T04:39:10.504 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2023-06-09T04:39:10.513 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-06-09T04:39:10.632 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-06-09T04:39:10.640 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2023-06-09T04:39:10.975 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-prettytable (0.7.2-5) ... 2023-06-09T04:39:11.026 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2023-06-09T04:39:11.326 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2023-06-09T04:39:11.377 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-logutils (0.3.3-7) ... 2023-06-09T04:39:11.693 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2023-06-09T04:39:11.731 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2023-06-09T04:39:11.858 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-06-09T04:39:12.078 INFO:teuthology.orchestra.run.smithi174.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2023-06-09T04:39:12.202 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-prettytable (0.7.2-5) ... 2023-06-09T04:39:12.380 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2023-06-09T04:39:12.506 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-06-09T04:39:12.570 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2023-06-09T04:39:12.884 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2023-06-09T04:39:12.938 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2023-06-09T04:39:13.273 INFO:teuthology.orchestra.run.smithi090.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2023-06-09T04:39:13.310 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-06-09T04:39:13.444 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-06-09T04:39:13.566 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2023-06-09T04:39:13.570 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-webob (1:1.8.5-2) ... 2023-06-09T04:39:13.697 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-06-09T04:39:13.971 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-06-09T04:39:14.073 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2023-06-09T04:39:14.508 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-06-09T04:39:14.531 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2023-06-09T04:39:14.634 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-06-09T04:39:14.768 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-webob (1:1.8.5-2) ... 2023-06-09T04:39:15.171 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-06-09T04:39:15.523 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2023-06-09T04:39:16.328 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-06-09T04:39:16.453 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-pytest (4.6.9-1) ... 2023-06-09T04:39:16.897 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2023-06-09T04:39:17.239 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2023-06-09T04:39:17.349 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-06-09T04:39:17.475 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-pytest (4.6.9-1) ... 2023-06-09T04:39:17.582 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-06-09T04:39:17.708 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-bs4 (4.8.2-1) ... 2023-06-09T04:39:17.927 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2023-06-09T04:39:18.109 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2023-06-09T04:39:18.295 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2023-06-09T04:39:18.519 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-asyncssh (1.12.2-1) ... 2023-06-09T04:39:18.638 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-06-09T04:39:18.765 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-bs4 (4.8.2-1) ... 2023-06-09T04:39:18.978 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-06-09T04:39:19.167 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2023-06-09T04:39:19.363 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-06-09T04:39:19.552 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-asyncssh (1.12.2-1) ... 2023-06-09T04:39:19.995 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-06-09T04:39:20.397 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-06-09T04:39:20.561 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-06-09T04:39:20.685 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python-natsort-doc (7.0.1-1) ... 2023-06-09T04:39:20.811 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2023-06-09T04:39:20.937 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-rsa (4.0-3) ... 2023-06-09T04:39:21.289 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up libthrift-0.13.0 (0.13.0-2build2) ... 2023-06-09T04:39:21.414 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-webtest (2.0.32-2) ... 2023-06-09T04:39:21.654 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-06-09T04:39:21.773 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-06-09T04:39:21.780 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python-natsort-doc (7.0.1-1) ... 2023-06-09T04:39:21.906 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2023-06-09T04:39:22.034 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-rsa (4.0-3) ... 2023-06-09T04:39:22.125 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-06-09T04:39:22.393 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up libthrift-0.13.0 (0.13.0-2build2) ... 2023-06-09T04:39:22.501 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2023-06-09T04:39:22.820 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-webtest (2.0.32-2) ... 2023-06-09T04:39:22.928 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up librados2 (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:39:23.148 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python-asyncssh-doc (1.12.2-1) ... 2023-06-09T04:39:23.179 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-06-09T04:39:23.273 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up librgw2 (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:39:23.400 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up libsqlite3-mod-ceph (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:39:23.526 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up libcephfs2 (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:39:23.531 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-06-09T04:39:23.652 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-routes (2.4.1-2) ... 2023-06-09T04:39:23.907 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2023-06-09T04:39:24.003 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up libradosstriper1 (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:39:24.129 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-google-auth (1.5.1-2) ... 2023-06-09T04:39:24.344 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up librados2 (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:39:24.489 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up librbd1 (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:39:24.573 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python-asyncssh-doc (1.12.2-1) ... 2023-06-09T04:39:24.615 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up ceph-mgr-modules-core (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:39:24.699 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up librgw2 (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:39:24.741 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up ceph-fuse (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:39:24.825 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up libsqlite3-mod-ceph (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:39:24.953 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up libcephfs2 (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:39:25.003 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-06-09T04:39:25.004 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-06-09T04:39:25.079 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-routes (2.4.1-2) ... 2023-06-09T04:39:25.422 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up libradosstriper1 (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:39:25.548 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-google-auth (1.5.1-2) ... 2023-06-09T04:39:25.825 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up libcephfs-dev (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:39:25.916 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up librbd1 (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:39:25.951 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-rados (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:39:26.042 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up ceph-mgr-modules-core (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:39:26.077 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up cephfs-top (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:39:26.169 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up ceph-fuse (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:39:26.220 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2023-06-09T04:39:26.428 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-06-09T04:39:26.428 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-06-09T04:39:27.230 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up libcephfs-dev (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:39:27.331 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-rbd (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:39:27.356 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-rados (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:39:27.457 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up rbd-fuse (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:39:27.482 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up cephfs-top (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:39:27.583 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-rgw (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:39:27.608 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2023-06-09T04:39:27.709 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up python3-cephfs (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:39:27.835 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up cephfs-shell (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:39:27.970 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up ceph-common (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:39:28.552 INFO:teuthology.orchestra.run.smithi174.stdout:Adding group ceph....done 2023-06-09T04:39:28.748 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-rbd (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:39:28.874 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up rbd-fuse (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:39:28.998 INFO:teuthology.orchestra.run.smithi174.stdout:Adding system user ceph....done 2023-06-09T04:39:29.000 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-rgw (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:39:29.126 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-cephfs (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:39:29.230 INFO:teuthology.orchestra.run.smithi174.stdout:Setting system user ceph properties....done 2023-06-09T04:39:29.252 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up cephfs-shell (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:39:29.268 INFO:teuthology.orchestra.run.smithi174.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-06-09T04:39:29.378 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up ceph-common (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:39:29.456 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-06-09T04:39:29.952 INFO:teuthology.orchestra.run.smithi090.stdout:Adding group ceph....done 2023-06-09T04:39:30.009 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-06-09T04:39:30.411 INFO:teuthology.orchestra.run.smithi090.stdout:Adding system user ceph....done 2023-06-09T04:39:30.634 INFO:teuthology.orchestra.run.smithi090.stdout:Setting system user ceph properties....done 2023-06-09T04:39:30.666 INFO:teuthology.orchestra.run.smithi090.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-06-09T04:39:30.862 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-06-09T04:39:30.882 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up cephfs-mirror (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:39:31.008 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up ceph-test (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:39:31.134 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up radosgw (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:39:31.413 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-06-09T04:39:31.450 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-06-09T04:39:31.450 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-06-09T04:39:32.317 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up cephfs-mirror (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:39:32.443 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up ceph-test (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:39:32.569 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up radosgw (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:39:32.711 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up ceph-base (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:39:32.896 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-06-09T04:39:32.896 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-06-09T04:39:33.220 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-06-09T04:39:34.129 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up ceph-mds (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:39:34.130 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up ceph-base (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:39:34.394 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-06-09T04:39:34.395 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-06-09T04:39:34.610 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-06-09T04:39:35.239 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up ceph-mgr (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:39:35.507 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-06-09T04:39:35.508 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-06-09T04:39:35.520 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up ceph-mds (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:39:35.790 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-06-09T04:39:35.790 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-06-09T04:39:36.349 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up ceph-osd (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:39:36.631 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up ceph-mgr (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:39:36.900 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-06-09T04:39:36.900 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-06-09T04:39:37.115 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-06-09T04:39:37.116 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-06-09T04:39:37.749 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up ceph-osd (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:39:37.975 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up ceph-mgr-k8sevents (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:39:38.101 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up ceph-mgr-diskprediction-local (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:39:38.260 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up ceph-mon (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:39:38.521 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-06-09T04:39:38.521 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-06-09T04:39:38.558 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-06-09T04:39:38.558 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-06-09T04:39:39.369 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up ceph-mgr-k8sevents (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:39:39.397 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up ceph-mgr-cephadm (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:39:39.495 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up ceph-mgr-diskprediction-local (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:39:39.548 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up ceph (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:39:39.646 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up ceph-mon (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:39:39.674 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up ceph-mgr-dashboard (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:39:39.892 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up ceph-volume (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:39:39.906 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-06-09T04:39:39.906 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-06-09T04:39:40.028 INFO:teuthology.orchestra.run.smithi174.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-06-09T04:39:40.188 INFO:teuthology.orchestra.run.smithi174.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-06-09T04:39:40.664 INFO:teuthology.orchestra.run.smithi174.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-06-09T04:39:40.731 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up ceph-mgr-cephadm (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:39:40.882 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up ceph (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:39:41.009 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up ceph-mgr-dashboard (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:39:41.169 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up ceph-volume (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:39:41.296 INFO:teuthology.orchestra.run.smithi090.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-06-09T04:39:41.457 INFO:teuthology.orchestra.run.smithi090.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-06-09T04:39:41.910 INFO:teuthology.orchestra.run.smithi090.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-06-09T04:39:45.691 INFO:teuthology.orchestra.run.smithi174.stdout:Processing triggers for fontconfig (2.13.1-2ubuntu3) ... 2023-06-09T04:39:46.437 INFO:teuthology.orchestra.run.smithi174.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-06-09T04:39:46.441 DEBUG:teuthology.orchestra.run.smithi174:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-06-09T04:39:46.562 INFO:teuthology.orchestra.run.smithi174.stdout:Reading package lists... 2023-06-09T04:39:46.758 INFO:teuthology.orchestra.run.smithi174.stdout:Building dependency tree... 2023-06-09T04:39:46.759 INFO:teuthology.orchestra.run.smithi174.stdout:Reading state information... 2023-06-09T04:39:46.865 INFO:teuthology.orchestra.run.smithi090.stdout:Processing triggers for fontconfig (2.13.1-2ubuntu3) ... 2023-06-09T04:39:46.932 INFO:teuthology.orchestra.run.smithi174.stdout:bison is already the newest version (2:3.5.1+dfsg-1). 2023-06-09T04:39:46.933 INFO:teuthology.orchestra.run.smithi174.stdout:flex is already the newest version (2.6.4-6.2). 2023-06-09T04:39:46.933 INFO:teuthology.orchestra.run.smithi174.stdout:iproute2 is already the newest version (5.5.0-1ubuntu1). 2023-06-09T04:39:46.933 INFO:teuthology.orchestra.run.smithi174.stdout:libtool-bin is already the newest version (2.4.6-14). 2023-06-09T04:39:46.933 INFO:teuthology.orchestra.run.smithi174.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2023-06-09T04:39:46.933 INFO:teuthology.orchestra.run.smithi174.stdout:util-linux is already the newest version (2.34-0.1ubuntu9.3). 2023-06-09T04:39:46.933 INFO:teuthology.orchestra.run.smithi174.stdout:uuid-dev is already the newest version (2.34-0.1ubuntu9.3). 2023-06-09T04:39:46.933 INFO:teuthology.orchestra.run.smithi174.stdout:The following packages were automatically installed and are no longer required: 2023-06-09T04:39:46.934 INFO:teuthology.orchestra.run.smithi174.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-06-09T04:39:46.934 INFO:teuthology.orchestra.run.smithi174.stdout:Use 'sudo apt autoremove' to remove them. 2023-06-09T04:39:46.934 INFO:teuthology.orchestra.run.smithi174.stdout:The following additional packages will be installed: 2023-06-09T04:39:46.935 INFO:teuthology.orchestra.run.smithi174.stdout: libbluetooth3 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 2023-06-09T04:39:46.935 INFO:teuthology.orchestra.run.smithi174.stdout: libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl1.1 libteamdctl0 modemmanager 2023-06-09T04:39:46.935 INFO:teuthology.orchestra.run.smithi174.stdout: network-manager-pptp postgresql-12 postgresql-client-12 2023-06-09T04:39:46.935 INFO:teuthology.orchestra.run.smithi174.stdout: postgresql-client-common ppp pptp-linux usb-modeswitch usb-modeswitch-data 2023-06-09T04:39:46.935 INFO:teuthology.orchestra.run.smithi174.stdout: wpasupplicant 2023-06-09T04:39:46.935 INFO:teuthology.orchestra.run.smithi174.stdout:Suggested packages: 2023-06-09T04:39:46.936 INFO:teuthology.orchestra.run.smithi174.stdout: indent-doc libssl-doc avahi-autoipd libteam-utils postgresql-doc 2023-06-09T04:39:46.936 INFO:teuthology.orchestra.run.smithi174.stdout: postgresql-doc-12 libjson-perl comgt wvdial wpagui libengine-pkcs11-openssl 2023-06-09T04:39:47.022 INFO:teuthology.orchestra.run.smithi174.stdout:The following NEW packages will be installed: 2023-06-09T04:39:47.023 INFO:teuthology.orchestra.run.smithi174.stdout: dump indent libaio-dev libbluetooth3 libelf-dev liblzo2-2 libmbim-glib4 2023-06-09T04:39:47.023 INFO:teuthology.orchestra.run.smithi174.stdout: libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy 2023-06-09T04:39:47.023 INFO:teuthology.orchestra.run.smithi174.stdout: libssl-dev libteamdctl0 modemmanager network-manager network-manager-pptp 2023-06-09T04:39:47.024 INFO:teuthology.orchestra.run.smithi174.stdout: postgresql postgresql-12 postgresql-client postgresql-client-12 2023-06-09T04:39:47.024 INFO:teuthology.orchestra.run.smithi174.stdout: postgresql-client-common postgresql-common postgresql-contrib ppp pptp-linux 2023-06-09T04:39:47.024 INFO:teuthology.orchestra.run.smithi174.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-06-09T04:39:47.024 INFO:teuthology.orchestra.run.smithi174.stdout:The following packages will be upgraded: 2023-06-09T04:39:47.025 INFO:teuthology.orchestra.run.smithi174.stdout: libssl1.1 2023-06-09T04:39:47.222 INFO:teuthology.orchestra.run.smithi174.stdout:1 upgraded, 31 newly installed, 0 to remove and 185 not upgraded. 2023-06-09T04:39:47.222 INFO:teuthology.orchestra.run.smithi174.stdout:Need to get 24.0 MB of archives. 2023-06-09T04:39:47.222 INFO:teuthology.orchestra.run.smithi174.stdout:After this operation, 79.9 MB of additional disk space will be used. 2023-06-09T04:39:47.222 INFO:teuthology.orchestra.run.smithi174.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl1.1 amd64 1.1.1f-1ubuntu2.19 [1,321 kB] 2023-06-09T04:39:47.639 INFO:teuthology.orchestra.run.smithi090.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-06-09T04:39:47.646 DEBUG:teuthology.orchestra.run.smithi090:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-06-09T04:39:47.766 INFO:teuthology.orchestra.run.smithi090.stdout:Reading package lists... 2023-06-09T04:39:47.876 INFO:teuthology.orchestra.run.smithi174.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 liblzo2-2 amd64 2.10-2 [50.8 kB] 2023-06-09T04:39:47.877 INFO:teuthology.orchestra.run.smithi174.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/universe amd64 dump amd64 0.4b46-6 [130 kB] 2023-06-09T04:39:47.884 INFO:teuthology.orchestra.run.smithi174.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 indent amd64 2.2.12-1 [86.9 kB] 2023-06-09T04:39:47.887 INFO:teuthology.orchestra.run.smithi174.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2023-06-09T04:39:47.887 INFO:teuthology.orchestra.run.smithi174.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libbluetooth3 amd64 5.53-0ubuntu3.6 [60.6 kB] 2023-06-09T04:39:47.890 INFO:teuthology.orchestra.run.smithi174.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 libelf-dev amd64 0.176-1.1build1 [57.0 kB] 2023-06-09T04:39:47.892 INFO:teuthology.orchestra.run.smithi174.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-glib4 amd64 1.26.2-1~ubuntu20.04.1 [123 kB] 2023-06-09T04:39:47.898 INFO:teuthology.orchestra.run.smithi174.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-proxy amd64 1.26.2-1~ubuntu20.04.1 [6,012 B] 2023-06-09T04:39:47.898 INFO:teuthology.orchestra.run.smithi174.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmm-glib0 amd64 1.18.6-1~ubuntu20.04.1 [203 kB] 2023-06-09T04:39:47.957 INFO:teuthology.orchestra.run.smithi174.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal/main amd64 libndp0 amd64 1.7-0ubuntu1 [10.9 kB] 2023-06-09T04:39:47.962 INFO:teuthology.orchestra.run.smithi090.stdout:Building dependency tree... 2023-06-09T04:39:47.963 INFO:teuthology.orchestra.run.smithi090.stdout:Reading state information... 2023-06-09T04:39:48.122 INFO:teuthology.orchestra.run.smithi174.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libnm0 amd64 1.22.10-1ubuntu2.3 [370 kB] 2023-06-09T04:39:48.149 INFO:teuthology.orchestra.run.smithi090.stdout:bison is already the newest version (2:3.5.1+dfsg-1). 2023-06-09T04:39:48.150 INFO:teuthology.orchestra.run.smithi090.stdout:flex is already the newest version (2.6.4-6.2). 2023-06-09T04:39:48.150 INFO:teuthology.orchestra.run.smithi090.stdout:iproute2 is already the newest version (5.5.0-1ubuntu1). 2023-06-09T04:39:48.150 INFO:teuthology.orchestra.run.smithi090.stdout:libtool-bin is already the newest version (2.4.6-14). 2023-06-09T04:39:48.150 INFO:teuthology.orchestra.run.smithi090.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2023-06-09T04:39:48.150 INFO:teuthology.orchestra.run.smithi090.stdout:util-linux is already the newest version (2.34-0.1ubuntu9.3). 2023-06-09T04:39:48.150 INFO:teuthology.orchestra.run.smithi090.stdout:uuid-dev is already the newest version (2.34-0.1ubuntu9.3). 2023-06-09T04:39:48.150 INFO:teuthology.orchestra.run.smithi090.stdout:The following packages were automatically installed and are no longer required: 2023-06-09T04:39:48.151 INFO:teuthology.orchestra.run.smithi090.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-06-09T04:39:48.151 INFO:teuthology.orchestra.run.smithi090.stdout:Use 'sudo apt autoremove' to remove them. 2023-06-09T04:39:48.151 INFO:teuthology.orchestra.run.smithi090.stdout:The following additional packages will be installed: 2023-06-09T04:39:48.151 INFO:teuthology.orchestra.run.smithi090.stdout: libbluetooth3 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 2023-06-09T04:39:48.152 INFO:teuthology.orchestra.run.smithi090.stdout: libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl1.1 libteamdctl0 modemmanager 2023-06-09T04:39:48.152 INFO:teuthology.orchestra.run.smithi090.stdout: network-manager-pptp postgresql-12 postgresql-client-12 2023-06-09T04:39:48.152 INFO:teuthology.orchestra.run.smithi090.stdout: postgresql-client-common ppp pptp-linux usb-modeswitch usb-modeswitch-data 2023-06-09T04:39:48.152 INFO:teuthology.orchestra.run.smithi090.stdout: wpasupplicant 2023-06-09T04:39:48.153 INFO:teuthology.orchestra.run.smithi090.stdout:Suggested packages: 2023-06-09T04:39:48.153 INFO:teuthology.orchestra.run.smithi090.stdout: indent-doc libssl-doc avahi-autoipd libteam-utils postgresql-doc 2023-06-09T04:39:48.153 INFO:teuthology.orchestra.run.smithi090.stdout: postgresql-doc-12 libjson-perl comgt wvdial wpagui libengine-pkcs11-openssl 2023-06-09T04:39:48.248 INFO:teuthology.orchestra.run.smithi090.stdout:The following NEW packages will be installed: 2023-06-09T04:39:48.249 INFO:teuthology.orchestra.run.smithi090.stdout: dump indent libaio-dev libbluetooth3 libelf-dev liblzo2-2 libmbim-glib4 2023-06-09T04:39:48.249 INFO:teuthology.orchestra.run.smithi090.stdout: libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy 2023-06-09T04:39:48.250 INFO:teuthology.orchestra.run.smithi090.stdout: libssl-dev libteamdctl0 modemmanager network-manager network-manager-pptp 2023-06-09T04:39:48.250 INFO:teuthology.orchestra.run.smithi090.stdout: postgresql postgresql-12 postgresql-client postgresql-client-12 2023-06-09T04:39:48.250 INFO:teuthology.orchestra.run.smithi090.stdout: postgresql-client-common postgresql-common postgresql-contrib ppp pptp-linux 2023-06-09T04:39:48.250 INFO:teuthology.orchestra.run.smithi090.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-06-09T04:39:48.251 INFO:teuthology.orchestra.run.smithi090.stdout:The following packages will be upgraded: 2023-06-09T04:39:48.252 INFO:teuthology.orchestra.run.smithi090.stdout: libssl1.1 2023-06-09T04:39:48.320 INFO:teuthology.orchestra.run.smithi090.stdout:1 upgraded, 31 newly installed, 0 to remove and 185 not upgraded. 2023-06-09T04:39:48.321 INFO:teuthology.orchestra.run.smithi090.stdout:Need to get 24.0 MB of archives. 2023-06-09T04:39:48.321 INFO:teuthology.orchestra.run.smithi090.stdout:After this operation, 79.9 MB of additional disk space will be used. 2023-06-09T04:39:48.321 INFO:teuthology.orchestra.run.smithi090.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl1.1 amd64 1.1.1f-1ubuntu2.19 [1,321 kB] 2023-06-09T04:39:48.457 INFO:teuthology.orchestra.run.smithi090.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 liblzo2-2 amd64 2.10-2 [50.8 kB] 2023-06-09T04:39:48.458 INFO:teuthology.orchestra.run.smithi090.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/universe amd64 dump amd64 0.4b46-6 [130 kB] 2023-06-09T04:39:48.462 INFO:teuthology.orchestra.run.smithi090.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 indent amd64 2.2.12-1 [86.9 kB] 2023-06-09T04:39:48.466 INFO:teuthology.orchestra.run.smithi090.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2023-06-09T04:39:48.467 INFO:teuthology.orchestra.run.smithi090.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libbluetooth3 amd64 5.53-0ubuntu3.6 [60.6 kB] 2023-06-09T04:39:48.469 INFO:teuthology.orchestra.run.smithi090.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 libelf-dev amd64 0.176-1.1build1 [57.0 kB] 2023-06-09T04:39:48.469 INFO:teuthology.orchestra.run.smithi090.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-glib4 amd64 1.26.2-1~ubuntu20.04.1 [123 kB] 2023-06-09T04:39:48.471 INFO:teuthology.orchestra.run.smithi090.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-proxy amd64 1.26.2-1~ubuntu20.04.1 [6,012 B] 2023-06-09T04:39:48.471 INFO:teuthology.orchestra.run.smithi090.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmm-glib0 amd64 1.18.6-1~ubuntu20.04.1 [203 kB] 2023-06-09T04:39:48.474 INFO:teuthology.orchestra.run.smithi090.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal/main amd64 libndp0 amd64 1.7-0ubuntu1 [10.9 kB] 2023-06-09T04:39:48.509 INFO:teuthology.orchestra.run.smithi090.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libnm0 amd64 1.22.10-1ubuntu2.3 [370 kB] 2023-06-09T04:39:48.616 INFO:teuthology.orchestra.run.smithi090.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpq5 amd64 12.15-0ubuntu0.20.04.1 [116 kB] 2023-06-09T04:39:48.621 INFO:teuthology.orchestra.run.smithi090.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-glib5 amd64 1.30.4-1~ubuntu20.04.1 [642 kB] 2023-06-09T04:39:48.623 INFO:teuthology.orchestra.run.smithi174.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpq5 amd64 12.15-0ubuntu0.20.04.1 [116 kB] 2023-06-09T04:39:48.641 INFO:teuthology.orchestra.run.smithi174.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-glib5 amd64 1.30.4-1~ubuntu20.04.1 [642 kB] 2023-06-09T04:39:48.646 INFO:teuthology.orchestra.run.smithi090.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-proxy amd64 1.30.4-1~ubuntu20.04.1 [5,908 B] 2023-06-09T04:39:48.647 INFO:teuthology.orchestra.run.smithi090.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.19 [1,584 kB] 2023-06-09T04:39:48.672 INFO:teuthology.orchestra.run.smithi090.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/main amd64 libteamdctl0 amd64 1.30-1 [11.8 kB] 2023-06-09T04:39:48.673 INFO:teuthology.orchestra.run.smithi090.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 modemmanager amd64 1.18.6-1~ubuntu20.04.1 [895 kB] 2023-06-09T04:39:48.684 INFO:teuthology.orchestra.run.smithi090.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 wpasupplicant amd64 2:2.9-1ubuntu4.3 [1,183 kB] 2023-06-09T04:39:48.698 INFO:teuthology.orchestra.run.smithi090.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 network-manager amd64 1.22.10-1ubuntu2.3 [1,855 kB] 2023-06-09T04:39:48.717 INFO:teuthology.orchestra.run.smithi090.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 ppp amd64 2.4.7-2+4.1ubuntu5.1 [328 kB] 2023-06-09T04:39:48.721 INFO:teuthology.orchestra.run.smithi090.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 pptp-linux amd64 1.10.0-1build1 [42.0 kB] 2023-06-09T04:39:48.756 INFO:teuthology.orchestra.run.smithi090.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 network-manager-pptp amd64 1.2.8-2 [30.1 kB] 2023-06-09T04:39:48.762 INFO:teuthology.orchestra.run.smithi174.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-proxy amd64 1.30.4-1~ubuntu20.04.1 [5,908 B] 2023-06-09T04:39:48.763 INFO:teuthology.orchestra.run.smithi174.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.19 [1,584 kB] 2023-06-09T04:39:48.798 INFO:teuthology.orchestra.run.smithi090.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client-common all 214ubuntu0.1 [28.2 kB] 2023-06-09T04:39:48.808 INFO:teuthology.orchestra.run.smithi090.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client-12 amd64 12.15-0ubuntu0.20.04.1 [1,052 kB] 2023-06-09T04:39:48.883 INFO:teuthology.orchestra.run.smithi174.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/main amd64 libteamdctl0 amd64 1.30-1 [11.8 kB] 2023-06-09T04:39:48.883 INFO:teuthology.orchestra.run.smithi174.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 modemmanager amd64 1.18.6-1~ubuntu20.04.1 [895 kB] 2023-06-09T04:39:48.886 INFO:teuthology.orchestra.run.smithi090.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-common all 214ubuntu0.1 [169 kB] 2023-06-09T04:39:48.889 INFO:teuthology.orchestra.run.smithi090.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-12 amd64 12.15-0ubuntu0.20.04.1 [13.5 MB] 2023-06-09T04:39:48.916 INFO:teuthology.orchestra.run.smithi174.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 wpasupplicant amd64 2:2.9-1ubuntu4.3 [1,183 kB] 2023-06-09T04:39:48.952 INFO:teuthology.orchestra.run.smithi174.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 network-manager amd64 1.22.10-1ubuntu2.3 [1,855 kB] 2023-06-09T04:39:48.997 INFO:teuthology.orchestra.run.smithi174.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 ppp amd64 2.4.7-2+4.1ubuntu5.1 [328 kB] 2023-06-09T04:39:49.006 INFO:teuthology.orchestra.run.smithi174.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 pptp-linux amd64 1.10.0-1build1 [42.0 kB] 2023-06-09T04:39:49.042 INFO:teuthology.orchestra.run.smithi090.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql all 12+214ubuntu0.1 [3,924 B] 2023-06-09T04:39:49.042 INFO:teuthology.orchestra.run.smithi090.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client all 12+214ubuntu0.1 [3,940 B] 2023-06-09T04:39:49.043 INFO:teuthology.orchestra.run.smithi090.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-contrib all 12+214ubuntu0.1 [3,932 B] 2023-06-09T04:39:49.043 INFO:teuthology.orchestra.run.smithi090.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch-data all 20191128-3 [32.3 kB] 2023-06-09T04:39:49.043 INFO:teuthology.orchestra.run.smithi090.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch amd64 2.5.2+repack0-2ubuntu3 [53.1 kB] 2023-06-09T04:39:49.172 INFO:teuthology.orchestra.run.smithi174.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 network-manager-pptp amd64 1.2.8-2 [30.1 kB] 2023-06-09T04:39:49.363 INFO:teuthology.orchestra.run.smithi174.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client-common all 214ubuntu0.1 [28.2 kB] 2023-06-09T04:39:49.413 INFO:teuthology.orchestra.run.smithi174.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client-12 amd64 12.15-0ubuntu0.20.04.1 [1,052 kB] 2023-06-09T04:39:49.585 INFO:teuthology.orchestra.run.smithi090.stdout:Preconfiguring packages ... 2023-06-09T04:39:49.794 INFO:teuthology.orchestra.run.smithi174.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-common all 214ubuntu0.1 [169 kB] 2023-06-09T04:39:49.809 INFO:teuthology.orchestra.run.smithi174.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-12 amd64 12.15-0ubuntu0.20.04.1 [13.5 MB] 2023-06-09T04:39:49.830 INFO:teuthology.orchestra.run.smithi090.stdout:Fetched 24.0 MB in 1s (30.6 MB/s) 2023-06-09T04:39:50.180 INFO:teuthology.orchestra.run.smithi090.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 118860 files and directories currently installed.) 2023-06-09T04:39:50.184 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../00-libssl1.1_1.1.1f-1ubuntu2.19_amd64.deb ... 2023-06-09T04:39:50.248 INFO:teuthology.orchestra.run.smithi174.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql all 12+214ubuntu0.1 [3,924 B] 2023-06-09T04:39:50.248 INFO:teuthology.orchestra.run.smithi174.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client all 12+214ubuntu0.1 [3,940 B] 2023-06-09T04:39:50.248 INFO:teuthology.orchestra.run.smithi174.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-contrib all 12+214ubuntu0.1 [3,932 B] 2023-06-09T04:39:50.249 INFO:teuthology.orchestra.run.smithi174.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch-data all 20191128-3 [32.3 kB] 2023-06-09T04:39:50.249 INFO:teuthology.orchestra.run.smithi174.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch amd64 2.5.2+repack0-2ubuntu3 [53.1 kB] 2023-06-09T04:39:50.361 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking libssl1.1:amd64 (1.1.1f-1ubuntu2.19) over (1.1.1f-1ubuntu2.16) ... 2023-06-09T04:39:50.790 INFO:teuthology.orchestra.run.smithi174.stdout:Preconfiguring packages ... 2023-06-09T04:39:50.925 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-06-09T04:39:50.944 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2_amd64.deb ... 2023-06-09T04:39:50.991 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking liblzo2-2:amd64 (2.10-2) ... 2023-06-09T04:39:51.032 INFO:teuthology.orchestra.run.smithi174.stdout:Fetched 24.0 MB in 3s (7,453 kB/s) 2023-06-09T04:39:51.370 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package dump. 2023-06-09T04:39:51.389 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../02-dump_0.4b46-6_amd64.deb ... 2023-06-09T04:39:51.390 INFO:teuthology.orchestra.run.smithi174.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 118860 files and directories currently installed.) 2023-06-09T04:39:51.394 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../00-libssl1.1_1.1.1f-1ubuntu2.19_amd64.deb ... 2023-06-09T04:39:51.428 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking dump (0.4b46-6) ... 2023-06-09T04:39:51.574 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking libssl1.1:amd64 (1.1.1f-1ubuntu2.19) over (1.1.1f-1ubuntu2.16) ... 2023-06-09T04:39:51.775 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package indent. 2023-06-09T04:39:51.795 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../03-indent_2.2.12-1_amd64.deb ... 2023-06-09T04:39:51.842 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking indent (2.2.12-1) ... 2023-06-09T04:39:52.128 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-06-09T04:39:52.148 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2_amd64.deb ... 2023-06-09T04:39:52.186 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking liblzo2-2:amd64 (2.10-2) ... 2023-06-09T04:39:52.195 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-06-09T04:39:52.214 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-5_amd64.deb ... 2023-06-09T04:39:52.253 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2023-06-09T04:39:52.556 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package dump. 2023-06-09T04:39:52.576 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../02-dump_0.4b46-6_amd64.deb ... 2023-06-09T04:39:52.613 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking dump (0.4b46-6) ... 2023-06-09T04:39:52.616 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-06-09T04:39:52.636 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../05-libbluetooth3_5.53-0ubuntu3.6_amd64.deb ... 2023-06-09T04:39:52.674 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking libbluetooth3:amd64 (5.53-0ubuntu3.6) ... 2023-06-09T04:39:52.976 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package indent. 2023-06-09T04:39:52.986 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-06-09T04:39:52.996 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../03-indent_2.2.12-1_amd64.deb ... 2023-06-09T04:39:53.006 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../06-libelf-dev_0.176-1.1build1_amd64.deb ... 2023-06-09T04:39:53.034 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking indent (2.2.12-1) ... 2023-06-09T04:39:53.052 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking libelf-dev:amd64 (0.176-1.1build1) ... 2023-06-09T04:39:53.395 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-06-09T04:39:53.416 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-5_amd64.deb ... 2023-06-09T04:39:53.424 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-06-09T04:39:53.442 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../07-libmbim-glib4_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2023-06-09T04:39:53.453 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2023-06-09T04:39:53.701 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2023-06-09T04:39:53.807 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-06-09T04:39:53.827 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../05-libbluetooth3_5.53-0ubuntu3.6_amd64.deb ... 2023-06-09T04:39:53.864 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking libbluetooth3:amd64 (5.53-0ubuntu3.6) ... 2023-06-09T04:39:54.142 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-06-09T04:39:54.162 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../06-libelf-dev_0.176-1.1build1_amd64.deb ... 2023-06-09T04:39:54.208 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking libelf-dev:amd64 (0.176-1.1build1) ... 2023-06-09T04:39:54.279 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package libmbim-proxy. 2023-06-09T04:39:54.299 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../08-libmbim-proxy_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2023-06-09T04:39:54.337 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2023-06-09T04:39:54.603 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-06-09T04:39:54.623 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../07-libmbim-glib4_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2023-06-09T04:39:54.661 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2023-06-09T04:39:54.699 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-06-09T04:39:54.719 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../09-libmm-glib0_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2023-06-09T04:39:54.765 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2023-06-09T04:39:54.947 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package libmbim-proxy. 2023-06-09T04:39:54.967 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../08-libmbim-proxy_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2023-06-09T04:39:55.005 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2023-06-09T04:39:55.145 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package libndp0:amd64. 2023-06-09T04:39:55.165 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../10-libndp0_1.7-0ubuntu1_amd64.deb ... 2023-06-09T04:39:55.203 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking libndp0:amd64 (1.7-0ubuntu1) ... 2023-06-09T04:39:55.434 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-06-09T04:39:55.454 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../09-libmm-glib0_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2023-06-09T04:39:55.500 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2023-06-09T04:39:55.564 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package libnm0:amd64. 2023-06-09T04:39:55.585 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../11-libnm0_1.22.10-1ubuntu2.3_amd64.deb ... 2023-06-09T04:39:55.623 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking libnm0:amd64 (1.22.10-1ubuntu2.3) ... 2023-06-09T04:39:55.862 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package libndp0:amd64. 2023-06-09T04:39:55.880 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../10-libndp0_1.7-0ubuntu1_amd64.deb ... 2023-06-09T04:39:55.919 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking libndp0:amd64 (1.7-0ubuntu1) ... 2023-06-09T04:39:56.009 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package libpq5:amd64. 2023-06-09T04:39:56.029 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../12-libpq5_12.15-0ubuntu0.20.04.1_amd64.deb ... 2023-06-09T04:39:56.067 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking libpq5:amd64 (12.15-0ubuntu0.20.04.1) ... 2023-06-09T04:39:56.280 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package libnm0:amd64. 2023-06-09T04:39:56.300 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../11-libnm0_1.22.10-1ubuntu2.3_amd64.deb ... 2023-06-09T04:39:56.338 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking libnm0:amd64 (1.22.10-1ubuntu2.3) ... 2023-06-09T04:39:56.455 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-06-09T04:39:56.475 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../13-libqmi-glib5_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2023-06-09T04:39:56.521 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2023-06-09T04:39:56.733 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package libpq5:amd64. 2023-06-09T04:39:56.752 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../12-libpq5_12.15-0ubuntu0.20.04.1_amd64.deb ... 2023-06-09T04:39:56.790 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking libpq5:amd64 (12.15-0ubuntu0.20.04.1) ... 2023-06-09T04:39:56.908 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package libqmi-proxy. 2023-06-09T04:39:56.928 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../14-libqmi-proxy_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2023-06-09T04:39:56.974 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2023-06-09T04:39:57.186 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-06-09T04:39:57.204 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../13-libqmi-glib5_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2023-06-09T04:39:57.243 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2023-06-09T04:39:57.252 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-06-09T04:39:57.272 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../15-libssl-dev_1.1.1f-1ubuntu2.19_amd64.deb ... 2023-06-09T04:39:57.310 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.19) ... 2023-06-09T04:39:57.579 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package libqmi-proxy. 2023-06-09T04:39:57.599 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../14-libqmi-proxy_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2023-06-09T04:39:57.637 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2023-06-09T04:39:57.832 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-06-09T04:39:57.851 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../16-libteamdctl0_1.30-1_amd64.deb ... 2023-06-09T04:39:57.898 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking libteamdctl0:amd64 (1.30-1) ... 2023-06-09T04:39:57.931 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-06-09T04:39:57.951 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../15-libssl-dev_1.1.1f-1ubuntu2.19_amd64.deb ... 2023-06-09T04:39:57.989 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.19) ... 2023-06-09T04:39:58.310 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package modemmanager. 2023-06-09T04:39:58.330 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../17-modemmanager_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2023-06-09T04:39:58.395 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking modemmanager (1.18.6-1~ubuntu20.04.1) ... 2023-06-09T04:39:58.526 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-06-09T04:39:58.545 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../16-libteamdctl0_1.30-1_amd64.deb ... 2023-06-09T04:39:58.584 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking libteamdctl0:amd64 (1.30-1) ... 2023-06-09T04:39:58.971 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package modemmanager. 2023-06-09T04:39:58.992 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../17-modemmanager_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2023-06-09T04:39:59.034 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package wpasupplicant. 2023-06-09T04:39:59.054 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../18-wpasupplicant_2%3a2.9-1ubuntu4.3_amd64.deb ... 2023-06-09T04:39:59.056 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking modemmanager (1.18.6-1~ubuntu20.04.1) ... 2023-06-09T04:39:59.092 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking wpasupplicant (2:2.9-1ubuntu4.3) ... 2023-06-09T04:39:59.709 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package network-manager. 2023-06-09T04:39:59.717 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package wpasupplicant. 2023-06-09T04:39:59.729 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../19-network-manager_1.22.10-1ubuntu2.3_amd64.deb ... 2023-06-09T04:39:59.737 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../18-wpasupplicant_2%3a2.9-1ubuntu4.3_amd64.deb ... 2023-06-09T04:39:59.775 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking wpasupplicant (2:2.9-1ubuntu4.3) ... 2023-06-09T04:39:59.822 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking network-manager (1.22.10-1ubuntu2.3) ... 2023-06-09T04:40:00.640 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package network-manager. 2023-06-09T04:40:00.653 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../19-network-manager_1.22.10-1ubuntu2.3_amd64.deb ... 2023-06-09T04:40:00.661 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package ppp. 2023-06-09T04:40:00.681 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../20-ppp_2.4.7-2+4.1ubuntu5.1_amd64.deb ... 2023-06-09T04:40:00.745 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking network-manager (1.22.10-1ubuntu2.3) ... 2023-06-09T04:40:01.144 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking ppp (2.4.7-2+4.1ubuntu5.1) ... 2023-06-09T04:40:01.507 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package pptp-linux. 2023-06-09T04:40:01.521 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../21-pptp-linux_1.10.0-1build1_amd64.deb ... 2023-06-09T04:40:01.547 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package ppp. 2023-06-09T04:40:01.566 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking pptp-linux (1.10.0-1build1) ... 2023-06-09T04:40:01.566 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../20-ppp_2.4.7-2+4.1ubuntu5.1_amd64.deb ... 2023-06-09T04:40:01.946 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package network-manager-pptp. 2023-06-09T04:40:01.965 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../22-network-manager-pptp_1.2.8-2_amd64.deb ... 2023-06-09T04:40:02.050 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking network-manager-pptp (1.2.8-2) ... 2023-06-09T04:40:02.056 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking ppp (2.4.7-2+4.1ubuntu5.1) ... 2023-06-09T04:40:02.382 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package postgresql-client-common. 2023-06-09T04:40:02.402 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../23-postgresql-client-common_214ubuntu0.1_all.deb ... 2023-06-09T04:40:02.418 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package pptp-linux. 2023-06-09T04:40:02.439 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../21-pptp-linux_1.10.0-1build1_amd64.deb ... 2023-06-09T04:40:02.440 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking postgresql-client-common (214ubuntu0.1) ... 2023-06-09T04:40:02.476 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking pptp-linux (1.10.0-1build1) ... 2023-06-09T04:40:02.788 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package postgresql-client-12. 2023-06-09T04:40:02.808 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../24-postgresql-client-12_12.15-0ubuntu0.20.04.1_amd64.deb ... 2023-06-09T04:40:02.846 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking postgresql-client-12 (12.15-0ubuntu0.20.04.1) ... 2023-06-09T04:40:02.879 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package network-manager-pptp. 2023-06-09T04:40:02.899 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../22-network-manager-pptp_1.2.8-2_amd64.deb ... 2023-06-09T04:40:02.973 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking network-manager-pptp (1.2.8-2) ... 2023-06-09T04:40:03.315 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package postgresql-client-common. 2023-06-09T04:40:03.335 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../23-postgresql-client-common_214ubuntu0.1_all.deb ... 2023-06-09T04:40:03.373 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking postgresql-client-common (214ubuntu0.1) ... 2023-06-09T04:40:03.477 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package postgresql-common. 2023-06-09T04:40:03.495 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../25-postgresql-common_214ubuntu0.1_all.deb ... 2023-06-09T04:40:03.574 INFO:teuthology.orchestra.run.smithi090.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-06-09T04:40:03.606 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking postgresql-common (214ubuntu0.1) ... 2023-06-09T04:40:03.719 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package postgresql-client-12. 2023-06-09T04:40:03.739 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../24-postgresql-client-12_12.15-0ubuntu0.20.04.1_amd64.deb ... 2023-06-09T04:40:03.777 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking postgresql-client-12 (12.15-0ubuntu0.20.04.1) ... 2023-06-09T04:40:04.119 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package postgresql-12. 2023-06-09T04:40:04.139 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../26-postgresql-12_12.15-0ubuntu0.20.04.1_amd64.deb ... 2023-06-09T04:40:04.184 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking postgresql-12 (12.15-0ubuntu0.20.04.1) ... 2023-06-09T04:40:04.406 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package postgresql-common. 2023-06-09T04:40:04.427 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../25-postgresql-common_214ubuntu0.1_all.deb ... 2023-06-09T04:40:04.496 INFO:teuthology.orchestra.run.smithi174.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-06-09T04:40:04.526 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking postgresql-common (214ubuntu0.1) ... 2023-06-09T04:40:05.013 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package postgresql-12. 2023-06-09T04:40:05.032 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../26-postgresql-12_12.15-0ubuntu0.20.04.1_amd64.deb ... 2023-06-09T04:40:05.078 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking postgresql-12 (12.15-0ubuntu0.20.04.1) ... 2023-06-09T04:40:05.684 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package postgresql. 2023-06-09T04:40:05.705 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../27-postgresql_12+214ubuntu0.1_all.deb ... 2023-06-09T04:40:05.742 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking postgresql (12+214ubuntu0.1) ... 2023-06-09T04:40:06.020 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package postgresql-client. 2023-06-09T04:40:06.038 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../28-postgresql-client_12+214ubuntu0.1_all.deb ... 2023-06-09T04:40:06.078 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking postgresql-client (12+214ubuntu0.1) ... 2023-06-09T04:40:06.381 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package postgresql-contrib. 2023-06-09T04:40:06.400 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../29-postgresql-contrib_12+214ubuntu0.1_all.deb ... 2023-06-09T04:40:06.448 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking postgresql-contrib (12+214ubuntu0.1) ... 2023-06-09T04:40:06.590 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package postgresql. 2023-06-09T04:40:06.610 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../27-postgresql_12+214ubuntu0.1_all.deb ... 2023-06-09T04:40:06.639 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking postgresql (12+214ubuntu0.1) ... 2023-06-09T04:40:06.726 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-06-09T04:40:06.745 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../30-usb-modeswitch-data_20191128-3_all.deb ... 2023-06-09T04:40:06.784 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking usb-modeswitch-data (20191128-3) ... 2023-06-09T04:40:06.925 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package postgresql-client. 2023-06-09T04:40:06.946 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../28-postgresql-client_12+214ubuntu0.1_all.deb ... 2023-06-09T04:40:06.983 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking postgresql-client (12+214ubuntu0.1) ... 2023-06-09T04:40:07.188 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package usb-modeswitch. 2023-06-09T04:40:07.208 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../31-usb-modeswitch_2.5.2+repack0-2ubuntu3_amd64.deb ... 2023-06-09T04:40:07.252 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package postgresql-contrib. 2023-06-09T04:40:07.272 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../29-postgresql-contrib_12+214ubuntu0.1_all.deb ... 2023-06-09T04:40:07.275 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2023-06-09T04:40:07.310 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking postgresql-contrib (12+214ubuntu0.1) ... 2023-06-09T04:40:07.596 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-06-09T04:40:07.616 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../30-usb-modeswitch-data_20191128-3_all.deb ... 2023-06-09T04:40:07.622 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up postgresql-client-common (214ubuntu0.1) ... 2023-06-09T04:40:07.654 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking usb-modeswitch-data (20191128-3) ... 2023-06-09T04:40:07.829 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up libssl1.1:amd64 (1.1.1f-1ubuntu2.19) ... 2023-06-09T04:40:08.049 INFO:teuthology.orchestra.run.smithi174.stdout:Selecting previously unselected package usb-modeswitch. 2023-06-09T04:40:08.068 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing to unpack .../31-usb-modeswitch_2.5.2+repack0-2ubuntu3_amd64.deb ... 2023-06-09T04:40:08.128 INFO:teuthology.orchestra.run.smithi174.stdout:Unpacking usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2023-06-09T04:40:08.206 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up libpq5:amd64 (12.15-0ubuntu0.20.04.1) ... 2023-06-09T04:40:08.332 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up liblzo2-2:amd64 (2.10-2) ... 2023-06-09T04:40:08.460 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2023-06-09T04:40:08.482 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up postgresql-client-common (214ubuntu0.1) ... 2023-06-09T04:40:08.585 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up wpasupplicant (2:2.9-1ubuntu4.3) ... 2023-06-09T04:40:08.696 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up libssl1.1:amd64 (1.1.1f-1ubuntu2.19) ... 2023-06-09T04:40:09.009 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-06-09T04:40:09.010 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-06-09T04:40:09.039 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up libpq5:amd64 (12.15-0ubuntu0.20.04.1) ... 2023-06-09T04:40:09.164 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up liblzo2-2:amd64 (2.10-2) ... 2023-06-09T04:40:09.290 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2023-06-09T04:40:09.416 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up wpasupplicant (2:2.9-1ubuntu4.3) ... 2023-06-09T04:40:09.853 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-06-09T04:40:09.853 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-06-09T04:40:09.864 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up postgresql-client-12 (12.15-0ubuntu0.20.04.1) ... 2023-06-09T04:40:10.771 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up postgresql-client-12 (12.15-0ubuntu0.20.04.1) ... 2023-06-09T04:40:11.981 INFO:teuthology.orchestra.run.smithi090.stdout:update-alternatives: using /usr/share/postgresql/12/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-06-09T04:40:12.105 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up libteamdctl0:amd64 (1.30-1) ... 2023-06-09T04:40:12.231 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up postgresql-common (214ubuntu0.1) ... 2023-06-09T04:40:12.826 INFO:teuthology.orchestra.run.smithi174.stdout:update-alternatives: using /usr/share/postgresql/12/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-06-09T04:40:12.934 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up libteamdctl0:amd64 (1.30-1) ... 2023-06-09T04:40:13.060 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up postgresql-common (214ubuntu0.1) ... 2023-06-09T04:40:13.454 INFO:teuthology.orchestra.run.smithi090.stdout:Adding user postgres to group ssl-cert 2023-06-09T04:40:13.813 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:40:13.813 INFO:teuthology.orchestra.run.smithi090.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-06-09T04:40:14.309 INFO:teuthology.orchestra.run.smithi090.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-06-09T04:40:14.309 INFO:teuthology.orchestra.run.smithi090.stdout:Removing obsolete dictionary files: 2023-06-09T04:40:14.319 INFO:teuthology.orchestra.run.smithi174.stdout:Adding user postgres to group ssl-cert 2023-06-09T04:40:14.704 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-06-09T04:40:14.704 INFO:teuthology.orchestra.run.smithi174.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-06-09T04:40:14.872 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-06-09T04:40:15.178 INFO:teuthology.orchestra.run.smithi174.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-06-09T04:40:15.178 INFO:teuthology.orchestra.run.smithi174.stdout:Removing obsolete dictionary files: 2023-06-09T04:40:15.744 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-06-09T04:40:16.319 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.19) ... 2023-06-09T04:40:16.446 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up usb-modeswitch-data (20191128-3) ... 2023-06-09T04:40:16.572 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up libelf-dev:amd64 (0.176-1.1build1) ... 2023-06-09T04:40:16.698 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up libnm0:amd64 (1.22.10-1ubuntu2.3) ... 2023-06-09T04:40:16.824 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up ppp (2.4.7-2+4.1ubuntu5.1) ... 2023-06-09T04:40:17.195 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.19) ... 2023-06-09T04:40:17.320 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up usb-modeswitch-data (20191128-3) ... 2023-06-09T04:40:17.472 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up libelf-dev:amd64 (0.176-1.1build1) ... 2023-06-09T04:40:17.597 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up libnm0:amd64 (1.22.10-1ubuntu2.3) ... 2023-06-09T04:40:17.723 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up ppp (2.4.7-2+4.1ubuntu5.1) ... 2023-06-09T04:40:18.008 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/pppd-dns.service -> /lib/systemd/system/pppd-dns.service. 2023-06-09T04:40:18.440 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up dump (0.4b46-6) ... 2023-06-09T04:40:18.552 INFO:teuthology.orchestra.run.smithi090.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-06-09T04:40:18.617 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2023-06-09T04:40:18.743 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up libbluetooth3:amd64 (5.53-0ubuntu3.6) ... 2023-06-09T04:40:18.869 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up indent (2.2.12-1) ... 2023-06-09T04:40:18.922 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/pppd-dns.service -> /lib/systemd/system/pppd-dns.service. 2023-06-09T04:40:18.996 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2023-06-09T04:40:19.190 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up libndp0:amd64 (1.7-0ubuntu1) ... 2023-06-09T04:40:19.316 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up postgresql-12 (12.15-0ubuntu0.20.04.1) ... 2023-06-09T04:40:19.328 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up dump (0.4b46-6) ... 2023-06-09T04:40:19.436 INFO:teuthology.orchestra.run.smithi174.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-06-09T04:40:19.505 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2023-06-09T04:40:19.631 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up libbluetooth3:amd64 (5.53-0ubuntu3.6) ... 2023-06-09T04:40:19.757 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up indent (2.2.12-1) ... 2023-06-09T04:40:19.883 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2023-06-09T04:40:20.024 INFO:teuthology.orchestra.run.smithi090.stdout:Creating new PostgreSQL cluster 12/main ... 2023-06-09T04:40:20.053 INFO:teuthology.orchestra.run.smithi090.stdout:/usr/lib/postgresql/12/bin/initdb -D /var/lib/postgresql/12/main --auth-local peer --auth-host md5 2023-06-09T04:40:20.068 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up libndp0:amd64 (1.7-0ubuntu1) ... 2023-06-09T04:40:20.124 INFO:teuthology.orchestra.run.smithi090.stdout:The files belonging to this database system will be owned by user "postgres". 2023-06-09T04:40:20.124 INFO:teuthology.orchestra.run.smithi090.stdout:This user must also own the server process. 2023-06-09T04:40:20.124 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:40:20.125 INFO:teuthology.orchestra.run.smithi090.stdout:The database cluster will be initialized with locale "en_US". 2023-06-09T04:40:20.125 INFO:teuthology.orchestra.run.smithi090.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-06-09T04:40:20.125 INFO:teuthology.orchestra.run.smithi090.stdout:The default text search configuration will be set to "english". 2023-06-09T04:40:20.125 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:40:20.125 INFO:teuthology.orchestra.run.smithi090.stdout:Data page checksums are disabled. 2023-06-09T04:40:20.125 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:40:20.125 INFO:teuthology.orchestra.run.smithi090.stdout:fixing permissions on existing directory /var/lib/postgresql/12/main ... ok 2023-06-09T04:40:20.128 INFO:teuthology.orchestra.run.smithi090.stdout:creating subdirectories ... ok 2023-06-09T04:40:20.128 INFO:teuthology.orchestra.run.smithi090.stdout:selecting dynamic shared memory implementation ... posix 2023-06-09T04:40:20.165 INFO:teuthology.orchestra.run.smithi090.stdout:selecting default max_connections ... 100 2023-06-09T04:40:20.193 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up postgresql-12 (12.15-0ubuntu0.20.04.1) ... 2023-06-09T04:40:20.210 INFO:teuthology.orchestra.run.smithi090.stdout:selecting default shared_buffers ... 128MB 2023-06-09T04:40:20.231 INFO:teuthology.orchestra.run.smithi090.stdout:selecting default time zone ... Etc/UTC 2023-06-09T04:40:20.232 INFO:teuthology.orchestra.run.smithi090.stdout:creating configuration files ... ok 2023-06-09T04:40:20.427 INFO:teuthology.orchestra.run.smithi090.stdout:running bootstrap script ... ok 2023-06-09T04:40:20.676 INFO:teuthology.orchestra.run.smithi174.stdout:Creating new PostgreSQL cluster 12/main ... 2023-06-09T04:40:20.704 INFO:teuthology.orchestra.run.smithi174.stdout:/usr/lib/postgresql/12/bin/initdb -D /var/lib/postgresql/12/main --auth-local peer --auth-host md5 2023-06-09T04:40:20.775 INFO:teuthology.orchestra.run.smithi174.stdout:The files belonging to this database system will be owned by user "postgres". 2023-06-09T04:40:20.776 INFO:teuthology.orchestra.run.smithi174.stdout:This user must also own the server process. 2023-06-09T04:40:20.776 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-06-09T04:40:20.776 INFO:teuthology.orchestra.run.smithi174.stdout:The database cluster will be initialized with locale "en_US". 2023-06-09T04:40:20.776 INFO:teuthology.orchestra.run.smithi174.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-06-09T04:40:20.776 INFO:teuthology.orchestra.run.smithi174.stdout:The default text search configuration will be set to "english". 2023-06-09T04:40:20.776 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-06-09T04:40:20.777 INFO:teuthology.orchestra.run.smithi174.stdout:Data page checksums are disabled. 2023-06-09T04:40:20.777 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-06-09T04:40:20.777 INFO:teuthology.orchestra.run.smithi174.stdout:fixing permissions on existing directory /var/lib/postgresql/12/main ... ok 2023-06-09T04:40:20.779 INFO:teuthology.orchestra.run.smithi174.stdout:creating subdirectories ... ok 2023-06-09T04:40:20.779 INFO:teuthology.orchestra.run.smithi174.stdout:selecting dynamic shared memory implementation ... posix 2023-06-09T04:40:20.817 INFO:teuthology.orchestra.run.smithi174.stdout:selecting default max_connections ... 100 2023-06-09T04:40:20.862 INFO:teuthology.orchestra.run.smithi174.stdout:selecting default shared_buffers ... 128MB 2023-06-09T04:40:20.883 INFO:teuthology.orchestra.run.smithi174.stdout:selecting default time zone ... Etc/UTC 2023-06-09T04:40:20.884 INFO:teuthology.orchestra.run.smithi174.stdout:creating configuration files ... ok 2023-06-09T04:40:21.062 INFO:teuthology.orchestra.run.smithi090.stdout:performing post-bootstrap initialization ... ok 2023-06-09T04:40:21.080 INFO:teuthology.orchestra.run.smithi174.stdout:running bootstrap script ... ok 2023-06-09T04:40:21.594 INFO:teuthology.orchestra.run.smithi090.stdout:syncing data to disk ... ok 2023-06-09T04:40:21.595 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:40:21.595 INFO:teuthology.orchestra.run.smithi090.stdout:Success. You can now start the database server using: 2023-06-09T04:40:21.595 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:40:21.595 INFO:teuthology.orchestra.run.smithi090.stdout: pg_ctlcluster 12 main start 2023-06-09T04:40:21.595 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:40:21.965 INFO:teuthology.orchestra.run.smithi174.stdout:performing post-bootstrap initialization ... ok 2023-06-09T04:40:22.168 INFO:teuthology.orchestra.run.smithi090.stdout:Ver Cluster Port Status Owner Data directory Log file 2023-06-09T04:40:22.169 INFO:teuthology.orchestra.run.smithi090.stdout:12 main 5432 down postgres /var/lib/postgresql/12/main /var/log/postgresql/postgresql-12-main.log 2023-06-09T04:40:22.387 INFO:teuthology.orchestra.run.smithi090.stdout:update-alternatives: using /usr/share/postgresql/12/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-06-09T04:40:22.474 INFO:teuthology.orchestra.run.smithi174.stdout:syncing data to disk ... ok 2023-06-09T04:40:22.474 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-06-09T04:40:22.475 INFO:teuthology.orchestra.run.smithi174.stdout:Success. You can now start the database server using: 2023-06-09T04:40:22.475 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-06-09T04:40:22.475 INFO:teuthology.orchestra.run.smithi174.stdout: pg_ctlcluster 12 main start 2023-06-09T04:40:22.475 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-06-09T04:40:23.038 INFO:teuthology.orchestra.run.smithi174.stdout:Ver Cluster Port Status Owner Data directory Log file 2023-06-09T04:40:23.038 INFO:teuthology.orchestra.run.smithi174.stdout:12 main 5432 down postgres /var/lib/postgresql/12/main /var/log/postgresql/postgresql-12-main.log 2023-06-09T04:40:23.240 INFO:teuthology.orchestra.run.smithi174.stdout:update-alternatives: using /usr/share/postgresql/12/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-06-09T04:40:26.202 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2023-06-09T04:40:26.328 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up pptp-linux (1.10.0-1build1) ... 2023-06-09T04:40:26.496 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up postgresql-client (12+214ubuntu0.1) ... 2023-06-09T04:40:26.623 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up network-manager (1.22.10-1ubuntu2.3) ... 2023-06-09T04:40:26.843 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2023-06-09T04:40:26.969 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up pptp-linux (1.10.0-1build1) ... 2023-06-09T04:40:27.137 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up postgresql-client (12+214ubuntu0.1) ... 2023-06-09T04:40:27.263 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up network-manager (1.22.10-1ubuntu2.3) ... 2023-06-09T04:40:27.828 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:40:27.828 INFO:teuthology.orchestra.run.smithi090.stdout:The following network interfaces were found in /etc/network/interfaces 2023-06-09T04:40:27.828 INFO:teuthology.orchestra.run.smithi090.stdout:which means they are currently configured by ifupdown: 2023-06-09T04:40:27.829 INFO:teuthology.orchestra.run.smithi090.stdout:- enp3s0f1 2023-06-09T04:40:27.829 INFO:teuthology.orchestra.run.smithi090.stdout:If you want to manage those interfaces with NetworkManager instead 2023-06-09T04:40:27.829 INFO:teuthology.orchestra.run.smithi090.stdout:remove their configuration from /etc/network/interfaces. 2023-06-09T04:40:27.829 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:40:28.056 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-06-09T04:40:28.450 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-06-09T04:40:28.450 INFO:teuthology.orchestra.run.smithi174.stdout:The following network interfaces were found in /etc/network/interfaces 2023-06-09T04:40:28.450 INFO:teuthology.orchestra.run.smithi174.stdout:which means they are currently configured by ifupdown: 2023-06-09T04:40:28.451 INFO:teuthology.orchestra.run.smithi174.stdout:- enp3s0f1 2023-06-09T04:40:28.451 INFO:teuthology.orchestra.run.smithi174.stdout:If you want to manage those interfaces with NetworkManager instead 2023-06-09T04:40:28.451 INFO:teuthology.orchestra.run.smithi174.stdout:remove their configuration from /etc/network/interfaces. 2023-06-09T04:40:28.451 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-06-09T04:40:28.619 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-06-09T04:40:28.681 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-06-09T04:40:29.190 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-06-09T04:40:29.617 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-06-09T04:40:30.155 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-06-09T04:40:30.536 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2023-06-09T04:40:30.671 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up network-manager-pptp (1.2.8-2) ... 2023-06-09T04:40:30.839 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up postgresql-contrib (12+214ubuntu0.1) ... 2023-06-09T04:40:30.965 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up postgresql (12+214ubuntu0.1) ... 2023-06-09T04:40:31.093 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2023-06-09T04:40:31.115 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2023-06-09T04:40:31.219 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2023-06-09T04:40:31.250 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up network-manager-pptp (1.2.8-2) ... 2023-06-09T04:40:31.345 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up modemmanager (1.18.6-1~ubuntu20.04.1) ... 2023-06-09T04:40:31.401 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up postgresql-contrib (12+214ubuntu0.1) ... 2023-06-09T04:40:31.660 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-06-09T04:40:31.660 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-06-09T04:40:31.710 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up postgresql (12+214ubuntu0.1) ... 2023-06-09T04:40:31.836 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2023-06-09T04:40:31.962 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2023-06-09T04:40:32.088 INFO:teuthology.orchestra.run.smithi174.stdout:Setting up modemmanager (1.18.6-1~ubuntu20.04.1) ... 2023-06-09T04:40:32.404 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-06-09T04:40:32.405 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-06-09T04:40:32.632 INFO:teuthology.orchestra.run.smithi090.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-06-09T04:40:32.775 INFO:teuthology.orchestra.run.smithi090.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-06-09T04:40:32.951 INFO:teuthology.orchestra.run.smithi090.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-06-09T04:40:33.374 INFO:teuthology.orchestra.run.smithi174.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-06-09T04:40:33.428 INFO:teuthology.orchestra.run.smithi090.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-06-09T04:40:33.517 INFO:teuthology.orchestra.run.smithi174.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-06-09T04:40:33.677 INFO:teuthology.orchestra.run.smithi174.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-06-09T04:40:34.178 INFO:teuthology.orchestra.run.smithi174.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-06-09T04:40:44.126 INFO:teuthology.orchestra.run.smithi090.stdout:Processing triggers for dbus (1.12.16-2ubuntu2.2) ... 2023-06-09T04:40:44.234 INFO:teuthology.orchestra.run.smithi090.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2023-06-09T04:40:44.898 INFO:teuthology.orchestra.run.smithi174.stdout:Processing triggers for dbus (1.12.16-2ubuntu2.2) ... 2023-06-09T04:40:45.015 INFO:teuthology.orchestra.run.smithi174.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2023-06-09T04:40:45.479 INFO:teuthology.orchestra.run.smithi090.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-06-09T04:40:45.485 DEBUG:teuthology.parallel:result is None 2023-06-09T04:40:46.180 INFO:teuthology.orchestra.run.smithi174.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-06-09T04:40:46.185 DEBUG:teuthology.parallel:result is None 2023-06-09T04:40:46.186 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=a02638f808b8fe11bccdd01222c0e6e2eb71120b 2023-06-09T04:40:46.325 DEBUG:teuthology.orchestra.run.smithi090:> dpkg-query -W -f '${Version}' ceph 2023-06-09T04:40:46.359 INFO:teuthology.orchestra.run.smithi090.stdout:18.0.0-4313-ga02638f8-1focal 2023-06-09T04:40:46.360 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-4313-ga02638f8-1focal 2023-06-09T04:40:46.360 INFO:teuthology.task.install:The correct ceph version 18.0.0-4313-ga02638f8-1focal is installed. 2023-06-09T04:40:46.361 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=a02638f808b8fe11bccdd01222c0e6e2eb71120b 2023-06-09T04:40:46.570 DEBUG:teuthology.orchestra.run.smithi174:> dpkg-query -W -f '${Version}' ceph 2023-06-09T04:40:46.606 INFO:teuthology.orchestra.run.smithi174.stdout:18.0.0-4313-ga02638f8-1focal 2023-06-09T04:40:46.607 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-4313-ga02638f8-1focal 2023-06-09T04:40:46.607 INFO:teuthology.task.install:The correct ceph version 18.0.0-4313-ga02638f8-1focal is installed. 2023-06-09T04:40:46.607 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-06-09T04:40:46.608 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2023-06-09T04:40:46.608 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-06-09T04:40:46.642 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2023-06-09T04:40:46.643 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-06-09T04:40:46.683 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-06-09T04:40:46.683 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2023-06-09T04:40:46.683 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd of=/usr/bin/daemon-helper 2023-06-09T04:40:46.717 DEBUG:teuthology.orchestra.run.smithi090:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-06-09T04:40:46.792 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2023-06-09T04:40:46.792 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd of=/usr/bin/daemon-helper 2023-06-09T04:40:46.826 DEBUG:teuthology.orchestra.run.smithi174:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-06-09T04:40:46.905 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-06-09T04:40:46.905 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2023-06-09T04:40:46.905 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd of=/usr/bin/adjust-ulimits 2023-06-09T04:40:46.939 DEBUG:teuthology.orchestra.run.smithi090:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-06-09T04:40:47.015 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2023-06-09T04:40:47.015 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd of=/usr/bin/adjust-ulimits 2023-06-09T04:40:47.049 DEBUG:teuthology.orchestra.run.smithi174:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-06-09T04:40:47.124 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-06-09T04:40:47.125 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2023-06-09T04:40:47.125 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd of=/usr/bin/stdin-killer 2023-06-09T04:40:47.160 DEBUG:teuthology.orchestra.run.smithi090:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-06-09T04:40:47.236 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2023-06-09T04:40:47.236 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd of=/usr/bin/stdin-killer 2023-06-09T04:40:47.270 DEBUG:teuthology.orchestra.run.smithi174:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-06-09T04:40:47.348 INFO:teuthology.run_tasks:Running task ceph... 2023-06-09T04:40:47.412 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-06-09T04:40:47.412 DEBUG:teuthology.orchestra.run.smithi090:> sudo chmod 777 /var/log/ceph 2023-06-09T04:40:47.420 DEBUG:teuthology.orchestra.run.smithi174:> sudo chmod 777 /var/log/ceph 2023-06-09T04:40:47.453 INFO:tasks.ceph:Disabling ceph logrotate... 2023-06-09T04:40:47.453 DEBUG:teuthology.orchestra.run.smithi090:> sudo rm -f -- /etc/logrotate.d/ceph 2023-06-09T04:40:47.494 DEBUG:teuthology.orchestra.run.smithi174:> sudo rm -f -- /etc/logrotate.d/ceph 2023-06-09T04:40:47.527 INFO:tasks.ceph:Creating extra log directories... 2023-06-09T04:40:47.527 DEBUG:teuthology.orchestra.run.smithi090:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-06-09T04:40:47.566 DEBUG:teuthology.orchestra.run.smithi174:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-06-09T04:40:47.610 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-06-09T04:40:47.610 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-06-09T04:40:47.611 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-06-09T04:40:47.611 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2023-06-09T04:40:47.611 DEBUG:teuthology.orchestra.run.smithi090:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-06-09T04:40:47.652 DEBUG:teuthology.orchestra.run.smithi090:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-06-09T04:40:47.778 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2023-06-09T04:40:47.779 DEBUG:teuthology.orchestra.run.smithi174:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-06-09T04:40:47.798 DEBUG:teuthology.orchestra.run.smithi174:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-06-09T04:40:47.926 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-06-09T04:40:47.926 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-06-09T04:40:47.926 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/xiubli-2023-06-09_04:16:27-fs:functional-wip-lxb-fscrypt-20230607-0901-distro-default-smithi/7299735', 'branch': 'wip-lxb-fscrypt-20230607-0901', 'description': 'fs:functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev}', 'email': None, 'first_in_suite': False, 'job_id': '7299735', 'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'xiubli-2023-06-09_04:16:27-fs:functional-wip-lxb-fscrypt-20230607-0901-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '20.04', 'overrides': {'admin_socket': {'branch': 'wip-lxb-fscrypt-20230607-0901'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': 'a02638f808b8fe11bccdd01222c0e6e2eb71120b'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'a02638f808b8fe11bccdd01222c0e6e2eb71120b'}}, 'kclient': {'syntax': 'v2'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-lxb-fscrypt-20230607-0901', 'sha1': 'a02638f808b8fe11bccdd01222c0e6e2eb71120b'}}, 'owner': 'scheduled_xiubli@teuthology', 'priority': 110, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'sha1': 'a02638f808b8fe11bccdd01222c0e6e2eb71120b', 'sleep_before_teardown': 0, 'suite': 'fs:functional', 'suite_branch': 'wip-lxb-fscrypt-20230607-0901', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_a02638f808b8fe11bccdd01222c0e6e2eb71120b/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'a02638f808b8fe11bccdd01222c0e6e2eb71120b', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi090.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwINnmi+N3LgR9ET61cABYBnDJDAAQE1klaPINljTOvitiIM3/5ICam+qurn41RkfyLPz4uwE1yDyHeI7QBKChMImagaJPfltOSsFsTn67ifp6uunrBJblDzycEd7/lJfdMwBn8dApfOw5SSnVdpzpaKWGNpPqshrinViULNhTz2PMAkza/R7qM6v4qqKKxQx/yVi8/Lt03nxO672k5WH/Wkz7KHX4nwyeTelksSojH9SBt4yR4WpLbMjuFX33Ag14KBWr9YQ30L5/h7VtBLQL+2c7sq3Bnll5zj8H+sIa0hOHmwR5sxs4cVs6Eb4Cblr6xTs0Q9vQefWDDYNL4qRpuj1NO+bW1xGcALK9TujCJ0/fdcMLQ0/r4QukVxSE1j6frwWwo/u8lxTTp/wbNVU14w+37ppSvzcPbOD5FNnCu4PMHgrtqp02ggncjqMYpHvxXoQ53JPn84XfXX04vWf5emRMQ76T0NvWW0jYtj7x7ex7l/iEGUGHVnaOmjLqij0=', 'smithi174.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwINnmi+N3LgR9ET61cABYBnDJDAAQE1klaPINljTOvitiIM3/5ICam+qurn41RkfyLPz4uwE1yDyHeI7QBKChMImagaJPfltOSsFsTn67ifp6uunrBJblDzycEd7/lJfdMwBn8dApfOw5SSnVdpzpaKWGNpPqshrinViULNhTz2PMAkza/R7qM6v4qqKKxQx/yVi8/Lt03nxO672k5WH/Wkz7KHX4nwyeTelksSojH9SBt4yR4WpLbMjuFX33Ag14KBWr9YQ30L5/h7VtBLQL+2c7sq3Bnll5zj8H+sIa0hOHmwR5sxs4cVs6Eb4Cblr6xTs0Q9vQefWDDYNL4qRpuj1NO+bW1xGcALK9TujCJ0/fdcMLQ0/r4QukVxSE1j6frwWwo/u8lxTTp/wbNVU14w+37ppSvzcPbOD5FNnCu4PMHgrtqp02ggncjqMYpHvxXoQ53JPn84XfXX04vWf5emRMQ76T0NvWW0jYtj7x7ex7l/iEGUGHVnaOmjLqij0='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'a02638f808b8fe11bccdd01222c0e6e2eb71120b'}}, {'ceph': None}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.tests_from_xfstests_dev']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '2ef0dcdee569e9851c9d2ffb6acfd4b80d031e61', 'timestamp': '2023-06-09_04:16:27', 'tube': 'smithi', 'user': 'xiubli', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.23459'} 2023-06-09T04:40:47.927 DEBUG:teuthology.orchestra.run.smithi090:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-06-09T04:40:47.934 DEBUG:teuthology.orchestra.run.smithi174:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-06-09T04:40:47.952 DEBUG:teuthology.orchestra.run.smithi090:> sudo install -d -m0777 -- /var/run/ceph 2023-06-09T04:40:47.994 DEBUG:teuthology.orchestra.run.smithi174:> sudo install -d -m0777 -- /var/run/ceph 2023-06-09T04:40:48.029 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2023-06-09T04:40:48.029 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/scratch_devs of=/dev/stdout 2023-06-09T04:40:48.080 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-06-09T04:40:48.080 DEBUG:teuthology.orchestra.run.smithi090:> stat /dev/vg_nvme/lv_1 2023-06-09T04:40:48.141 INFO:teuthology.orchestra.run.smithi090.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-06-09T04:40:48.141 INFO:teuthology.orchestra.run.smithi090.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-06-09T04:40:48.142 INFO:teuthology.orchestra.run.smithi090.stdout:Device: 5h/5d Inode: 498 Links: 1 2023-06-09T04:40:48.142 INFO:teuthology.orchestra.run.smithi090.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-06-09T04:40:48.142 INFO:teuthology.orchestra.run.smithi090.stdout:Access: 2023-06-09 04:35:25.705567087 +0000 2023-06-09T04:40:48.142 INFO:teuthology.orchestra.run.smithi090.stdout:Modify: 2023-06-09 04:35:25.265577229 +0000 2023-06-09T04:40:48.142 INFO:teuthology.orchestra.run.smithi090.stdout:Change: 2023-06-09 04:35:25.265577229 +0000 2023-06-09T04:40:48.142 INFO:teuthology.orchestra.run.smithi090.stdout: Birth: - 2023-06-09T04:40:48.143 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-06-09T04:40:48.219 INFO:teuthology.orchestra.run.smithi090.stderr:1+0 records in 2023-06-09T04:40:48.220 INFO:teuthology.orchestra.run.smithi090.stderr:1+0 records out 2023-06-09T04:40:48.220 INFO:teuthology.orchestra.run.smithi090.stderr:512 bytes copied, 0.000707654 s, 724 kB/s 2023-06-09T04:40:48.222 DEBUG:teuthology.orchestra.run.smithi090:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-06-09T04:40:48.287 DEBUG:teuthology.orchestra.run.smithi090:> stat /dev/vg_nvme/lv_2 2023-06-09T04:40:48.344 INFO:teuthology.orchestra.run.smithi090.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-06-09T04:40:48.344 INFO:teuthology.orchestra.run.smithi090.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-06-09T04:40:48.345 INFO:teuthology.orchestra.run.smithi090.stdout:Device: 5h/5d Inode: 504 Links: 1 2023-06-09T04:40:48.345 INFO:teuthology.orchestra.run.smithi090.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-06-09T04:40:48.345 INFO:teuthology.orchestra.run.smithi090.stdout:Access: 2023-06-09 04:35:26.453549846 +0000 2023-06-09T04:40:48.345 INFO:teuthology.orchestra.run.smithi090.stdout:Modify: 2023-06-09 04:35:26.001560264 +0000 2023-06-09T04:40:48.345 INFO:teuthology.orchestra.run.smithi090.stdout:Change: 2023-06-09 04:35:26.001560264 +0000 2023-06-09T04:40:48.345 INFO:teuthology.orchestra.run.smithi090.stdout: Birth: - 2023-06-09T04:40:48.346 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-06-09T04:40:48.418 INFO:teuthology.orchestra.run.smithi090.stderr:1+0 records in 2023-06-09T04:40:48.419 INFO:teuthology.orchestra.run.smithi090.stderr:1+0 records out 2023-06-09T04:40:48.419 INFO:teuthology.orchestra.run.smithi090.stderr:512 bytes copied, 0.000683236 s, 749 kB/s 2023-06-09T04:40:48.420 DEBUG:teuthology.orchestra.run.smithi090:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-06-09T04:40:48.488 DEBUG:teuthology.orchestra.run.smithi090:> stat /dev/vg_nvme/lv_3 2023-06-09T04:40:48.553 INFO:teuthology.orchestra.run.smithi090.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-06-09T04:40:48.553 INFO:teuthology.orchestra.run.smithi090.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-06-09T04:40:48.553 INFO:teuthology.orchestra.run.smithi090.stdout:Device: 5h/5d Inode: 507 Links: 1 2023-06-09T04:40:48.554 INFO:teuthology.orchestra.run.smithi090.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-06-09T04:40:48.554 INFO:teuthology.orchestra.run.smithi090.stdout:Access: 2023-06-09 04:35:27.225532052 +0000 2023-06-09T04:40:48.554 INFO:teuthology.orchestra.run.smithi090.stdout:Modify: 2023-06-09 04:35:26.757542839 +0000 2023-06-09T04:40:48.554 INFO:teuthology.orchestra.run.smithi090.stdout:Change: 2023-06-09 04:35:26.757542839 +0000 2023-06-09T04:40:48.554 INFO:teuthology.orchestra.run.smithi090.stdout: Birth: - 2023-06-09T04:40:48.554 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-06-09T04:40:48.626 INFO:teuthology.orchestra.run.smithi090.stderr:1+0 records in 2023-06-09T04:40:48.626 INFO:teuthology.orchestra.run.smithi090.stderr:1+0 records out 2023-06-09T04:40:48.627 INFO:teuthology.orchestra.run.smithi090.stderr:512 bytes copied, 0.000653625 s, 783 kB/s 2023-06-09T04:40:48.628 DEBUG:teuthology.orchestra.run.smithi090:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-06-09T04:40:48.694 DEBUG:teuthology.orchestra.run.smithi090:> stat /dev/vg_nvme/lv_4 2023-06-09T04:40:48.758 INFO:teuthology.orchestra.run.smithi090.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-06-09T04:40:48.759 INFO:teuthology.orchestra.run.smithi090.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-06-09T04:40:48.759 INFO:teuthology.orchestra.run.smithi090.stdout:Device: 5h/5d Inode: 513 Links: 1 2023-06-09T04:40:48.759 INFO:teuthology.orchestra.run.smithi090.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-06-09T04:40:48.759 INFO:teuthology.orchestra.run.smithi090.stdout:Access: 2023-06-09 04:35:27.981514626 +0000 2023-06-09T04:40:48.759 INFO:teuthology.orchestra.run.smithi090.stdout:Modify: 2023-06-09 04:35:27.513525413 +0000 2023-06-09T04:40:48.759 INFO:teuthology.orchestra.run.smithi090.stdout:Change: 2023-06-09 04:35:27.513525413 +0000 2023-06-09T04:40:48.759 INFO:teuthology.orchestra.run.smithi090.stdout: Birth: - 2023-06-09T04:40:48.760 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-06-09T04:40:48.830 INFO:teuthology.orchestra.run.smithi090.stderr:1+0 records in 2023-06-09T04:40:48.830 INFO:teuthology.orchestra.run.smithi090.stderr:1+0 records out 2023-06-09T04:40:48.830 INFO:teuthology.orchestra.run.smithi090.stderr:512 bytes copied, 0.00065748 s, 779 kB/s 2023-06-09T04:40:48.832 DEBUG:teuthology.orchestra.run.smithi090:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-06-09T04:40:48.902 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-06-09T04:40:48.902 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2023-06-09T04:40:48.902 DEBUG:teuthology.orchestra.run.smithi174:> dd if=/scratch_devs of=/dev/stdout 2023-06-09T04:40:48.919 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-06-09T04:40:48.919 DEBUG:teuthology.orchestra.run.smithi174:> stat /dev/vg_nvme/lv_1 2023-06-09T04:40:48.978 INFO:teuthology.orchestra.run.smithi174.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-06-09T04:40:48.978 INFO:teuthology.orchestra.run.smithi174.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-06-09T04:40:48.978 INFO:teuthology.orchestra.run.smithi174.stdout:Device: 5h/5d Inode: 498 Links: 1 2023-06-09T04:40:48.978 INFO:teuthology.orchestra.run.smithi174.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-06-09T04:40:48.978 INFO:teuthology.orchestra.run.smithi174.stdout:Access: 2023-06-09 04:35:32.186530797 +0000 2023-06-09T04:40:48.979 INFO:teuthology.orchestra.run.smithi174.stdout:Modify: 2023-06-09 04:35:31.734492216 +0000 2023-06-09T04:40:48.979 INFO:teuthology.orchestra.run.smithi174.stdout:Change: 2023-06-09 04:35:31.734492216 +0000 2023-06-09T04:40:48.979 INFO:teuthology.orchestra.run.smithi174.stdout: Birth: - 2023-06-09T04:40:48.979 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-06-09T04:40:49.050 INFO:teuthology.orchestra.run.smithi174.stderr:1+0 records in 2023-06-09T04:40:49.050 INFO:teuthology.orchestra.run.smithi174.stderr:1+0 records out 2023-06-09T04:40:49.050 INFO:teuthology.orchestra.run.smithi174.stderr:512 bytes copied, 0.000557218 s, 919 kB/s 2023-06-09T04:40:49.052 DEBUG:teuthology.orchestra.run.smithi174:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-06-09T04:40:49.116 DEBUG:teuthology.orchestra.run.smithi174:> stat /dev/vg_nvme/lv_2 2023-06-09T04:40:49.178 INFO:teuthology.orchestra.run.smithi174.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-06-09T04:40:49.179 INFO:teuthology.orchestra.run.smithi174.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-06-09T04:40:49.179 INFO:teuthology.orchestra.run.smithi174.stdout:Device: 5h/5d Inode: 504 Links: 1 2023-06-09T04:40:49.180 INFO:teuthology.orchestra.run.smithi174.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-06-09T04:40:49.180 INFO:teuthology.orchestra.run.smithi174.stdout:Access: 2023-06-09 04:35:32.954594501 +0000 2023-06-09T04:40:49.180 INFO:teuthology.orchestra.run.smithi174.stdout:Modify: 2023-06-09 04:35:32.486555681 +0000 2023-06-09T04:40:49.180 INFO:teuthology.orchestra.run.smithi174.stdout:Change: 2023-06-09 04:35:32.486555681 +0000 2023-06-09T04:40:49.181 INFO:teuthology.orchestra.run.smithi174.stdout: Birth: - 2023-06-09T04:40:49.181 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-06-09T04:40:49.251 INFO:teuthology.orchestra.run.smithi174.stderr:1+0 records in 2023-06-09T04:40:49.252 INFO:teuthology.orchestra.run.smithi174.stderr:1+0 records out 2023-06-09T04:40:49.252 INFO:teuthology.orchestra.run.smithi174.stderr:512 bytes copied, 0.000665754 s, 769 kB/s 2023-06-09T04:40:49.254 DEBUG:teuthology.orchestra.run.smithi174:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-06-09T04:40:49.321 DEBUG:teuthology.orchestra.run.smithi174:> stat /dev/vg_nvme/lv_3 2023-06-09T04:40:49.388 INFO:teuthology.orchestra.run.smithi174.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-06-09T04:40:49.388 INFO:teuthology.orchestra.run.smithi174.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-06-09T04:40:49.388 INFO:teuthology.orchestra.run.smithi174.stdout:Device: 5h/5d Inode: 511 Links: 1 2023-06-09T04:40:49.388 INFO:teuthology.orchestra.run.smithi174.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-06-09T04:40:49.388 INFO:teuthology.orchestra.run.smithi174.stdout:Access: 2023-06-09 04:35:33.254618642 +0000 2023-06-09T04:40:49.389 INFO:teuthology.orchestra.run.smithi174.stdout:Modify: 2023-06-09 04:35:33.250618321 +0000 2023-06-09T04:40:49.389 INFO:teuthology.orchestra.run.smithi174.stdout:Change: 2023-06-09 04:35:33.250618321 +0000 2023-06-09T04:40:49.389 INFO:teuthology.orchestra.run.smithi174.stdout: Birth: - 2023-06-09T04:40:49.389 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-06-09T04:40:49.464 INFO:teuthology.orchestra.run.smithi174.stderr:1+0 records in 2023-06-09T04:40:49.464 INFO:teuthology.orchestra.run.smithi174.stderr:1+0 records out 2023-06-09T04:40:49.464 INFO:teuthology.orchestra.run.smithi174.stderr:512 bytes copied, 0.000713457 s, 718 kB/s 2023-06-09T04:40:49.466 DEBUG:teuthology.orchestra.run.smithi174:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-06-09T04:40:49.533 DEBUG:teuthology.orchestra.run.smithi174:> stat /dev/vg_nvme/lv_4 2023-06-09T04:40:49.594 INFO:teuthology.orchestra.run.smithi174.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-06-09T04:40:49.594 INFO:teuthology.orchestra.run.smithi174.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-06-09T04:40:49.594 INFO:teuthology.orchestra.run.smithi174.stdout:Device: 5h/5d Inode: 514 Links: 1 2023-06-09T04:40:49.595 INFO:teuthology.orchestra.run.smithi174.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-06-09T04:40:49.595 INFO:teuthology.orchestra.run.smithi174.stdout:Access: 2023-06-09 04:35:34.458713543 +0000 2023-06-09T04:40:49.595 INFO:teuthology.orchestra.run.smithi174.stdout:Modify: 2023-06-09 04:35:34.006678761 +0000 2023-06-09T04:40:49.595 INFO:teuthology.orchestra.run.smithi174.stdout:Change: 2023-06-09 04:35:34.006678761 +0000 2023-06-09T04:40:49.595 INFO:teuthology.orchestra.run.smithi174.stdout: Birth: - 2023-06-09T04:40:49.595 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-06-09T04:40:49.667 INFO:teuthology.orchestra.run.smithi174.stderr:1+0 records in 2023-06-09T04:40:49.667 INFO:teuthology.orchestra.run.smithi174.stderr:1+0 records out 2023-06-09T04:40:49.667 INFO:teuthology.orchestra.run.smithi174.stderr:512 bytes copied, 0.000480948 s, 1.1 MB/s 2023-06-09T04:40:49.669 DEBUG:teuthology.orchestra.run.smithi174:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-06-09T04:40:49.733 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-06-09T04:40:49.734 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi090.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi174.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-06-09T04:40:49.734 INFO:tasks.ceph:Generating config... 2023-06-09T04:40:49.735 INFO:tasks.ceph:[client] client mount timeout = 600 2023-06-09T04:40:49.735 INFO:tasks.ceph:[client] debug client = 20 2023-06-09T04:40:49.736 INFO:tasks.ceph:[client] debug ms = 1 2023-06-09T04:40:49.736 INFO:tasks.ceph:[client] pid file = 2023-06-09T04:40:49.736 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-06-09T04:40:49.736 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-06-09T04:40:49.736 INFO:tasks.ceph:[global] ms die on skipped message = False 2023-06-09T04:40:49.737 INFO:tasks.ceph:[mds] debug mds = 20 2023-06-09T04:40:49.737 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-06-09T04:40:49.737 INFO:tasks.ceph:[mds] debug ms = 1 2023-06-09T04:40:49.737 INFO:tasks.ceph:[mds] mds debug frag = True 2023-06-09T04:40:49.737 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-06-09T04:40:49.737 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-06-09T04:40:49.738 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-06-09T04:40:49.738 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-06-09T04:40:49.738 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-06-09T04:40:49.738 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-06-09T04:40:49.738 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-06-09T04:40:49.739 INFO:tasks.ceph:[mgr] debug ms = 1 2023-06-09T04:40:49.739 INFO:tasks.ceph:[mon] debug mon = 20 2023-06-09T04:40:49.739 INFO:tasks.ceph:[mon] debug ms = 1 2023-06-09T04:40:49.739 INFO:tasks.ceph:[mon] debug paxos = 20 2023-06-09T04:40:49.739 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-06-09T04:40:49.740 INFO:tasks.ceph:[osd] bdev async discard = True 2023-06-09T04:40:49.740 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-06-09T04:40:49.740 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-06-09T04:40:49.740 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-06-09T04:40:49.741 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-06-09T04:40:49.741 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-06-09T04:40:49.741 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-06-09T04:40:49.741 INFO:tasks.ceph:[osd] debug ms = 1 2023-06-09T04:40:49.741 INFO:tasks.ceph:[osd] debug osd = 20 2023-06-09T04:40:49.741 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-06-09T04:40:49.742 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-06-09T04:40:49.742 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-06-09T04:40:49.742 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-06-09T04:40:49.742 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-06-09T04:40:49.742 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-06-09T04:40:49.743 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-06-09T04:40:49.743 INFO:tasks.ceph:Setting up mon.a... 2023-06-09T04:40:49.743 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-06-09T04:40:49.810 INFO:teuthology.orchestra.run.smithi090.stdout:creating /etc/ceph/ceph.keyring 2023-06-09T04:40:49.838 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-06-09T04:40:49.913 DEBUG:teuthology.orchestra.run.smithi090:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-06-09T04:40:49.942 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.90'), ('mon.b', '172.21.15.174'), ('mon.c', '[v2:172.21.15.174:3301,v1:172.21.15.174:6790]')] 2023-06-09T04:40:49.942 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.90,172.21.15.174,[v2:172.21.15.174:3301,v1:172.21.15.174:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-06-09T04:40:49.943 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2023-06-09T04:40:49.944 DEBUG:teuthology.orchestra.run.smithi090:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-06-09T04:40:49.999 DEBUG:teuthology.orchestra.run.smithi090:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.90 --add b 172.21.15.174 --addv c '[v2:172.21.15.174:3301,v1:172.21.15.174:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-06-09T04:40:50.108 INFO:teuthology.orchestra.run.smithi090.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-06-09T04:40:50.108 INFO:teuthology.orchestra.run.smithi090.stdout:monmaptool: generated fsid 700369c0-a111-43b4-9415-844ad1742b70 2023-06-09T04:40:50.108 INFO:teuthology.orchestra.run.smithi090.stdout:setting min_mon_release = pacific 2023-06-09T04:40:50.108 INFO:teuthology.orchestra.run.smithi090.stdout:epoch 0 2023-06-09T04:40:50.108 INFO:teuthology.orchestra.run.smithi090.stdout:fsid 700369c0-a111-43b4-9415-844ad1742b70 2023-06-09T04:40:50.108 INFO:teuthology.orchestra.run.smithi090.stdout:last_changed 2023-06-09T04:40:50.107321+0000 2023-06-09T04:40:50.109 INFO:teuthology.orchestra.run.smithi090.stdout:created 2023-06-09T04:40:50.107321+0000 2023-06-09T04:40:50.109 INFO:teuthology.orchestra.run.smithi090.stdout:min_mon_release 16 (pacific) 2023-06-09T04:40:50.109 INFO:teuthology.orchestra.run.smithi090.stdout:election_strategy: 1 2023-06-09T04:40:50.109 INFO:teuthology.orchestra.run.smithi090.stdout:0: [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] mon.a 2023-06-09T04:40:50.109 INFO:teuthology.orchestra.run.smithi090.stdout:1: [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] mon.b 2023-06-09T04:40:50.109 INFO:teuthology.orchestra.run.smithi090.stdout:2: [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] mon.c 2023-06-09T04:40:50.109 INFO:teuthology.orchestra.run.smithi090.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-06-09T04:40:50.111 DEBUG:teuthology.orchestra.run.smithi090:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-06-09T04:40:50.130 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 700369c0-a111-43b4-9415-844ad1742b70... 2023-06-09T04:40:50.131 DEBUG:teuthology.orchestra.run.smithi090:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-06-09T04:40:50.182 DEBUG:teuthology.orchestra.run.smithi174:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-06-09T04:40:50.254 INFO:teuthology.orchestra.run.smithi090.stdout:[global] 2023-06-09T04:40:50.255 INFO:teuthology.orchestra.run.smithi090.stdout: chdir = "" 2023-06-09T04:40:50.255 INFO:teuthology.orchestra.run.smithi090.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-06-09T04:40:50.255 INFO:teuthology.orchestra.run.smithi090.stdout: auth supported = cephx 2023-06-09T04:40:50.255 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:40:50.255 INFO:teuthology.orchestra.run.smithi090.stdout: filestore xattr use omap = true 2023-06-09T04:40:50.255 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:40:50.256 INFO:teuthology.orchestra.run.smithi090.stdout: mon clock drift allowed = 1.000 2023-06-09T04:40:50.256 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:40:50.256 INFO:teuthology.orchestra.run.smithi090.stdout: osd crush chooseleaf type = 0 2023-06-09T04:40:50.256 INFO:teuthology.orchestra.run.smithi090.stdout: auth debug = true 2023-06-09T04:40:50.256 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:40:50.256 INFO:teuthology.orchestra.run.smithi090.stdout: ms die on old message = true 2023-06-09T04:40:50.256 INFO:teuthology.orchestra.run.smithi090.stdout: ms die on bug = true 2023-06-09T04:40:50.256 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:40:50.257 INFO:teuthology.orchestra.run.smithi090.stdout: mon max pg per osd = 10000 # >= luminous 2023-06-09T04:40:50.257 INFO:teuthology.orchestra.run.smithi090.stdout: mon pg warn max object skew = 0 2023-06-09T04:40:50.257 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:40:50.257 INFO:teuthology.orchestra.run.smithi090.stdout: # disable pg_autoscaler by default for new pools 2023-06-09T04:40:50.257 INFO:teuthology.orchestra.run.smithi090.stdout: osd_pool_default_pg_autoscale_mode = off 2023-06-09T04:40:50.257 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:40:50.257 INFO:teuthology.orchestra.run.smithi090.stdout: osd pool default size = 2 2023-06-09T04:40:50.257 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:40:50.258 INFO:teuthology.orchestra.run.smithi090.stdout: mon osd allow primary affinity = true 2023-06-09T04:40:50.258 INFO:teuthology.orchestra.run.smithi090.stdout: mon osd allow pg remap = true 2023-06-09T04:40:50.258 INFO:teuthology.orchestra.run.smithi090.stdout: mon warn on legacy crush tunables = false 2023-06-09T04:40:50.258 INFO:teuthology.orchestra.run.smithi090.stdout: mon warn on crush straw calc version zero = false 2023-06-09T04:40:50.258 INFO:teuthology.orchestra.run.smithi090.stdout: mon warn on no sortbitwise = false 2023-06-09T04:40:50.258 INFO:teuthology.orchestra.run.smithi090.stdout: mon warn on osd down out interval zero = false 2023-06-09T04:40:50.258 INFO:teuthology.orchestra.run.smithi090.stdout: mon warn on too few osds = false 2023-06-09T04:40:50.259 INFO:teuthology.orchestra.run.smithi090.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-06-09T04:40:50.259 INFO:teuthology.orchestra.run.smithi090.stdout: mon_warn_on_pool_no_redundancy = false 2023-06-09T04:40:50.259 INFO:teuthology.orchestra.run.smithi090.stdout: mon_allow_pool_size_one = true 2023-06-09T04:40:50.259 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:40:50.259 INFO:teuthology.orchestra.run.smithi090.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-06-09T04:40:50.259 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:40:50.259 INFO:teuthology.orchestra.run.smithi090.stdout: osd default data pool replay window = 5 2023-06-09T04:40:50.259 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:40:50.260 INFO:teuthology.orchestra.run.smithi090.stdout: mon allow pool delete = true 2023-06-09T04:40:50.260 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:40:50.260 INFO:teuthology.orchestra.run.smithi090.stdout: mon cluster log file level = debug 2023-06-09T04:40:50.260 INFO:teuthology.orchestra.run.smithi090.stdout: debug asserts on shutdown = true 2023-06-09T04:40:50.260 INFO:teuthology.orchestra.run.smithi090.stdout: mon health detail to clog = false 2023-06-09T04:40:50.260 INFO:teuthology.orchestra.run.smithi090.stdout: mon host = "172.21.15.90,172.21.15.174,[v2:172.21.15.174:3301,v1:172.21.15.174:6790]" 2023-06-09T04:40:50.260 INFO:teuthology.orchestra.run.smithi090.stdout: ms die on skipped message = False 2023-06-09T04:40:50.260 INFO:teuthology.orchestra.run.smithi090.stdout: fsid = 700369c0-a111-43b4-9415-844ad1742b70 2023-06-09T04:40:50.261 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:40:50.261 INFO:teuthology.orchestra.run.smithi090.stdout:[osd] 2023-06-09T04:40:50.261 INFO:teuthology.orchestra.run.smithi090.stdout: osd journal size = 100 2023-06-09T04:40:50.261 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:40:50.261 INFO:teuthology.orchestra.run.smithi090.stdout: osd scrub load threshold = 5.0 2023-06-09T04:40:50.261 INFO:teuthology.orchestra.run.smithi090.stdout: osd scrub max interval = 600 2023-06-09T04:40:50.261 INFO:teuthology.orchestra.run.smithi090.stdout: osd mclock profile = high_recovery_ops 2023-06-09T04:40:50.261 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:40:50.262 INFO:teuthology.orchestra.run.smithi090.stdout: osd recover clone overlap = true 2023-06-09T04:40:50.262 INFO:teuthology.orchestra.run.smithi090.stdout: osd recovery max chunk = 1048576 2023-06-09T04:40:50.262 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:40:50.262 INFO:teuthology.orchestra.run.smithi090.stdout: osd debug shutdown = true 2023-06-09T04:40:50.262 INFO:teuthology.orchestra.run.smithi090.stdout: osd debug op order = true 2023-06-09T04:40:50.262 INFO:teuthology.orchestra.run.smithi090.stdout: osd debug verify stray on activate = true 2023-06-09T04:40:50.262 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:40:50.262 INFO:teuthology.orchestra.run.smithi090.stdout: osd open classes on start = true 2023-06-09T04:40:50.263 INFO:teuthology.orchestra.run.smithi090.stdout: osd debug pg log writeout = true 2023-06-09T04:40:50.263 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:40:50.263 INFO:teuthology.orchestra.run.smithi090.stdout: osd deep scrub update digest min age = 30 2023-06-09T04:40:50.263 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:40:50.263 INFO:teuthology.orchestra.run.smithi090.stdout: osd map max advance = 10 2023-06-09T04:40:50.263 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:40:50.263 INFO:teuthology.orchestra.run.smithi090.stdout: journal zero on create = true 2023-06-09T04:40:50.263 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:40:50.264 INFO:teuthology.orchestra.run.smithi090.stdout: filestore ondisk finisher threads = 3 2023-06-09T04:40:50.264 INFO:teuthology.orchestra.run.smithi090.stdout: filestore apply finisher threads = 3 2023-06-09T04:40:50.264 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:40:50.264 INFO:teuthology.orchestra.run.smithi090.stdout: bdev debug aio = true 2023-06-09T04:40:50.264 INFO:teuthology.orchestra.run.smithi090.stdout: osd debug misdirected ops = true 2023-06-09T04:40:50.264 INFO:teuthology.orchestra.run.smithi090.stdout: bdev async discard = True 2023-06-09T04:40:50.264 INFO:teuthology.orchestra.run.smithi090.stdout: bdev enable discard = True 2023-06-09T04:40:50.264 INFO:teuthology.orchestra.run.smithi090.stdout: bluestore allocator = bitmap 2023-06-09T04:40:50.265 INFO:teuthology.orchestra.run.smithi090.stdout: bluestore block size = 96636764160 2023-06-09T04:40:50.265 INFO:teuthology.orchestra.run.smithi090.stdout: bluestore fsck on mount = True 2023-06-09T04:40:50.265 INFO:teuthology.orchestra.run.smithi090.stdout: debug bluefs = 1/20 2023-06-09T04:40:50.265 INFO:teuthology.orchestra.run.smithi090.stdout: debug bluestore = 1/20 2023-06-09T04:40:50.265 INFO:teuthology.orchestra.run.smithi090.stdout: debug ms = 1 2023-06-09T04:40:50.265 INFO:teuthology.orchestra.run.smithi090.stdout: debug osd = 20 2023-06-09T04:40:50.265 INFO:teuthology.orchestra.run.smithi090.stdout: debug rocksdb = 4/10 2023-06-09T04:40:50.265 INFO:teuthology.orchestra.run.smithi090.stdout: mon osd backfillfull_ratio = 0.85 2023-06-09T04:40:50.266 INFO:teuthology.orchestra.run.smithi090.stdout: mon osd full ratio = 0.9 2023-06-09T04:40:50.266 INFO:teuthology.orchestra.run.smithi090.stdout: mon osd nearfull ratio = 0.8 2023-06-09T04:40:50.266 INFO:teuthology.orchestra.run.smithi090.stdout: osd failsafe full ratio = 0.95 2023-06-09T04:40:50.266 INFO:teuthology.orchestra.run.smithi090.stdout: osd objectstore = bluestore 2023-06-09T04:40:50.266 INFO:teuthology.orchestra.run.smithi090.stdout: osd op complaint time = 180 2023-06-09T04:40:50.266 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:40:50.266 INFO:teuthology.orchestra.run.smithi090.stdout:[mgr] 2023-06-09T04:40:50.266 INFO:teuthology.orchestra.run.smithi090.stdout: debug ms = 1 2023-06-09T04:40:50.267 INFO:teuthology.orchestra.run.smithi090.stdout: debug mgr = 20 2023-06-09T04:40:50.267 INFO:teuthology.orchestra.run.smithi090.stdout: debug mon = 20 2023-06-09T04:40:50.267 INFO:teuthology.orchestra.run.smithi090.stdout: debug auth = 20 2023-06-09T04:40:50.267 INFO:teuthology.orchestra.run.smithi090.stdout: mon reweight min pgs per osd = 4 2023-06-09T04:40:50.267 INFO:teuthology.orchestra.run.smithi090.stdout: mon reweight min bytes per osd = 10 2023-06-09T04:40:50.267 INFO:teuthology.orchestra.run.smithi090.stdout: mgr/telemetry/nag = false 2023-06-09T04:40:50.267 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:40:50.267 INFO:teuthology.orchestra.run.smithi090.stdout:[mon] 2023-06-09T04:40:50.268 INFO:teuthology.orchestra.run.smithi090.stdout: debug ms = 1 2023-06-09T04:40:50.268 INFO:teuthology.orchestra.run.smithi090.stdout: debug mon = 20 2023-06-09T04:40:50.268 INFO:teuthology.orchestra.run.smithi090.stdout: debug paxos = 20 2023-06-09T04:40:50.268 INFO:teuthology.orchestra.run.smithi090.stdout: debug auth = 20 2023-06-09T04:40:50.268 INFO:teuthology.orchestra.run.smithi090.stdout: mon data avail warn = 5 2023-06-09T04:40:50.268 INFO:teuthology.orchestra.run.smithi090.stdout: mon mgr mkfs grace = 240 2023-06-09T04:40:50.268 INFO:teuthology.orchestra.run.smithi090.stdout: mon reweight min pgs per osd = 4 2023-06-09T04:40:50.268 INFO:teuthology.orchestra.run.smithi090.stdout: mon osd reporter subtree level = osd 2023-06-09T04:40:50.269 INFO:teuthology.orchestra.run.smithi090.stdout: mon osd prime pg temp = true 2023-06-09T04:40:50.269 INFO:teuthology.orchestra.run.smithi090.stdout: mon reweight min bytes per osd = 10 2023-06-09T04:40:50.269 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:40:50.269 INFO:teuthology.orchestra.run.smithi090.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-06-09T04:40:50.269 INFO:teuthology.orchestra.run.smithi090.stdout: auth mon ticket ttl = 660 # 11m 2023-06-09T04:40:50.269 INFO:teuthology.orchestra.run.smithi090.stdout: auth service ticket ttl = 240 # 4m 2023-06-09T04:40:50.269 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:40:50.269 INFO:teuthology.orchestra.run.smithi090.stdout: # don't complain about insecure global_id in the test suite 2023-06-09T04:40:50.270 INFO:teuthology.orchestra.run.smithi090.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-06-09T04:40:50.270 INFO:teuthology.orchestra.run.smithi090.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-06-09T04:40:50.270 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:40:50.270 INFO:teuthology.orchestra.run.smithi090.stdout: # 1m isn't quite enough 2023-06-09T04:40:50.270 INFO:teuthology.orchestra.run.smithi090.stdout: mon_down_mkfs_grace = 2m 2023-06-09T04:40:50.270 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:40:50.270 INFO:teuthology.orchestra.run.smithi090.stdout: mon_warn_on_filestore_osds = false 2023-06-09T04:40:50.270 INFO:teuthology.orchestra.run.smithi090.stdout: mon op complaint time = 120 2023-06-09T04:40:50.271 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:40:50.271 INFO:teuthology.orchestra.run.smithi090.stdout:[client] 2023-06-09T04:40:50.271 INFO:teuthology.orchestra.run.smithi090.stdout: rgw cache enabled = true 2023-06-09T04:40:50.271 INFO:teuthology.orchestra.run.smithi090.stdout: rgw enable ops log = true 2023-06-09T04:40:50.271 INFO:teuthology.orchestra.run.smithi090.stdout: rgw enable usage log = true 2023-06-09T04:40:50.271 INFO:teuthology.orchestra.run.smithi090.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-06-09T04:40:50.271 INFO:teuthology.orchestra.run.smithi090.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-06-09T04:40:50.271 INFO:teuthology.orchestra.run.smithi090.stdout: client mount timeout = 600 2023-06-09T04:40:50.272 INFO:teuthology.orchestra.run.smithi090.stdout: debug client = 20 2023-06-09T04:40:50.272 INFO:teuthology.orchestra.run.smithi090.stdout: debug ms = 1 2023-06-09T04:40:50.272 INFO:teuthology.orchestra.run.smithi090.stdout: pid file = "" 2023-06-09T04:40:50.272 INFO:teuthology.orchestra.run.smithi090.stdout: rados mon op timeout = 900 2023-06-09T04:40:50.272 INFO:teuthology.orchestra.run.smithi090.stdout: rados osd op timeout = 900 2023-06-09T04:40:50.272 INFO:teuthology.orchestra.run.smithi090.stdout:[mon.a] 2023-06-09T04:40:50.272 INFO:teuthology.orchestra.run.smithi090.stdout:[mon.b] 2023-06-09T04:40:50.272 INFO:teuthology.orchestra.run.smithi090.stdout:[mon.c] 2023-06-09T04:40:50.273 INFO:teuthology.orchestra.run.smithi090.stdout:[mds.a] 2023-06-09T04:40:50.273 INFO:teuthology.orchestra.run.smithi090.stdout:[mds.c] 2023-06-09T04:40:50.273 INFO:teuthology.orchestra.run.smithi090.stdout:[mds.b] 2023-06-09T04:40:50.273 INFO:teuthology.orchestra.run.smithi090.stdout:[mds.d] 2023-06-09T04:40:50.273 INFO:teuthology.orchestra.run.smithi090.stdout:[mds] 2023-06-09T04:40:50.273 INFO:teuthology.orchestra.run.smithi090.stdout: debug mds = 20 2023-06-09T04:40:50.273 INFO:teuthology.orchestra.run.smithi090.stdout: debug mds balancer = 20 2023-06-09T04:40:50.273 INFO:teuthology.orchestra.run.smithi090.stdout: debug ms = 1 2023-06-09T04:40:50.274 INFO:teuthology.orchestra.run.smithi090.stdout: mds debug frag = True 2023-06-09T04:40:50.274 INFO:teuthology.orchestra.run.smithi090.stdout: mds debug scatterstat = True 2023-06-09T04:40:50.274 INFO:teuthology.orchestra.run.smithi090.stdout: mds op complaint time = 180 2023-06-09T04:40:50.274 INFO:teuthology.orchestra.run.smithi090.stdout: mds verify scatter = True 2023-06-09T04:40:50.274 INFO:teuthology.orchestra.run.smithi090.stdout: osd op complaint time = 180 2023-06-09T04:40:50.274 INFO:teuthology.orchestra.run.smithi090.stdout: rados mon op timeout = 900 2023-06-09T04:40:50.274 INFO:teuthology.orchestra.run.smithi090.stdout: rados osd op timeout = 900 2023-06-09T04:40:50.275 INFO:teuthology.orchestra.run.smithi174.stdout:[global] 2023-06-09T04:40:50.275 INFO:teuthology.orchestra.run.smithi174.stdout: chdir = "" 2023-06-09T04:40:50.275 INFO:teuthology.orchestra.run.smithi174.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-06-09T04:40:50.275 INFO:teuthology.orchestra.run.smithi174.stdout: auth supported = cephx 2023-06-09T04:40:50.275 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-06-09T04:40:50.275 INFO:teuthology.orchestra.run.smithi174.stdout: filestore xattr use omap = true 2023-06-09T04:40:50.276 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-06-09T04:40:50.276 INFO:teuthology.orchestra.run.smithi174.stdout: mon clock drift allowed = 1.000 2023-06-09T04:40:50.276 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-06-09T04:40:50.276 INFO:teuthology.orchestra.run.smithi174.stdout: osd crush chooseleaf type = 0 2023-06-09T04:40:50.276 INFO:teuthology.orchestra.run.smithi174.stdout: auth debug = true 2023-06-09T04:40:50.276 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-06-09T04:40:50.276 INFO:teuthology.orchestra.run.smithi174.stdout: ms die on old message = true 2023-06-09T04:40:50.277 INFO:teuthology.orchestra.run.smithi174.stdout: ms die on bug = true 2023-06-09T04:40:50.277 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-06-09T04:40:50.277 INFO:teuthology.orchestra.run.smithi174.stdout: mon max pg per osd = 10000 # >= luminous 2023-06-09T04:40:50.277 INFO:teuthology.orchestra.run.smithi174.stdout: mon pg warn max object skew = 0 2023-06-09T04:40:50.277 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-06-09T04:40:50.277 INFO:teuthology.orchestra.run.smithi174.stdout: # disable pg_autoscaler by default for new pools 2023-06-09T04:40:50.277 INFO:teuthology.orchestra.run.smithi174.stdout: osd_pool_default_pg_autoscale_mode = off 2023-06-09T04:40:50.277 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-06-09T04:40:50.278 INFO:teuthology.orchestra.run.smithi174.stdout: osd pool default size = 2 2023-06-09T04:40:50.278 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-06-09T04:40:50.278 INFO:teuthology.orchestra.run.smithi174.stdout: mon osd allow primary affinity = true 2023-06-09T04:40:50.278 INFO:teuthology.orchestra.run.smithi174.stdout: mon osd allow pg remap = true 2023-06-09T04:40:50.278 INFO:teuthology.orchestra.run.smithi174.stdout: mon warn on legacy crush tunables = false 2023-06-09T04:40:50.278 INFO:teuthology.orchestra.run.smithi174.stdout: mon warn on crush straw calc version zero = false 2023-06-09T04:40:50.278 INFO:teuthology.orchestra.run.smithi174.stdout: mon warn on no sortbitwise = false 2023-06-09T04:40:50.278 INFO:teuthology.orchestra.run.smithi174.stdout: mon warn on osd down out interval zero = false 2023-06-09T04:40:50.279 INFO:teuthology.orchestra.run.smithi174.stdout: mon warn on too few osds = false 2023-06-09T04:40:50.279 INFO:teuthology.orchestra.run.smithi174.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-06-09T04:40:50.279 INFO:teuthology.orchestra.run.smithi174.stdout: mon_warn_on_pool_no_redundancy = false 2023-06-09T04:40:50.279 INFO:teuthology.orchestra.run.smithi174.stdout: mon_allow_pool_size_one = true 2023-06-09T04:40:50.279 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-06-09T04:40:50.279 INFO:teuthology.orchestra.run.smithi174.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-06-09T04:40:50.279 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-06-09T04:40:50.279 INFO:teuthology.orchestra.run.smithi174.stdout: osd default data pool replay window = 5 2023-06-09T04:40:50.280 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-06-09T04:40:50.280 INFO:teuthology.orchestra.run.smithi174.stdout: mon allow pool delete = true 2023-06-09T04:40:50.280 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-06-09T04:40:50.280 INFO:teuthology.orchestra.run.smithi174.stdout: mon cluster log file level = debug 2023-06-09T04:40:50.280 INFO:teuthology.orchestra.run.smithi174.stdout: debug asserts on shutdown = true 2023-06-09T04:40:50.280 INFO:teuthology.orchestra.run.smithi174.stdout: mon health detail to clog = false 2023-06-09T04:40:50.280 INFO:teuthology.orchestra.run.smithi174.stdout: mon host = "172.21.15.90,172.21.15.174,[v2:172.21.15.174:3301,v1:172.21.15.174:6790]" 2023-06-09T04:40:50.280 INFO:teuthology.orchestra.run.smithi174.stdout: ms die on skipped message = False 2023-06-09T04:40:50.281 INFO:teuthology.orchestra.run.smithi174.stdout: fsid = 700369c0-a111-43b4-9415-844ad1742b70 2023-06-09T04:40:50.281 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-06-09T04:40:50.281 INFO:teuthology.orchestra.run.smithi174.stdout:[osd] 2023-06-09T04:40:50.281 INFO:teuthology.orchestra.run.smithi174.stdout: osd journal size = 100 2023-06-09T04:40:50.281 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-06-09T04:40:50.281 INFO:teuthology.orchestra.run.smithi174.stdout: osd scrub load threshold = 5.0 2023-06-09T04:40:50.281 INFO:teuthology.orchestra.run.smithi174.stdout: osd scrub max interval = 600 2023-06-09T04:40:50.281 INFO:teuthology.orchestra.run.smithi174.stdout: osd mclock profile = high_recovery_ops 2023-06-09T04:40:50.282 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-06-09T04:40:50.282 INFO:teuthology.orchestra.run.smithi174.stdout: osd recover clone overlap = true 2023-06-09T04:40:50.282 INFO:teuthology.orchestra.run.smithi174.stdout: osd recovery max chunk = 1048576 2023-06-09T04:40:50.282 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-06-09T04:40:50.282 INFO:teuthology.orchestra.run.smithi174.stdout: osd debug shutdown = true 2023-06-09T04:40:50.282 INFO:teuthology.orchestra.run.smithi174.stdout: osd debug op order = true 2023-06-09T04:40:50.282 INFO:teuthology.orchestra.run.smithi174.stdout: osd debug verify stray on activate = true 2023-06-09T04:40:50.282 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-06-09T04:40:50.283 INFO:teuthology.orchestra.run.smithi174.stdout: osd open classes on start = true 2023-06-09T04:40:50.283 INFO:teuthology.orchestra.run.smithi174.stdout: osd debug pg log writeout = true 2023-06-09T04:40:50.283 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-06-09T04:40:50.283 INFO:teuthology.orchestra.run.smithi174.stdout: osd deep scrub update digest min age = 30 2023-06-09T04:40:50.283 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-06-09T04:40:50.283 INFO:teuthology.orchestra.run.smithi174.stdout: osd map max advance = 10 2023-06-09T04:40:50.283 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-06-09T04:40:50.283 INFO:teuthology.orchestra.run.smithi174.stdout: journal zero on create = true 2023-06-09T04:40:50.284 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-06-09T04:40:50.284 INFO:teuthology.orchestra.run.smithi174.stdout: filestore ondisk finisher threads = 3 2023-06-09T04:40:50.284 INFO:teuthology.orchestra.run.smithi174.stdout: filestore apply finisher threads = 3 2023-06-09T04:40:50.284 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-06-09T04:40:50.284 INFO:teuthology.orchestra.run.smithi174.stdout: bdev debug aio = true 2023-06-09T04:40:50.284 INFO:teuthology.orchestra.run.smithi174.stdout: osd debug misdirected ops = true 2023-06-09T04:40:50.284 INFO:teuthology.orchestra.run.smithi174.stdout: bdev async discard = True 2023-06-09T04:40:50.284 INFO:teuthology.orchestra.run.smithi174.stdout: bdev enable discard = True 2023-06-09T04:40:50.285 INFO:teuthology.orchestra.run.smithi174.stdout: bluestore allocator = bitmap 2023-06-09T04:40:50.285 INFO:teuthology.orchestra.run.smithi174.stdout: bluestore block size = 96636764160 2023-06-09T04:40:50.285 INFO:teuthology.orchestra.run.smithi174.stdout: bluestore fsck on mount = True 2023-06-09T04:40:50.285 INFO:teuthology.orchestra.run.smithi174.stdout: debug bluefs = 1/20 2023-06-09T04:40:50.285 INFO:teuthology.orchestra.run.smithi174.stdout: debug bluestore = 1/20 2023-06-09T04:40:50.285 INFO:teuthology.orchestra.run.smithi174.stdout: debug ms = 1 2023-06-09T04:40:50.285 INFO:teuthology.orchestra.run.smithi174.stdout: debug osd = 20 2023-06-09T04:40:50.285 INFO:teuthology.orchestra.run.smithi174.stdout: debug rocksdb = 4/10 2023-06-09T04:40:50.286 INFO:teuthology.orchestra.run.smithi174.stdout: mon osd backfillfull_ratio = 0.85 2023-06-09T04:40:50.286 INFO:teuthology.orchestra.run.smithi174.stdout: mon osd full ratio = 0.9 2023-06-09T04:40:50.286 INFO:teuthology.orchestra.run.smithi174.stdout: mon osd nearfull ratio = 0.8 2023-06-09T04:40:50.286 INFO:teuthology.orchestra.run.smithi174.stdout: osd failsafe full ratio = 0.95 2023-06-09T04:40:50.286 INFO:teuthology.orchestra.run.smithi174.stdout: osd objectstore = bluestore 2023-06-09T04:40:50.286 INFO:teuthology.orchestra.run.smithi174.stdout: osd op complaint time = 180 2023-06-09T04:40:50.286 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-06-09T04:40:50.286 INFO:teuthology.orchestra.run.smithi174.stdout:[mgr] 2023-06-09T04:40:50.287 INFO:teuthology.orchestra.run.smithi174.stdout: debug ms = 1 2023-06-09T04:40:50.287 INFO:teuthology.orchestra.run.smithi174.stdout: debug mgr = 20 2023-06-09T04:40:50.287 INFO:teuthology.orchestra.run.smithi174.stdout: debug mon = 20 2023-06-09T04:40:50.287 INFO:teuthology.orchestra.run.smithi174.stdout: debug auth = 20 2023-06-09T04:40:50.287 INFO:teuthology.orchestra.run.smithi174.stdout: mon reweight min pgs per osd = 4 2023-06-09T04:40:50.287 INFO:teuthology.orchestra.run.smithi174.stdout: mon reweight min bytes per osd = 10 2023-06-09T04:40:50.287 INFO:teuthology.orchestra.run.smithi174.stdout: mgr/telemetry/nag = false 2023-06-09T04:40:50.287 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-06-09T04:40:50.288 INFO:teuthology.orchestra.run.smithi174.stdout:[mon] 2023-06-09T04:40:50.288 INFO:teuthology.orchestra.run.smithi174.stdout: debug ms = 1 2023-06-09T04:40:50.288 INFO:teuthology.orchestra.run.smithi174.stdout: debug mon = 20 2023-06-09T04:40:50.288 INFO:teuthology.orchestra.run.smithi174.stdout: debug paxos = 20 2023-06-09T04:40:50.288 INFO:teuthology.orchestra.run.smithi174.stdout: debug auth = 20 2023-06-09T04:40:50.288 INFO:teuthology.orchestra.run.smithi174.stdout: mon data avail warn = 5 2023-06-09T04:40:50.288 INFO:teuthology.orchestra.run.smithi174.stdout: mon mgr mkfs grace = 240 2023-06-09T04:40:50.288 INFO:teuthology.orchestra.run.smithi174.stdout: mon reweight min pgs per osd = 4 2023-06-09T04:40:50.289 INFO:teuthology.orchestra.run.smithi174.stdout: mon osd reporter subtree level = osd 2023-06-09T04:40:50.289 INFO:teuthology.orchestra.run.smithi174.stdout: mon osd prime pg temp = true 2023-06-09T04:40:50.289 INFO:teuthology.orchestra.run.smithi174.stdout: mon reweight min bytes per osd = 10 2023-06-09T04:40:50.289 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-06-09T04:40:50.289 INFO:teuthology.orchestra.run.smithi174.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-06-09T04:40:50.289 INFO:teuthology.orchestra.run.smithi174.stdout: auth mon ticket ttl = 660 # 11m 2023-06-09T04:40:50.289 INFO:teuthology.orchestra.run.smithi174.stdout: auth service ticket ttl = 240 # 4m 2023-06-09T04:40:50.289 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-06-09T04:40:50.290 INFO:teuthology.orchestra.run.smithi174.stdout: # don't complain about insecure global_id in the test suite 2023-06-09T04:40:50.290 INFO:teuthology.orchestra.run.smithi174.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-06-09T04:40:50.290 INFO:teuthology.orchestra.run.smithi174.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-06-09T04:40:50.290 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-06-09T04:40:50.290 INFO:teuthology.orchestra.run.smithi174.stdout: # 1m isn't quite enough 2023-06-09T04:40:50.290 INFO:teuthology.orchestra.run.smithi174.stdout: mon_down_mkfs_grace = 2m 2023-06-09T04:40:50.290 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-06-09T04:40:50.290 INFO:teuthology.orchestra.run.smithi174.stdout: mon_warn_on_filestore_osds = false 2023-06-09T04:40:50.291 INFO:teuthology.orchestra.run.smithi174.stdout: mon op complaint time = 120 2023-06-09T04:40:50.291 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-06-09T04:40:50.291 INFO:teuthology.orchestra.run.smithi174.stdout:[client] 2023-06-09T04:40:50.291 INFO:teuthology.orchestra.run.smithi174.stdout: rgw cache enabled = true 2023-06-09T04:40:50.291 INFO:teuthology.orchestra.run.smithi174.stdout: rgw enable ops log = true 2023-06-09T04:40:50.291 INFO:teuthology.orchestra.run.smithi174.stdout: rgw enable usage log = true 2023-06-09T04:40:50.291 INFO:teuthology.orchestra.run.smithi174.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-06-09T04:40:50.292 INFO:teuthology.orchestra.run.smithi174.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-06-09T04:40:50.292 INFO:teuthology.orchestra.run.smithi174.stdout: client mount timeout = 600 2023-06-09T04:40:50.292 INFO:teuthology.orchestra.run.smithi174.stdout: debug client = 20 2023-06-09T04:40:50.292 INFO:teuthology.orchestra.run.smithi174.stdout: debug ms = 1 2023-06-09T04:40:50.292 INFO:teuthology.orchestra.run.smithi174.stdout: pid file = "" 2023-06-09T04:40:50.292 INFO:teuthology.orchestra.run.smithi174.stdout: rados mon op timeout = 900 2023-06-09T04:40:50.292 INFO:teuthology.orchestra.run.smithi174.stdout: rados osd op timeout = 900 2023-06-09T04:40:50.292 INFO:teuthology.orchestra.run.smithi174.stdout:[mon.a] 2023-06-09T04:40:50.293 INFO:teuthology.orchestra.run.smithi174.stdout:[mon.b] 2023-06-09T04:40:50.293 INFO:teuthology.orchestra.run.smithi174.stdout:[mon.c] 2023-06-09T04:40:50.293 INFO:teuthology.orchestra.run.smithi174.stdout:[mds.a] 2023-06-09T04:40:50.293 INFO:teuthology.orchestra.run.smithi174.stdout:[mds.c] 2023-06-09T04:40:50.293 INFO:teuthology.orchestra.run.smithi174.stdout:[mds.b] 2023-06-09T04:40:50.293 INFO:teuthology.orchestra.run.smithi174.stdout:[mds.d] 2023-06-09T04:40:50.293 INFO:teuthology.orchestra.run.smithi174.stdout:[mds] 2023-06-09T04:40:50.293 INFO:teuthology.orchestra.run.smithi174.stdout: debug mds = 20 2023-06-09T04:40:50.294 INFO:teuthology.orchestra.run.smithi174.stdout: debug mds balancer = 20 2023-06-09T04:40:50.294 INFO:teuthology.orchestra.run.smithi174.stdout: debug ms = 1 2023-06-09T04:40:50.294 INFO:teuthology.orchestra.run.smithi174.stdout: mds debug frag = True 2023-06-09T04:40:50.294 INFO:teuthology.orchestra.run.smithi174.stdout: mds debug scatterstat = True 2023-06-09T04:40:50.294 INFO:teuthology.orchestra.run.smithi174.stdout: mds op complaint time = 180 2023-06-09T04:40:50.294 INFO:teuthology.orchestra.run.smithi174.stdout: mds verify scatter = True 2023-06-09T04:40:50.294 INFO:teuthology.orchestra.run.smithi174.stdout: osd op complaint time = 180 2023-06-09T04:40:50.294 INFO:teuthology.orchestra.run.smithi174.stdout: rados mon op timeout = 900 2023-06-09T04:40:50.294 INFO:teuthology.orchestra.run.smithi174.stdout: rados osd op timeout = 900 2023-06-09T04:40:50.295 INFO:tasks.ceph:Creating admin key on mon.a... 2023-06-09T04:40:50.296 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-06-09T04:40:50.382 INFO:tasks.ceph:Copying monmap to all nodes... 2023-06-09T04:40:50.382 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2023-06-09T04:40:50.383 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-06-09T04:40:50.397 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2023-06-09T04:40:50.397 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-06-09T04:40:50.455 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi090.front.sepia.ceph.com 2023-06-09T04:40:50.456 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2023-06-09T04:40:50.456 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd of=/etc/ceph/ceph.keyring 2023-06-09T04:40:50.456 DEBUG:teuthology.orchestra.run.smithi090:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-06-09T04:40:50.561 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2023-06-09T04:40:50.561 DEBUG:teuthology.orchestra.run.smithi090:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-06-09T04:40:50.625 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi174.front.sepia.ceph.com 2023-06-09T04:40:50.625 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2023-06-09T04:40:50.626 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd of=/etc/ceph/ceph.keyring 2023-06-09T04:40:50.626 DEBUG:teuthology.orchestra.run.smithi174:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-06-09T04:40:50.684 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2023-06-09T04:40:50.684 DEBUG:teuthology.orchestra.run.smithi174:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-06-09T04:40:50.747 INFO:tasks.ceph:Setting up mon nodes... 2023-06-09T04:40:50.747 INFO:tasks.ceph:Setting up mgr nodes... 2023-06-09T04:40:50.747 DEBUG:teuthology.orchestra.run.smithi090:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-06-09T04:40:50.847 INFO:teuthology.orchestra.run.smithi090.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-06-09T04:40:50.854 DEBUG:teuthology.orchestra.run.smithi174:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-06-09T04:40:50.948 INFO:teuthology.orchestra.run.smithi174.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-06-09T04:40:50.962 INFO:tasks.ceph:Setting up mds nodes... 2023-06-09T04:40:50.963 DEBUG:teuthology.orchestra.run.smithi090:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-06-09T04:40:51.063 INFO:teuthology.orchestra.run.smithi090.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-06-09T04:40:51.071 DEBUG:teuthology.orchestra.run.smithi090:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-06-09T04:40:51.104 DEBUG:teuthology.orchestra.run.smithi090:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-06-09T04:40:51.247 INFO:teuthology.orchestra.run.smithi090.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-06-09T04:40:51.254 DEBUG:teuthology.orchestra.run.smithi090:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-06-09T04:40:51.285 DEBUG:teuthology.orchestra.run.smithi174:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-06-09T04:40:51.387 INFO:teuthology.orchestra.run.smithi174.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-06-09T04:40:51.394 DEBUG:teuthology.orchestra.run.smithi174:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-06-09T04:40:51.426 DEBUG:teuthology.orchestra.run.smithi174:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-06-09T04:40:51.572 INFO:teuthology.orchestra.run.smithi174.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-06-09T04:40:51.578 DEBUG:teuthology.orchestra.run.smithi174:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-06-09T04:40:51.607 INFO:tasks.ceph_client:Setting up client nodes... 2023-06-09T04:40:51.608 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-06-09T04:40:51.684 INFO:teuthology.orchestra.run.smithi090.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-06-09T04:40:51.712 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-06-09T04:40:51.782 INFO:teuthology.orchestra.run.smithi090.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-06-09T04:40:51.808 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-06-09T04:40:51.886 INFO:teuthology.orchestra.run.smithi174.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-06-09T04:40:51.915 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-06-09T04:40:51.990 INFO:teuthology.orchestra.run.smithi174.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-06-09T04:40:52.018 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-06-09T04:40:52.019 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi090.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi174.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-06-09T04:40:52.019 DEBUG:teuthology.orchestra.run.smithi090:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-06-09T04:40:52.052 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-06-09T04:40:52.052 INFO:tasks.ceph:role: osd.0 2023-06-09T04:40:52.053 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi090.front.sepia.ceph.com 2023-06-09T04:40:52.053 DEBUG:teuthology.orchestra.run.smithi090:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-06-09T04:40:52.652 INFO:teuthology.orchestra.run.smithi090.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-06-09T04:40:52.652 INFO:teuthology.orchestra.run.smithi090.stdout: = sectsz=512 attr=2, projid32bit=1 2023-06-09T04:40:52.653 INFO:teuthology.orchestra.run.smithi090.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-06-09T04:40:52.653 INFO:teuthology.orchestra.run.smithi090.stdout: = reflink=1 2023-06-09T04:40:52.653 INFO:teuthology.orchestra.run.smithi090.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-06-09T04:40:52.653 INFO:teuthology.orchestra.run.smithi090.stdout: = sunit=0 swidth=0 blks 2023-06-09T04:40:52.653 INFO:teuthology.orchestra.run.smithi090.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-06-09T04:40:52.653 INFO:teuthology.orchestra.run.smithi090.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-06-09T04:40:52.653 INFO:teuthology.orchestra.run.smithi090.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-06-09T04:40:52.654 INFO:teuthology.orchestra.run.smithi090.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-06-09T04:40:52.659 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi090.front.sepia.ceph.com -o noatime 2023-06-09T04:40:52.659 DEBUG:teuthology.orchestra.run.smithi090:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-06-09T04:40:52.793 DEBUG:teuthology.orchestra.run.smithi090:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-06-09T04:40:52.810 INFO:teuthology.orchestra.run.smithi090.stderr:sudo: /sbin/restorecon: command not found 2023-06-09T04:40:52.811 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-09T04:40:52.811 DEBUG:teuthology.orchestra.run.smithi090:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-06-09T04:40:52.890 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-06-09T04:40:52.890 INFO:tasks.ceph:role: osd.1 2023-06-09T04:40:52.891 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi090.front.sepia.ceph.com 2023-06-09T04:40:52.891 DEBUG:teuthology.orchestra.run.smithi090:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-06-09T04:40:53.417 INFO:teuthology.orchestra.run.smithi090.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-06-09T04:40:53.417 INFO:teuthology.orchestra.run.smithi090.stdout: = sectsz=512 attr=2, projid32bit=1 2023-06-09T04:40:53.418 INFO:teuthology.orchestra.run.smithi090.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-06-09T04:40:53.418 INFO:teuthology.orchestra.run.smithi090.stdout: = reflink=1 2023-06-09T04:40:53.418 INFO:teuthology.orchestra.run.smithi090.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-06-09T04:40:53.418 INFO:teuthology.orchestra.run.smithi090.stdout: = sunit=0 swidth=0 blks 2023-06-09T04:40:53.418 INFO:teuthology.orchestra.run.smithi090.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-06-09T04:40:53.418 INFO:teuthology.orchestra.run.smithi090.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-06-09T04:40:53.418 INFO:teuthology.orchestra.run.smithi090.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-06-09T04:40:53.418 INFO:teuthology.orchestra.run.smithi090.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-06-09T04:40:53.422 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi090.front.sepia.ceph.com -o noatime 2023-06-09T04:40:53.422 DEBUG:teuthology.orchestra.run.smithi090:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-06-09T04:40:53.488 DEBUG:teuthology.orchestra.run.smithi090:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-06-09T04:40:53.509 INFO:teuthology.orchestra.run.smithi090.stderr:sudo: /sbin/restorecon: command not found 2023-06-09T04:40:53.509 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-09T04:40:53.510 DEBUG:teuthology.orchestra.run.smithi090:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-06-09T04:40:53.586 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-06-09T04:40:53.586 INFO:tasks.ceph:role: osd.2 2023-06-09T04:40:53.586 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi090.front.sepia.ceph.com 2023-06-09T04:40:53.587 DEBUG:teuthology.orchestra.run.smithi090:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-06-09T04:40:54.154 INFO:teuthology.orchestra.run.smithi090.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-06-09T04:40:54.154 INFO:teuthology.orchestra.run.smithi090.stdout: = sectsz=512 attr=2, projid32bit=1 2023-06-09T04:40:54.154 INFO:teuthology.orchestra.run.smithi090.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-06-09T04:40:54.154 INFO:teuthology.orchestra.run.smithi090.stdout: = reflink=1 2023-06-09T04:40:54.154 INFO:teuthology.orchestra.run.smithi090.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-06-09T04:40:54.154 INFO:teuthology.orchestra.run.smithi090.stdout: = sunit=0 swidth=0 blks 2023-06-09T04:40:54.155 INFO:teuthology.orchestra.run.smithi090.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-06-09T04:40:54.155 INFO:teuthology.orchestra.run.smithi090.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-06-09T04:40:54.155 INFO:teuthology.orchestra.run.smithi090.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-06-09T04:40:54.155 INFO:teuthology.orchestra.run.smithi090.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-06-09T04:40:54.158 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi090.front.sepia.ceph.com -o noatime 2023-06-09T04:40:54.159 DEBUG:teuthology.orchestra.run.smithi090:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-06-09T04:40:54.281 DEBUG:teuthology.orchestra.run.smithi090:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-06-09T04:40:54.302 INFO:teuthology.orchestra.run.smithi090.stderr:sudo: /sbin/restorecon: command not found 2023-06-09T04:40:54.303 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-09T04:40:54.304 DEBUG:teuthology.orchestra.run.smithi090:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-06-09T04:40:54.385 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-06-09T04:40:54.385 INFO:tasks.ceph:role: osd.3 2023-06-09T04:40:54.385 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi090.front.sepia.ceph.com 2023-06-09T04:40:54.386 DEBUG:teuthology.orchestra.run.smithi090:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-06-09T04:40:54.960 INFO:teuthology.orchestra.run.smithi090.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-06-09T04:40:54.961 INFO:teuthology.orchestra.run.smithi090.stdout: = sectsz=512 attr=2, projid32bit=1 2023-06-09T04:40:54.961 INFO:teuthology.orchestra.run.smithi090.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-06-09T04:40:54.961 INFO:teuthology.orchestra.run.smithi090.stdout: = reflink=1 2023-06-09T04:40:54.961 INFO:teuthology.orchestra.run.smithi090.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-06-09T04:40:54.961 INFO:teuthology.orchestra.run.smithi090.stdout: = sunit=0 swidth=0 blks 2023-06-09T04:40:54.961 INFO:teuthology.orchestra.run.smithi090.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-06-09T04:40:54.961 INFO:teuthology.orchestra.run.smithi090.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-06-09T04:40:54.962 INFO:teuthology.orchestra.run.smithi090.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-06-09T04:40:54.962 INFO:teuthology.orchestra.run.smithi090.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-06-09T04:40:54.966 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi090.front.sepia.ceph.com -o noatime 2023-06-09T04:40:54.967 DEBUG:teuthology.orchestra.run.smithi090:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-06-09T04:40:55.106 DEBUG:teuthology.orchestra.run.smithi090:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-06-09T04:40:55.126 INFO:teuthology.orchestra.run.smithi090.stderr:sudo: /sbin/restorecon: command not found 2023-06-09T04:40:55.127 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-09T04:40:55.128 DEBUG:teuthology.orchestra.run.smithi090:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-06-09T04:40:55.339 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:40:55.331+0000 7f0bb5472700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-06-09T04:40:55.343 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:40:55.335+0000 7f0bb5472700 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-06-09T04:40:55.344 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:40:55.335+0000 7f0bb5472700 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-06-09T04:40:55.344 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:40:55.335+0000 7f0bb5472700 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-06-09T04:40:55.344 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:40:55.335+0000 7f0bb5472700 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-06-09T04:40:55.346 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:40:55.339+0000 7f0bb5472700 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-06-09T04:40:58.396 DEBUG:teuthology.orchestra.run.smithi090:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-06-09T04:40:58.430 DEBUG:teuthology.orchestra.run.smithi090:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-06-09T04:40:58.556 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:40:58.552+0000 7f48a9616700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-06-09T04:40:58.557 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:40:58.552+0000 7f48a9616700 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-06-09T04:40:58.557 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:40:58.552+0000 7f48a9616700 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-06-09T04:40:58.557 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:40:58.552+0000 7f48a9616700 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-06-09T04:40:58.557 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:40:58.552+0000 7f48a9616700 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-06-09T04:40:58.560 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:40:58.556+0000 7f48a9616700 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-06-09T04:41:01.625 DEBUG:teuthology.orchestra.run.smithi090:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-06-09T04:41:01.659 DEBUG:teuthology.orchestra.run.smithi090:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-06-09T04:41:01.782 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:01.776+0000 7f4b3be8b700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-06-09T04:41:01.783 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:01.776+0000 7f4b3be8b700 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-06-09T04:41:01.783 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:01.776+0000 7f4b3be8b700 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-06-09T04:41:01.783 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:01.776+0000 7f4b3be8b700 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-06-09T04:41:01.783 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:01.776+0000 7f4b3be8b700 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-06-09T04:41:01.785 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:01.780+0000 7f4b3be8b700 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-06-09T04:41:04.829 DEBUG:teuthology.orchestra.run.smithi090:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-06-09T04:41:04.862 DEBUG:teuthology.orchestra.run.smithi090:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-06-09T04:41:04.987 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:04.980+0000 7faf4bab6700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-06-09T04:41:04.988 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:04.984+0000 7faf4bab6700 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-06-09T04:41:04.989 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:04.984+0000 7faf4bab6700 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-06-09T04:41:04.989 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:04.984+0000 7faf4bab6700 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-06-09T04:41:04.989 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:04.984+0000 7faf4bab6700 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-06-09T04:41:04.990 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:04.984+0000 7faf4bab6700 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-06-09T04:41:08.036 DEBUG:teuthology.orchestra.run.smithi090:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-06-09T04:41:08.068 DEBUG:teuthology.orchestra.run.smithi174:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-06-09T04:41:08.104 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-06-09T04:41:08.105 INFO:tasks.ceph:role: osd.4 2023-06-09T04:41:08.105 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi174.front.sepia.ceph.com 2023-06-09T04:41:08.105 DEBUG:teuthology.orchestra.run.smithi174:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-06-09T04:41:08.683 INFO:teuthology.orchestra.run.smithi174.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-06-09T04:41:08.683 INFO:teuthology.orchestra.run.smithi174.stdout: = sectsz=512 attr=2, projid32bit=1 2023-06-09T04:41:08.683 INFO:teuthology.orchestra.run.smithi174.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-06-09T04:41:08.683 INFO:teuthology.orchestra.run.smithi174.stdout: = reflink=1 2023-06-09T04:41:08.683 INFO:teuthology.orchestra.run.smithi174.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-06-09T04:41:08.683 INFO:teuthology.orchestra.run.smithi174.stdout: = sunit=0 swidth=0 blks 2023-06-09T04:41:08.684 INFO:teuthology.orchestra.run.smithi174.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-06-09T04:41:08.684 INFO:teuthology.orchestra.run.smithi174.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-06-09T04:41:08.684 INFO:teuthology.orchestra.run.smithi174.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-06-09T04:41:08.684 INFO:teuthology.orchestra.run.smithi174.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-06-09T04:41:08.687 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi174.front.sepia.ceph.com -o noatime 2023-06-09T04:41:08.687 DEBUG:teuthology.orchestra.run.smithi174:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-06-09T04:41:08.814 DEBUG:teuthology.orchestra.run.smithi174:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-06-09T04:41:08.840 INFO:teuthology.orchestra.run.smithi174.stderr:sudo: /sbin/restorecon: command not found 2023-06-09T04:41:08.841 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-09T04:41:08.841 DEBUG:teuthology.orchestra.run.smithi174:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-06-09T04:41:08.920 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-06-09T04:41:08.920 INFO:tasks.ceph:role: osd.5 2023-06-09T04:41:08.921 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi174.front.sepia.ceph.com 2023-06-09T04:41:08.921 DEBUG:teuthology.orchestra.run.smithi174:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-06-09T04:41:09.460 INFO:teuthology.orchestra.run.smithi174.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-06-09T04:41:09.461 INFO:teuthology.orchestra.run.smithi174.stdout: = sectsz=512 attr=2, projid32bit=1 2023-06-09T04:41:09.461 INFO:teuthology.orchestra.run.smithi174.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-06-09T04:41:09.461 INFO:teuthology.orchestra.run.smithi174.stdout: = reflink=1 2023-06-09T04:41:09.461 INFO:teuthology.orchestra.run.smithi174.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-06-09T04:41:09.461 INFO:teuthology.orchestra.run.smithi174.stdout: = sunit=0 swidth=0 blks 2023-06-09T04:41:09.461 INFO:teuthology.orchestra.run.smithi174.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-06-09T04:41:09.461 INFO:teuthology.orchestra.run.smithi174.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-06-09T04:41:09.462 INFO:teuthology.orchestra.run.smithi174.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-06-09T04:41:09.462 INFO:teuthology.orchestra.run.smithi174.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-06-09T04:41:09.465 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi174.front.sepia.ceph.com -o noatime 2023-06-09T04:41:09.465 DEBUG:teuthology.orchestra.run.smithi174:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-06-09T04:41:09.532 DEBUG:teuthology.orchestra.run.smithi174:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-06-09T04:41:09.552 INFO:teuthology.orchestra.run.smithi174.stderr:sudo: /sbin/restorecon: command not found 2023-06-09T04:41:09.553 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-09T04:41:09.554 DEBUG:teuthology.orchestra.run.smithi174:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-06-09T04:41:09.631 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-06-09T04:41:09.632 INFO:tasks.ceph:role: osd.6 2023-06-09T04:41:09.632 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi174.front.sepia.ceph.com 2023-06-09T04:41:09.632 DEBUG:teuthology.orchestra.run.smithi174:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-06-09T04:41:10.207 INFO:teuthology.orchestra.run.smithi174.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-06-09T04:41:10.207 INFO:teuthology.orchestra.run.smithi174.stdout: = sectsz=512 attr=2, projid32bit=1 2023-06-09T04:41:10.207 INFO:teuthology.orchestra.run.smithi174.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-06-09T04:41:10.207 INFO:teuthology.orchestra.run.smithi174.stdout: = reflink=1 2023-06-09T04:41:10.208 INFO:teuthology.orchestra.run.smithi174.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-06-09T04:41:10.208 INFO:teuthology.orchestra.run.smithi174.stdout: = sunit=0 swidth=0 blks 2023-06-09T04:41:10.208 INFO:teuthology.orchestra.run.smithi174.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-06-09T04:41:10.208 INFO:teuthology.orchestra.run.smithi174.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-06-09T04:41:10.208 INFO:teuthology.orchestra.run.smithi174.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-06-09T04:41:10.208 INFO:teuthology.orchestra.run.smithi174.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-06-09T04:41:10.210 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi174.front.sepia.ceph.com -o noatime 2023-06-09T04:41:10.211 DEBUG:teuthology.orchestra.run.smithi174:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-06-09T04:41:10.334 DEBUG:teuthology.orchestra.run.smithi174:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-06-09T04:41:10.355 INFO:teuthology.orchestra.run.smithi174.stderr:sudo: /sbin/restorecon: command not found 2023-06-09T04:41:10.356 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-09T04:41:10.357 DEBUG:teuthology.orchestra.run.smithi174:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-06-09T04:41:10.431 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-06-09T04:41:10.431 INFO:tasks.ceph:role: osd.7 2023-06-09T04:41:10.431 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi174.front.sepia.ceph.com 2023-06-09T04:41:10.432 DEBUG:teuthology.orchestra.run.smithi174:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-06-09T04:41:11.018 INFO:teuthology.orchestra.run.smithi174.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-06-09T04:41:11.018 INFO:teuthology.orchestra.run.smithi174.stdout: = sectsz=512 attr=2, projid32bit=1 2023-06-09T04:41:11.018 INFO:teuthology.orchestra.run.smithi174.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-06-09T04:41:11.018 INFO:teuthology.orchestra.run.smithi174.stdout: = reflink=1 2023-06-09T04:41:11.019 INFO:teuthology.orchestra.run.smithi174.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-06-09T04:41:11.019 INFO:teuthology.orchestra.run.smithi174.stdout: = sunit=0 swidth=0 blks 2023-06-09T04:41:11.019 INFO:teuthology.orchestra.run.smithi174.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-06-09T04:41:11.019 INFO:teuthology.orchestra.run.smithi174.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-06-09T04:41:11.019 INFO:teuthology.orchestra.run.smithi174.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-06-09T04:41:11.019 INFO:teuthology.orchestra.run.smithi174.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-06-09T04:41:11.023 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi174.front.sepia.ceph.com -o noatime 2023-06-09T04:41:11.023 DEBUG:teuthology.orchestra.run.smithi174:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-06-09T04:41:11.203 DEBUG:teuthology.orchestra.run.smithi174:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-06-09T04:41:11.226 INFO:teuthology.orchestra.run.smithi174.stderr:sudo: /sbin/restorecon: command not found 2023-06-09T04:41:11.227 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-09T04:41:11.227 DEBUG:teuthology.orchestra.run.smithi174:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-06-09T04:41:11.382 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:11.379+0000 7f00b20a6700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-06-09T04:41:11.388 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:11.383+0000 7f00b20a6700 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-06-09T04:41:11.388 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:11.383+0000 7f00b20a6700 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-06-09T04:41:11.388 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:11.383+0000 7f00b20a6700 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-06-09T04:41:11.388 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:11.383+0000 7f00b20a6700 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-06-09T04:41:11.390 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:11.387+0000 7f00b20a6700 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-06-09T04:41:14.456 DEBUG:teuthology.orchestra.run.smithi174:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-06-09T04:41:14.491 DEBUG:teuthology.orchestra.run.smithi174:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-06-09T04:41:14.616 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:14.611+0000 7fe525cb8700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-06-09T04:41:14.617 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:14.611+0000 7fe525cb8700 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-06-09T04:41:14.617 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:14.611+0000 7fe525cb8700 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-06-09T04:41:14.617 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:14.611+0000 7fe525cb8700 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-06-09T04:41:14.617 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:14.611+0000 7fe525cb8700 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-06-09T04:41:14.619 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:14.615+0000 7fe525cb8700 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-06-09T04:41:17.694 DEBUG:teuthology.orchestra.run.smithi174:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-06-09T04:41:17.726 DEBUG:teuthology.orchestra.run.smithi174:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-06-09T04:41:17.858 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:17.855+0000 7fafd103d700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-06-09T04:41:17.859 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:17.855+0000 7fafd103d700 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-06-09T04:41:17.859 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:17.855+0000 7fafd103d700 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-06-09T04:41:17.859 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:17.855+0000 7fafd103d700 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-06-09T04:41:17.860 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:17.855+0000 7fafd103d700 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-06-09T04:41:17.862 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:17.859+0000 7fafd103d700 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-06-09T04:41:17.929 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:41:17.936 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:41:20.913 DEBUG:teuthology.orchestra.run.smithi174:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-06-09T04:41:20.946 DEBUG:teuthology.orchestra.run.smithi174:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-06-09T04:41:21.072 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:21.067+0000 7f4657639700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-06-09T04:41:21.073 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:21.067+0000 7f4657639700 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-06-09T04:41:21.073 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:21.067+0000 7f4657639700 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-06-09T04:41:21.073 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:21.067+0000 7f4657639700 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-06-09T04:41:21.073 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:21.067+0000 7f4657639700 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-06-09T04:41:21.075 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:21.071+0000 7f4657639700 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-06-09T04:41:24.127 DEBUG:teuthology.orchestra.run.smithi174:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-06-09T04:41:24.157 INFO:tasks.ceph:Reading keys from all nodes... 2023-06-09T04:41:24.158 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2023-06-09T04:41:24.158 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-06-09T04:41:24.192 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2023-06-09T04:41:24.192 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-06-09T04:41:24.267 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2023-06-09T04:41:24.267 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-06-09T04:41:24.343 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2023-06-09T04:41:24.343 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-06-09T04:41:24.423 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2023-06-09T04:41:24.423 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-06-09T04:41:24.500 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2023-06-09T04:41:24.500 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-06-09T04:41:24.579 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2023-06-09T04:41:24.580 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-06-09T04:41:24.654 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2023-06-09T04:41:24.654 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-06-09T04:41:24.690 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2023-06-09T04:41:24.690 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-06-09T04:41:24.766 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2023-06-09T04:41:24.766 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-06-09T04:41:24.846 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2023-06-09T04:41:24.846 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-06-09T04:41:24.921 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2023-06-09T04:41:24.922 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-06-09T04:41:24.998 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2023-06-09T04:41:24.998 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-06-09T04:41:25.076 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2023-06-09T04:41:25.077 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-06-09T04:41:25.149 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2023-06-09T04:41:25.150 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-06-09T04:41:25.169 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2023-06-09T04:41:25.169 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-06-09T04:41:25.230 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2023-06-09T04:41:25.230 DEBUG:teuthology.orchestra.run.smithi174:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-06-09T04:41:25.247 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2023-06-09T04:41:25.248 DEBUG:teuthology.orchestra.run.smithi174:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-06-09T04:41:25.307 INFO:tasks.ceph:Adding keys to all mons... 2023-06-09T04:41:25.307 DEBUG:teuthology.orchestra.run.smithi090:> sudo tee -a /etc/ceph/ceph.keyring 2023-06-09T04:41:25.314 DEBUG:teuthology.orchestra.run.smithi174:> sudo tee -a /etc/ceph/ceph.keyring 2023-06-09T04:41:25.356 INFO:teuthology.orchestra.run.smithi090.stdout:[mgr.y] 2023-06-09T04:41:25.357 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQBSrYJkuyt1MhAAAO5JZufesMjU51hCG9Fz1g== 2023-06-09T04:41:25.357 INFO:teuthology.orchestra.run.smithi090.stdout:[mds.a] 2023-06-09T04:41:25.357 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQBTrYJkwmTHAxAAvGnkxDjwaTsOj9lVipjiuw== 2023-06-09T04:41:25.357 INFO:teuthology.orchestra.run.smithi090.stdout:[mds.c] 2023-06-09T04:41:25.357 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQBTrYJkKeC8DhAAtK6uJE3MeXIo2wr7yt3Wdg== 2023-06-09T04:41:25.357 INFO:teuthology.orchestra.run.smithi090.stdout:[osd.0] 2023-06-09T04:41:25.357 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQBXrYJkCCQ5FBAAsQ3Bn8ASjG5NG0Irke/ngw== 2023-06-09T04:41:25.358 INFO:teuthology.orchestra.run.smithi090.stdout:[osd.1] 2023-06-09T04:41:25.358 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQBarYJk1MMiIRAAYrhOPrt2tagEqtErtABtVw== 2023-06-09T04:41:25.358 INFO:teuthology.orchestra.run.smithi090.stdout:[osd.2] 2023-06-09T04:41:25.358 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQBdrYJkraGfLhAAYFJjOwtn4DUmWUy8fpmpHg== 2023-06-09T04:41:25.358 INFO:teuthology.orchestra.run.smithi090.stdout:[osd.3] 2023-06-09T04:41:25.358 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQBgrYJkOkrcOhAAxcria0ETkdDsG1wsvFijSA== 2023-06-09T04:41:25.358 INFO:teuthology.orchestra.run.smithi090.stdout:[mgr.x] 2023-06-09T04:41:25.359 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQBSrYJkBZmHOBAA0UeOT/8Bua7Wvhs2WLgWhQ== 2023-06-09T04:41:25.359 INFO:teuthology.orchestra.run.smithi090.stdout:[mds.b] 2023-06-09T04:41:25.359 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQBTrYJkGl8VFxAA61fApHDVnQ/R8gR8Ly0MUQ== 2023-06-09T04:41:25.359 INFO:teuthology.orchestra.run.smithi090.stdout:[mds.d] 2023-06-09T04:41:25.359 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQBTrYJkQ24gIhAArIVH2s2uyytTIemU0qUdcw== 2023-06-09T04:41:25.359 INFO:teuthology.orchestra.run.smithi090.stdout:[osd.4] 2023-06-09T04:41:25.359 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQBnrYJkXSfOFhAAdEX2NZcgYyQOIcnrBOCAcQ== 2023-06-09T04:41:25.359 INFO:teuthology.orchestra.run.smithi090.stdout:[osd.5] 2023-06-09T04:41:25.360 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQBqrYJkQ0PDJBAAsvUj6nqY8aNljo16VQQCFA== 2023-06-09T04:41:25.360 INFO:teuthology.orchestra.run.smithi090.stdout:[osd.6] 2023-06-09T04:41:25.360 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQBtrYJkY98tMxAA4cwO9N/Bq/LHakBLnPgwlg== 2023-06-09T04:41:25.360 INFO:teuthology.orchestra.run.smithi090.stdout:[osd.7] 2023-06-09T04:41:25.360 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQBxrYJkr7hNBBAASjmfYXWG1Bg0JpgeKFvBWg== 2023-06-09T04:41:25.360 INFO:teuthology.orchestra.run.smithi090.stdout:[client.0] 2023-06-09T04:41:25.361 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQBTrYJk2YfBKBAAKBjDM7uav/YVb8uSQPNRGA== 2023-06-09T04:41:25.361 INFO:teuthology.orchestra.run.smithi090.stdout:[client.2] 2023-06-09T04:41:25.361 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQBTrYJk3ICZLhAAETQ8PH5RuHYoGlCYmEW2Wg== 2023-06-09T04:41:25.361 INFO:teuthology.orchestra.run.smithi090.stdout:[client.1] 2023-06-09T04:41:25.361 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQBTrYJkVN7bNBAA3GsUGsmcOfG14+PYOmYDOQ== 2023-06-09T04:41:25.361 INFO:teuthology.orchestra.run.smithi090.stdout:[client.3] 2023-06-09T04:41:25.361 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQBTrYJkPd0JOxAASn4fN3nzWzehRxN6I321fw== 2023-06-09T04:41:25.379 INFO:teuthology.orchestra.run.smithi174.stdout:[mgr.y] 2023-06-09T04:41:25.379 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQBSrYJkuyt1MhAAAO5JZufesMjU51hCG9Fz1g== 2023-06-09T04:41:25.379 INFO:teuthology.orchestra.run.smithi174.stdout:[mds.a] 2023-06-09T04:41:25.379 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQBTrYJkwmTHAxAAvGnkxDjwaTsOj9lVipjiuw== 2023-06-09T04:41:25.379 INFO:teuthology.orchestra.run.smithi174.stdout:[mds.c] 2023-06-09T04:41:25.380 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQBTrYJkKeC8DhAAtK6uJE3MeXIo2wr7yt3Wdg== 2023-06-09T04:41:25.380 INFO:teuthology.orchestra.run.smithi174.stdout:[osd.0] 2023-06-09T04:41:25.380 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQBXrYJkCCQ5FBAAsQ3Bn8ASjG5NG0Irke/ngw== 2023-06-09T04:41:25.380 INFO:teuthology.orchestra.run.smithi174.stdout:[osd.1] 2023-06-09T04:41:25.380 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQBarYJk1MMiIRAAYrhOPrt2tagEqtErtABtVw== 2023-06-09T04:41:25.380 INFO:teuthology.orchestra.run.smithi174.stdout:[osd.2] 2023-06-09T04:41:25.380 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQBdrYJkraGfLhAAYFJjOwtn4DUmWUy8fpmpHg== 2023-06-09T04:41:25.381 INFO:teuthology.orchestra.run.smithi174.stdout:[osd.3] 2023-06-09T04:41:25.381 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQBgrYJkOkrcOhAAxcria0ETkdDsG1wsvFijSA== 2023-06-09T04:41:25.381 INFO:teuthology.orchestra.run.smithi174.stdout:[mgr.x] 2023-06-09T04:41:25.381 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQBSrYJkBZmHOBAA0UeOT/8Bua7Wvhs2WLgWhQ== 2023-06-09T04:41:25.381 INFO:teuthology.orchestra.run.smithi174.stdout:[mds.b] 2023-06-09T04:41:25.381 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQBTrYJkGl8VFxAA61fApHDVnQ/R8gR8Ly0MUQ== 2023-06-09T04:41:25.381 INFO:teuthology.orchestra.run.smithi174.stdout:[mds.d] 2023-06-09T04:41:25.382 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQBTrYJkQ24gIhAArIVH2s2uyytTIemU0qUdcw== 2023-06-09T04:41:25.382 INFO:teuthology.orchestra.run.smithi174.stdout:[osd.4] 2023-06-09T04:41:25.382 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQBnrYJkXSfOFhAAdEX2NZcgYyQOIcnrBOCAcQ== 2023-06-09T04:41:25.382 INFO:teuthology.orchestra.run.smithi174.stdout:[osd.5] 2023-06-09T04:41:25.382 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQBqrYJkQ0PDJBAAsvUj6nqY8aNljo16VQQCFA== 2023-06-09T04:41:25.382 INFO:teuthology.orchestra.run.smithi174.stdout:[osd.6] 2023-06-09T04:41:25.382 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQBtrYJkY98tMxAA4cwO9N/Bq/LHakBLnPgwlg== 2023-06-09T04:41:25.383 INFO:teuthology.orchestra.run.smithi174.stdout:[osd.7] 2023-06-09T04:41:25.383 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQBxrYJkr7hNBBAASjmfYXWG1Bg0JpgeKFvBWg== 2023-06-09T04:41:25.383 INFO:teuthology.orchestra.run.smithi174.stdout:[client.0] 2023-06-09T04:41:25.383 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQBTrYJk2YfBKBAAKBjDM7uav/YVb8uSQPNRGA== 2023-06-09T04:41:25.383 INFO:teuthology.orchestra.run.smithi174.stdout:[client.2] 2023-06-09T04:41:25.383 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQBTrYJk3ICZLhAAETQ8PH5RuHYoGlCYmEW2Wg== 2023-06-09T04:41:25.383 INFO:teuthology.orchestra.run.smithi174.stdout:[client.1] 2023-06-09T04:41:25.383 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQBTrYJkVN7bNBAA3GsUGsmcOfG14+PYOmYDOQ== 2023-06-09T04:41:25.384 INFO:teuthology.orchestra.run.smithi174.stdout:[client.3] 2023-06-09T04:41:25.384 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQBTrYJkPd0JOxAASn4fN3nzWzehRxN6I321fw== 2023-06-09T04:41:25.385 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-06-09T04:41:25.413 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-06-09T04:41:25.509 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-06-09T04:41:25.515 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-06-09T04:41:25.603 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-06-09T04:41:25.609 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-06-09T04:41:25.695 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-09T04:41:25.701 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-09T04:41:25.781 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-09T04:41:25.787 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-09T04:41:25.870 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-09T04:41:25.876 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-09T04:41:25.956 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-09T04:41:25.963 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-09T04:41:26.047 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-06-09T04:41:26.053 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-06-09T04:41:26.136 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-06-09T04:41:26.143 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-06-09T04:41:26.229 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-06-09T04:41:26.235 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-06-09T04:41:26.321 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-09T04:41:26.327 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-09T04:41:26.408 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-09T04:41:26.414 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-09T04:41:26.495 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-09T04:41:26.501 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-09T04:41:26.582 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-09T04:41:26.589 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-09T04:41:26.672 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-06-09T04:41:26.679 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-06-09T04:41:26.761 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-06-09T04:41:26.767 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-06-09T04:41:26.850 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-06-09T04:41:26.856 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-06-09T04:41:26.943 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-06-09T04:41:26.950 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-06-09T04:41:27.033 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-06-09T04:41:27.034 DEBUG:teuthology.orchestra.run.smithi090:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-06-09T04:41:27.067 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-06-09T04:41:27.220 DEBUG:teuthology.orchestra.run.smithi090:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-06-09T04:41:27.253 DEBUG:teuthology.orchestra.run.smithi174:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-06-09T04:41:27.288 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-06-09T04:41:27.438 DEBUG:teuthology.orchestra.run.smithi174:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-06-09T04:41:27.470 DEBUG:teuthology.orchestra.run.smithi174:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-06-09T04:41:27.549 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-06-09T04:41:27.704 DEBUG:teuthology.orchestra.run.smithi174:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-06-09T04:41:27.738 DEBUG:teuthology.orchestra.run.smithi090:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-06-09T04:41:27.745 DEBUG:teuthology.orchestra.run.smithi174:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-06-09T04:41:27.801 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-06-09T04:41:27.801 INFO:tasks.ceph.mon.a:Restarting daemon 2023-06-09T04:41:27.802 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-06-09T04:41:27.808 INFO:tasks.ceph.mon.a:Started 2023-06-09T04:41:27.809 INFO:tasks.ceph.mon.b:Restarting daemon 2023-06-09T04:41:27.809 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-06-09T04:41:27.847 INFO:tasks.ceph.mon.b:Started 2023-06-09T04:41:27.847 INFO:tasks.ceph.mon.c:Restarting daemon 2023-06-09T04:41:27.848 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-06-09T04:41:27.852 INFO:tasks.ceph.mon.c:Started 2023-06-09T04:41:27.852 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-06-09T04:41:27.852 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-06-09T04:41:27.853 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-06-09T04:41:27.860 INFO:tasks.ceph.mgr.y:Started 2023-06-09T04:41:27.860 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-06-09T04:41:27.860 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-06-09T04:41:27.865 INFO:tasks.ceph.mgr.x:Started 2023-06-09T04:41:27.865 INFO:tasks.ceph:Setting crush tunables to default 2023-06-09T04:41:27.866 DEBUG:teuthology.orchestra.run.smithi090:> sudo ceph --cluster ceph osd crush tunables default 2023-06-09T04:41:28.031 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:28.028+0000 7f670b93a700 1 Processor -- start 2023-06-09T04:41:28.032 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:28.028+0000 7f670b93a700 1 -- start start 2023-06-09T04:41:28.034 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:28.028+0000 7f670b93a700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6704158540 0x7f6704070320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:28.034 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:28.028+0000 7f670b93a700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6704070b70 con 0x7f670406c340 2023-06-09T04:41:28.034 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:28.028+0000 7f670b93a700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6704070e50 con 0x7f67040cd1e0 2023-06-09T04:41:28.034 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:28.028+0000 7f670b93a700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67040c9340 con 0x7f6704158540 2023-06-09T04:41:28.035 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:28.028+0000 7f6708ed5700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f670406c340 0x7f67040ccad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:52988/0 (socket says 172.21.15.90:52988) 2023-06-09T04:41:28.035 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:28.028+0000 7f6708ed5700 1 -- 172.21.15.90:0/716172283 learned_addr learned my addr 172.21.15.90:0/716172283 (peer_addr_for_me v1:172.21.15.90:0/0) 2023-06-09T04:41:28.035 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:28.028+0000 7f67096d6700 1 --2- 172.21.15.90:0/716172283 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6704158540 0x7f6704070320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:28.036 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:28.032+0000 7f67096d6700 1 -- 172.21.15.90:0/716172283 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6704158540 msgr2=0x7f6704070320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-06-09T04:41:28.036 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:28.032+0000 7f67096d6700 1 -- 172.21.15.90:0/716172283 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6704158540 msgr2=0x7f6704070320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-06-09T04:41:28.036 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:28.032+0000 7f67096d6700 1 --2- 172.21.15.90:0/716172283 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6704158540 0x7f6704070320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-06-09T04:41:28.036 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:28.032+0000 7f67096d6700 1 --2- 172.21.15.90:0/716172283 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6704158540 0x7f6704070320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-06-09T04:41:28.202 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:28.196+0000 7f66fbfff700 1 -- 172.21.15.90:0/716172283 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1718730034 0 0) 0x7f6704070b70 con 0x7f670406c340 2023-06-09T04:41:28.202 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:28.196+0000 7f66fbfff700 1 -- 172.21.15.90:0/716172283 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f66f00035d0 con 0x7f670406c340 2023-06-09T04:41:28.202 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:28.196+0000 7f66fbfff700 1 -- 172.21.15.90:0/716172283 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1867463015 0 0) 0x7f6704070e50 con 0x7f67040cd1e0 2023-06-09T04:41:28.203 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:28.196+0000 7f66fbfff700 1 -- 172.21.15.90:0/716172283 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6704070b70 con 0x7f67040cd1e0 2023-06-09T04:41:28.204 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:28.200+0000 7f66fbfff700 1 -- 172.21.15.90:0/716172283 <== mon.1 v1:172.21.15.174:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1170886737 0 0) 0x7f6704070b70 con 0x7f67040cd1e0 2023-06-09T04:41:28.204 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:28.200+0000 7f66fbfff700 1 -- 172.21.15.90:0/716172283 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6704158540 msgr2=0x7f6704070320 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-06-09T04:41:28.204 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:28.200+0000 7f66fbfff700 1 --2- 172.21.15.90:0/716172283 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6704158540 0x7f6704070320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:28.204 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:28.200+0000 7f66fbfff700 1 -- 172.21.15.90:0/716172283 >> v1:172.21.15.90:6789/0 conn(0x7f670406c340 legacy=0x7f67040ccad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:28.204 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:28.200+0000 7f66fbfff700 1 -- 172.21.15.90:0/716172283 --> v1:172.21.15.174:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6704071130 con 0x7f67040cd1e0 2023-06-09T04:41:28.204 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:28.200+0000 7f66fbfff700 1 -- 172.21.15.90:0/716172283 <== mon.1 v1:172.21.15.174:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3604404106 0 0) 0x7f66fc001670 con 0x7f67040cd1e0 2023-06-09T04:41:28.204 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:28.200+0000 7f66fbfff700 1 -- 172.21.15.90:0/716172283 >> v1:172.21.15.174:6789/0 conn(0x7f67040cd1e0 legacy=0x7f67040c9760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:28.205 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:28.200+0000 7f66fbfff700 1 --2- 172.21.15.90:0/716172283 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f66f0003be0 0x7f66f0003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:28.205 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:28.200+0000 7f66fbfff700 1 --2- 172.21.15.90:0/716172283 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f66f0004870 0x7f66f0004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:28.205 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:28.200+0000 7f66fbfff700 1 --2- 172.21.15.90:0/716172283 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6704158540 0x7f66f000ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:28.205 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:28.200+0000 7f66fbfff700 1 -- 172.21.15.90:0/716172283 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66f4001230 con 0x7f66f0003be0 2023-06-09T04:41:28.205 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:28.200+0000 7f66fbfff700 1 -- 172.21.15.90:0/716172283 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67040c9340 con 0x7f66f0004870 2023-06-09T04:41:28.205 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:28.200+0000 7f66fbfff700 1 -- 172.21.15.90:0/716172283 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66f0005600 con 0x7f6704158540 2023-06-09T04:41:28.206 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:28.200+0000 7f6709ed7700 1 --2- 172.21.15.90:0/716172283 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6704158540 0x7f66f000ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:28.206 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:28.200+0000 7f67096d6700 1 --2- 172.21.15.90:0/716172283 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f66f0003be0 0x7f66f0003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:28.206 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:28.200+0000 7f6708ed5700 1 --2- 172.21.15.90:0/716172283 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f66f0004870 0x7f66f0004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:28.207 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:28.200+0000 7f67096d6700 1 -- 172.21.15.90:0/716172283 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6704158540 msgr2=0x7f66f000ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:28.207 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:28.200+0000 7f67096d6700 1 --2- 172.21.15.90:0/716172283 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6704158540 0x7f66f000ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:28.207 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:28.200+0000 7f67096d6700 1 -- 172.21.15.90:0/716172283 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f66f0004870 msgr2=0x7f66f0004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:28.207 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:28.200+0000 7f67096d6700 1 --2- 172.21.15.90:0/716172283 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f66f0004870 0x7f66f0004ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:28.207 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:28.200+0000 7f67096d6700 1 -- 172.21.15.90:0/716172283 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6704070b70 con 0x7f66f0003be0 2023-06-09T04:41:28.207 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:28.200+0000 7f67096d6700 1 --2- 172.21.15.90:0/716172283 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f66f0003be0 0x7f66f0003fb0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f6700009fd0 tx=0x7f66f00058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ea1e57e533cc533 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:28.208 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:28.204+0000 7f66fbfff700 1 -- 172.21.15.90:0/716172283 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6700007e20 con 0x7f66f0003be0 2023-06-09T04:41:28.208 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:28.204+0000 7f66fbfff700 1 -- 172.21.15.90:0/716172283 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6700003a40 con 0x7f66f0003be0 2023-06-09T04:41:28.208 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:28.204+0000 7f66fbfff700 1 -- 172.21.15.90:0/716172283 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6700003df0 con 0x7f66f0003be0 2023-06-09T04:41:28.209 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:28.204+0000 7f670b93a700 1 -- 172.21.15.90:0/716172283 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f66f0003be0 msgr2=0x7f66f0003fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:28.209 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:28.204+0000 7f670b93a700 1 --2- 172.21.15.90:0/716172283 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f66f0003be0 0x7f66f0003fb0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f6700009fd0 tx=0x7f66f00058a0 comp rx=0 tx=0).stop 2023-06-09T04:41:28.210 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:28.204+0000 7f6709ed7700 1 -- 172.21.15.90:0/716172283 reap_dead start 2023-06-09T04:41:28.210 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:28.204+0000 7f670b93a700 1 -- 172.21.15.90:0/716172283 shutdown_connections 2023-06-09T04:41:28.210 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:28.204+0000 7f670b93a700 1 -- 172.21.15.90:0/716172283 >> 172.21.15.90:0/716172283 conn(0x7f67040cecf0 msgr2=0x7f67040cf0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:28.210 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:28.204+0000 7f670b93a700 1 -- 172.21.15.90:0/716172283 shutdown_connections 2023-06-09T04:41:28.211 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:28.204+0000 7f670b93a700 1 -- 172.21.15.90:0/716172283 wait complete. 2023-06-09T04:41:28.213 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:28.208+0000 7f670b93a700 1 Processor -- start 2023-06-09T04:41:28.213 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:28.208+0000 7f670b93a700 1 -- start start 2023-06-09T04:41:28.214 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:28.208+0000 7f670b93a700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f66f0003be0 0x7f67040ad7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:28.215 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:28.208+0000 7f670b93a700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f67040abce0 0x7f67040c85f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:28.215 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:28.208+0000 7f670b93a700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f67040c5dc0 0x7f67040c6230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:28.215 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:28.212+0000 7f670b93a700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f670414a1d0 con 0x7f67040abce0 2023-06-09T04:41:28.215 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:28.212+0000 7f670b93a700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67040c6770 con 0x7f66f0003be0 2023-06-09T04:41:28.215 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:28.212+0000 7f670b93a700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f670415b800 con 0x7f67040c5dc0 2023-06-09T04:41:28.216 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:28.212+0000 7f6708ed5700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f67040abce0 0x7f67040c85f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:28.217 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:28.212+0000 7f6708ed5700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f67040abce0 0x7f67040c85f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:36206/0 (socket says 172.21.15.90:36206) 2023-06-09T04:41:28.217 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:28.212+0000 7f6708ed5700 1 -- 172.21.15.90:0/283804726 learned_addr learned my addr 172.21.15.90:0/283804726 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:41:28.217 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:28.212+0000 7f67096d6700 1 --2- 172.21.15.90:0/283804726 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f66f0003be0 0x7f67040ad7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:28.217 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:28.212+0000 7f6709ed7700 1 --2- 172.21.15.90:0/283804726 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f67040c5dc0 0x7f67040c6230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:28.217 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:28.212+0000 7f6708ed5700 1 -- 172.21.15.90:0/283804726 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f67040c5dc0 msgr2=0x7f67040c6230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:28.217 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:28.212+0000 7f6708ed5700 1 --2- 172.21.15.90:0/283804726 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f67040c5dc0 0x7f67040c6230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:28.217 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:28.212+0000 7f6708ed5700 1 -- 172.21.15.90:0/283804726 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f66f0003be0 msgr2=0x7f67040ad7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:28.218 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:28.212+0000 7f6708ed5700 1 --2- 172.21.15.90:0/283804726 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f66f0003be0 0x7f67040ad7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:28.218 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:28.212+0000 7f6708ed5700 1 -- 172.21.15.90:0/283804726 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67040ae490 con 0x7f67040abce0 2023-06-09T04:41:28.218 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:28.212+0000 7f6708ed5700 1 --2- 172.21.15.90:0/283804726 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f67040abce0 0x7f67040c85f0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f66f4007310 tx=0x7f66f4007620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:28.218 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:28.212+0000 7f66f9ffb700 1 -- 172.21.15.90:0/283804726 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66f4001460 con 0x7f67040abce0 2023-06-09T04:41:28.218 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:28.212+0000 7f66f9ffb700 1 -- 172.21.15.90:0/283804726 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66f400f5a0 con 0x7f67040abce0 2023-06-09T04:41:28.218 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:28.212+0000 7f670b93a700 1 -- 172.21.15.90:0/283804726 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67040ac280 con 0x7f67040abce0 2023-06-09T04:41:28.218 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:28.212+0000 7f66f9ffb700 1 -- 172.21.15.90:0/283804726 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66f400f930 con 0x7f67040abce0 2023-06-09T04:41:28.219 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:28.212+0000 7f66f9ffb700 1 -- 172.21.15.90:0/283804726 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f66f400fd90 con 0x7f67040abce0 2023-06-09T04:41:28.219 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:28.212+0000 7f670b93a700 1 -- 172.21.15.90:0/283804726 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67040ae1b0 con 0x7f67040abce0 2023-06-09T04:41:28.219 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:28.212+0000 7f66f9ffb700 1 -- 172.21.15.90:0/283804726 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f66f401e920 con 0x7f67040abce0 2023-06-09T04:41:28.219 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:28.216+0000 7f670b93a700 1 -- 172.21.15.90:0/283804726 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f670404db30 con 0x7f67040abce0 2023-06-09T04:41:28.222 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:28.216+0000 7f66f9ffb700 1 -- 172.21.15.90:0/283804726 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f66f401a070 con 0x7f67040abce0 2023-06-09T04:41:28.329 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:28.324+0000 7f670b93a700 1 -- 172.21.15.90:0/283804726 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f670414d1b0 con 0x7f67040abce0 2023-06-09T04:41:28.334 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:28.328+0000 7f66f9ffb700 1 -- 172.21.15.90:0/283804726 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f66f401eae0 con 0x7f67040abce0 2023-06-09T04:41:28.336 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:28.332+0000 7f670b93a700 1 -- 172.21.15.90:0/283804726 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f67040abce0 msgr2=0x7f67040c85f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:28.337 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:28.332+0000 7f670b93a700 1 --2- 172.21.15.90:0/283804726 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f67040abce0 0x7f67040c85f0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f66f4007310 tx=0x7f66f4007620 comp rx=0 tx=0).stop 2023-06-09T04:41:28.337 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:28.332+0000 7f670b93a700 1 -- 172.21.15.90:0/283804726 shutdown_connections 2023-06-09T04:41:28.337 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:28.332+0000 7f670b93a700 1 --2- 172.21.15.90:0/283804726 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f67040c5dc0 0x7f67040c6230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:28.337 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:28.332+0000 7f670b93a700 1 --2- 172.21.15.90:0/283804726 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f67040abce0 0x7f67040c85f0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:28.337 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:28.332+0000 7f670b93a700 1 --2- 172.21.15.90:0/283804726 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f66f0003be0 0x7f67040ad7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:28.337 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:28.332+0000 7f670b93a700 1 -- 172.21.15.90:0/283804726 >> 172.21.15.90:0/283804726 conn(0x7f67040cecf0 msgr2=0x7f67040698b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:28.337 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:28.332+0000 7f670b93a700 1 -- 172.21.15.90:0/283804726 shutdown_connections 2023-06-09T04:41:28.338 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:28.332+0000 7f670b93a700 1 -- 172.21.15.90:0/283804726 wait complete. 2023-06-09T04:41:28.338 INFO:teuthology.orchestra.run.smithi090.stderr:adjusted tunables profile to default 2023-06-09T04:41:28.356 INFO:tasks.ceph:check_enable_crimson: False 2023-06-09T04:41:28.357 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-06-09T04:41:28.357 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2023-06-09T04:41:28.357 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-06-09T04:41:28.389 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2023-06-09T04:41:28.389 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-06-09T04:41:28.440 INFO:tasks.ceph.mgr.x.smithi174.stderr:2023-06-09T04:41:28.435+0000 7fc902ef92c0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-06-09T04:41:28.452 INFO:tasks.ceph.mgr.y.smithi090.stderr:2023-06-09T04:41:28.448+0000 7f36f99f92c0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-06-09T04:41:28.463 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2023-06-09T04:41:28.463 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-06-09T04:41:28.541 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2023-06-09T04:41:28.541 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-06-09T04:41:28.613 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2023-06-09T04:41:28.614 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-06-09T04:41:28.647 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2023-06-09T04:41:28.647 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-06-09T04:41:28.722 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2023-06-09T04:41:28.723 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-06-09T04:41:28.797 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2023-06-09T04:41:28.798 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-06-09T04:41:28.873 DEBUG:teuthology.orchestra.run.smithi174:> sudo ceph --cluster ceph osd new 46a4a7c5-babd-4ef3-9830-51487cff5eb4 0 2023-06-09T04:41:29.069 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.067+0000 7f328f59e700 1 Processor -- start 2023-06-09T04:41:29.070 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.067+0000 7f328f59e700 1 -- start start 2023-06-09T04:41:29.071 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.067+0000 7f328f59e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f32900d04e0 0x7f32900ccc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:29.072 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.067+0000 7f328f59e700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f32900d0fc0 0x7f3290165a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:29.072 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.067+0000 7f328f59e700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32900cdad0 con 0x7f329006a0a0 2023-06-09T04:41:29.072 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.067+0000 7f328f59e700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f329015c380 con 0x7f32900d0fc0 2023-06-09T04:41:29.072 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.067+0000 7f328f59e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f329006a580 con 0x7f32900d04e0 2023-06-09T04:41:29.073 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.067+0000 7f328ed9d700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f32900d0fc0 0x7f3290165a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:29.073 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.067+0000 7f328e59c700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f32900d04e0 0x7f32900ccc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:29.073 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.067+0000 7f328ed9d700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f32900d0fc0 0x7f3290165a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:47070/0 (socket says 172.21.15.174:47070) 2023-06-09T04:41:29.073 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.067+0000 7f328ed9d700 1 -- 172.21.15.174:0/2564341100 learned_addr learned my addr 172.21.15.174:0/2564341100 (peer_addr_for_me v2:172.21.15.174:0/0) 2023-06-09T04:41:29.074 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.067+0000 7f328ed9d700 1 -- 172.21.15.174:0/2564341100 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f32900d04e0 msgr2=0x7f32900ccc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:29.074 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.067+0000 7f328ed9d700 1 --2- 172.21.15.174:0/2564341100 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f32900d04e0 0x7f32900ccc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:29.074 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.067+0000 7f328ed9d700 1 -- 172.21.15.174:0/2564341100 >> v1:172.21.15.90:6789/0 conn(0x7f329006a0a0 legacy=0x7f32900d08b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:29.074 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.067+0000 7f328ed9d700 1 -- 172.21.15.174:0/2564341100 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32900cd480 con 0x7f32900d0fc0 2023-06-09T04:41:29.074 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.067+0000 7f328ed9d700 1 --2- 172.21.15.174:0/2564341100 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f32900d0fc0 0x7f3290165a40 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f3288009e50 tx=0x7f328800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9503aee67592e686 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:29.074 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.067+0000 7f328d59a700 1 -- 172.21.15.174:0/2564341100 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f328800e070 con 0x7f32900d0fc0 2023-06-09T04:41:29.074 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.067+0000 7f328d59a700 1 -- 172.21.15.174:0/2564341100 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3288003a40 con 0x7f32900d0fc0 2023-06-09T04:41:29.075 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.067+0000 7f328d59a700 1 -- 172.21.15.174:0/2564341100 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3288003df0 con 0x7f32900d0fc0 2023-06-09T04:41:29.075 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.071+0000 7f328f59e700 1 -- 172.21.15.174:0/2564341100 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f32900d0fc0 msgr2=0x7f3290165a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:29.075 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.071+0000 7f328f59e700 1 --2- 172.21.15.174:0/2564341100 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f32900d0fc0 0x7f3290165a40 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f3288009e50 tx=0x7f328800b330 comp rx=0 tx=0).stop 2023-06-09T04:41:29.076 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.071+0000 7f328f59e700 1 -- 172.21.15.174:0/2564341100 shutdown_connections 2023-06-09T04:41:29.076 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.071+0000 7f328f59e700 1 --2- 172.21.15.174:0/2564341100 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f32900d0fc0 0x7f3290165a40 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:29.076 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.071+0000 7f328f59e700 1 --2- 172.21.15.174:0/2564341100 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f32900d04e0 0x7f32900ccc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:29.076 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.071+0000 7f328f59e700 1 -- 172.21.15.174:0/2564341100 >> 172.21.15.174:0/2564341100 conn(0x7f32900cfcb0 msgr2=0x7f32900d25e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:29.076 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.071+0000 7f328f59e700 1 -- 172.21.15.174:0/2564341100 shutdown_connections 2023-06-09T04:41:29.076 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.071+0000 7f328f59e700 1 -- 172.21.15.174:0/2564341100 wait complete. 2023-06-09T04:41:29.077 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.071+0000 7f328f59e700 1 Processor -- start 2023-06-09T04:41:29.078 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.075+0000 7f328f59e700 1 -- start start 2023-06-09T04:41:29.079 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.075+0000 7f328f59e700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f329006a0a0 0x7f329015ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:29.079 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.075+0000 7f328f59e700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f32900d04e0 0x7f329015a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:29.079 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.075+0000 7f328f59e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f32900d0fc0 0x7f329015a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:29.079 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.075+0000 7f328f59e700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32900cb6f0 con 0x7f32900d04e0 2023-06-09T04:41:29.080 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.075+0000 7f328f59e700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f329015aef0 con 0x7f329006a0a0 2023-06-09T04:41:29.080 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.075+0000 7f328f59e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32900cb410 con 0x7f32900d0fc0 2023-06-09T04:41:29.081 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.075+0000 7f328ed9d700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f32900d0fc0 0x7f329015a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:29.081 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.075+0000 7f328ed9d700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f32900d0fc0 0x7f329015a9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.174:35848/0 (socket says 172.21.15.174:35848) 2023-06-09T04:41:29.081 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.075+0000 7f328ed9d700 1 -- 172.21.15.174:0/1180759506 learned_addr learned my addr 172.21.15.174:0/1180759506 (peer_addr_for_me v2:172.21.15.174:0/0) 2023-06-09T04:41:29.081 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.075+0000 7f328e59c700 1 --2- 172.21.15.174:0/1180759506 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f329006a0a0 0x7f329015ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:29.082 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.075+0000 7f328dd9b700 1 --2- 172.21.15.174:0/1180759506 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f32900d04e0 0x7f329015a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:29.082 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.075+0000 7f328ed9d700 1 -- 172.21.15.174:0/1180759506 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f329006a0a0 msgr2=0x7f329015ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:29.082 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.075+0000 7f328ed9d700 1 --2- 172.21.15.174:0/1180759506 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f329006a0a0 0x7f329015ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:29.082 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.075+0000 7f328ed9d700 1 -- 172.21.15.174:0/1180759506 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f32900d04e0 msgr2=0x7f329015a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:29.082 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.075+0000 7f328ed9d700 1 --2- 172.21.15.174:0/1180759506 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f32900d04e0 0x7f329015a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:29.082 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.075+0000 7f328ed9d700 1 -- 172.21.15.174:0/1180759506 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3288009b30 con 0x7f32900d0fc0 2023-06-09T04:41:29.082 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.075+0000 7f328e59c700 1 --2- 172.21.15.174:0/1180759506 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f329006a0a0 0x7f329015ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:41:29.083 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.075+0000 7f328ed9d700 1 --2- 172.21.15.174:0/1180759506 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f32900d0fc0 0x7f329015a9b0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f328800b680 tx=0x7f3288004af0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:29.083 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.075+0000 7f3286ffd700 1 -- 172.21.15.174:0/1180759506 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3288004440 con 0x7f32900d0fc0 2023-06-09T04:41:29.083 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.075+0000 7f3286ffd700 1 -- 172.21.15.174:0/1180759506 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32880045c0 con 0x7f32900d0fc0 2023-06-09T04:41:29.083 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.075+0000 7f3286ffd700 1 -- 172.21.15.174:0/1180759506 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3288004970 con 0x7f32900d0fc0 2023-06-09T04:41:29.083 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.075+0000 7f328f59e700 1 -- 172.21.15.174:0/1180759506 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3290158290 con 0x7f32900d0fc0 2023-06-09T04:41:29.083 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.075+0000 7f328f59e700 1 -- 172.21.15.174:0/1180759506 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3290158850 con 0x7f32900d0fc0 2023-06-09T04:41:29.084 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.079+0000 7f3286ffd700 1 -- 172.21.15.174:0/1180759506 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f3288025750 con 0x7f32900d0fc0 2023-06-09T04:41:29.084 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.079+0000 7f3286ffd700 1 -- 172.21.15.174:0/1180759506 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f3288012b10 con 0x7f32900d0fc0 2023-06-09T04:41:29.084 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.079+0000 7f328f59e700 1 -- 172.21.15.174:0/1180759506 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f329004e380 con 0x7f32900d0fc0 2023-06-09T04:41:29.087 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.083+0000 7f3286ffd700 1 -- 172.21.15.174:0/1180759506 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f3288043b00 con 0x7f32900d0fc0 2023-06-09T04:41:29.144 INFO:tasks.ceph.mgr.x.smithi174.stderr:2023-06-09T04:41:29.139+0000 7fc902ef92c0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-06-09T04:41:29.148 INFO:tasks.ceph.mgr.y.smithi090.stderr:2023-06-09T04:41:29.144+0000 7f36f99f92c0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-06-09T04:41:29.165 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.159+0000 7f328f59e700 1 -- 172.21.15.174:0/1180759506 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "osd new", "uuid": "46a4a7c5-babd-4ef3-9830-51487cff5eb4", "id": 0} v 0) v1 -- 0x7f32900ccd50 con 0x7f32900d0fc0 2023-06-09T04:41:29.176 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.171+0000 7f3286ffd700 1 -- 172.21.15.174:0/1180759506 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "46a4a7c5-babd-4ef3-9830-51487cff5eb4", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f3288032070 con 0x7f32900d0fc0 2023-06-09T04:41:29.177 INFO:teuthology.orchestra.run.smithi174.stdout:0 2023-06-09T04:41:29.178 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.175+0000 7f328f59e700 1 -- 172.21.15.174:0/1180759506 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f32900d0fc0 msgr2=0x7f329015a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:29.178 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.175+0000 7f328f59e700 1 --2- 172.21.15.174:0/1180759506 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f32900d0fc0 0x7f329015a9b0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f328800b680 tx=0x7f3288004af0 comp rx=0 tx=0).stop 2023-06-09T04:41:29.179 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.175+0000 7f328f59e700 1 -- 172.21.15.174:0/1180759506 shutdown_connections 2023-06-09T04:41:29.179 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.175+0000 7f328f59e700 1 --2- 172.21.15.174:0/1180759506 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f32900d0fc0 0x7f329015a9b0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:29.179 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.175+0000 7f328f59e700 1 --2- 172.21.15.174:0/1180759506 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f32900d04e0 0x7f329015a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:29.179 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.175+0000 7f328f59e700 1 --2- 172.21.15.174:0/1180759506 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f329006a0a0 0x7f329015ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:29.180 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.175+0000 7f328f59e700 1 -- 172.21.15.174:0/1180759506 >> 172.21.15.174:0/1180759506 conn(0x7f32900cfcb0 msgr2=0x7f32900b5410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:29.180 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.175+0000 7f328f59e700 1 -- 172.21.15.174:0/1180759506 shutdown_connections 2023-06-09T04:41:29.180 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.175+0000 7f328f59e700 1 -- 172.21.15.174:0/1180759506 wait complete. 2023-06-09T04:41:29.197 DEBUG:teuthology.orchestra.run.smithi174:> sudo ceph --cluster ceph osd new 1543988f-c498-494a-a6f9-fac8413db6ea 1 2023-06-09T04:41:29.222 INFO:tasks.ceph.mgr.x.smithi174.stderr:2023-06-09T04:41:29.219+0000 7fc902ef92c0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-06-09T04:41:29.228 INFO:tasks.ceph.mgr.y.smithi090.stderr:2023-06-09T04:41:29.224+0000 7f36f99f92c0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-06-09T04:41:29.351 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.347+0000 7fc385ae4700 1 Processor -- start 2023-06-09T04:41:29.351 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.347+0000 7fc385ae4700 1 -- start start 2023-06-09T04:41:29.353 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.347+0000 7fc385ae4700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc380158ae0 0x7fc38006af50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:29.353 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.347+0000 7fc385ae4700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc3800ad840 0x7fc3800cd610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:29.353 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.347+0000 7fc385ae4700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3800cdf90 con 0x7fc3800cdb50 2023-06-09T04:41:29.353 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.347+0000 7fc385ae4700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3800adc70 con 0x7fc380158ae0 2023-06-09T04:41:29.353 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.347+0000 7fc385ae4700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3800cc1d0 con 0x7fc3800ad840 2023-06-09T04:41:29.354 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.347+0000 7fc37ffff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc3800ad840 0x7fc3800cd610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:29.354 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.347+0000 7fc37ffff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc3800ad840 0x7fc3800cd610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.174:35856/0 (socket says 172.21.15.174:35856) 2023-06-09T04:41:29.354 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.347+0000 7fc37ffff700 1 -- 172.21.15.174:0/3041421779 learned_addr learned my addr 172.21.15.174:0/3041421779 (peer_addr_for_me v2:172.21.15.174:0/0) 2023-06-09T04:41:29.355 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.347+0000 7fc384ae2700 1 --2- 172.21.15.174:0/3041421779 >> v2:172.21.15.174:3300/0 conn(0x7fc380158ae0 0x7fc38006af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:29.355 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.351+0000 7fc37ffff700 1 -- 172.21.15.174:0/3041421779 >> v2:172.21.15.174:3300/0 conn(0x7fc380158ae0 msgr2=0x7fc38006af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:29.355 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.351+0000 7fc37ffff700 1 --2- 172.21.15.174:0/3041421779 >> v2:172.21.15.174:3300/0 conn(0x7fc380158ae0 0x7fc38006af50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:29.355 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.351+0000 7fc37ffff700 1 -- 172.21.15.174:0/3041421779 >> v1:172.21.15.174:6789/0 conn(0x7fc3800cdb50 legacy=0x7fc38015c750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:29.355 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.351+0000 7fc37ffff700 1 -- 172.21.15.174:0/3041421779 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3800cc3e0 con 0x7fc3800ad840 2023-06-09T04:41:29.355 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.351+0000 7fc37f7fe700 1 -- 172.21.15.174:0/3041421779 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4186802908 0 0) 0x7fc3800cdf90 con 0x7fc3800cdb50 2023-06-09T04:41:29.356 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.351+0000 7fc37ffff700 1 --2- 172.21.15.174:0/3041421779 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc3800ad840 0x7fc3800cd610 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fc36c00b9c0 tx=0x7fc36c00bcd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7fcb69b107e42d24 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:29.356 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.351+0000 7fc37f7fe700 1 -- 172.21.15.174:0/3041421779 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc36c00cc60 con 0x7fc3800ad840 2023-06-09T04:41:29.356 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.351+0000 7fc37f7fe700 1 -- 172.21.15.174:0/3041421779 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc36c00cdc0 con 0x7fc3800ad840 2023-06-09T04:41:29.356 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.351+0000 7fc37f7fe700 1 -- 172.21.15.174:0/3041421779 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc36c00f680 con 0x7fc3800ad840 2023-06-09T04:41:29.357 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.351+0000 7fc385ae4700 1 -- 172.21.15.174:0/3041421779 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc3800ad840 msgr2=0x7fc3800cd610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:29.357 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.351+0000 7fc385ae4700 1 --2- 172.21.15.174:0/3041421779 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc3800ad840 0x7fc3800cd610 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fc36c00b9c0 tx=0x7fc36c00bcd0 comp rx=0 tx=0).stop 2023-06-09T04:41:29.357 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.351+0000 7fc385ae4700 1 -- 172.21.15.174:0/3041421779 shutdown_connections 2023-06-09T04:41:29.357 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.351+0000 7fc385ae4700 1 --2- 172.21.15.174:0/3041421779 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc3800ad840 0x7fc3800cd610 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:29.358 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.351+0000 7fc385ae4700 1 --2- 172.21.15.174:0/3041421779 >> v2:172.21.15.174:3300/0 conn(0x7fc380158ae0 0x7fc38006af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:29.358 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.351+0000 7fc385ae4700 1 -- 172.21.15.174:0/3041421779 >> 172.21.15.174:0/3041421779 conn(0x7fc3800afe40 msgr2=0x7fc3800b0240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:29.358 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.351+0000 7fc385ae4700 1 -- 172.21.15.174:0/3041421779 shutdown_connections 2023-06-09T04:41:29.358 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.351+0000 7fc385ae4700 1 -- 172.21.15.174:0/3041421779 wait complete. 2023-06-09T04:41:29.359 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.355+0000 7fc385ae4700 1 Processor -- start 2023-06-09T04:41:29.360 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.355+0000 7fc385ae4700 1 -- start start 2023-06-09T04:41:29.361 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.355+0000 7fc385ae4700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc3800ad840 0x7fc380157a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:29.361 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.355+0000 7fc385ae4700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc3800cdb50 0x7fc38009bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:29.361 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.355+0000 7fc385ae4700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc380158ae0 0x7fc38009a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:29.362 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.355+0000 7fc385ae4700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc38009c1c0 con 0x7fc3800ad840 2023-06-09T04:41:29.362 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.355+0000 7fc385ae4700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc38009abe0 con 0x7fc3800cdb50 2023-06-09T04:41:29.362 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.355+0000 7fc385ae4700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc38009aec0 con 0x7fc380158ae0 2023-06-09T04:41:29.363 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.359+0000 7fc3852e3700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc380158ae0 0x7fc38009a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:29.363 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.359+0000 7fc37ffff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc3800cdb50 0x7fc38009bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:29.363 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.359+0000 7fc37ffff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc3800cdb50 0x7fc38009bc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:47098/0 (socket says 172.21.15.174:47098) 2023-06-09T04:41:29.363 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.359+0000 7fc3852e3700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc380158ae0 0x7fc38009a300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.174:35866/0 (socket says 172.21.15.174:35866) 2023-06-09T04:41:29.363 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.359+0000 7fc37ffff700 1 -- 172.21.15.174:0/3738931172 learned_addr learned my addr 172.21.15.174:0/3738931172 (peer_addr_for_me v2:172.21.15.174:0/0) 2023-06-09T04:41:29.364 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.359+0000 7fc384ae2700 1 --2- 172.21.15.174:0/3738931172 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc3800ad840 0x7fc380157a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:29.364 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.359+0000 7fc3852e3700 1 -- 172.21.15.174:0/3738931172 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc3800cdb50 msgr2=0x7fc38009bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:29.364 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.359+0000 7fc3852e3700 1 --2- 172.21.15.174:0/3738931172 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc3800cdb50 0x7fc38009bc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:29.364 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.359+0000 7fc3852e3700 1 -- 172.21.15.174:0/3738931172 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc3800ad840 msgr2=0x7fc380157a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:29.364 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.359+0000 7fc3852e3700 1 --2- 172.21.15.174:0/3738931172 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc3800ad840 0x7fc380157a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:29.364 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.359+0000 7fc3852e3700 1 -- 172.21.15.174:0/3738931172 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc36c00b620 con 0x7fc380158ae0 2023-06-09T04:41:29.364 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.359+0000 7fc384ae2700 1 --2- 172.21.15.174:0/3738931172 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc3800ad840 0x7fc380157a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:41:29.365 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.359+0000 7fc37ffff700 1 --2- 172.21.15.174:0/3738931172 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc3800cdb50 0x7fc38009bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:41:29.365 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.359+0000 7fc3852e3700 1 --2- 172.21.15.174:0/3738931172 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc380158ae0 0x7fc38009a300 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fc37800cbb0 tx=0x7fc37800cec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:29.365 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.359+0000 7fc37d7fa700 1 -- 172.21.15.174:0/3738931172 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc378003e50 con 0x7fc380158ae0 2023-06-09T04:41:29.366 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.359+0000 7fc37d7fa700 1 -- 172.21.15.174:0/3738931172 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc37800a6f0 con 0x7fc380158ae0 2023-06-09T04:41:29.366 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.359+0000 7fc37d7fa700 1 -- 172.21.15.174:0/3738931172 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc37800aaa0 con 0x7fc380158ae0 2023-06-09T04:41:29.366 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.359+0000 7fc385ae4700 1 -- 172.21.15.174:0/3738931172 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc38009b1a0 con 0x7fc380158ae0 2023-06-09T04:41:29.366 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.359+0000 7fc385ae4700 1 -- 172.21.15.174:0/3738931172 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc38009b760 con 0x7fc380158ae0 2023-06-09T04:41:29.366 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.359+0000 7fc37d7fa700 1 -- 172.21.15.174:0/3738931172 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fc378005070 con 0x7fc380158ae0 2023-06-09T04:41:29.366 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.359+0000 7fc37d7fa700 1 -- 172.21.15.174:0/3738931172 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7fc37801ca50 con 0x7fc380158ae0 2023-06-09T04:41:29.366 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.359+0000 7fc385ae4700 1 -- 172.21.15.174:0/3738931172 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc38004e380 con 0x7fc380158ae0 2023-06-09T04:41:29.370 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.367+0000 7fc37d7fa700 1 -- 172.21.15.174:0/3738931172 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7fc378017070 con 0x7fc380158ae0 2023-06-09T04:41:29.398 INFO:tasks.ceph.mgr.y.smithi090.stderr:2023-06-09T04:41:29.392+0000 7f36f99f92c0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-06-09T04:41:29.409 INFO:tasks.ceph.mgr.x.smithi174.stderr:2023-06-09T04:41:29.403+0000 7fc902ef92c0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-06-09T04:41:29.449 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.443+0000 7fc385ae4700 1 -- 172.21.15.174:0/3738931172 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "osd new", "uuid": "1543988f-c498-494a-a6f9-fac8413db6ea", "id": 1} v 0) v1 -- 0x7fc3800b0cf0 con 0x7fc380158ae0 2023-06-09T04:41:29.458 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.455+0000 7fc37d7fa700 1 -- 172.21.15.174:0/3738931172 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1543988f-c498-494a-a6f9-fac8413db6ea", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7fc378005460 con 0x7fc380158ae0 2023-06-09T04:41:29.458 INFO:teuthology.orchestra.run.smithi174.stdout:1 2023-06-09T04:41:29.459 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.455+0000 7fc385ae4700 1 -- 172.21.15.174:0/3738931172 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc380158ae0 msgr2=0x7fc38009a300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:29.459 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.455+0000 7fc385ae4700 1 --2- 172.21.15.174:0/3738931172 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc380158ae0 0x7fc38009a300 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fc37800cbb0 tx=0x7fc37800cec0 comp rx=0 tx=0).stop 2023-06-09T04:41:29.460 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.455+0000 7fc385ae4700 1 -- 172.21.15.174:0/3738931172 shutdown_connections 2023-06-09T04:41:29.460 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.455+0000 7fc385ae4700 1 --2- 172.21.15.174:0/3738931172 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc380158ae0 0x7fc38009a300 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:29.460 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.455+0000 7fc385ae4700 1 --2- 172.21.15.174:0/3738931172 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc3800cdb50 0x7fc38009bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:29.460 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.455+0000 7fc385ae4700 1 --2- 172.21.15.174:0/3738931172 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc3800ad840 0x7fc380157a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:29.461 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.455+0000 7fc385ae4700 1 -- 172.21.15.174:0/3738931172 >> 172.21.15.174:0/3738931172 conn(0x7fc3800afe40 msgr2=0x7fc380070550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:29.461 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.455+0000 7fc385ae4700 1 -- 172.21.15.174:0/3738931172 shutdown_connections 2023-06-09T04:41:29.461 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.455+0000 7fc385ae4700 1 -- 172.21.15.174:0/3738931172 wait complete. 2023-06-09T04:41:29.480 DEBUG:teuthology.orchestra.run.smithi174:> sudo ceph --cluster ceph osd new 79669dd6-ffc8-4197-b9f7-b3b372b2b9b4 2 2023-06-09T04:41:29.651 INFO:tasks.ceph.mgr.y.smithi090.stderr:2023-06-09T04:41:29.648+0000 7f36f99f92c0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-06-09T04:41:29.681 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.675+0000 7ff29f59e700 1 Processor -- start 2023-06-09T04:41:29.681 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.675+0000 7ff29f59e700 1 -- start start 2023-06-09T04:41:29.682 INFO:tasks.ceph.mgr.x.smithi174.stderr:2023-06-09T04:41:29.679+0000 7fc902ef92c0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-06-09T04:41:29.683 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.679+0000 7ff29f59e700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ff2a00cdd20 0x7ff2a006af50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:29.683 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.679+0000 7ff29f59e700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2a00cc3e0 con 0x7ff2a00ad840 2023-06-09T04:41:29.684 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.679+0000 7ff29f59e700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2a00cc6c0 con 0x7ff2a0158ae0 2023-06-09T04:41:29.684 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.679+0000 7ff29f59e700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2a00cc1d0 con 0x7ff2a00cdd20 2023-06-09T04:41:29.684 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.679+0000 7ff29dd9b700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ff2a00cdd20 0x7ff2a006af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:29.684 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.679+0000 7ff29dd9b700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ff2a00cdd20 0x7ff2a006af50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:47110/0 (socket says 172.21.15.174:47110) 2023-06-09T04:41:29.684 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.679+0000 7ff29dd9b700 1 -- 172.21.15.174:0/703284334 learned_addr learned my addr 172.21.15.174:0/703284334 (peer_addr_for_me v2:172.21.15.174:0/0) 2023-06-09T04:41:29.684 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.679+0000 7ff29dd9b700 1 -- 172.21.15.174:0/703284334 >> v1:172.21.15.174:6789/0 conn(0x7ff2a0158ae0 legacy=0x7ff2a00cd610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:29.686 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.679+0000 7ff29dd9b700 1 -- 172.21.15.174:0/703284334 >> v1:172.21.15.90:6789/0 conn(0x7ff2a00ad840 legacy=0x7ff2a0069820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:29.686 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.679+0000 7ff29dd9b700 1 -- 172.21.15.174:0/703284334 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2a00cc9a0 con 0x7ff2a00cdd20 2023-06-09T04:41:29.686 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.679+0000 7ff29dd9b700 1 --2- 172.21.15.174:0/703284334 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff2a00cdd20 0x7ff2a006af50 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7ff294009910 tx=0x7ff294009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e6865f43e59ad29b server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:29.686 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.679+0000 7ff29d59a700 1 -- 172.21.15.174:0/703284334 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff294004230 con 0x7ff2a00cdd20 2023-06-09T04:41:29.686 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.679+0000 7ff29d59a700 1 -- 172.21.15.174:0/703284334 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff294004390 con 0x7ff2a00cdd20 2023-06-09T04:41:29.687 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.679+0000 7ff29d59a700 1 -- 172.21.15.174:0/703284334 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff294009e60 con 0x7ff2a00cdd20 2023-06-09T04:41:29.687 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.679+0000 7ff29f59e700 1 -- 172.21.15.174:0/703284334 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff2a00cdd20 msgr2=0x7ff2a006af50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:29.687 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.679+0000 7ff29f59e700 1 --2- 172.21.15.174:0/703284334 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff2a00cdd20 0x7ff2a006af50 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7ff294009910 tx=0x7ff294009c20 comp rx=0 tx=0).stop 2023-06-09T04:41:29.687 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.683+0000 7ff29f59e700 1 -- 172.21.15.174:0/703284334 shutdown_connections 2023-06-09T04:41:29.687 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.683+0000 7ff29f59e700 1 --2- 172.21.15.174:0/703284334 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff2a00cdd20 0x7ff2a006af50 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:29.687 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.683+0000 7ff29f59e700 1 -- 172.21.15.174:0/703284334 >> 172.21.15.174:0/703284334 conn(0x7ff2a00afe40 msgr2=0x7ff2a00b0240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:29.687 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.683+0000 7ff29f59e700 1 -- 172.21.15.174:0/703284334 shutdown_connections 2023-06-09T04:41:29.688 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.683+0000 7ff29f59e700 1 -- 172.21.15.174:0/703284334 wait complete. 2023-06-09T04:41:29.688 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.683+0000 7ff29f59e700 1 Processor -- start 2023-06-09T04:41:29.688 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.683+0000 7ff29f59e700 1 -- start start 2023-06-09T04:41:29.690 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.687+0000 7ff29f59e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff2a00ad840 0x7ff2a0154d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:29.690 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.687+0000 7ff29f59e700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff2a00cdd20 0x7ff2a01e7ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:29.690 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.687+0000 7ff29f59e700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff2a0158ae0 0x7ff2a0154470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:29.690 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.687+0000 7ff29f59e700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2a01e6de0 con 0x7ff2a00cdd20 2023-06-09T04:41:29.690 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.687+0000 7ff29f59e700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2a01e8790 con 0x7ff2a0158ae0 2023-06-09T04:41:29.690 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.687+0000 7ff29f59e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2a0155580 con 0x7ff2a00ad840 2023-06-09T04:41:29.692 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.687+0000 7ff29e59c700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff2a00ad840 0x7ff2a0154d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:29.692 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.687+0000 7ff29e59c700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff2a00ad840 0x7ff2a0154d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.174:35882/0 (socket says 172.21.15.174:35882) 2023-06-09T04:41:29.692 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.687+0000 7ff29e59c700 1 -- 172.21.15.174:0/447352748 learned_addr learned my addr 172.21.15.174:0/447352748 (peer_addr_for_me v2:172.21.15.174:0/0) 2023-06-09T04:41:29.693 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.687+0000 7ff29ed9d700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff2a0158ae0 0x7ff2a0154470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:29.693 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.687+0000 7ff29dd9b700 1 --2- 172.21.15.174:0/447352748 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff2a00cdd20 0x7ff2a01e7ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:29.693 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.687+0000 7ff29e59c700 1 -- 172.21.15.174:0/447352748 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff2a0158ae0 msgr2=0x7ff2a0154470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:29.693 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.687+0000 7ff29e59c700 1 --2- 172.21.15.174:0/447352748 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff2a0158ae0 0x7ff2a0154470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:29.693 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.687+0000 7ff29e59c700 1 -- 172.21.15.174:0/447352748 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff2a00cdd20 msgr2=0x7ff2a01e7ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:29.693 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.687+0000 7ff29e59c700 1 --2- 172.21.15.174:0/447352748 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff2a00cdd20 0x7ff2a01e7ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:29.693 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.687+0000 7ff29e59c700 1 -- 172.21.15.174:0/447352748 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff294009570 con 0x7ff2a00ad840 2023-06-09T04:41:29.694 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.687+0000 7ff29dd9b700 1 --2- 172.21.15.174:0/447352748 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff2a00cdd20 0x7ff2a01e7ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:41:29.694 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.687+0000 7ff29e59c700 1 --2- 172.21.15.174:0/447352748 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff2a00ad840 0x7ff2a0154d00 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7ff29000c530 tx=0x7ff29000c840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:29.694 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.687+0000 7ff28effd700 1 -- 172.21.15.174:0/447352748 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2900052d0 con 0x7ff2a00ad840 2023-06-09T04:41:29.694 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.687+0000 7ff28effd700 1 -- 172.21.15.174:0/447352748 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff290005430 con 0x7ff2a00ad840 2023-06-09T04:41:29.694 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.687+0000 7ff28effd700 1 -- 172.21.15.174:0/447352748 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2900055a0 con 0x7ff2a00ad840 2023-06-09T04:41:29.694 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.687+0000 7ff29f59e700 1 -- 172.21.15.174:0/447352748 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2a01e6a40 con 0x7ff2a00ad840 2023-06-09T04:41:29.694 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.687+0000 7ff29f59e700 1 -- 172.21.15.174:0/447352748 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2a01e84b0 con 0x7ff2a00ad840 2023-06-09T04:41:29.695 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.687+0000 7ff28effd700 1 -- 172.21.15.174:0/447352748 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7ff2900039a0 con 0x7ff2a00ad840 2023-06-09T04:41:29.695 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.687+0000 7ff28effd700 1 -- 172.21.15.174:0/447352748 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7ff290011c50 con 0x7ff2a00ad840 2023-06-09T04:41:29.695 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.687+0000 7ff29f59e700 1 -- 172.21.15.174:0/447352748 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2a01e68a0 con 0x7ff2a00ad840 2023-06-09T04:41:29.696 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.691+0000 7ff28effd700 1 -- 172.21.15.174:0/447352748 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7ff2a01e68a0 con 0x7ff2a00ad840 2023-06-09T04:41:29.728 INFO:tasks.ceph.mgr.y.smithi090.stderr:2023-06-09T04:41:29.724+0000 7f36f99f92c0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-06-09T04:41:29.769 INFO:tasks.ceph.mgr.x.smithi174.stderr:2023-06-09T04:41:29.763+0000 7fc902ef92c0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-06-09T04:41:29.772 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.767+0000 7ff29f59e700 1 -- 172.21.15.174:0/447352748 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "osd new", "uuid": "79669dd6-ffc8-4197-b9f7-b3b372b2b9b4", "id": 2} v 0) v1 -- 0x7ff2a01e6f20 con 0x7ff2a00ad840 2023-06-09T04:41:29.786 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.783+0000 7ff28effd700 1 -- 172.21.15.174:0/447352748 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "79669dd6-ffc8-4197-b9f7-b3b372b2b9b4", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7ff2a01e6f20 con 0x7ff2a00ad840 2023-06-09T04:41:29.786 INFO:teuthology.orchestra.run.smithi174.stdout:2 2023-06-09T04:41:29.788 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.783+0000 7ff29f59e700 1 -- 172.21.15.174:0/447352748 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff2a00ad840 msgr2=0x7ff2a0154d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:29.788 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.783+0000 7ff29f59e700 1 --2- 172.21.15.174:0/447352748 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff2a00ad840 0x7ff2a0154d00 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7ff29000c530 tx=0x7ff29000c840 comp rx=0 tx=0).stop 2023-06-09T04:41:29.788 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.783+0000 7ff29f59e700 1 -- 172.21.15.174:0/447352748 shutdown_connections 2023-06-09T04:41:29.788 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.783+0000 7ff29f59e700 1 --2- 172.21.15.174:0/447352748 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff2a0158ae0 0x7ff2a0154470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:29.788 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.783+0000 7ff29f59e700 1 --2- 172.21.15.174:0/447352748 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff2a00cdd20 0x7ff2a01e7ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:29.789 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.783+0000 7ff29f59e700 1 --2- 172.21.15.174:0/447352748 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff2a00ad840 0x7ff2a0154d00 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:29.789 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.783+0000 7ff29f59e700 1 -- 172.21.15.174:0/447352748 >> 172.21.15.174:0/447352748 conn(0x7ff2a00afe40 msgr2=0x7ff2a00cb0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:29.789 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.783+0000 7ff29f59e700 1 -- 172.21.15.174:0/447352748 shutdown_connections 2023-06-09T04:41:29.789 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.783+0000 7ff29f59e700 1 -- 172.21.15.174:0/447352748 wait complete. 2023-06-09T04:41:29.807 DEBUG:teuthology.orchestra.run.smithi174:> sudo ceph --cluster ceph osd new 4062ab6f-ce40-450a-aa17-b10098766c7b 3 2023-06-09T04:41:29.965 INFO:tasks.ceph.mgr.y.smithi090.stderr:2023-06-09T04:41:29.960+0000 7f36f99f92c0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-06-09T04:41:29.974 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.971+0000 7f2bfd337700 1 Processor -- start 2023-06-09T04:41:29.974 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.971+0000 7f2bfd337700 1 -- start start 2023-06-09T04:41:29.976 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.971+0000 7f2bfd337700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2bf806ce40 0x7f2bf80b1950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:29.976 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.971+0000 7f2bfd337700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f2bf8160560 0x7f2bf80d2400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:29.976 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.971+0000 7f2bfd337700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2bf80d2940 0x7f2bf80cefe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:29.976 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.971+0000 7f2bfd337700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bf8160ab0 con 0x7f2bf806ce40 2023-06-09T04:41:29.977 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.971+0000 7f2bfd337700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bf806d210 con 0x7f2bf8160560 2023-06-09T04:41:29.977 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.971+0000 7f2bfd337700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bf80b8080 con 0x7f2bf80d2940 2023-06-09T04:41:29.978 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.971+0000 7f2bf77fe700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f2bf8160560 0x7f2bf80d2400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:29.978 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.971+0000 7f2bfcb36700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2bf80d2940 0x7f2bf80cefe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:29.978 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.971+0000 7f2bfcb36700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2bf80d2940 0x7f2bf80cefe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.174:35886/0 (socket says 172.21.15.174:35886) 2023-06-09T04:41:29.979 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.971+0000 7f2bfcb36700 1 -- 172.21.15.174:0/1163191447 learned_addr learned my addr 172.21.15.174:0/1163191447 (peer_addr_for_me v2:172.21.15.174:0/0) 2023-06-09T04:41:29.979 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.971+0000 7f2bf7fff700 1 --2- 172.21.15.174:0/1163191447 >> v2:172.21.15.90:3300/0 conn(0x7f2bf806ce40 0x7f2bf80b1950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:29.979 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.971+0000 7f2bfcb36700 1 -- 172.21.15.174:0/1163191447 >> v2:172.21.15.174:3300/0 conn(0x7f2bf8160560 msgr2=0x7f2bf80d2400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:29.979 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.971+0000 7f2bfcb36700 1 --2- 172.21.15.174:0/1163191447 >> v2:172.21.15.174:3300/0 conn(0x7f2bf8160560 0x7f2bf80d2400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:29.979 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.971+0000 7f2bfcb36700 1 -- 172.21.15.174:0/1163191447 >> v2:172.21.15.90:3300/0 conn(0x7f2bf806ce40 msgr2=0x7f2bf80b1950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:29.979 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.971+0000 7f2bfcb36700 1 --2- 172.21.15.174:0/1163191447 >> v2:172.21.15.90:3300/0 conn(0x7f2bf806ce40 0x7f2bf80b1950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:29.979 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.971+0000 7f2bfcb36700 1 -- 172.21.15.174:0/1163191447 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bf80b8510 con 0x7f2bf80d2940 2023-06-09T04:41:29.980 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.971+0000 7f2bf7fff700 1 --2- 172.21.15.174:0/1163191447 >> v2:172.21.15.90:3300/0 conn(0x7f2bf806ce40 0x7f2bf80b1950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:41:29.980 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.975+0000 7f2bfcb36700 1 --2- 172.21.15.174:0/1163191447 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2bf80d2940 0x7f2bf80cefe0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f2bf808bfd0 tx=0x7f2bf0009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=af384db0f60ac916 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:29.980 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.975+0000 7f2bf6ffd700 1 -- 172.21.15.174:0/1163191447 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bf0011830 con 0x7f2bf80d2940 2023-06-09T04:41:29.980 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.975+0000 7f2bf6ffd700 1 -- 172.21.15.174:0/1163191447 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bf0011990 con 0x7f2bf80d2940 2023-06-09T04:41:29.980 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.975+0000 7f2bf6ffd700 1 -- 172.21.15.174:0/1163191447 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bf0011d40 con 0x7f2bf80d2940 2023-06-09T04:41:29.981 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.975+0000 7f2bfd337700 1 -- 172.21.15.174:0/1163191447 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2bf80d2940 msgr2=0x7f2bf80cefe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:29.981 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.975+0000 7f2bfd337700 1 --2- 172.21.15.174:0/1163191447 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2bf80d2940 0x7f2bf80cefe0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f2bf808bfd0 tx=0x7f2bf0009c20 comp rx=0 tx=0).stop 2023-06-09T04:41:29.981 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.975+0000 7f2bfd337700 1 -- 172.21.15.174:0/1163191447 shutdown_connections 2023-06-09T04:41:29.981 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.975+0000 7f2bfd337700 1 --2- 172.21.15.174:0/1163191447 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2bf80d2940 0x7f2bf80cefe0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:29.981 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.975+0000 7f2bfd337700 1 --2- 172.21.15.174:0/1163191447 >> v2:172.21.15.174:3300/0 conn(0x7f2bf8160560 0x7f2bf80d2400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:29.982 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.975+0000 7f2bfd337700 1 --2- 172.21.15.174:0/1163191447 >> v2:172.21.15.90:3300/0 conn(0x7f2bf806ce40 0x7f2bf80b1950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:29.982 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.975+0000 7f2bfd337700 1 -- 172.21.15.174:0/1163191447 >> 172.21.15.174:0/1163191447 conn(0x7f2bf809b960 msgr2=0x7f2bf80b5560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:29.982 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.975+0000 7f2bfd337700 1 -- 172.21.15.174:0/1163191447 shutdown_connections 2023-06-09T04:41:29.982 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.975+0000 7f2bfd337700 1 -- 172.21.15.174:0/1163191447 wait complete. 2023-06-09T04:41:29.982 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.979+0000 7f2bfd337700 1 Processor -- start 2023-06-09T04:41:29.983 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.979+0000 7f2bfd337700 1 -- start start 2023-06-09T04:41:29.984 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.979+0000 7f2bfd337700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2bf806ce40 0x7f2bf80cb870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:29.984 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.979+0000 7f2bfd337700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2bf80d2940 0x7f2bf8149bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:29.984 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.979+0000 7f2bfd337700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2bf8160560 0x7f2bf814a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:29.984 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.979+0000 7f2bfd337700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bf814ff30 con 0x7f2bf8160560 2023-06-09T04:41:29.984 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.979+0000 7f2bfd337700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bf80ca7d0 con 0x7f2bf80d2940 2023-06-09T04:41:29.984 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.979+0000 7f2bfd337700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bf80caab0 con 0x7f2bf806ce40 2023-06-09T04:41:29.985 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.979+0000 7f2bf7fff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2bf806ce40 0x7f2bf80cb870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:29.985 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.979+0000 7f2bf7fff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2bf806ce40 0x7f2bf80cb870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.174:35900/0 (socket says 172.21.15.174:35900) 2023-06-09T04:41:29.985 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.979+0000 7f2bf7fff700 1 -- 172.21.15.174:0/432400010 learned_addr learned my addr 172.21.15.174:0/432400010 (peer_addr_for_me v2:172.21.15.174:0/0) 2023-06-09T04:41:29.985 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.979+0000 7f2bf77fe700 1 --2- 172.21.15.174:0/432400010 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2bf80d2940 0x7f2bf8149bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:29.986 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.979+0000 7f2bfcb36700 1 --2- 172.21.15.174:0/432400010 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2bf8160560 0x7f2bf814a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:29.987 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.979+0000 7f2bf7fff700 1 -- 172.21.15.174:0/432400010 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2bf80d2940 msgr2=0x7f2bf8149bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:29.987 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.979+0000 7f2bf7fff700 1 --2- 172.21.15.174:0/432400010 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2bf80d2940 0x7f2bf8149bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:29.987 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.979+0000 7f2bf7fff700 1 -- 172.21.15.174:0/432400010 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2bf8160560 msgr2=0x7f2bf814a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:29.987 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.979+0000 7f2bf7fff700 1 --2- 172.21.15.174:0/432400010 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2bf8160560 0x7f2bf814a130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:29.987 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.979+0000 7f2bf7fff700 1 -- 172.21.15.174:0/432400010 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bf0009570 con 0x7f2bf806ce40 2023-06-09T04:41:29.987 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.979+0000 7f2bf77fe700 1 --2- 172.21.15.174:0/432400010 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2bf80d2940 0x7f2bf8149bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:41:29.987 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.979+0000 7f2bfcb36700 1 --2- 172.21.15.174:0/432400010 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2bf8160560 0x7f2bf814a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:41:29.988 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.979+0000 7f2bf7fff700 1 --2- 172.21.15.174:0/432400010 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2bf806ce40 0x7f2bf80cb870 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f2be8007e10 tx=0x7f2be800d3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:29.988 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.979+0000 7f2bf4ff9700 1 -- 172.21.15.174:0/432400010 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2be800de90 con 0x7f2bf806ce40 2023-06-09T04:41:29.988 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.979+0000 7f2bf4ff9700 1 -- 172.21.15.174:0/432400010 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2be800f040 con 0x7f2bf806ce40 2023-06-09T04:41:29.988 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.979+0000 7f2bf4ff9700 1 -- 172.21.15.174:0/432400010 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2be8003c60 con 0x7f2bf806ce40 2023-06-09T04:41:29.988 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.979+0000 7f2bfd337700 1 -- 172.21.15.174:0/432400010 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bf80cad90 con 0x7f2bf806ce40 2023-06-09T04:41:29.988 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.983+0000 7f2bfd337700 1 -- 172.21.15.174:0/432400010 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bf80cb350 con 0x7f2bf806ce40 2023-06-09T04:41:29.988 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.983+0000 7f2bf4ff9700 1 -- 172.21.15.174:0/432400010 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f2be8004330 con 0x7f2bf806ce40 2023-06-09T04:41:29.988 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.983+0000 7f2bf4ff9700 1 -- 172.21.15.174:0/432400010 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f2be8003dc0 con 0x7f2bf806ce40 2023-06-09T04:41:29.989 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.983+0000 7f2bfd337700 1 -- 172.21.15.174:0/432400010 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bf804e380 con 0x7f2bf806ce40 2023-06-09T04:41:29.989 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:29.983+0000 7f2bf4ff9700 1 -- 172.21.15.174:0/432400010 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f2be8024060 con 0x7f2bf806ce40 2023-06-09T04:41:30.016 INFO:tasks.ceph.mgr.x.smithi174.stderr:2023-06-09T04:41:30.011+0000 7fc902ef92c0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-06-09T04:41:30.053 INFO:tasks.ceph.mgr.y.smithi090.stderr:2023-06-09T04:41:30.048+0000 7f36f99f92c0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-06-09T04:41:30.066 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.063+0000 7f2bfd337700 1 -- 172.21.15.174:0/432400010 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "osd new", "uuid": "4062ab6f-ce40-450a-aa17-b10098766c7b", "id": 3} v 0) v1 -- 0x7f2bf80d3360 con 0x7f2bf806ce40 2023-06-09T04:41:30.079 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.075+0000 7f2bf4ff9700 1 -- 172.21.15.174:0/432400010 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4062ab6f-ce40-450a-aa17-b10098766c7b", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f2be801a070 con 0x7f2bf806ce40 2023-06-09T04:41:30.079 INFO:teuthology.orchestra.run.smithi174.stdout:3 2023-06-09T04:41:30.081 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.075+0000 7f2bfd337700 1 -- 172.21.15.174:0/432400010 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2bf806ce40 msgr2=0x7f2bf80cb870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:30.081 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.075+0000 7f2bfd337700 1 --2- 172.21.15.174:0/432400010 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2bf806ce40 0x7f2bf80cb870 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f2be8007e10 tx=0x7f2be800d3b0 comp rx=0 tx=0).stop 2023-06-09T04:41:30.081 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.075+0000 7f2bfd337700 1 -- 172.21.15.174:0/432400010 shutdown_connections 2023-06-09T04:41:30.081 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.075+0000 7f2bfd337700 1 --2- 172.21.15.174:0/432400010 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2bf8160560 0x7f2bf814a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:30.081 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.075+0000 7f2bfd337700 1 --2- 172.21.15.174:0/432400010 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2bf80d2940 0x7f2bf8149bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:30.081 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.075+0000 7f2bfd337700 1 --2- 172.21.15.174:0/432400010 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2bf806ce40 0x7f2bf80cb870 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:30.081 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.075+0000 7f2bfd337700 1 -- 172.21.15.174:0/432400010 >> 172.21.15.174:0/432400010 conn(0x7f2bf809b960 msgr2=0x7f2bf80b0750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:30.082 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.075+0000 7f2bfd337700 1 -- 172.21.15.174:0/432400010 shutdown_connections 2023-06-09T04:41:30.082 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.075+0000 7f2bfd337700 1 -- 172.21.15.174:0/432400010 wait complete. 2023-06-09T04:41:30.099 DEBUG:teuthology.orchestra.run.smithi174:> sudo ceph --cluster ceph osd new a10820e4-b348-4d92-9796-3b01484ace1c 4 2023-06-09T04:41:30.107 INFO:tasks.ceph.mgr.x.smithi174.stderr:2023-06-09T04:41:30.103+0000 7fc902ef92c0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-06-09T04:41:30.143 INFO:tasks.ceph.mgr.y.smithi090.stderr:2023-06-09T04:41:30.140+0000 7f36f99f92c0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-06-09T04:41:30.205 INFO:tasks.ceph.mgr.x.smithi174.stderr:2023-06-09T04:41:30.199+0000 7fc902ef92c0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-06-09T04:41:30.263 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.259+0000 7f3341baf700 1 Processor -- start 2023-06-09T04:41:30.263 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.259+0000 7f3341baf700 1 -- start start 2023-06-09T04:41:30.264 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.259+0000 7f3341baf700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f333c15a010 0x7f333c06bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:30.264 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.259+0000 7f3341baf700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f333c0ccc60 0x7f333c070a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:30.264 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.259+0000 7f3341baf700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f333c06c820 con 0x7f333c06c1a0 2023-06-09T04:41:30.264 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.259+0000 7f3341baf700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f333c06d0c0 con 0x7f333c15a010 2023-06-09T04:41:30.264 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.259+0000 7f3341baf700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f333c06c620 con 0x7f333c0ccc60 2023-06-09T04:41:30.265 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.259+0000 7f333bfff700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f333c06c1a0 0x7f333c0cc550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.174:35950/0 (socket says 172.21.15.174:35950) 2023-06-09T04:41:30.266 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.259+0000 7f333bfff700 1 -- 172.21.15.174:0/584380357 learned_addr learned my addr 172.21.15.174:0/584380357 (peer_addr_for_me v1:172.21.15.174:0/0) 2023-06-09T04:41:30.266 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.259+0000 7f33413ae700 1 --2- 172.21.15.174:0/584380357 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f333c0ccc60 0x7f333c070a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:30.266 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.259+0000 7f3340bad700 1 --2- 172.21.15.174:0/584380357 >> v2:172.21.15.90:3300/0 conn(0x7f333c15a010 0x7f333c06bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:30.266 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.259+0000 7f333b7fe700 1 -- 172.21.15.174:0/584380357 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1491851329 0 0) 0x7f333c06c820 con 0x7f333c06c1a0 2023-06-09T04:41:30.266 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.259+0000 7f333b7fe700 1 -- 172.21.15.174:0/584380357 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f332c0035d0 con 0x7f333c06c1a0 2023-06-09T04:41:30.266 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.259+0000 7f33413ae700 1 -- 172.21.15.174:0/584380357 >> v2:172.21.15.90:3300/0 conn(0x7f333c15a010 msgr2=0x7f333c06bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:30.267 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.259+0000 7f33413ae700 1 --2- 172.21.15.174:0/584380357 >> v2:172.21.15.90:3300/0 conn(0x7f333c15a010 0x7f333c06bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:30.267 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.259+0000 7f33413ae700 1 -- 172.21.15.174:0/584380357 >> v1:172.21.15.174:6789/0 conn(0x7f333c06c1a0 legacy=0x7f333c0cc550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:30.267 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.259+0000 7f33413ae700 1 -- 172.21.15.174:0/584380357 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f333c06cb00 con 0x7f333c0ccc60 2023-06-09T04:41:30.267 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.263+0000 7f33413ae700 1 --2- 172.21.15.174:0/584380357 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f333c0ccc60 0x7f333c070a50 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f3334009d90 tx=0x7f333400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dc9b5a0543fc48de server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:30.268 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.263+0000 7f333b7fe700 1 -- 172.21.15.174:0/584380357 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f333400e070 con 0x7f333c0ccc60 2023-06-09T04:41:30.268 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.263+0000 7f333b7fe700 1 -- 172.21.15.174:0/584380357 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f333400bb20 con 0x7f333c0ccc60 2023-06-09T04:41:30.268 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.263+0000 7f333b7fe700 1 -- 172.21.15.174:0/584380357 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3334012430 con 0x7f333c0ccc60 2023-06-09T04:41:30.268 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.263+0000 7f3341baf700 1 -- 172.21.15.174:0/584380357 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f333c0ccc60 msgr2=0x7f333c070a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:30.268 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.263+0000 7f3341baf700 1 --2- 172.21.15.174:0/584380357 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f333c0ccc60 0x7f333c070a50 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f3334009d90 tx=0x7f333400b330 comp rx=0 tx=0).stop 2023-06-09T04:41:30.269 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.263+0000 7f3341baf700 1 -- 172.21.15.174:0/584380357 shutdown_connections 2023-06-09T04:41:30.269 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.263+0000 7f3341baf700 1 --2- 172.21.15.174:0/584380357 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f333c0ccc60 0x7f333c070a50 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:30.269 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.263+0000 7f3341baf700 1 --2- 172.21.15.174:0/584380357 >> v2:172.21.15.90:3300/0 conn(0x7f333c15a010 0x7f333c06bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:30.269 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.263+0000 7f3341baf700 1 -- 172.21.15.174:0/584380357 >> 172.21.15.174:0/584380357 conn(0x7f333c0afe40 msgr2=0x7f333c0b0240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:30.269 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.263+0000 7f3341baf700 1 -- 172.21.15.174:0/584380357 shutdown_connections 2023-06-09T04:41:30.269 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.263+0000 7f3341baf700 1 -- 172.21.15.174:0/584380357 wait complete. 2023-06-09T04:41:30.270 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.267+0000 7f3341baf700 1 Processor -- start 2023-06-09T04:41:30.271 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.267+0000 7f3341baf700 1 -- start start 2023-06-09T04:41:30.273 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.267+0000 7f3341baf700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f333c06c1a0 0x7f333c15a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:30.273 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.267+0000 7f3341baf700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f333c0ccc60 0x7f333c0704b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:30.273 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.267+0000 7f3341baf700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f333c15a010 0x7f333c0c42c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:30.273 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.267+0000 7f3341baf700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f333c1f2570 con 0x7f333c15a010 2023-06-09T04:41:30.273 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.267+0000 7f3341baf700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f333c1f19f0 con 0x7f333c0ccc60 2023-06-09T04:41:30.274 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.267+0000 7f3341baf700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f333c1f1cd0 con 0x7f333c06c1a0 2023-06-09T04:41:30.275 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.267+0000 7f3340bad700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f333c06c1a0 0x7f333c15a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:30.275 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.267+0000 7f333bfff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f333c0ccc60 0x7f333c0704b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:30.275 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.267+0000 7f3340bad700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f333c06c1a0 0x7f333c15a3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.174:35926/0 (socket says 172.21.15.174:35926) 2023-06-09T04:41:30.275 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.267+0000 7f3340bad700 1 -- 172.21.15.174:0/3010346035 learned_addr learned my addr 172.21.15.174:0/3010346035 (peer_addr_for_me v2:172.21.15.174:0/0) 2023-06-09T04:41:30.275 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.271+0000 7f33413ae700 1 --2- 172.21.15.174:0/3010346035 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f333c15a010 0x7f333c0c42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:30.275 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.271+0000 7f3340bad700 1 -- 172.21.15.174:0/3010346035 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f333c0ccc60 msgr2=0x7f333c0704b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:30.276 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.271+0000 7f3340bad700 1 --2- 172.21.15.174:0/3010346035 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f333c0ccc60 0x7f333c0704b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:30.276 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.271+0000 7f3340bad700 1 -- 172.21.15.174:0/3010346035 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f333c15a010 msgr2=0x7f333c0c42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:30.276 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.271+0000 7f3340bad700 1 --2- 172.21.15.174:0/3010346035 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f333c15a010 0x7f333c0c42c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:30.276 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.271+0000 7f3340bad700 1 -- 172.21.15.174:0/3010346035 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3334009a70 con 0x7f333c06c1a0 2023-06-09T04:41:30.276 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.271+0000 7f333bfff700 1 --2- 172.21.15.174:0/3010346035 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f333c0ccc60 0x7f333c0704b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:41:30.276 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.271+0000 7f33413ae700 1 --2- 172.21.15.174:0/3010346035 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f333c15a010 0x7f333c0c42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:41:30.276 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.271+0000 7f3340bad700 1 --2- 172.21.15.174:0/3010346035 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f333c06c1a0 0x7f333c15a3e0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f333000e870 tx=0x7f333000eb80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:30.277 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.271+0000 7f33397fa700 1 -- 172.21.15.174:0/3010346035 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33300095a0 con 0x7f333c06c1a0 2023-06-09T04:41:30.277 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.271+0000 7f33397fa700 1 -- 172.21.15.174:0/3010346035 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3330013680 con 0x7f333c06c1a0 2023-06-09T04:41:30.277 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.271+0000 7f3341baf700 1 -- 172.21.15.174:0/3010346035 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f333c1f1fb0 con 0x7f333c06c1a0 2023-06-09T04:41:30.277 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.271+0000 7f33397fa700 1 -- 172.21.15.174:0/3010346035 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33300139f0 con 0x7f333c06c1a0 2023-06-09T04:41:30.277 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.271+0000 7f3341baf700 1 -- 172.21.15.174:0/3010346035 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f333c15a920 con 0x7f333c06c1a0 2023-06-09T04:41:30.277 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.271+0000 7f33397fa700 1 -- 172.21.15.174:0/3010346035 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f3330005a40 con 0x7f333c06c1a0 2023-06-09T04:41:30.278 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.271+0000 7f33397fa700 1 -- 172.21.15.174:0/3010346035 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f3330005cf0 con 0x7f333c06c1a0 2023-06-09T04:41:30.278 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.271+0000 7f3341baf700 1 -- 172.21.15.174:0/3010346035 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f333c0cbbc0 con 0x7f333c06c1a0 2023-06-09T04:41:30.279 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.275+0000 7f33397fa700 1 -- 172.21.15.174:0/3010346035 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f3330021060 con 0x7f333c06c1a0 2023-06-09T04:41:30.356 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.351+0000 7f3341baf700 1 -- 172.21.15.174:0/3010346035 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "osd new", "uuid": "a10820e4-b348-4d92-9796-3b01484ace1c", "id": 4} v 0) v1 -- 0x7f333c1f4c00 con 0x7f333c06c1a0 2023-06-09T04:41:30.366 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.363+0000 7f33397fa700 1 -- 172.21.15.174:0/3010346035 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a10820e4-b348-4d92-9796-3b01484ace1c", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f333c1f4c00 con 0x7f333c06c1a0 2023-06-09T04:41:30.366 INFO:teuthology.orchestra.run.smithi174.stdout:4 2023-06-09T04:41:30.367 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.363+0000 7f3341baf700 1 -- 172.21.15.174:0/3010346035 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f333c06c1a0 msgr2=0x7f333c15a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:30.368 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.363+0000 7f3341baf700 1 --2- 172.21.15.174:0/3010346035 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f333c06c1a0 0x7f333c15a3e0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f333000e870 tx=0x7f333000eb80 comp rx=0 tx=0).stop 2023-06-09T04:41:30.368 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.363+0000 7f3341baf700 1 -- 172.21.15.174:0/3010346035 shutdown_connections 2023-06-09T04:41:30.368 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.363+0000 7f3341baf700 1 --2- 172.21.15.174:0/3010346035 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f333c15a010 0x7f333c0c42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:30.369 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.363+0000 7f3341baf700 1 --2- 172.21.15.174:0/3010346035 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f333c0ccc60 0x7f333c0704b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:30.369 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.363+0000 7f3341baf700 1 --2- 172.21.15.174:0/3010346035 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f333c06c1a0 0x7f333c15a3e0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:30.369 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.363+0000 7f3341baf700 1 -- 172.21.15.174:0/3010346035 >> 172.21.15.174:0/3010346035 conn(0x7f333c0afe40 msgr2=0x7f333c0ad130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:30.369 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.363+0000 7f3341baf700 1 -- 172.21.15.174:0/3010346035 shutdown_connections 2023-06-09T04:41:30.369 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.363+0000 7f3341baf700 1 -- 172.21.15.174:0/3010346035 wait complete. 2023-06-09T04:41:30.387 DEBUG:teuthology.orchestra.run.smithi174:> sudo ceph --cluster ceph osd new b4da1c32-be05-420b-9346-90d91aa70569 5 2023-06-09T04:41:30.596 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.591+0000 7ff07b59e700 1 Processor -- start 2023-06-09T04:41:30.597 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.591+0000 7ff07b59e700 1 -- start start 2023-06-09T04:41:30.598 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.595+0000 7ff07b59e700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7ff07c070b80 0x7ff07c070f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:30.599 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.595+0000 7ff07b59e700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff07c160b50 con 0x7ff07c0cf020 2023-06-09T04:41:30.599 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.595+0000 7ff07b59e700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff07c071490 con 0x7ff07c15c300 2023-06-09T04:41:30.599 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.595+0000 7ff07b59e700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff07c0cb710 con 0x7ff07c070b80 2023-06-09T04:41:30.599 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.595+0000 7ff079d9b700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7ff07c15c300 0x7ff07c0cb000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.174:35958/0 (socket says 172.21.15.174:35958) 2023-06-09T04:41:30.600 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.595+0000 7ff079d9b700 1 -- 172.21.15.174:0/1726650319 learned_addr learned my addr 172.21.15.174:0/1726650319 (peer_addr_for_me v1:172.21.15.174:0/0) 2023-06-09T04:41:30.600 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.595+0000 7ff07a59c700 1 --2- 172.21.15.174:0/1726650319 >> v2:172.21.15.90:3300/0 conn(0x7ff07c070b80 0x7ff07c070f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:30.600 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.595+0000 7ff07959a700 1 -- 172.21.15.174:0/1726650319 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1546184352 0 0) 0x7ff07c071490 con 0x7ff07c15c300 2023-06-09T04:41:30.600 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.595+0000 7ff07959a700 1 -- 172.21.15.174:0/1726650319 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff0640035d0 con 0x7ff07c15c300 2023-06-09T04:41:30.602 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.595+0000 7ff07959a700 1 -- 172.21.15.174:0/1726650319 <== mon.1 v1:172.21.15.174:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1943173785 0 0) 0x7ff0640035d0 con 0x7ff07c15c300 2023-06-09T04:41:30.602 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.595+0000 7ff07959a700 1 -- 172.21.15.174:0/1726650319 >> v2:172.21.15.90:3300/0 conn(0x7ff07c070b80 msgr2=0x7ff07c070f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:30.602 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.595+0000 7ff07959a700 1 --2- 172.21.15.174:0/1726650319 >> v2:172.21.15.90:3300/0 conn(0x7ff07c070b80 0x7ff07c070f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:30.602 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.595+0000 7ff07959a700 1 -- 172.21.15.174:0/1726650319 >> v1:172.21.15.90:6789/0 conn(0x7ff07c0cf020 legacy=0x7ff07c0b3100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:30.603 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.595+0000 7ff07959a700 1 -- 172.21.15.174:0/1726650319 --> v1:172.21.15.174:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff07c0c9f60 con 0x7ff07c15c300 2023-06-09T04:41:30.603 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.595+0000 7ff07959a700 1 -- 172.21.15.174:0/1726650319 <== mon.1 v1:172.21.15.174:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3604404106 0 0) 0x7ff070001670 con 0x7ff07c15c300 2023-06-09T04:41:30.603 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.595+0000 7ff07959a700 1 -- 172.21.15.174:0/1726650319 >> v1:172.21.15.174:6789/0 conn(0x7ff07c15c300 legacy=0x7ff07c0cb000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:30.603 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.595+0000 7ff07959a700 1 --2- 172.21.15.174:0/1726650319 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff064003a20 0x7ff064003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:30.603 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.595+0000 7ff07959a700 1 --2- 172.21.15.174:0/1726650319 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff064004870 0x7ff064004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:30.603 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.595+0000 7ff07959a700 1 --2- 172.21.15.174:0/1726650319 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff064005220 0x7ff06400ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:30.603 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.595+0000 7ff07959a700 1 -- 172.21.15.174:0/1726650319 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff07c0cb710 con 0x7ff064003a20 2023-06-09T04:41:30.604 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.595+0000 7ff07959a700 1 -- 172.21.15.174:0/1726650319 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff06400c0a0 con 0x7ff064004870 2023-06-09T04:41:30.604 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.595+0000 7ff07959a700 1 -- 172.21.15.174:0/1726650319 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff06400c260 con 0x7ff064005220 2023-06-09T04:41:30.604 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.595+0000 7ff079d9b700 1 --2- 172.21.15.174:0/1726650319 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff064004870 0x7ff064004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:30.604 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.595+0000 7ff07ad9d700 1 --2- 172.21.15.174:0/1726650319 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff064005220 0x7ff06400ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:30.604 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.595+0000 7ff07a59c700 1 --2- 172.21.15.174:0/1726650319 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff064003a20 0x7ff064003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:30.604 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.599+0000 7ff079d9b700 1 -- 172.21.15.174:0/1726650319 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff064005220 msgr2=0x7ff06400ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:30.604 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.599+0000 7ff079d9b700 1 --2- 172.21.15.174:0/1726650319 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff064005220 0x7ff06400ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:30.605 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.599+0000 7ff079d9b700 1 -- 172.21.15.174:0/1726650319 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff064003a20 msgr2=0x7ff064003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:30.605 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.599+0000 7ff079d9b700 1 --2- 172.21.15.174:0/1726650319 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff064003a20 0x7ff064003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:30.605 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.599+0000 7ff079d9b700 1 -- 172.21.15.174:0/1726650319 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0640035d0 con 0x7ff064004870 2023-06-09T04:41:30.605 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.599+0000 7ff07ad9d700 1 -- 172.21.15.174:0/1726650319 reap_dead start 2023-06-09T04:41:30.605 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.599+0000 7ff079d9b700 1 --2- 172.21.15.174:0/1726650319 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff064004870 0x7ff064004ce0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7ff07000c320 tx=0x7ff0640058a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9b048d7ca3ba47b0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:30.606 INFO:tasks.ceph.mgr.y.smithi090.stderr:2023-06-09T04:41:30.600+0000 7f36f99f92c0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-06-09T04:41:30.607 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.599+0000 7ff07959a700 1 -- 172.21.15.174:0/1726650319 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff070007c30 con 0x7ff064004870 2023-06-09T04:41:30.607 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.599+0000 7ff07959a700 1 -- 172.21.15.174:0/1726650319 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff07000ce40 con 0x7ff064004870 2023-06-09T04:41:30.607 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.599+0000 7ff07959a700 1 -- 172.21.15.174:0/1726650319 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff070005bc0 con 0x7ff064004870 2023-06-09T04:41:30.607 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.599+0000 7ff07b59e700 1 -- 172.21.15.174:0/1726650319 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff064004870 msgr2=0x7ff064004ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:30.607 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.599+0000 7ff07b59e700 1 --2- 172.21.15.174:0/1726650319 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff064004870 0x7ff064004ce0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7ff07000c320 tx=0x7ff0640058a0 comp rx=0 tx=0).stop 2023-06-09T04:41:30.607 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.599+0000 7ff07b59e700 1 -- 172.21.15.174:0/1726650319 shutdown_connections 2023-06-09T04:41:30.608 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.599+0000 7ff07b59e700 1 --2- 172.21.15.174:0/1726650319 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff064004870 0x7ff064004ce0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:30.608 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.599+0000 7ff07b59e700 1 -- 172.21.15.174:0/1726650319 >> 172.21.15.174:0/1726650319 conn(0x7ff07c0b1c30 msgr2=0x7ff07c0cf410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:30.608 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.599+0000 7ff07b59e700 1 -- 172.21.15.174:0/1726650319 shutdown_connections 2023-06-09T04:41:30.608 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.599+0000 7ff07b59e700 1 -- 172.21.15.174:0/1726650319 wait complete. 2023-06-09T04:41:30.609 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.603+0000 7ff07b59e700 1 Processor -- start 2023-06-09T04:41:30.609 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.603+0000 7ff07b59e700 1 -- start start 2023-06-09T04:41:30.609 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.603+0000 7ff07b59e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff064004870 0x7ff07c0c58a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:30.609 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.603+0000 7ff07b59e700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff07c06cf80 0x7ff07c0c5010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:30.609 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.603+0000 7ff07b59e700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff07c1f4ce0 0x7ff07c1f5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:30.609 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.603+0000 7ff07b59e700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff07c1f56a0 con 0x7ff07c1f4ce0 2023-06-09T04:41:30.610 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.603+0000 7ff07b59e700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff07c0acec0 con 0x7ff07c06cf80 2023-06-09T04:41:30.610 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.603+0000 7ff07b59e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff07c06a990 con 0x7ff064004870 2023-06-09T04:41:30.611 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.603+0000 7ff07a59c700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff064004870 0x7ff07c0c58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:30.611 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.603+0000 7ff079d9b700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff07c06cf80 0x7ff07c0c5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:30.611 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.603+0000 7ff07a59c700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff064004870 0x7ff07c0c58a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.174:35950/0 (socket says 172.21.15.174:35950) 2023-06-09T04:41:30.611 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.603+0000 7ff07a59c700 1 -- 172.21.15.174:0/728718379 learned_addr learned my addr 172.21.15.174:0/728718379 (peer_addr_for_me v2:172.21.15.174:0/0) 2023-06-09T04:41:30.612 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.603+0000 7ff07ad9d700 1 --2- 172.21.15.174:0/728718379 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff07c1f4ce0 0x7ff07c1f5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:30.612 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.607+0000 7ff07a59c700 1 -- 172.21.15.174:0/728718379 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff07c06cf80 msgr2=0x7ff07c0c5010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:30.612 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.607+0000 7ff07a59c700 1 --2- 172.21.15.174:0/728718379 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff07c06cf80 0x7ff07c0c5010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:30.612 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.607+0000 7ff07a59c700 1 -- 172.21.15.174:0/728718379 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff07c1f4ce0 msgr2=0x7ff07c1f5160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:30.612 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.607+0000 7ff07a59c700 1 --2- 172.21.15.174:0/728718379 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff07c1f4ce0 0x7ff07c1f5160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:30.612 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.607+0000 7ff07a59c700 1 -- 172.21.15.174:0/728718379 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff07c06ac70 con 0x7ff064004870 2023-06-09T04:41:30.612 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.607+0000 7ff07a59c700 1 --2- 172.21.15.174:0/728718379 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff064004870 0x7ff07c0c58a0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ff06c011a20 tx=0x7ff06c011d30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:30.613 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.607+0000 7ff06affd700 1 -- 172.21.15.174:0/728718379 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff06c011ec0 con 0x7ff064004870 2023-06-09T04:41:30.613 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.607+0000 7ff06affd700 1 -- 172.21.15.174:0/728718379 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff06c00f940 con 0x7ff064004870 2023-06-09T04:41:30.613 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.607+0000 7ff06affd700 1 -- 172.21.15.174:0/728718379 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff06c00fcf0 con 0x7ff064004870 2023-06-09T04:41:30.613 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.607+0000 7ff07b59e700 1 -- 172.21.15.174:0/728718379 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff07c0acb50 con 0x7ff064004870 2023-06-09T04:41:30.613 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.607+0000 7ff07b59e700 1 -- 172.21.15.174:0/728718379 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff07c0c38a0 con 0x7ff064004870 2023-06-09T04:41:30.614 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.607+0000 7ff06affd700 1 -- 172.21.15.174:0/728718379 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7ff06c014740 con 0x7ff064004870 2023-06-09T04:41:30.614 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.607+0000 7ff06affd700 1 -- 172.21.15.174:0/728718379 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7ff06c01d630 con 0x7ff064004870 2023-06-09T04:41:30.614 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.607+0000 7ff07b59e700 1 -- 172.21.15.174:0/728718379 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff07c067380 con 0x7ff064004870 2023-06-09T04:41:30.615 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.611+0000 7ff06affd700 1 -- 172.21.15.174:0/728718379 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7ff06c022020 con 0x7ff064004870 2023-06-09T04:41:30.692 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.687+0000 7ff07b59e700 1 -- 172.21.15.174:0/728718379 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "osd new", "uuid": "b4da1c32-be05-420b-9346-90d91aa70569", "id": 5} v 0) v1 -- 0x7ff07c0ca4d0 con 0x7ff064004870 2023-06-09T04:41:30.703 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.699+0000 7ff06affd700 1 -- 172.21.15.174:0/728718379 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b4da1c32-be05-420b-9346-90d91aa70569", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7ff06c0149f0 con 0x7ff064004870 2023-06-09T04:41:30.704 INFO:teuthology.orchestra.run.smithi174.stdout:5 2023-06-09T04:41:30.705 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.699+0000 7ff07b59e700 1 -- 172.21.15.174:0/728718379 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff064004870 msgr2=0x7ff07c0c58a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:30.706 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.699+0000 7ff07b59e700 1 --2- 172.21.15.174:0/728718379 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff064004870 0x7ff07c0c58a0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ff06c011a20 tx=0x7ff06c011d30 comp rx=0 tx=0).stop 2023-06-09T04:41:30.706 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.699+0000 7ff07b59e700 1 -- 172.21.15.174:0/728718379 shutdown_connections 2023-06-09T04:41:30.706 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.699+0000 7ff07b59e700 1 --2- 172.21.15.174:0/728718379 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff07c1f4ce0 0x7ff07c1f5160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:30.706 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.699+0000 7ff07b59e700 1 --2- 172.21.15.174:0/728718379 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff07c06cf80 0x7ff07c0c5010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:30.706 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.699+0000 7ff07b59e700 1 --2- 172.21.15.174:0/728718379 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff064004870 0x7ff07c0c58a0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:30.706 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.699+0000 7ff07b59e700 1 -- 172.21.15.174:0/728718379 >> 172.21.15.174:0/728718379 conn(0x7ff07c0b1c30 msgr2=0x7ff07c15e6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:30.706 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.699+0000 7ff07b59e700 1 -- 172.21.15.174:0/728718379 shutdown_connections 2023-06-09T04:41:30.707 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.699+0000 7ff07b59e700 1 -- 172.21.15.174:0/728718379 wait complete. 2023-06-09T04:41:30.723 INFO:tasks.ceph.mgr.x.smithi174.stderr:2023-06-09T04:41:30.719+0000 7fc902ef92c0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-06-09T04:41:30.727 DEBUG:teuthology.orchestra.run.smithi174:> sudo ceph --cluster ceph osd new d1b98041-d243-4355-bd0a-e22cf9875b32 6 2023-06-09T04:41:30.767 INFO:tasks.ceph.mgr.y.smithi090.stderr:2023-06-09T04:41:30.764+0000 7f36f99f92c0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-06-09T04:41:30.878 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.875+0000 7fe512758700 1 Processor -- start 2023-06-09T04:41:30.879 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.875+0000 7fe512758700 1 -- start start 2023-06-09T04:41:30.880 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.875+0000 7fe512758700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe50c0cab50 0x7fe50c06af50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:30.880 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.875+0000 7fe512758700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fe50c0b3bc0 0x7fe50c0caf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:30.880 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.875+0000 7fe512758700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe50c0cc1d0 con 0x7fe50c069cf0 2023-06-09T04:41:30.880 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.875+0000 7fe512758700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe50c0cb460 con 0x7fe50c0b3bc0 2023-06-09T04:41:30.880 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.875+0000 7fe512758700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe50c0cc420 con 0x7fe50c0cab50 2023-06-09T04:41:30.881 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.875+0000 7fe510f55700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fe50c0b3bc0 0x7fe50c0caf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:30.881 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.875+0000 7fe511756700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe50c0cab50 0x7fe50c06af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:30.882 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.875+0000 7fe510f55700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fe50c0b3bc0 0x7fe50c0caf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:47186/0 (socket says 172.21.15.174:47186) 2023-06-09T04:41:30.882 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.875+0000 7fe510f55700 1 -- 172.21.15.174:0/2581330232 learned_addr learned my addr 172.21.15.174:0/2581330232 (peer_addr_for_me v2:172.21.15.174:0/0) 2023-06-09T04:41:30.882 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.875+0000 7fe510f55700 1 -- 172.21.15.174:0/2581330232 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe50c0cab50 msgr2=0x7fe50c06af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:30.882 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.875+0000 7fe510f55700 1 --2- 172.21.15.174:0/2581330232 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe50c0cab50 0x7fe50c06af50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:30.882 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.875+0000 7fe510f55700 1 -- 172.21.15.174:0/2581330232 >> v1:172.21.15.174:6789/0 conn(0x7fe50c069cf0 legacy=0x7fe50c06a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:30.882 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.875+0000 7fe510f55700 1 -- 172.21.15.174:0/2581330232 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe50c0cc700 con 0x7fe50c0b3bc0 2023-06-09T04:41:30.883 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.875+0000 7fe511756700 1 --2- 172.21.15.174:0/2581330232 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe50c0cab50 0x7fe50c06af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:41:30.883 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.879+0000 7fe510f55700 1 --2- 172.21.15.174:0/2581330232 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe50c0b3bc0 0x7fe50c0caf20 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fe4fc009910 tx=0x7fe4fc009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=36403ca68d9b7693 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:30.884 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.879+0000 7fe503fff700 1 -- 172.21.15.174:0/2581330232 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4fc011830 con 0x7fe50c0b3bc0 2023-06-09T04:41:30.884 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.879+0000 7fe503fff700 1 -- 172.21.15.174:0/2581330232 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4fc011990 con 0x7fe50c0b3bc0 2023-06-09T04:41:30.884 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.879+0000 7fe503fff700 1 -- 172.21.15.174:0/2581330232 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4fc011d40 con 0x7fe50c0b3bc0 2023-06-09T04:41:30.884 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.879+0000 7fe512758700 1 -- 172.21.15.174:0/2581330232 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe50c0b3bc0 msgr2=0x7fe50c0caf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:30.884 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.879+0000 7fe512758700 1 --2- 172.21.15.174:0/2581330232 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe50c0b3bc0 0x7fe50c0caf20 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fe4fc009910 tx=0x7fe4fc009c20 comp rx=0 tx=0).stop 2023-06-09T04:41:30.884 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.879+0000 7fe512758700 1 -- 172.21.15.174:0/2581330232 shutdown_connections 2023-06-09T04:41:30.884 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.879+0000 7fe512758700 1 --2- 172.21.15.174:0/2581330232 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe50c0b3bc0 0x7fe50c0caf20 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:30.885 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.879+0000 7fe512758700 1 --2- 172.21.15.174:0/2581330232 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe50c0cab50 0x7fe50c06af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:30.885 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.879+0000 7fe512758700 1 -- 172.21.15.174:0/2581330232 >> 172.21.15.174:0/2581330232 conn(0x7fe50c0afe40 msgr2=0x7fe50c0b0240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:30.885 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.879+0000 7fe512758700 1 -- 172.21.15.174:0/2581330232 shutdown_connections 2023-06-09T04:41:30.885 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.879+0000 7fe512758700 1 -- 172.21.15.174:0/2581330232 wait complete. 2023-06-09T04:41:30.886 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.883+0000 7fe512758700 1 Processor -- start 2023-06-09T04:41:30.886 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.883+0000 7fe512758700 1 -- start start 2023-06-09T04:41:30.887 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.883+0000 7fe512758700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe50c069cf0 0x7fe50c0977b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:30.887 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.883+0000 7fe512758700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe50c0b3bc0 0x7fe50c06aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:30.887 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.883+0000 7fe512758700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe50c0cab50 0x7fe50c15cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:30.887 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.883+0000 7fe512758700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe50c0c20a0 con 0x7fe50c0cab50 2023-06-09T04:41:30.888 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.883+0000 7fe512758700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe50c0c2380 con 0x7fe50c0b3bc0 2023-06-09T04:41:30.888 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.883+0000 7fe512758700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe50c0c2660 con 0x7fe50c069cf0 2023-06-09T04:41:30.889 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.883+0000 7fe511756700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe50c069cf0 0x7fe50c0977b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:30.889 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.883+0000 7fe511756700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe50c069cf0 0x7fe50c0977b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.174:35964/0 (socket says 172.21.15.174:35964) 2023-06-09T04:41:30.889 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.883+0000 7fe511756700 1 -- 172.21.15.174:0/4193718050 learned_addr learned my addr 172.21.15.174:0/4193718050 (peer_addr_for_me v2:172.21.15.174:0/0) 2023-06-09T04:41:30.889 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.883+0000 7fe510f55700 1 --2- 172.21.15.174:0/4193718050 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe50c0b3bc0 0x7fe50c06aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:30.890 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.883+0000 7fe511f57700 1 --2- 172.21.15.174:0/4193718050 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe50c0cab50 0x7fe50c15cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:30.890 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.883+0000 7fe510f55700 1 -- 172.21.15.174:0/4193718050 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe50c069cf0 msgr2=0x7fe50c0977b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:30.890 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.883+0000 7fe510f55700 1 --2- 172.21.15.174:0/4193718050 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe50c069cf0 0x7fe50c0977b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:30.890 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.883+0000 7fe510f55700 1 -- 172.21.15.174:0/4193718050 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe50c0cab50 msgr2=0x7fe50c15cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:30.890 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.883+0000 7fe510f55700 1 --2- 172.21.15.174:0/4193718050 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe50c0cab50 0x7fe50c15cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:30.890 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.883+0000 7fe510f55700 1 -- 172.21.15.174:0/4193718050 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5080094b0 con 0x7fe50c0b3bc0 2023-06-09T04:41:30.890 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.883+0000 7fe511756700 1 --2- 172.21.15.174:0/4193718050 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe50c069cf0 0x7fe50c0977b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:41:30.891 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.883+0000 7fe510f55700 1 --2- 172.21.15.174:0/4193718050 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe50c0b3bc0 0x7fe50c06aad0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fe4fc016000 tx=0x7fe4fc004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:30.891 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.883+0000 7fe501ffb700 1 -- 172.21.15.174:0/4193718050 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4fc004380 con 0x7fe50c0b3bc0 2023-06-09T04:41:30.891 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.883+0000 7fe501ffb700 1 -- 172.21.15.174:0/4193718050 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4fc01f070 con 0x7fe50c0b3bc0 2023-06-09T04:41:30.891 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.883+0000 7fe512758700 1 -- 172.21.15.174:0/4193718050 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4fc009570 con 0x7fe50c0b3bc0 2023-06-09T04:41:30.891 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.883+0000 7fe501ffb700 1 -- 172.21.15.174:0/4193718050 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4fc0036c0 con 0x7fe50c0b3bc0 2023-06-09T04:41:30.892 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.887+0000 7fe512758700 1 -- 172.21.15.174:0/4193718050 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe50c0c2c20 con 0x7fe50c0b3bc0 2023-06-09T04:41:30.892 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.887+0000 7fe501ffb700 1 -- 172.21.15.174:0/4193718050 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fe4fc021030 con 0x7fe50c0b3bc0 2023-06-09T04:41:30.892 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.887+0000 7fe501ffb700 1 -- 172.21.15.174:0/4193718050 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7fe4fc024480 con 0x7fe50c0b3bc0 2023-06-09T04:41:30.892 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.887+0000 7fe512758700 1 -- 172.21.15.174:0/4193718050 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe50c0c27a0 con 0x7fe50c0b3bc0 2023-06-09T04:41:30.896 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.891+0000 7fe501ffb700 1 -- 172.21.15.174:0/4193718050 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7fe50c0c27a0 con 0x7fe50c0b3bc0 2023-06-09T04:41:30.911 INFO:tasks.ceph.mgr.x.smithi174.stderr:2023-06-09T04:41:30.907+0000 7fc902ef92c0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-06-09T04:41:30.972 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.967+0000 7fe512758700 1 -- 172.21.15.174:0/4193718050 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd new", "uuid": "d1b98041-d243-4355-bd0a-e22cf9875b32", "id": 6} v 0) v1 -- 0x7fe50c04e380 con 0x7fe50c0b3bc0 2023-06-09T04:41:30.982 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.979+0000 7fe501ffb700 1 -- 172.21.15.174:0/4193718050 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d1b98041-d243-4355-bd0a-e22cf9875b32", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7fe4fc029020 con 0x7fe50c0b3bc0 2023-06-09T04:41:30.983 INFO:teuthology.orchestra.run.smithi174.stdout:6 2023-06-09T04:41:30.984 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.979+0000 7fe512758700 1 -- 172.21.15.174:0/4193718050 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe50c0b3bc0 msgr2=0x7fe50c06aad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:30.985 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.979+0000 7fe512758700 1 --2- 172.21.15.174:0/4193718050 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe50c0b3bc0 0x7fe50c06aad0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fe4fc016000 tx=0x7fe4fc004770 comp rx=0 tx=0).stop 2023-06-09T04:41:30.985 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.979+0000 7fe512758700 1 -- 172.21.15.174:0/4193718050 shutdown_connections 2023-06-09T04:41:30.985 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.979+0000 7fe512758700 1 --2- 172.21.15.174:0/4193718050 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe50c0cab50 0x7fe50c15cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:30.985 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.979+0000 7fe512758700 1 --2- 172.21.15.174:0/4193718050 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe50c0b3bc0 0x7fe50c06aad0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:30.985 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.979+0000 7fe512758700 1 --2- 172.21.15.174:0/4193718050 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe50c069cf0 0x7fe50c0977b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:30.985 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.979+0000 7fe512758700 1 -- 172.21.15.174:0/4193718050 >> 172.21.15.174:0/4193718050 conn(0x7fe50c0afe40 msgr2=0x7fe50c06d030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:30.985 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.979+0000 7fe512758700 1 -- 172.21.15.174:0/4193718050 shutdown_connections 2023-06-09T04:41:30.986 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:30.979+0000 7fe512758700 1 -- 172.21.15.174:0/4193718050 wait complete. 2023-06-09T04:41:31.005 DEBUG:teuthology.orchestra.run.smithi174:> sudo ceph --cluster ceph osd new 5a207936-f89f-416b-b79b-34ec96f77c8f 7 2023-06-09T04:41:31.123 INFO:tasks.ceph.mgr.y.smithi090.stderr:2023-06-09T04:41:31.120+0000 7f36f99f92c0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-06-09T04:41:31.162 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:31.159+0000 7f14868f2700 1 Processor -- start 2023-06-09T04:41:31.163 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:31.159+0000 7f14868f2700 1 -- start start 2023-06-09T04:41:31.166 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:31.163+0000 7f14868f2700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f14800d0010 0x7f14800af8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:31.166 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:31.163+0000 7f14868f2700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f14800b1b30 0x7f148006f600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:31.166 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:31.163+0000 7f14868f2700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f148006fb40 0x7f148015d940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:31.166 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:31.163+0000 7f14868f2700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14800b0d80 con 0x7f148006fb40 2023-06-09T04:41:31.166 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:31.163+0000 7f14868f2700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f148006ff80 con 0x7f14800b1b30 2023-06-09T04:41:31.166 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:31.163+0000 7f14868f2700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14800d03e0 con 0x7f14800d0010 2023-06-09T04:41:31.167 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:31.163+0000 7f14850ef700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f14800b1b30 0x7f148006f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:31.167 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:31.163+0000 7f14858f0700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f14800d0010 0x7f14800af8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:31.168 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:31.163+0000 7f14850ef700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f14800b1b30 0x7f148006f600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:47208/0 (socket says 172.21.15.174:47208) 2023-06-09T04:41:31.168 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:31.163+0000 7f14850ef700 1 -- 172.21.15.174:0/338663384 learned_addr learned my addr 172.21.15.174:0/338663384 (peer_addr_for_me v2:172.21.15.174:0/0) 2023-06-09T04:41:31.168 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:31.163+0000 7f14860f1700 1 --2- 172.21.15.174:0/338663384 >> v2:172.21.15.90:3300/0 conn(0x7f148006fb40 0x7f148015d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:31.168 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:31.163+0000 7f14850ef700 1 -- 172.21.15.174:0/338663384 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f14800d0010 msgr2=0x7f14800af8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:31.168 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:31.163+0000 7f14850ef700 1 --2- 172.21.15.174:0/338663384 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f14800d0010 0x7f14800af8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:31.168 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:31.163+0000 7f14850ef700 1 -- 172.21.15.174:0/338663384 >> v2:172.21.15.90:3300/0 conn(0x7f148006fb40 msgr2=0x7f148015d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:31.168 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:31.163+0000 7f14850ef700 1 --2- 172.21.15.174:0/338663384 >> v2:172.21.15.90:3300/0 conn(0x7f148006fb40 0x7f148015d940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:31.169 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:31.163+0000 7f14850ef700 1 -- 172.21.15.174:0/338663384 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14800b0100 con 0x7f14800b1b30 2023-06-09T04:41:31.169 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:31.163+0000 7f14850ef700 1 --2- 172.21.15.174:0/338663384 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f14800b1b30 0x7f148006f600 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f1480071210 tx=0x7f1470009bf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=189de3b269288400 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:31.169 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:31.163+0000 7f14848ee700 1 -- 172.21.15.174:0/338663384 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1470011830 con 0x7f14800b1b30 2023-06-09T04:41:31.169 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:31.163+0000 7f14848ee700 1 -- 172.21.15.174:0/338663384 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1470011990 con 0x7f14800b1b30 2023-06-09T04:41:31.170 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:31.163+0000 7f14848ee700 1 -- 172.21.15.174:0/338663384 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1470011d20 con 0x7f14800b1b30 2023-06-09T04:41:31.170 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:31.167+0000 7f14868f2700 1 -- 172.21.15.174:0/338663384 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f14800b1b30 msgr2=0x7f148006f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:31.170 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:31.167+0000 7f14868f2700 1 --2- 172.21.15.174:0/338663384 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f14800b1b30 0x7f148006f600 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f1480071210 tx=0x7f1470009bf0 comp rx=0 tx=0).stop 2023-06-09T04:41:31.171 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:31.167+0000 7f14868f2700 1 -- 172.21.15.174:0/338663384 shutdown_connections 2023-06-09T04:41:31.171 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:31.167+0000 7f14868f2700 1 --2- 172.21.15.174:0/338663384 >> v2:172.21.15.90:3300/0 conn(0x7f148006fb40 0x7f148015d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:31.171 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:31.167+0000 7f14868f2700 1 --2- 172.21.15.174:0/338663384 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f14800b1b30 0x7f148006f600 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:31.171 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:31.167+0000 7f14868f2700 1 --2- 172.21.15.174:0/338663384 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f14800d0010 0x7f14800af8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:31.171 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:31.167+0000 7f14868f2700 1 -- 172.21.15.174:0/338663384 >> 172.21.15.174:0/338663384 conn(0x7f14800d0610 msgr2=0x7f14800d0a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:31.172 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:31.167+0000 7f14868f2700 1 -- 172.21.15.174:0/338663384 shutdown_connections 2023-06-09T04:41:31.172 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:31.167+0000 7f14868f2700 1 -- 172.21.15.174:0/338663384 wait complete. 2023-06-09T04:41:31.172 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:31.167+0000 7f14868f2700 1 Processor -- start 2023-06-09T04:41:31.173 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:31.167+0000 7f14868f2700 1 -- start start 2023-06-09T04:41:31.174 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:31.171+0000 7f14868f2700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f148006fb40 0x7f1480156230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:31.174 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:31.171+0000 7f14868f2700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f14800b1b30 0x7f1480155990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:31.174 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:31.171+0000 7f14868f2700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f14800d0010 0x7f1480150c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:31.174 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:31.171+0000 7f14868f2700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1480157960 con 0x7f14800d0010 2023-06-09T04:41:31.174 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:31.171+0000 7f14868f2700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14801568c0 con 0x7f14800b1b30 2023-06-09T04:41:31.174 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:31.171+0000 7f14868f2700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1480156ba0 con 0x7f148006fb40 2023-06-09T04:41:31.176 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:31.171+0000 7f14858f0700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f148006fb40 0x7f1480156230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:31.176 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:31.171+0000 7f14850ef700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f14800b1b30 0x7f1480155990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:31.176 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:31.171+0000 7f14858f0700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f148006fb40 0x7f1480156230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.174:35984/0 (socket says 172.21.15.174:35984) 2023-06-09T04:41:31.176 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:31.171+0000 7f14858f0700 1 -- 172.21.15.174:0/1071004337 learned_addr learned my addr 172.21.15.174:0/1071004337 (peer_addr_for_me v2:172.21.15.174:0/0) 2023-06-09T04:41:31.176 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:31.171+0000 7f14860f1700 1 --2- 172.21.15.174:0/1071004337 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f14800d0010 0x7f1480150c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:31.176 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:31.171+0000 7f14858f0700 1 -- 172.21.15.174:0/1071004337 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f14800b1b30 msgr2=0x7f1480155990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:31.177 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:31.171+0000 7f14858f0700 1 --2- 172.21.15.174:0/1071004337 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f14800b1b30 0x7f1480155990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:31.177 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:31.171+0000 7f14858f0700 1 -- 172.21.15.174:0/1071004337 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f14800d0010 msgr2=0x7f1480150c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:31.177 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:31.171+0000 7f14858f0700 1 --2- 172.21.15.174:0/1071004337 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f14800d0010 0x7f1480150c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:31.177 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:31.171+0000 7f14858f0700 1 -- 172.21.15.174:0/1071004337 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1470009570 con 0x7f148006fb40 2023-06-09T04:41:31.177 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:31.171+0000 7f14858f0700 1 --2- 172.21.15.174:0/1071004337 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f148006fb40 0x7f1480156230 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f147c00ebe0 tx=0x7f147c00eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:31.177 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:31.171+0000 7f14767fc700 1 -- 172.21.15.174:0/1071004337 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f147c009740 con 0x7f148006fb40 2023-06-09T04:41:31.177 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:31.171+0000 7f14767fc700 1 -- 172.21.15.174:0/1071004337 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f147c00c850 con 0x7f148006fb40 2023-06-09T04:41:31.177 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:31.171+0000 7f14767fc700 1 -- 172.21.15.174:0/1071004337 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f147c00cbe0 con 0x7f148006fb40 2023-06-09T04:41:31.178 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:31.171+0000 7f14868f2700 1 -- 172.21.15.174:0/1071004337 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1480156e80 con 0x7f148006fb40 2023-06-09T04:41:31.178 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:31.171+0000 7f14868f2700 1 -- 172.21.15.174:0/1071004337 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1480157440 con 0x7f148006fb40 2023-06-09T04:41:31.178 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:31.171+0000 7f14767fc700 1 -- 172.21.15.174:0/1071004337 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f147c005a40 con 0x7f148006fb40 2023-06-09T04:41:31.178 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:31.171+0000 7f14767fc700 1 -- 172.21.15.174:0/1071004337 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f147c006890 con 0x7f148006fb40 2023-06-09T04:41:31.178 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:31.171+0000 7f14868f2700 1 -- 172.21.15.174:0/1071004337 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f148004e380 con 0x7f148006fb40 2023-06-09T04:41:31.181 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:31.175+0000 7f14767fc700 1 -- 172.21.15.174:0/1071004337 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f147c021060 con 0x7f148006fb40 2023-06-09T04:41:31.260 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:31.255+0000 7f14868f2700 1 -- 172.21.15.174:0/1071004337 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "osd new", "uuid": "5a207936-f89f-416b-b79b-34ec96f77c8f", "id": 7} v 0) v1 -- 0x7f14800b1160 con 0x7f148006fb40 2023-06-09T04:41:31.269 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:31.263+0000 7f14767fc700 1 -- 172.21.15.174:0/1071004337 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5a207936-f89f-416b-b79b-34ec96f77c8f", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f147c029020 con 0x7f148006fb40 2023-06-09T04:41:31.270 INFO:teuthology.orchestra.run.smithi174.stdout:7 2023-06-09T04:41:31.271 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:31.267+0000 7f14868f2700 1 -- 172.21.15.174:0/1071004337 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f148006fb40 msgr2=0x7f1480156230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:31.271 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:31.267+0000 7f14868f2700 1 --2- 172.21.15.174:0/1071004337 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f148006fb40 0x7f1480156230 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f147c00ebe0 tx=0x7f147c00eef0 comp rx=0 tx=0).stop 2023-06-09T04:41:31.272 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:31.267+0000 7f14868f2700 1 -- 172.21.15.174:0/1071004337 shutdown_connections 2023-06-09T04:41:31.272 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:31.267+0000 7f14868f2700 1 --2- 172.21.15.174:0/1071004337 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f14800d0010 0x7f1480150c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:31.272 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:31.267+0000 7f14868f2700 1 --2- 172.21.15.174:0/1071004337 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f14800b1b30 0x7f1480155990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:31.272 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:31.267+0000 7f14868f2700 1 --2- 172.21.15.174:0/1071004337 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f148006fb40 0x7f1480156230 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:31.272 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:31.267+0000 7f14868f2700 1 -- 172.21.15.174:0/1071004337 >> 172.21.15.174:0/1071004337 conn(0x7f14800d0610 msgr2=0x7f14800b3720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:31.273 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:31.267+0000 7f14868f2700 1 -- 172.21.15.174:0/1071004337 shutdown_connections 2023-06-09T04:41:31.273 INFO:teuthology.orchestra.run.smithi174.stderr:2023-06-09T04:41:31.267+0000 7f14868f2700 1 -- 172.21.15.174:0/1071004337 wait complete. 2023-06-09T04:41:31.291 INFO:tasks.ceph.osd.0:Restarting daemon 2023-06-09T04:41:31.291 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-06-09T04:41:31.298 INFO:tasks.ceph.osd.0:Started 2023-06-09T04:41:31.299 INFO:tasks.ceph.osd.1:Restarting daemon 2023-06-09T04:41:31.299 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-06-09T04:41:31.303 INFO:tasks.ceph.osd.1:Started 2023-06-09T04:41:31.303 INFO:tasks.ceph.osd.2:Restarting daemon 2023-06-09T04:41:31.303 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-06-09T04:41:31.307 INFO:tasks.ceph.osd.2:Started 2023-06-09T04:41:31.307 INFO:tasks.ceph.osd.3:Restarting daemon 2023-06-09T04:41:31.308 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-06-09T04:41:31.308 INFO:tasks.ceph.mgr.x.smithi174.stderr:2023-06-09T04:41:31.303+0000 7fc902ef92c0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-06-09T04:41:31.314 INFO:tasks.ceph.osd.3:Started 2023-06-09T04:41:31.314 INFO:tasks.ceph.osd.4:Restarting daemon 2023-06-09T04:41:31.314 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-06-09T04:41:31.321 INFO:tasks.ceph.osd.4:Started 2023-06-09T04:41:31.321 INFO:tasks.ceph.osd.5:Restarting daemon 2023-06-09T04:41:31.322 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-06-09T04:41:31.326 INFO:tasks.ceph.osd.5:Started 2023-06-09T04:41:31.326 INFO:tasks.ceph.osd.6:Restarting daemon 2023-06-09T04:41:31.326 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-06-09T04:41:31.330 INFO:tasks.ceph.osd.6:Started 2023-06-09T04:41:31.330 INFO:tasks.ceph.osd.7:Restarting daemon 2023-06-09T04:41:31.331 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-06-09T04:41:31.336 INFO:tasks.ceph.osd.7:Started 2023-06-09T04:41:31.337 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T04:41:31.372 INFO:tasks.ceph.mgr.y.smithi090.stderr:2023-06-09T04:41:31.368+0000 7f36f99f92c0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-06-09T04:41:31.473 INFO:tasks.ceph.mgr.y.smithi090.stderr:2023-06-09T04:41:31.468+0000 7f36f99f92c0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-06-09T04:41:31.517 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:31.512+0000 7f551586f700 1 Processor -- start 2023-06-09T04:41:31.517 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:31.512+0000 7f551586f700 1 -- start start 2023-06-09T04:41:31.520 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:31.516+0000 7f551586f700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f5510159dc0 0x7f551006c160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:31.520 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:31.516+0000 7f551586f700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f551015a190 0x7f55100b1750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:31.520 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:31.516+0000 7f551586f700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55100b2ed0 con 0x7f5510069820 2023-06-09T04:41:31.521 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:31.516+0000 7f551586f700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55100b31b0 con 0x7f5510159dc0 2023-06-09T04:41:31.521 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:31.516+0000 7f551586f700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55100b3490 con 0x7f551015a190 2023-06-09T04:41:31.521 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:31.516+0000 7f550ffff700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f5510069820 0x7f5510162b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:52998/0 (socket says 172.21.15.90:52998) 2023-06-09T04:41:31.521 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:31.516+0000 7f550ffff700 1 -- 172.21.15.90:0/3503523681 learned_addr learned my addr 172.21.15.90:0/3503523681 (peer_addr_for_me v1:172.21.15.90:0/0) 2023-06-09T04:41:31.521 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:31.516+0000 7f5507fff700 1 --2- 172.21.15.90:0/3503523681 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f551015a190 0x7f55100b1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:31.521 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:31.516+0000 7f550effd700 1 --2- 172.21.15.90:0/3503523681 >> v2:172.21.15.174:3300/0 conn(0x7f5510159dc0 0x7f551006c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:31.523 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:31.516+0000 7f550e7fc700 1 -- 172.21.15.90:0/3503523681 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1297479132 0 0) 0x7f55100b2ed0 con 0x7f5510069820 2023-06-09T04:41:31.523 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:31.516+0000 7f550e7fc700 1 -- 172.21.15.90:0/3503523681 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f54fc0035d0 con 0x7f5510069820 2023-06-09T04:41:31.523 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:31.516+0000 7f5507fff700 1 -- 172.21.15.90:0/3503523681 >> v2:172.21.15.174:3300/0 conn(0x7f5510159dc0 msgr2=0x7f551006c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:31.523 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:31.516+0000 7f5507fff700 1 --2- 172.21.15.90:0/3503523681 >> v2:172.21.15.174:3300/0 conn(0x7f5510159dc0 0x7f551006c160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:31.523 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:31.516+0000 7f5507fff700 1 -- 172.21.15.90:0/3503523681 >> v1:172.21.15.90:6789/0 conn(0x7f5510069820 legacy=0x7f5510162b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:31.523 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:31.516+0000 7f5507fff700 1 -- 172.21.15.90:0/3503523681 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f551006c860 con 0x7f551015a190 2023-06-09T04:41:31.524 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:31.516+0000 7f550effd700 1 --2- 172.21.15.90:0/3503523681 >> v2:172.21.15.174:3300/0 conn(0x7f5510159dc0 0x7f551006c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:41:31.524 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:31.516+0000 7f5507fff700 1 --2- 172.21.15.90:0/3503523681 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f551015a190 0x7f55100b1750 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f54f8009850 tx=0x7f54f8009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=15cef2c4340d1253 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:31.524 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:31.516+0000 7f550e7fc700 1 -- 172.21.15.90:0/3503523681 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54f8011830 con 0x7f551015a190 2023-06-09T04:41:31.524 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:31.516+0000 7f550e7fc700 1 -- 172.21.15.90:0/3503523681 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54f8011990 con 0x7f551015a190 2023-06-09T04:41:31.524 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:31.516+0000 7f550e7fc700 1 -- 172.21.15.90:0/3503523681 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54f8011d40 con 0x7f551015a190 2023-06-09T04:41:31.525 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:31.520+0000 7f551586f700 1 -- 172.21.15.90:0/3503523681 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f551015a190 msgr2=0x7f55100b1750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:31.525 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:31.520+0000 7f551586f700 1 --2- 172.21.15.90:0/3503523681 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f551015a190 0x7f55100b1750 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f54f8009850 tx=0x7f54f8009b60 comp rx=0 tx=0).stop 2023-06-09T04:41:31.525 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:31.520+0000 7f551586f700 1 -- 172.21.15.90:0/3503523681 shutdown_connections 2023-06-09T04:41:31.525 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:31.520+0000 7f551586f700 1 --2- 172.21.15.90:0/3503523681 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f551015a190 0x7f55100b1750 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:31.525 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:31.520+0000 7f551586f700 1 --2- 172.21.15.90:0/3503523681 >> v2:172.21.15.174:3300/0 conn(0x7f5510159dc0 0x7f551006c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:31.526 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:31.520+0000 7f551586f700 1 -- 172.21.15.90:0/3503523681 >> 172.21.15.90:0/3503523681 conn(0x7f551006dfe0 msgr2=0x7f55100cc750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:31.526 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:31.520+0000 7f551586f700 1 -- 172.21.15.90:0/3503523681 shutdown_connections 2023-06-09T04:41:31.526 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:31.520+0000 7f551586f700 1 -- 172.21.15.90:0/3503523681 wait complete. 2023-06-09T04:41:31.527 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:31.520+0000 7f551586f700 1 Processor -- start 2023-06-09T04:41:31.527 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:31.524+0000 7f551586f700 1 -- start start 2023-06-09T04:41:31.529 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:31.524+0000 7f551586f700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5510069820 0x7f5510152200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:31.529 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:31.524+0000 7f551586f700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5510159dc0 0x7f551015a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:31.529 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:31.524+0000 7f551586f700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f551015a190 0x7f55100cbc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:31.529 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:31.524+0000 7f551586f700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f551015afb0 con 0x7f5510159dc0 2023-06-09T04:41:31.529 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:31.524+0000 7f551586f700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f551015b290 con 0x7f5510069820 2023-06-09T04:41:31.529 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:31.524+0000 7f551586f700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f551015b570 con 0x7f551015a190 2023-06-09T04:41:31.530 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:31.524+0000 7f5507fff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5510159dc0 0x7f551015a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:31.530 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:31.524+0000 7f5507fff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5510159dc0 0x7f551015a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:36258/0 (socket says 172.21.15.90:36258) 2023-06-09T04:41:31.530 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:31.524+0000 7f5507fff700 1 -- 172.21.15.90:0/475580242 learned_addr learned my addr 172.21.15.90:0/475580242 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:41:31.530 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:31.524+0000 7f550effd700 1 --2- 172.21.15.90:0/475580242 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5510069820 0x7f5510152200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:31.530 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:31.524+0000 7f550ffff700 1 --2- 172.21.15.90:0/475580242 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f551015a190 0x7f55100cbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:31.531 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:31.524+0000 7f5507fff700 1 -- 172.21.15.90:0/475580242 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f551015a190 msgr2=0x7f55100cbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:31.531 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:31.524+0000 7f5507fff700 1 --2- 172.21.15.90:0/475580242 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f551015a190 0x7f55100cbc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:31.532 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:31.524+0000 7f5507fff700 1 -- 172.21.15.90:0/475580242 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5510069820 msgr2=0x7f5510152200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:31.532 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:31.524+0000 7f5507fff700 1 --2- 172.21.15.90:0/475580242 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5510069820 0x7f5510152200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:31.532 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:31.524+0000 7f5507fff700 1 -- 172.21.15.90:0/475580242 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55000094b0 con 0x7f5510159dc0 2023-06-09T04:41:31.532 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:31.524+0000 7f550effd700 1 --2- 172.21.15.90:0/475580242 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5510069820 0x7f5510152200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:41:31.532 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:31.524+0000 7f5507fff700 1 --2- 172.21.15.90:0/475580242 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5510159dc0 0x7f551015a640 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f54f8014040 tx=0x7f54f8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:31.532 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:31.524+0000 7f550cff9700 1 -- 172.21.15.90:0/475580242 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54f80036c0 con 0x7f5510159dc0 2023-06-09T04:41:31.532 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:31.524+0000 7f550cff9700 1 -- 172.21.15.90:0/475580242 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54f801e070 con 0x7f5510159dc0 2023-06-09T04:41:31.533 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:31.524+0000 7f551586f700 1 -- 172.21.15.90:0/475580242 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54f80094b0 con 0x7f5510159dc0 2023-06-09T04:41:31.533 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:31.524+0000 7f550cff9700 1 -- 172.21.15.90:0/475580242 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54f8003a80 con 0x7f5510159dc0 2023-06-09T04:41:31.533 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:31.524+0000 7f551586f700 1 -- 172.21.15.90:0/475580242 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f551008a250 con 0x7f5510159dc0 2023-06-09T04:41:31.533 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:31.524+0000 7f550cff9700 1 -- 172.21.15.90:0/475580242 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f54f8025480 con 0x7f5510159dc0 2023-06-09T04:41:31.533 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:31.524+0000 7f550cff9700 1 -- 172.21.15.90:0/475580242 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f54f8020070 con 0x7f5510159dc0 2023-06-09T04:41:31.533 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:31.528+0000 7f551586f700 1 -- 172.21.15.90:0/475580242 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f551004db30 con 0x7f5510159dc0 2023-06-09T04:41:31.537 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:31.532+0000 7f550cff9700 1 -- 172.21.15.90:0/475580242 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f54f802a020 con 0x7f5510159dc0 2023-06-09T04:41:31.554 INFO:tasks.ceph.mgr.y.smithi090.stderr:2023-06-09T04:41:31.548+0000 7f36f99f92c0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-06-09T04:41:31.561 INFO:tasks.ceph.mgr.x.smithi174.stderr:2023-06-09T04:41:31.555+0000 7fc902ef92c0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-06-09T04:41:31.633 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:31.628+0000 7f551586f700 1 -- 172.21.15.90:0/475580242 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5510153d10 con 0x7f5510159dc0 2023-06-09T04:41:31.635 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:31.632+0000 7f550cff9700 1 -- 172.21.15.90:0/475580242 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f54f8015020 con 0x7f5510159dc0 2023-06-09T04:41:31.635 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:41:31.635 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":10,"fsid":"700369c0-a111-43b4-9415-844ad1742b70","created":"2023-06-09T04:41:28.180311+0000","modified":"2023-06-09T04:41:31.262765+0000","last_up_change":"0.000000","last_in_change":"2023-06-09T04:41:31.262765+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"46a4a7c5-babd-4ef3-9830-51487cff5eb4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"1543988f-c498-494a-a6f9-fac8413db6ea","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"79669dd6-ffc8-4197-b9f7-b3b372b2b9b4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"4062ab6f-ce40-450a-aa17-b10098766c7b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"a10820e4-b348-4d92-9796-3b01484ace1c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"b4da1c32-be05-420b-9346-90d91aa70569","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"d1b98041-d243-4355-bd0a-e22cf9875b32","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"5a207936-f89f-416b-b79b-34ec96f77c8f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:41:31.636 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:31.632+0000 7f551586f700 1 -- 172.21.15.90:0/475580242 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5510159dc0 msgr2=0x7f551015a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:31.636 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:31.632+0000 7f551586f700 1 --2- 172.21.15.90:0/475580242 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5510159dc0 0x7f551015a640 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f54f8014040 tx=0x7f54f8004770 comp rx=0 tx=0).stop 2023-06-09T04:41:31.636 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:31.632+0000 7f551586f700 1 -- 172.21.15.90:0/475580242 shutdown_connections 2023-06-09T04:41:31.637 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:31.632+0000 7f551586f700 1 --2- 172.21.15.90:0/475580242 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f551015a190 0x7f55100cbc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:31.637 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:31.632+0000 7f551586f700 1 --2- 172.21.15.90:0/475580242 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5510159dc0 0x7f551015a640 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:31.637 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:31.632+0000 7f551586f700 1 --2- 172.21.15.90:0/475580242 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5510069820 0x7f5510152200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:31.637 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:31.632+0000 7f551586f700 1 -- 172.21.15.90:0/475580242 >> 172.21.15.90:0/475580242 conn(0x7f551006dfe0 msgr2=0x7f55100ca590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:31.637 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:31.632+0000 7f551586f700 1 -- 172.21.15.90:0/475580242 shutdown_connections 2023-06-09T04:41:31.638 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:31.632+0000 7f551586f700 1 -- 172.21.15.90:0/475580242 wait complete. 2023-06-09T04:41:31.653 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-06-09T04:41:31.653 INFO:tasks.ceph:Waiting for OSDs to come up 2023-06-09T04:41:31.662 INFO:tasks.ceph.mgr.x.smithi174.stderr:2023-06-09T04:41:31.659+0000 7fc902ef92c0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-06-09T04:41:31.749 INFO:tasks.ceph.mgr.x.smithi174.stderr:2023-06-09T04:41:31.743+0000 7fc902ef92c0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-06-09T04:41:31.972 INFO:tasks.ceph.osd.1.smithi090.stderr:2023-06-09T04:41:31.968+0000 7fb26e058700 -1 Falling back to public interface 2023-06-09T04:41:31.988 INFO:tasks.ceph.osd.0.smithi090.stderr:2023-06-09T04:41:31.984+0000 7f31cb778700 -1 Falling back to public interface 2023-06-09T04:41:31.989 INFO:tasks.ceph.osd.6.smithi174.stderr:2023-06-09T04:41:31.983+0000 7f4e51c2f700 -1 Falling back to public interface 2023-06-09T04:41:31.997 INFO:tasks.ceph.osd.3.smithi090.stderr:2023-06-09T04:41:31.992+0000 7f3d2d3d5700 -1 Falling back to public interface 2023-06-09T04:41:32.004 INFO:tasks.ceph.osd.7.smithi174.stderr:2023-06-09T04:41:31.999+0000 7fc93ddf0700 -1 Falling back to public interface 2023-06-09T04:41:32.012 INFO:tasks.ceph.osd.2.smithi090.stderr:2023-06-09T04:41:32.008+0000 7f2d2a8a4700 -1 Falling back to public interface 2023-06-09T04:41:32.041 INFO:tasks.ceph.osd.5.smithi174.stderr:2023-06-09T04:41:32.035+0000 7fa7cf2e4700 -1 Falling back to public interface 2023-06-09T04:41:32.042 INFO:tasks.ceph.osd.4.smithi174.stderr:2023-06-09T04:41:32.035+0000 7f38286fa700 -1 Falling back to public interface 2023-06-09T04:41:32.459 DEBUG:teuthology.orchestra.run.smithi090:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-06-09T04:41:32.579 INFO:tasks.ceph.mgr.x.smithi174.stderr:2023-06-09T04:41:32.575+0000 7fc902ef92c0 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-06-09T04:41:32.603 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:32.600+0000 7ff0b9b58700 1 Processor -- start 2023-06-09T04:41:32.604 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:32.600+0000 7ff0b9b58700 1 -- start start 2023-06-09T04:41:32.605 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:32.600+0000 7ff0b9b58700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7ff0b4160500 0x7ff0b40c8d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:32.605 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:32.600+0000 7ff0b9b58700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff0b40ca520 0x7ff0b406b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:32.605 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:32.600+0000 7ff0b9b58700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0b41608d0 con 0x7ff0b406bed0 2023-06-09T04:41:32.605 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:32.600+0000 7ff0b9b58700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0b40c1930 con 0x7ff0b4160500 2023-06-09T04:41:32.605 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:32.600+0000 7ff0b9b58700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0b40ca970 con 0x7ff0b40ca520 2023-06-09T04:41:32.606 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:32.600+0000 7ff0b8b56700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7ff0b4160500 0x7ff0b40c8d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:32.606 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:32.600+0000 7ff0b8b56700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7ff0b4160500 0x7ff0b40c8d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:36264/0 (socket says 172.21.15.90:36264) 2023-06-09T04:41:32.607 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:32.600+0000 7ff0b8b56700 1 -- 172.21.15.90:0/49077414 learned_addr learned my addr 172.21.15.90:0/49077414 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:41:32.607 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:32.600+0000 7ff0b3fff700 1 --2- 172.21.15.90:0/49077414 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff0b40ca520 0x7ff0b406b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:32.607 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:32.600+0000 7ff0b8b56700 1 -- 172.21.15.90:0/49077414 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff0b40ca520 msgr2=0x7ff0b406b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:32.607 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:32.600+0000 7ff0b8b56700 1 --2- 172.21.15.90:0/49077414 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff0b40ca520 0x7ff0b406b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:32.607 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:32.600+0000 7ff0b8b56700 1 -- 172.21.15.90:0/49077414 >> v1:172.21.15.174:6789/0 conn(0x7ff0b406bed0 legacy=0x7ff0b4163fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:32.607 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:32.600+0000 7ff0b8b56700 1 -- 172.21.15.90:0/49077414 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0b40cda90 con 0x7ff0b4160500 2023-06-09T04:41:32.607 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:32.600+0000 7ff0b3fff700 1 --2- 172.21.15.90:0/49077414 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff0b40ca520 0x7ff0b406b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:41:32.608 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:32.604+0000 7ff0b8b56700 1 --2- 172.21.15.90:0/49077414 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff0b4160500 0x7ff0b40c8d10 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff0a8009910 tx=0x7ff0a8009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e61d9bc12b4686f7 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:32.609 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:32.604+0000 7ff0b37fe700 1 -- 172.21.15.90:0/49077414 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0a800ba60 con 0x7ff0b4160500 2023-06-09T04:41:32.609 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:32.604+0000 7ff0b37fe700 1 -- 172.21.15.90:0/49077414 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0a800bbc0 con 0x7ff0b4160500 2023-06-09T04:41:32.609 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:32.604+0000 7ff0b37fe700 1 -- 172.21.15.90:0/49077414 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0a8009e60 con 0x7ff0b4160500 2023-06-09T04:41:32.609 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:32.604+0000 7ff0b9b58700 1 -- 172.21.15.90:0/49077414 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff0b4160500 msgr2=0x7ff0b40c8d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:32.609 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:32.604+0000 7ff0b9b58700 1 --2- 172.21.15.90:0/49077414 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff0b4160500 0x7ff0b40c8d10 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff0a8009910 tx=0x7ff0a8009c20 comp rx=0 tx=0).stop 2023-06-09T04:41:32.609 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:32.604+0000 7ff0b9b58700 1 -- 172.21.15.90:0/49077414 shutdown_connections 2023-06-09T04:41:32.609 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:32.604+0000 7ff0b9b58700 1 --2- 172.21.15.90:0/49077414 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff0b40ca520 0x7ff0b406b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:32.610 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:32.604+0000 7ff0b9b58700 1 --2- 172.21.15.90:0/49077414 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff0b4160500 0x7ff0b40c8d10 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:32.610 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:32.604+0000 7ff0b9b58700 1 -- 172.21.15.90:0/49077414 >> 172.21.15.90:0/49077414 conn(0x7ff0b40ce390 msgr2=0x7ff0b40ce790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:32.610 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:32.604+0000 7ff0b9b58700 1 -- 172.21.15.90:0/49077414 shutdown_connections 2023-06-09T04:41:32.610 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:32.604+0000 7ff0b9b58700 1 -- 172.21.15.90:0/49077414 wait complete. 2023-06-09T04:41:32.611 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:32.608+0000 7ff0b9b58700 1 Processor -- start 2023-06-09T04:41:32.611 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:32.608+0000 7ff0b9b58700 1 -- start start 2023-06-09T04:41:32.613 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:32.608+0000 7ff0b9b58700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff0b406bed0 0x7ff0b40c4a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:32.613 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:32.608+0000 7ff0b9b58700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff0b40ca520 0x7ff0b40c5460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:32.613 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:32.608+0000 7ff0b9b58700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff0b4160500 0x7ff0b4155df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:32.613 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:32.608+0000 7ff0b9b58700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0b4156330 con 0x7ff0b40ca520 2023-06-09T04:41:32.613 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:32.608+0000 7ff0b9b58700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0b40c45d0 con 0x7ff0b4160500 2023-06-09T04:41:32.613 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:32.608+0000 7ff0b9b58700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0b40b1200 con 0x7ff0b406bed0 2023-06-09T04:41:32.614 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:32.608+0000 7ff0b3fff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff0b40ca520 0x7ff0b40c5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:32.614 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:32.608+0000 7ff0b3fff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff0b40ca520 0x7ff0b40c5460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:36278/0 (socket says 172.21.15.90:36278) 2023-06-09T04:41:32.615 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:32.608+0000 7ff0b3fff700 1 -- 172.21.15.90:0/3520787686 learned_addr learned my addr 172.21.15.90:0/3520787686 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:41:32.615 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:32.608+0000 7ff0b8b56700 1 --2- 172.21.15.90:0/3520787686 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff0b406bed0 0x7ff0b40c4a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:32.615 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:32.608+0000 7ff0b9357700 1 --2- 172.21.15.90:0/3520787686 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff0b4160500 0x7ff0b4155df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:32.615 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:32.608+0000 7ff0b3fff700 1 -- 172.21.15.90:0/3520787686 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff0b406bed0 msgr2=0x7ff0b40c4a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:32.615 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:32.608+0000 7ff0b3fff700 1 --2- 172.21.15.90:0/3520787686 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff0b406bed0 0x7ff0b40c4a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:32.615 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:32.608+0000 7ff0b3fff700 1 -- 172.21.15.90:0/3520787686 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff0b4160500 msgr2=0x7ff0b4155df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:32.615 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:32.608+0000 7ff0b3fff700 1 --2- 172.21.15.90:0/3520787686 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff0b4160500 0x7ff0b4155df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:32.616 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:32.608+0000 7ff0b3fff700 1 -- 172.21.15.90:0/3520787686 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0a8009570 con 0x7ff0b40ca520 2023-06-09T04:41:32.616 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:32.608+0000 7ff0b3fff700 1 --2- 172.21.15.90:0/3520787686 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff0b40ca520 0x7ff0b40c5460 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7ff0a400c770 tx=0x7ff0a400ca80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:32.616 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:32.608+0000 7ff0b17fa700 1 -- 172.21.15.90:0/3520787686 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0a4011800 con 0x7ff0b40ca520 2023-06-09T04:41:32.616 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:32.608+0000 7ff0b17fa700 1 -- 172.21.15.90:0/3520787686 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0a4011960 con 0x7ff0b40ca520 2023-06-09T04:41:32.616 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:32.608+0000 7ff0b9b58700 1 -- 172.21.15.90:0/3520787686 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0b40c5af0 con 0x7ff0b40ca520 2023-06-09T04:41:32.616 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:32.608+0000 7ff0b17fa700 1 -- 172.21.15.90:0/3520787686 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0a4011d10 con 0x7ff0b40ca520 2023-06-09T04:41:32.617 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:32.612+0000 7ff0b9b58700 1 -- 172.21.15.90:0/3520787686 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0b40c60b0 con 0x7ff0b40ca520 2023-06-09T04:41:32.617 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:32.612+0000 7ff0b17fa700 1 -- 172.21.15.90:0/3520787686 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7ff0a401a450 con 0x7ff0b40ca520 2023-06-09T04:41:32.617 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:32.612+0000 7ff0b17fa700 1 -- 172.21.15.90:0/3520787686 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7ff0a401add0 con 0x7ff0b40ca520 2023-06-09T04:41:32.617 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:32.612+0000 7ff0b9b58700 1 -- 172.21.15.90:0/3520787686 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0b404db30 con 0x7ff0b40ca520 2023-06-09T04:41:32.619 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:32.616+0000 7ff0b17fa700 1 -- 172.21.15.90:0/3520787686 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7ff0a401f060 con 0x7ff0b40ca520 2023-06-09T04:41:32.668 INFO:tasks.ceph.mgr.x.smithi174.stderr:2023-06-09T04:41:32.663+0000 7fc902ef92c0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-06-09T04:41:32.682 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:32.676+0000 7ff0b9b58700 1 -- 172.21.15.90:0/3520787686 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff0b406c8f0 con 0x7ff0b40ca520 2023-06-09T04:41:32.683 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:32.680+0000 7ff0b17fa700 1 -- 172.21.15.90:0/3520787686 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7ff0a4028020 con 0x7ff0b40ca520 2023-06-09T04:41:32.683 INFO:teuthology.misc.health.smithi090.stdout: 2023-06-09T04:41:32.684 INFO:teuthology.misc.health.smithi090.stdout:{"epoch":10,"fsid":"700369c0-a111-43b4-9415-844ad1742b70","created":"2023-06-09T04:41:28.180311+0000","modified":"2023-06-09T04:41:31.262765+0000","last_up_change":"0.000000","last_in_change":"2023-06-09T04:41:31.262765+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"46a4a7c5-babd-4ef3-9830-51487cff5eb4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"1543988f-c498-494a-a6f9-fac8413db6ea","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"79669dd6-ffc8-4197-b9f7-b3b372b2b9b4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"4062ab6f-ce40-450a-aa17-b10098766c7b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"a10820e4-b348-4d92-9796-3b01484ace1c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"b4da1c32-be05-420b-9346-90d91aa70569","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"d1b98041-d243-4355-bd0a-e22cf9875b32","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"5a207936-f89f-416b-b79b-34ec96f77c8f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:41:32.684 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:32.680+0000 7ff0b9b58700 1 -- 172.21.15.90:0/3520787686 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff0b40ca520 msgr2=0x7ff0b40c5460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:32.684 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:32.680+0000 7ff0b9b58700 1 --2- 172.21.15.90:0/3520787686 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff0b40ca520 0x7ff0b40c5460 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7ff0a400c770 tx=0x7ff0a400ca80 comp rx=0 tx=0).stop 2023-06-09T04:41:32.685 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:32.680+0000 7ff0b9b58700 1 -- 172.21.15.90:0/3520787686 shutdown_connections 2023-06-09T04:41:32.685 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:32.680+0000 7ff0b9b58700 1 --2- 172.21.15.90:0/3520787686 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff0b4160500 0x7ff0b4155df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:32.685 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:32.680+0000 7ff0b9b58700 1 --2- 172.21.15.90:0/3520787686 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff0b40ca520 0x7ff0b40c5460 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:32.685 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:32.680+0000 7ff0b9b58700 1 --2- 172.21.15.90:0/3520787686 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff0b406bed0 0x7ff0b40c4a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:32.686 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:32.680+0000 7ff0b9b58700 1 -- 172.21.15.90:0/3520787686 >> 172.21.15.90:0/3520787686 conn(0x7ff0b40ce390 msgr2=0x7ff0b4162cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:32.686 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:32.680+0000 7ff0b9b58700 1 -- 172.21.15.90:0/3520787686 shutdown_connections 2023-06-09T04:41:32.686 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:32.680+0000 7ff0b9b58700 1 -- 172.21.15.90:0/3520787686 wait complete. 2023-06-09T04:41:32.699 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-06-09T04:41:32.838 INFO:tasks.ceph.mgr.x.smithi174.stderr:2023-06-09T04:41:32.835+0000 7fc902ef92c0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-06-09T04:41:32.923 INFO:tasks.ceph.mgr.y.smithi090.stderr:2023-06-09T04:41:32.920+0000 7f36f99f92c0 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-06-09T04:41:32.930 INFO:tasks.ceph.mgr.x.smithi174.stderr:2023-06-09T04:41:32.927+0000 7fc902ef92c0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-06-09T04:41:33.016 INFO:tasks.ceph.mgr.y.smithi090.stderr:2023-06-09T04:41:33.012+0000 7f36f99f92c0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-06-09T04:41:33.032 INFO:tasks.ceph.mgr.x.smithi174.stderr:2023-06-09T04:41:33.027+0000 7fc902ef92c0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-06-09T04:41:33.203 INFO:tasks.ceph.mgr.y.smithi090.stderr:2023-06-09T04:41:33.200+0000 7f36f99f92c0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-06-09T04:41:33.253 INFO:tasks.ceph.mgr.x.smithi174.stderr:2023-06-09T04:41:33.247+0000 7fc902ef92c0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-06-09T04:41:33.295 INFO:tasks.ceph.mgr.y.smithi090.stderr:2023-06-09T04:41:33.292+0000 7f36f99f92c0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-06-09T04:41:33.397 INFO:tasks.ceph.mgr.y.smithi090.stderr:2023-06-09T04:41:33.392+0000 7f36f99f92c0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-06-09T04:41:33.517 INFO:tasks.ceph.mgr.x.smithi174.stderr:2023-06-09T04:41:33.511+0000 7fc902ef92c0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-06-09T04:41:33.624 INFO:tasks.ceph.mgr.y.smithi090.stderr:2023-06-09T04:41:33.620+0000 7f36f99f92c0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-06-09T04:41:33.884 INFO:tasks.ceph.mgr.y.smithi090.stderr:2023-06-09T04:41:33.880+0000 7f36f99f92c0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-06-09T04:41:34.284 INFO:tasks.ceph.mgr.x.smithi174.stderr:2023-06-09T04:41:34.279+0000 7fc902ef92c0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-06-09T04:41:34.667 INFO:tasks.ceph.mgr.y.smithi090.stderr:2023-06-09T04:41:34.664+0000 7f36f99f92c0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-06-09T04:41:35.320 INFO:tasks.ceph.mgr.x.smithi174.stderr:2023-06-09T04:41:35.315+0000 7fc8ea17d700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-06-09T04:41:35.320 INFO:tasks.ceph.mgr.x.smithi174.stderr:2023-06-09T04:41:35.315+0000 7fc8ea17d700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-06-09T04:41:35.886 INFO:tasks.ceph.osd.6.smithi174.stderr:2023-06-09T04:41:35.883+0000 7f4e51c2f700 -1 osd.6 0 log_to_monitors true 2023-06-09T04:41:35.942 INFO:tasks.ceph.osd.1.smithi090.stderr:2023-06-09T04:41:35.936+0000 7fb26e058700 -1 osd.1 0 log_to_monitors true 2023-06-09T04:41:35.958 INFO:tasks.ceph.osd.2.smithi090.stderr:2023-06-09T04:41:35.952+0000 7f2d2a8a4700 -1 osd.2 0 log_to_monitors true 2023-06-09T04:41:35.961 INFO:tasks.ceph.osd.7.smithi174.stderr:2023-06-09T04:41:35.959+0000 7fc93ddf0700 -1 osd.7 0 log_to_monitors true 2023-06-09T04:41:35.997 INFO:tasks.ceph.osd.0.smithi090.stderr:2023-06-09T04:41:35.992+0000 7f31cb778700 -1 osd.0 0 log_to_monitors true 2023-06-09T04:41:36.038 INFO:tasks.ceph.osd.3.smithi090.stderr:2023-06-09T04:41:36.032+0000 7f3d2d3d5700 -1 osd.3 0 log_to_monitors true 2023-06-09T04:41:36.051 INFO:tasks.ceph.osd.4.smithi174.stderr:2023-06-09T04:41:36.047+0000 7f38286fa700 -1 osd.4 0 log_to_monitors true 2023-06-09T04:41:36.062 INFO:tasks.ceph.osd.5.smithi174.stderr:2023-06-09T04:41:36.059+0000 7fa7cf2e4700 -1 osd.5 0 log_to_monitors true 2023-06-09T04:41:39.505 DEBUG:teuthology.orchestra.run.smithi090:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-06-09T04:41:39.740 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:39.736+0000 7f3196fd5700 1 Processor -- start 2023-06-09T04:41:39.742 INFO:tasks.ceph.osd.0.smithi090.stderr:2023-06-09T04:41:39.736+0000 7f31c873f700 -1 osd.0 0 waiting for initial osdmap 2023-06-09T04:41:39.743 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:39.736+0000 7f3196fd5700 1 -- start start 2023-06-09T04:41:39.743 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:39.740+0000 7f3196fd5700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f319015b750 0x7f319006a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:39.744 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:39.740+0000 7f3196fd5700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f319006f8c0 0x7f31900c8d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:39.744 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:39.740+0000 7f3196fd5700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31900ccd60 con 0x7f319006b990 2023-06-09T04:41:39.744 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:39.740+0000 7f3196fd5700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f319015bb20 con 0x7f319006f8c0 2023-06-09T04:41:39.744 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:39.740+0000 7f3196fd5700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31900c9540 con 0x7f319015b750 2023-06-09T04:41:39.745 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:39.740+0000 7f31967d4700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f319006b990 0x7f319015bda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.90:34658/0 (socket says 172.21.15.90:34658) 2023-06-09T04:41:39.745 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:39.740+0000 7f31967d4700 1 -- 172.21.15.90:0/1240365088 learned_addr learned my addr 172.21.15.90:0/1240365088 (peer_addr_for_me v1:172.21.15.90:0/0) 2023-06-09T04:41:39.745 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:39.740+0000 7f3195fd3700 1 --2- 172.21.15.90:0/1240365088 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f319015b750 0x7f319006a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:39.745 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:39.740+0000 7f31957d2700 1 --2- 172.21.15.90:0/1240365088 >> v2:172.21.15.174:3300/0 conn(0x7f319006f8c0 0x7f31900c8d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:39.745 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:39.740+0000 7f3195fd3700 1 -- 172.21.15.90:0/1240365088 >> v2:172.21.15.174:3300/0 conn(0x7f319006f8c0 msgr2=0x7f31900c8d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:39.745 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:39.740+0000 7f3195fd3700 1 --2- 172.21.15.90:0/1240365088 >> v2:172.21.15.174:3300/0 conn(0x7f319006f8c0 0x7f31900c8d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:39.745 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:39.740+0000 7f3195fd3700 1 -- 172.21.15.90:0/1240365088 >> v1:172.21.15.174:6789/0 conn(0x7f319006b990 legacy=0x7f319015bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:39.746 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:39.740+0000 7f3195fd3700 1 -- 172.21.15.90:0/1240365088 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31900cc430 con 0x7f319015b750 2023-06-09T04:41:39.746 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:39.740+0000 7f3195fd3700 1 --2- 172.21.15.90:0/1240365088 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f319015b750 0x7f319006a3c0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f318000bb00 tx=0x7f318000be10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=237503142066c773 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:39.746 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:39.740+0000 7f3194fd1700 1 -- 172.21.15.90:0/1240365088 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3180006d30 con 0x7f319015b750 2023-06-09T04:41:39.746 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:39.740+0000 7f3194fd1700 1 -- 172.21.15.90:0/1240365088 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3180006e90 con 0x7f319015b750 2023-06-09T04:41:39.747 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:39.744+0000 7f3196fd5700 1 -- 172.21.15.90:0/1240365088 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f319015b750 msgr2=0x7f319006a3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:39.747 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:39.744+0000 7f3196fd5700 1 --2- 172.21.15.90:0/1240365088 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f319015b750 0x7f319006a3c0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f318000bb00 tx=0x7f318000be10 comp rx=0 tx=0).stop 2023-06-09T04:41:39.747 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:39.744+0000 7f3196fd5700 1 -- 172.21.15.90:0/1240365088 shutdown_connections 2023-06-09T04:41:39.748 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:39.744+0000 7f3196fd5700 1 --2- 172.21.15.90:0/1240365088 >> v2:172.21.15.174:3300/0 conn(0x7f319006f8c0 0x7f31900c8d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:39.748 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:39.744+0000 7f3196fd5700 1 --2- 172.21.15.90:0/1240365088 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f319015b750 0x7f319006a3c0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:39.748 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:39.744+0000 7f3196fd5700 1 -- 172.21.15.90:0/1240365088 >> 172.21.15.90:0/1240365088 conn(0x7f31900ce390 msgr2=0x7f31900ce790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:39.748 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:39.744+0000 7f3196fd5700 1 -- 172.21.15.90:0/1240365088 shutdown_connections 2023-06-09T04:41:39.748 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:39.744+0000 7f3196fd5700 1 -- 172.21.15.90:0/1240365088 wait complete. 2023-06-09T04:41:39.753 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:39.748+0000 7f3196fd5700 1 Processor -- start 2023-06-09T04:41:39.753 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:39.748+0000 7f3196fd5700 1 -- start start 2023-06-09T04:41:39.753 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:39.748+0000 7f3196fd5700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f319006b990 0x7f31901559e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:39.754 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:39.748+0000 7f3196fd5700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f319006f8c0 0x7f31900b1200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:39.754 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:39.748+0000 7f3196fd5700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f319015b750 0x7f31900c47d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:39.754 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:39.748+0000 7f3195fd3700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f319006b990 0x7f31901559e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:39.754 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:39.748+0000 7f3195fd3700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f319006b990 0x7f31901559e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:37024/0 (socket says 172.21.15.90:37024) 2023-06-09T04:41:39.755 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:39.748+0000 7f3196fd5700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31900c4d10 con 0x7f319006b990 2023-06-09T04:41:39.755 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:39.748+0000 7f3196fd5700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3190156530 con 0x7f319015b750 2023-06-09T04:41:39.755 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:39.748+0000 7f31957d2700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f319006f8c0 0x7f31900b1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:39.756 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:39.748+0000 7f31957d2700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f319006f8c0 0x7f31900b1200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.90:49276/0 (socket says 172.21.15.90:49276) 2023-06-09T04:41:39.756 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:39.748+0000 7f31957d2700 1 -- 172.21.15.90:0/1260339913 learned_addr learned my addr 172.21.15.90:0/1260339913 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:41:39.756 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:39.752+0000 7f31967d4700 1 --2- 172.21.15.90:0/1260339913 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f319015b750 0x7f31900c47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:39.756 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:39.748+0000 7f3196fd5700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3190156810 con 0x7f319006f8c0 2023-06-09T04:41:39.756 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:39.752+0000 7f3195fd3700 1 -- 172.21.15.90:0/1260339913 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f319006f8c0 msgr2=0x7f31900b1200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:39.757 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:39.752+0000 7f3195fd3700 1 --2- 172.21.15.90:0/1260339913 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f319006f8c0 0x7f31900b1200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:39.757 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:39.752+0000 7f3195fd3700 1 -- 172.21.15.90:0/1260339913 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f319015b750 msgr2=0x7f31900c47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:39.757 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:39.752+0000 7f3195fd3700 1 --2- 172.21.15.90:0/1260339913 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f319015b750 0x7f31900c47d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:39.757 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:39.752+0000 7f3195fd3700 1 -- 172.21.15.90:0/1260339913 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f318000b760 con 0x7f319006b990 2023-06-09T04:41:39.757 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:39.752+0000 7f3195fd3700 1 --2- 172.21.15.90:0/1260339913 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f319006b990 0x7f31901559e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f3180018000 tx=0x7f3180004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:39.758 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:39.752+0000 7f318e7fc700 1 -- 172.21.15.90:0/1260339913 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f318001b890 con 0x7f319006b990 2023-06-09T04:41:39.758 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:39.752+0000 7f318e7fc700 1 -- 172.21.15.90:0/1260339913 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f318001ba30 con 0x7f319006b990 2023-06-09T04:41:39.758 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:39.752+0000 7f318e7fc700 1 -- 172.21.15.90:0/1260339913 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f318001bde0 con 0x7f319006b990 2023-06-09T04:41:39.759 INFO:tasks.ceph.osd.0.smithi090.stderr:2023-06-09T04:41:39.752+0000 7f31beff1700 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-06-09T04:41:39.759 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:39.752+0000 7f3196fd5700 1 -- 172.21.15.90:0/1260339913 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3190156af0 con 0x7f319006b990 2023-06-09T04:41:39.759 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:39.752+0000 7f3196fd5700 1 -- 172.21.15.90:0/1260339913 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31901570b0 con 0x7f319006b990 2023-06-09T04:41:39.762 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:39.756+0000 7f3196fd5700 1 -- 172.21.15.90:0/1260339913 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f319004db30 con 0x7f319006b990 2023-06-09T04:41:39.762 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:39.756+0000 7f318e7fc700 1 -- 172.21.15.90:0/1260339913 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) v1 ==== 85602+0+0 (secure 0 0 0) 0x7f3180025410 con 0x7f319006b990 2023-06-09T04:41:39.763 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:39.760+0000 7f318e7fc700 1 --2- 172.21.15.90:0/1260339913 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f31780663f0 0x7f31780688a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:39.763 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:39.760+0000 7f318e7fc700 1 -- 172.21.15.90:0/1260339913 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2231+0+0 (secure 0 0 0) 0x7f3180016030 con 0x7f319006b990 2023-06-09T04:41:39.766 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:39.764+0000 7f31957d2700 1 --2- 172.21.15.90:0/1260339913 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f31780663f0 0x7f31780688a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:39.767 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:39.764+0000 7f31957d2700 1 --2- 172.21.15.90:0/1260339913 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f31780663f0 0x7f31780688a0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f31900ce940 tx=0x7f3184008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:39.772 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:39.768+0000 7f318e7fc700 1 -- 172.21.15.90:0/1260339913 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3180052dc0 con 0x7f319006b990 2023-06-09T04:41:39.776 INFO:tasks.ceph.osd.6.smithi174.stderr:2023-06-09T04:41:39.771+0000 7f4e4d24b700 -1 osd.6 0 waiting for initial osdmap 2023-06-09T04:41:39.783 INFO:tasks.ceph.osd.6.smithi174.stderr:2023-06-09T04:41:39.779+0000 7f4e453f1700 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-06-09T04:41:39.803 INFO:tasks.ceph.osd.5.smithi174.stderr:2023-06-09T04:41:39.799+0000 7fa7ca900700 -1 osd.5 0 waiting for initial osdmap 2023-06-09T04:41:39.809 INFO:tasks.ceph.osd.5.smithi174.stderr:2023-06-09T04:41:39.803+0000 7fa7c29f1700 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-06-09T04:41:39.814 INFO:tasks.ceph.osd.2.smithi090.stderr:2023-06-09T04:41:39.808+0000 7f2d25ec0700 -1 osd.2 0 waiting for initial osdmap 2023-06-09T04:41:39.823 INFO:tasks.ceph.osd.2.smithi090.stderr:2023-06-09T04:41:39.820+0000 7f2d1dff1700 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-06-09T04:41:39.853 INFO:tasks.ceph.osd.4.smithi174.stderr:2023-06-09T04:41:39.847+0000 7f3823d16700 -1 osd.4 0 waiting for initial osdmap 2023-06-09T04:41:39.859 INFO:tasks.ceph.osd.4.smithi174.stderr:2023-06-09T04:41:39.855+0000 7f381bdf1700 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-06-09T04:41:39.873 INFO:tasks.ceph.osd.3.smithi090.stderr:2023-06-09T04:41:39.868+0000 7f3d289f1700 -1 osd.3 0 waiting for initial osdmap 2023-06-09T04:41:39.879 INFO:tasks.ceph.osd.7.smithi174.stderr:2023-06-09T04:41:39.875+0000 7fc93940c700 -1 osd.7 0 waiting for initial osdmap 2023-06-09T04:41:39.884 INFO:tasks.ceph.osd.3.smithi090.stderr:2023-06-09T04:41:39.880+0000 7f3d20bf1700 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-06-09T04:41:39.887 INFO:tasks.ceph.osd.1.smithi090.stderr:2023-06-09T04:41:39.884+0000 7fb269674700 -1 osd.1 0 waiting for initial osdmap 2023-06-09T04:41:39.891 INFO:tasks.ceph.osd.7.smithi174.stderr:2023-06-09T04:41:39.887+0000 7fc9315f1700 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-06-09T04:41:39.896 INFO:tasks.ceph.osd.1.smithi090.stderr:2023-06-09T04:41:39.892+0000 7fb2617f1700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-06-09T04:41:39.972 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:39.968+0000 7f3196fd5700 1 -- 172.21.15.90:0/1260339913 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3190156950 con 0x7f319006b990 2023-06-09T04:41:39.973 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:39.968+0000 7f318e7fc700 1 -- 172.21.15.90:0/1260339913 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f3190156950 con 0x7f319006b990 2023-06-09T04:41:39.973 INFO:teuthology.misc.health.smithi090.stdout: 2023-06-09T04:41:39.974 INFO:teuthology.misc.health.smithi090.stdout:{"epoch":12,"fsid":"700369c0-a111-43b4-9415-844ad1742b70","created":"2023-06-09T04:41:28.180311+0000","modified":"2023-06-09T04:41:37.363932+0000","last_up_change":"0.000000","last_in_change":"2023-06-09T04:41:31.262765+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"46a4a7c5-babd-4ef3-9830-51487cff5eb4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"1543988f-c498-494a-a6f9-fac8413db6ea","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"79669dd6-ffc8-4197-b9f7-b3b372b2b9b4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"4062ab6f-ce40-450a-aa17-b10098766c7b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"a10820e4-b348-4d92-9796-3b01484ace1c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"b4da1c32-be05-420b-9346-90d91aa70569","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"d1b98041-d243-4355-bd0a-e22cf9875b32","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"5a207936-f89f-416b-b79b-34ec96f77c8f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:41:39.977 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:39.972+0000 7f3196fd5700 1 -- 172.21.15.90:0/1260339913 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f31780663f0 msgr2=0x7f31780688a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:39.977 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:39.972+0000 7f3196fd5700 1 --2- 172.21.15.90:0/1260339913 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f31780663f0 0x7f31780688a0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f31900ce940 tx=0x7f3184008040 comp rx=0 tx=0).stop 2023-06-09T04:41:39.978 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:39.972+0000 7f3196fd5700 1 -- 172.21.15.90:0/1260339913 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f319006b990 msgr2=0x7f31901559e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:39.978 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:39.972+0000 7f3196fd5700 1 --2- 172.21.15.90:0/1260339913 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f319006b990 0x7f31901559e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f3180018000 tx=0x7f3180004770 comp rx=0 tx=0).stop 2023-06-09T04:41:39.978 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:39.972+0000 7f3196fd5700 1 -- 172.21.15.90:0/1260339913 shutdown_connections 2023-06-09T04:41:39.978 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:39.972+0000 7f3196fd5700 1 --2- 172.21.15.90:0/1260339913 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f31780663f0 0x7f31780688a0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:39.978 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:39.972+0000 7f3196fd5700 1 --2- 172.21.15.90:0/1260339913 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f319015b750 0x7f31900c47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:39.978 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:39.972+0000 7f3196fd5700 1 --2- 172.21.15.90:0/1260339913 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f319006f8c0 0x7f31900b1200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:39.978 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:39.972+0000 7f3196fd5700 1 --2- 172.21.15.90:0/1260339913 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f319006b990 0x7f31901559e0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:39.979 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:39.972+0000 7f3196fd5700 1 -- 172.21.15.90:0/1260339913 >> 172.21.15.90:0/1260339913 conn(0x7f31900ce390 msgr2=0x7f319006bd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:39.979 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:39.972+0000 7f3196fd5700 1 -- 172.21.15.90:0/1260339913 shutdown_connections 2023-06-09T04:41:39.979 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:39.972+0000 7f3196fd5700 1 -- 172.21.15.90:0/1260339913 wait complete. 2023-06-09T04:41:39.995 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-06-09T04:41:46.800 DEBUG:teuthology.orchestra.run.smithi090:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-06-09T04:41:46.961 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:46.956+0000 7f9c6359e700 1 Processor -- start 2023-06-09T04:41:46.962 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:46.956+0000 7f9c6359e700 1 -- start start 2023-06-09T04:41:46.964 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:46.960+0000 7f9c6359e700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f9c6406b990 0x7f9c6406be10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:46.964 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:46.960+0000 7f9c6359e700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c640c8d10 con 0x7f9c64156840 2023-06-09T04:41:46.964 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:46.960+0000 7f9c6359e700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c640c8f60 con 0x7f9c64070180 2023-06-09T04:41:46.964 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:46.960+0000 7f9c6359e700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c6406c350 con 0x7f9c6406b990 2023-06-09T04:41:46.965 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:46.960+0000 7f9c6259c700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f9c64156840 0x7f9c64159da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:46794/0 (socket says 172.21.15.90:46794) 2023-06-09T04:41:46.965 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:46.960+0000 7f9c6259c700 1 -- 172.21.15.90:0/1332995050 learned_addr learned my addr 172.21.15.90:0/1332995050 (peer_addr_for_me v1:172.21.15.90:0/0) 2023-06-09T04:41:46.966 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:46.960+0000 7f9c5bfff700 1 --2- 172.21.15.90:0/1332995050 >> v2:172.21.15.90:3300/0 conn(0x7f9c6406b990 0x7f9c6406be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:46.966 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:46.960+0000 7f9c61d9b700 1 -- 172.21.15.90:0/1332995050 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 453255420 0 0) 0x7f9c640c8d10 con 0x7f9c64156840 2023-06-09T04:41:46.966 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:46.960+0000 7f9c61d9b700 1 -- 172.21.15.90:0/1332995050 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c500035d0 con 0x7f9c64156840 2023-06-09T04:41:46.966 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:46.960+0000 7f9c5bfff700 1 -- 172.21.15.90:0/1332995050 >> v1:172.21.15.174:6789/0 conn(0x7f9c64070180 legacy=0x7f9c640705e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:46.966 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:46.960+0000 7f9c5bfff700 1 -- 172.21.15.90:0/1332995050 >> v1:172.21.15.90:6789/0 conn(0x7f9c64156840 legacy=0x7f9c64159da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:46.966 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:46.960+0000 7f9c5bfff700 1 -- 172.21.15.90:0/1332995050 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c640c9240 con 0x7f9c6406b990 2023-06-09T04:41:46.967 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:46.960+0000 7f9c5bfff700 1 --2- 172.21.15.90:0/1332995050 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9c6406b990 0x7f9c6406be10 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f9c4c009850 tx=0x7f9c4c009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b92eb0aa6be91bed server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:46.967 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:46.960+0000 7f9c61d9b700 1 -- 172.21.15.90:0/1332995050 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c4c011830 con 0x7f9c6406b990 2023-06-09T04:41:46.967 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:46.964+0000 7f9c61d9b700 1 -- 172.21.15.90:0/1332995050 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c4c011990 con 0x7f9c6406b990 2023-06-09T04:41:46.967 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:46.964+0000 7f9c61d9b700 1 -- 172.21.15.90:0/1332995050 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c4c011d40 con 0x7f9c6406b990 2023-06-09T04:41:46.968 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:46.964+0000 7f9c6359e700 1 -- 172.21.15.90:0/1332995050 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9c6406b990 msgr2=0x7f9c6406be10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:46.968 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:46.964+0000 7f9c6359e700 1 --2- 172.21.15.90:0/1332995050 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9c6406b990 0x7f9c6406be10 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f9c4c009850 tx=0x7f9c4c009b60 comp rx=0 tx=0).stop 2023-06-09T04:41:46.968 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:46.964+0000 7f9c6359e700 1 -- 172.21.15.90:0/1332995050 shutdown_connections 2023-06-09T04:41:46.969 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:46.964+0000 7f9c6359e700 1 --2- 172.21.15.90:0/1332995050 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9c6406b990 0x7f9c6406be10 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:46.969 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:46.964+0000 7f9c6359e700 1 -- 172.21.15.90:0/1332995050 >> 172.21.15.90:0/1332995050 conn(0x7f9c640ce390 msgr2=0x7f9c640ce790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:46.969 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:46.964+0000 7f9c6359e700 1 -- 172.21.15.90:0/1332995050 shutdown_connections 2023-06-09T04:41:46.969 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:46.964+0000 7f9c6359e700 1 -- 172.21.15.90:0/1332995050 wait complete. 2023-06-09T04:41:46.971 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:46.968+0000 7f9c6359e700 1 Processor -- start 2023-06-09T04:41:46.972 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:46.968+0000 7f9c6359e700 1 -- start start 2023-06-09T04:41:46.973 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:46.968+0000 7f9c6359e700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9c6406b990 0x7f9c640cb0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:46.973 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:46.968+0000 7f9c6359e700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9c64070180 0x7f9c641585a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:46.973 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:46.968+0000 7f9c6359e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9c64156840 0x7f9c64158ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:46.973 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:46.968+0000 7f9c6359e700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c640c75a0 con 0x7f9c6406b990 2023-06-09T04:41:46.973 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:46.968+0000 7f9c6359e700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c64159110 con 0x7f9c64070180 2023-06-09T04:41:46.973 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:46.968+0000 7f9c6359e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c640c6c00 con 0x7f9c64156840 2023-06-09T04:41:46.975 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:46.968+0000 7f9c6259c700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9c6406b990 0x7f9c640cb0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:46.975 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:46.968+0000 7f9c6259c700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9c6406b990 0x7f9c640cb0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:55744/0 (socket says 172.21.15.90:55744) 2023-06-09T04:41:46.975 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:46.968+0000 7f9c6259c700 1 -- 172.21.15.90:0/3186928236 learned_addr learned my addr 172.21.15.90:0/3186928236 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:41:46.975 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:46.968+0000 7f9c62d9d700 1 --2- 172.21.15.90:0/3186928236 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9c64156840 0x7f9c64158ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:46.975 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:46.968+0000 7f9c5bfff700 1 --2- 172.21.15.90:0/3186928236 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9c64070180 0x7f9c641585a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:46.975 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:46.968+0000 7f9c6259c700 1 -- 172.21.15.90:0/3186928236 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9c64156840 msgr2=0x7f9c64158ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:46.975 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:46.968+0000 7f9c6259c700 1 --2- 172.21.15.90:0/3186928236 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9c64156840 0x7f9c64158ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:46.976 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:46.968+0000 7f9c6259c700 1 -- 172.21.15.90:0/3186928236 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9c64070180 msgr2=0x7f9c641585a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:46.976 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:46.968+0000 7f9c6259c700 1 --2- 172.21.15.90:0/3186928236 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9c64070180 0x7f9c641585a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:46.976 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:46.968+0000 7f9c6259c700 1 -- 172.21.15.90:0/3186928236 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c4c0094b0 con 0x7f9c6406b990 2023-06-09T04:41:46.976 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:46.968+0000 7f9c62d9d700 1 --2- 172.21.15.90:0/3186928236 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9c64156840 0x7f9c64158ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:41:46.976 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:46.968+0000 7f9c5bfff700 1 --2- 172.21.15.90:0/3186928236 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9c64070180 0x7f9c641585a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:41:46.976 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:46.968+0000 7f9c6259c700 1 --2- 172.21.15.90:0/3186928236 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9c6406b990 0x7f9c640cb0e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f9c5400c700 tx=0x7f9c5400cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:46.976 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:46.968+0000 7f9c5affd700 1 -- 172.21.15.90:0/3186928236 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c54005d90 con 0x7f9c6406b990 2023-06-09T04:41:46.977 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:46.968+0000 7f9c5affd700 1 -- 172.21.15.90:0/3186928236 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c540070d0 con 0x7f9c6406b990 2023-06-09T04:41:46.977 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:46.968+0000 7f9c6359e700 1 -- 172.21.15.90:0/3186928236 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c640c6ee0 con 0x7f9c6406b990 2023-06-09T04:41:46.977 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:46.968+0000 7f9c5affd700 1 -- 172.21.15.90:0/3186928236 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c54007480 con 0x7f9c6406b990 2023-06-09T04:41:46.977 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:46.972+0000 7f9c6359e700 1 -- 172.21.15.90:0/3186928236 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c64157ae0 con 0x7f9c6406b990 2023-06-09T04:41:46.977 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:46.972+0000 7f9c6359e700 1 -- 172.21.15.90:0/3186928236 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c6404db30 con 0x7f9c6406b990 2023-06-09T04:41:46.978 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:46.972+0000 7f9c5affd700 1 -- 172.21.15.90:0/3186928236 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9c540075e0 con 0x7f9c6406b990 2023-06-09T04:41:46.980 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:46.976+0000 7f9c5affd700 1 --2- 172.21.15.90:0/3186928236 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f9c440662f0 0x7f9c440687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:46.980 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:46.976+0000 7f9c5affd700 1 -- 172.21.15.90:0/3186928236 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f9c54082f60 con 0x7f9c6406b990 2023-06-09T04:41:46.980 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:46.976+0000 7f9c5bfff700 1 --2- 172.21.15.90:0/3186928236 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f9c440662f0 0x7f9c440687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:46.982 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:46.976+0000 7f9c5bfff700 1 --2- 172.21.15.90:0/3186928236 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f9c440662f0 0x7f9c440687a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f9c640ad3e0 tx=0x7f9c4c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:46.986 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:46.984+0000 7f9c5affd700 1 -- 172.21.15.90:0/3186928236 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9c54050800 con 0x7f9c6406b990 2023-06-09T04:41:47.159 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:47.152+0000 7f9c6359e700 1 -- 172.21.15.90:0/3186928236 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9c6406c8f0 con 0x7f9c6406b990 2023-06-09T04:41:47.160 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:47.156+0000 7f9c5affd700 1 -- 172.21.15.90:0/3186928236 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12850 (secure 0 0 0) 0x7f9c54053e20 con 0x7f9c6406b990 2023-06-09T04:41:47.161 INFO:teuthology.misc.health.smithi090.stdout: 2023-06-09T04:41:47.161 INFO:teuthology.misc.health.smithi090.stdout:{"epoch":17,"fsid":"700369c0-a111-43b4-9415-844ad1742b70","created":"2023-06-09T04:41:28.180311+0000","modified":"2023-06-09T04:41:44.805241+0000","last_up_change":"2023-06-09T04:41:40.746475+0000","last_in_change":"2023-06-09T04:41:31.262765+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-09T04:41:42.402564+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"46a4a7c5-babd-4ef3-9830-51487cff5eb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":2780271267},{"type":"v1","addr":"172.21.15.90:6809","nonce":2780271267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2780271267},{"type":"v1","addr":"172.21.15.90:6811","nonce":2780271267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2780271267},{"type":"v1","addr":"172.21.15.90:6815","nonce":2780271267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2780271267},{"type":"v1","addr":"172.21.15.90:6813","nonce":2780271267}]},"public_addr":"172.21.15.90:6809/2780271267","cluster_addr":"172.21.15.90:6811/2780271267","heartbeat_back_addr":"172.21.15.90:6815/2780271267","heartbeat_front_addr":"172.21.15.90:6813/2780271267","state":["exists","up"]},{"osd":1,"uuid":"1543988f-c498-494a-a6f9-fac8413db6ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":3064028136},{"type":"v1","addr":"172.21.15.90:6801","nonce":3064028136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":3064028136},{"type":"v1","addr":"172.21.15.90:6803","nonce":3064028136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":3064028136},{"type":"v1","addr":"172.21.15.90:6807","nonce":3064028136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":3064028136},{"type":"v1","addr":"172.21.15.90:6805","nonce":3064028136}]},"public_addr":"172.21.15.90:6801/3064028136","cluster_addr":"172.21.15.90:6803/3064028136","heartbeat_back_addr":"172.21.15.90:6807/3064028136","heartbeat_front_addr":"172.21.15.90:6805/3064028136","state":["exists","up"]},{"osd":2,"uuid":"79669dd6-ffc8-4197-b9f7-b3b372b2b9b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":3713146326},{"type":"v1","addr":"172.21.15.90:6825","nonce":3713146326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":3713146326},{"type":"v1","addr":"172.21.15.90:6827","nonce":3713146326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":3713146326},{"type":"v1","addr":"172.21.15.90:6831","nonce":3713146326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":3713146326},{"type":"v1","addr":"172.21.15.90:6829","nonce":3713146326}]},"public_addr":"172.21.15.90:6825/3713146326","cluster_addr":"172.21.15.90:6827/3713146326","heartbeat_back_addr":"172.21.15.90:6831/3713146326","heartbeat_front_addr":"172.21.15.90:6829/3713146326","state":["exists","up"]},{"osd":3,"uuid":"4062ab6f-ce40-450a-aa17-b10098766c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":3499839122},{"type":"v1","addr":"172.21.15.90:6817","nonce":3499839122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":3499839122},{"type":"v1","addr":"172.21.15.90:6819","nonce":3499839122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":3499839122},{"type":"v1","addr":"172.21.15.90:6823","nonce":3499839122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":3499839122},{"type":"v1","addr":"172.21.15.90:6821","nonce":3499839122}]},"public_addr":"172.21.15.90:6817/3499839122","cluster_addr":"172.21.15.90:6819/3499839122","heartbeat_back_addr":"172.21.15.90:6823/3499839122","heartbeat_front_addr":"172.21.15.90:6821/3499839122","state":["exists","up"]},{"osd":4,"uuid":"a10820e4-b348-4d92-9796-3b01484ace1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6817","nonce":1138565854},{"type":"v1","addr":"172.21.15.174:6819","nonce":1138565854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6821","nonce":1138565854},{"type":"v1","addr":"172.21.15.174:6823","nonce":1138565854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":1138565854},{"type":"v1","addr":"172.21.15.174:6831","nonce":1138565854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":1138565854},{"type":"v1","addr":"172.21.15.174:6829","nonce":1138565854}]},"public_addr":"172.21.15.174:6819/1138565854","cluster_addr":"172.21.15.174:6823/1138565854","heartbeat_back_addr":"172.21.15.174:6831/1138565854","heartbeat_front_addr":"172.21.15.174:6829/1138565854","state":["exists","up"]},{"osd":5,"uuid":"b4da1c32-be05-420b-9346-90d91aa70569","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":1707702879},{"type":"v1","addr":"172.21.15.174:6818","nonce":1707702879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":1707702879},{"type":"v1","addr":"172.21.15.174:6822","nonce":1707702879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6827","nonce":1707702879},{"type":"v1","addr":"172.21.15.174:6828","nonce":1707702879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":1707702879},{"type":"v1","addr":"172.21.15.174:6825","nonce":1707702879}]},"public_addr":"172.21.15.174:6818/1707702879","cluster_addr":"172.21.15.174:6822/1707702879","heartbeat_back_addr":"172.21.15.174:6828/1707702879","heartbeat_front_addr":"172.21.15.174:6825/1707702879","state":["exists","up"]},{"osd":6,"uuid":"d1b98041-d243-4355-bd0a-e22cf9875b32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":864450534},{"type":"v1","addr":"172.21.15.174:6801","nonce":864450534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":864450534},{"type":"v1","addr":"172.21.15.174:6803","nonce":864450534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":864450534},{"type":"v1","addr":"172.21.15.174:6807","nonce":864450534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":864450534},{"type":"v1","addr":"172.21.15.174:6805","nonce":864450534}]},"public_addr":"172.21.15.174:6801/864450534","cluster_addr":"172.21.15.174:6803/864450534","heartbeat_back_addr":"172.21.15.174:6807/864450534","heartbeat_front_addr":"172.21.15.174:6805/864450534","state":["exists","up"]},{"osd":7,"uuid":"5a207936-f89f-416b-b79b-34ec96f77c8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":2527640659},{"type":"v1","addr":"172.21.15.174:6809","nonce":2527640659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":2527640659},{"type":"v1","addr":"172.21.15.174:6811","nonce":2527640659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":2527640659},{"type":"v1","addr":"172.21.15.174:6815","nonce":2527640659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":2527640659},{"type":"v1","addr":"172.21.15.174:6813","nonce":2527640659}]},"public_addr":"172.21.15.174:6809/2527640659","cluster_addr":"172.21.15.174:6811/2527640659","heartbeat_back_addr":"172.21.15.174:6815/2527640659","heartbeat_front_addr":"172.21.15.174:6813/2527640659","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:36.972152+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:36.984561+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:36.998817+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:37.054944+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:37.085014+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:37.115125+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:36.854608+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:36.971685+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:41:47.163 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:47.160+0000 7f9c6359e700 1 -- 172.21.15.90:0/3186928236 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f9c440662f0 msgr2=0x7f9c440687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:47.163 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:47.160+0000 7f9c6359e700 1 --2- 172.21.15.90:0/3186928236 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f9c440662f0 0x7f9c440687a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f9c640ad3e0 tx=0x7f9c4c008030 comp rx=0 tx=0).stop 2023-06-09T04:41:47.164 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:47.160+0000 7f9c6359e700 1 -- 172.21.15.90:0/3186928236 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9c6406b990 msgr2=0x7f9c640cb0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:47.164 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:47.160+0000 7f9c6359e700 1 --2- 172.21.15.90:0/3186928236 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9c6406b990 0x7f9c640cb0e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f9c5400c700 tx=0x7f9c5400cac0 comp rx=0 tx=0).stop 2023-06-09T04:41:47.164 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:47.160+0000 7f9c6359e700 1 -- 172.21.15.90:0/3186928236 shutdown_connections 2023-06-09T04:41:47.164 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:47.160+0000 7f9c6359e700 1 --2- 172.21.15.90:0/3186928236 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f9c440662f0 0x7f9c440687a0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:47.164 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:47.160+0000 7f9c6359e700 1 --2- 172.21.15.90:0/3186928236 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9c64156840 0x7f9c64158ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:47.165 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:47.160+0000 7f9c6359e700 1 --2- 172.21.15.90:0/3186928236 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9c64070180 0x7f9c641585a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:47.165 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:47.160+0000 7f9c6359e700 1 --2- 172.21.15.90:0/3186928236 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9c6406b990 0x7f9c640cb0e0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:47.165 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:47.160+0000 7f9c6359e700 1 -- 172.21.15.90:0/3186928236 >> 172.21.15.90:0/3186928236 conn(0x7f9c640ce390 msgr2=0x7f9c6414dc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:47.165 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:47.160+0000 7f9c6359e700 1 -- 172.21.15.90:0/3186928236 shutdown_connections 2023-06-09T04:41:47.165 INFO:teuthology.misc.health.smithi090.stderr:2023-06-09T04:41:47.160+0000 7f9c6359e700 1 -- 172.21.15.90:0/3186928236 wait complete. 2023-06-09T04:41:47.181 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-06-09T04:41:47.181 INFO:tasks.ceph:Creating RBD pool 2023-06-09T04:41:47.181 DEBUG:teuthology.orchestra.run.smithi090:> sudo ceph --cluster ceph osd pool create rbd 8 2023-06-09T04:41:47.350 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:47.344+0000 7fa345f3e700 1 Processor -- start 2023-06-09T04:41:47.350 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:47.344+0000 7fa345f3e700 1 -- start start 2023-06-09T04:41:47.353 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:47.348+0000 7fa345f3e700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fa3400b1ca0 0x7fa340160920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:47.353 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:47.348+0000 7fa345f3e700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fa3400d2400 0x7fa3400d28a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:47.353 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:47.348+0000 7fa345f3e700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa34015c6b0 con 0x7fa3400b18d0 2023-06-09T04:41:47.354 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:47.348+0000 7fa345f3e700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3400d2de0 con 0x7fa3400d2400 2023-06-09T04:41:47.354 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:47.348+0000 7fa345f3e700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3400cf6a0 con 0x7fa3400b1ca0 2023-06-09T04:41:47.355 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:47.348+0000 7fa34573d700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fa3400d2400 0x7fa3400d28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:47.355 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:47.348+0000 7fa34573d700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fa3400d2400 0x7fa3400d28a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:55746/0 (socket says 172.21.15.90:55746) 2023-06-09T04:41:47.355 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:47.348+0000 7fa34573d700 1 -- 172.21.15.90:0/3334485892 learned_addr learned my addr 172.21.15.90:0/3334485892 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:41:47.355 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:47.348+0000 7fa33ffff700 1 --2- 172.21.15.90:0/3334485892 >> v2:172.21.15.174:3300/0 conn(0x7fa3400b1ca0 0x7fa340160920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:47.355 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:47.348+0000 7fa34573d700 1 -- 172.21.15.90:0/3334485892 >> v2:172.21.15.174:3300/0 conn(0x7fa3400b1ca0 msgr2=0x7fa340160920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:47.356 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:47.348+0000 7fa34573d700 1 --2- 172.21.15.90:0/3334485892 >> v2:172.21.15.174:3300/0 conn(0x7fa3400b1ca0 0x7fa340160920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:47.356 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:47.348+0000 7fa34573d700 1 -- 172.21.15.90:0/3334485892 >> v1:172.21.15.174:6789/0 conn(0x7fa3400b18d0 legacy=0x7fa3400cee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:47.356 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:47.348+0000 7fa34573d700 1 -- 172.21.15.90:0/3334485892 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3400cf980 con 0x7fa3400d2400 2023-06-09T04:41:47.356 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:47.352+0000 7fa34573d700 1 --2- 172.21.15.90:0/3334485892 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa3400d2400 0x7fa3400d28a0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fa3400b86a0 tx=0x7fa33800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ede03b1e813858b server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:47.356 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:47.352+0000 7fa33f7fe700 1 -- 172.21.15.90:0/3334485892 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa33800e070 con 0x7fa3400d2400 2023-06-09T04:41:47.356 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:47.352+0000 7fa33f7fe700 1 -- 172.21.15.90:0/3334485892 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa338003a40 con 0x7fa3400d2400 2023-06-09T04:41:47.356 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:47.352+0000 7fa33f7fe700 1 -- 172.21.15.90:0/3334485892 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa338003df0 con 0x7fa3400d2400 2023-06-09T04:41:47.357 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:47.352+0000 7fa345f3e700 1 -- 172.21.15.90:0/3334485892 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa3400d2400 msgr2=0x7fa3400d28a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:47.357 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:47.352+0000 7fa345f3e700 1 --2- 172.21.15.90:0/3334485892 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa3400d2400 0x7fa3400d28a0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fa3400b86a0 tx=0x7fa33800b330 comp rx=0 tx=0).stop 2023-06-09T04:41:47.357 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:47.352+0000 7fa345f3e700 1 -- 172.21.15.90:0/3334485892 shutdown_connections 2023-06-09T04:41:47.358 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:47.352+0000 7fa345f3e700 1 --2- 172.21.15.90:0/3334485892 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa3400d2400 0x7fa3400d28a0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:47.358 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:47.352+0000 7fa345f3e700 1 --2- 172.21.15.90:0/3334485892 >> v2:172.21.15.174:3300/0 conn(0x7fa3400b1ca0 0x7fa340160920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:47.358 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:47.352+0000 7fa345f3e700 1 -- 172.21.15.90:0/3334485892 >> 172.21.15.90:0/3334485892 conn(0x7fa34009b9b0 msgr2=0x7fa3400b55d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:47.358 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:47.352+0000 7fa345f3e700 1 -- 172.21.15.90:0/3334485892 shutdown_connections 2023-06-09T04:41:47.358 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:47.352+0000 7fa345f3e700 1 -- 172.21.15.90:0/3334485892 wait complete. 2023-06-09T04:41:47.360 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:47.356+0000 7fa345f3e700 1 Processor -- start 2023-06-09T04:41:47.360 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:47.356+0000 7fa345f3e700 1 -- start start 2023-06-09T04:41:47.363 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:47.356+0000 7fa345f3e700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa3400b18d0 0x7fa34006c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:47.363 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:47.356+0000 7fa345f3e700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa3400b1ca0 0x7fa3400b40c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:47.363 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:47.360+0000 7fa345f3e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa3400d2400 0x7fa3400b4600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:47.363 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:47.360+0000 7fa345f3e700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa34006bc00 con 0x7fa3400b18d0 2023-06-09T04:41:47.363 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:47.360+0000 7fa345f3e700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3400b20e0 con 0x7fa3400b1ca0 2023-06-09T04:41:47.363 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:47.360+0000 7fa345f3e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa34006b640 con 0x7fa3400d2400 2023-06-09T04:41:47.364 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:47.360+0000 7fa344f3c700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa3400b18d0 0x7fa34006c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:47.365 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:47.360+0000 7fa344f3c700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa3400b18d0 0x7fa34006c4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:55750/0 (socket says 172.21.15.90:55750) 2023-06-09T04:41:47.365 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:47.360+0000 7fa344f3c700 1 -- 172.21.15.90:0/3103914745 learned_addr learned my addr 172.21.15.90:0/3103914745 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:41:47.365 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:47.360+0000 7fa34573d700 1 --2- 172.21.15.90:0/3103914745 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa3400d2400 0x7fa3400b4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:47.366 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:47.360+0000 7fa33ffff700 1 --2- 172.21.15.90:0/3103914745 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa3400b1ca0 0x7fa3400b40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:47.366 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:47.360+0000 7fa344f3c700 1 -- 172.21.15.90:0/3103914745 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa3400d2400 msgr2=0x7fa3400b4600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:47.366 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:47.360+0000 7fa344f3c700 1 --2- 172.21.15.90:0/3103914745 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa3400d2400 0x7fa3400b4600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:47.366 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:47.360+0000 7fa344f3c700 1 -- 172.21.15.90:0/3103914745 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa3400b1ca0 msgr2=0x7fa3400b40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:47.366 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:47.360+0000 7fa344f3c700 1 --2- 172.21.15.90:0/3103914745 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa3400b1ca0 0x7fa3400b40c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:47.366 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:47.360+0000 7fa344f3c700 1 -- 172.21.15.90:0/3103914745 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa338009b30 con 0x7fa3400b18d0 2023-06-09T04:41:47.366 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:47.360+0000 7fa34573d700 1 --2- 172.21.15.90:0/3103914745 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa3400d2400 0x7fa3400b4600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:41:47.367 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:47.360+0000 7fa344f3c700 1 --2- 172.21.15.90:0/3103914745 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa3400b18d0 0x7fa34006c4f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fa33400c4d0 tx=0x7fa33400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:47.367 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:47.360+0000 7fa33d7fa700 1 -- 172.21.15.90:0/3103914745 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa334011790 con 0x7fa3400b18d0 2023-06-09T04:41:47.367 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:47.360+0000 7fa33d7fa700 1 -- 172.21.15.90:0/3103914745 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3340118f0 con 0x7fa3400b18d0 2023-06-09T04:41:47.367 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:47.360+0000 7fa345f3e700 1 -- 172.21.15.90:0/3103914745 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa34006b920 con 0x7fa3400b18d0 2023-06-09T04:41:47.368 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:47.360+0000 7fa33d7fa700 1 -- 172.21.15.90:0/3103914745 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa334011ca0 con 0x7fa3400b18d0 2023-06-09T04:41:47.368 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:47.360+0000 7fa345f3e700 1 -- 172.21.15.90:0/3103914745 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3400cac20 con 0x7fa3400b18d0 2023-06-09T04:41:47.368 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:47.364+0000 7fa345f3e700 1 -- 172.21.15.90:0/3103914745 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3400ca7a0 con 0x7fa3400b18d0 2023-06-09T04:41:47.368 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:47.364+0000 7fa33d7fa700 1 -- 172.21.15.90:0/3103914745 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa334012420 con 0x7fa3400b18d0 2023-06-09T04:41:47.370 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:47.364+0000 7fa33d7fa700 1 --2- 172.21.15.90:0/3103914745 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fa3240662f0 0x7fa3240687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:47.370 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:47.364+0000 7fa33d7fa700 1 -- 172.21.15.90:0/3103914745 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa3340834c0 con 0x7fa3400b18d0 2023-06-09T04:41:47.371 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:47.368+0000 7fa33ffff700 1 --2- 172.21.15.90:0/3103914745 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fa3240662f0 0x7fa3240687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:47.372 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:47.368+0000 7fa33ffff700 1 --2- 172.21.15.90:0/3103914745 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fa3240662f0 0x7fa3240687a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa3400cf310 tx=0x7fa32c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:47.373 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:47.368+0000 7fa33d7fa700 1 -- 172.21.15.90:0/3103914745 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa3400ca7a0 con 0x7fa3400b18d0 2023-06-09T04:41:47.542 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:47.536+0000 7fa345f3e700 1 -- 172.21.15.90:0/3103914745 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7fa3400ca7a0 con 0x7fa3400b18d0 2023-06-09T04:41:47.854 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:47.848+0000 7fa33d7fa700 1 -- 172.21.15.90:0/3103914745 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v18) v1 ==== 109+0+0 (secure 0 0 0) 0x7fa3400ca7a0 con 0x7fa3400b18d0 2023-06-09T04:41:47.860 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:47.856+0000 7fa345f3e700 1 -- 172.21.15.90:0/3103914745 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fa3240662f0 msgr2=0x7fa3240687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:47.861 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:47.856+0000 7fa345f3e700 1 --2- 172.21.15.90:0/3103914745 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fa3240662f0 0x7fa3240687a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa3400cf310 tx=0x7fa32c008040 comp rx=0 tx=0).stop 2023-06-09T04:41:47.861 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:47.856+0000 7fa345f3e700 1 -- 172.21.15.90:0/3103914745 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa3400b18d0 msgr2=0x7fa34006c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:47.861 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:47.856+0000 7fa345f3e700 1 --2- 172.21.15.90:0/3103914745 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa3400b18d0 0x7fa34006c4f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fa33400c4d0 tx=0x7fa33400c890 comp rx=0 tx=0).stop 2023-06-09T04:41:47.862 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:47.856+0000 7fa345f3e700 1 -- 172.21.15.90:0/3103914745 shutdown_connections 2023-06-09T04:41:47.862 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:47.856+0000 7fa345f3e700 1 --2- 172.21.15.90:0/3103914745 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fa3240662f0 0x7fa3240687a0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:47.862 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:47.856+0000 7fa345f3e700 1 --2- 172.21.15.90:0/3103914745 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa3400d2400 0x7fa3400b4600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:47.862 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:47.856+0000 7fa345f3e700 1 --2- 172.21.15.90:0/3103914745 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa3400b1ca0 0x7fa3400b40c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:47.862 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:47.856+0000 7fa345f3e700 1 --2- 172.21.15.90:0/3103914745 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa3400b18d0 0x7fa34006c4f0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:47.862 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:47.856+0000 7fa345f3e700 1 -- 172.21.15.90:0/3103914745 >> 172.21.15.90:0/3103914745 conn(0x7fa34009b9b0 msgr2=0x7fa3400ce9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:47.863 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:47.856+0000 7fa345f3e700 1 -- 172.21.15.90:0/3103914745 shutdown_connections 2023-06-09T04:41:47.863 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:47.856+0000 7fa345f3e700 1 -- 172.21.15.90:0/3103914745 wait complete. 2023-06-09T04:41:47.863 INFO:teuthology.orchestra.run.smithi090.stderr:pool 'rbd' created 2023-06-09T04:41:47.882 DEBUG:teuthology.orchestra.run.smithi090:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-06-09T04:41:48.037 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:41:48.041 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:41:48.057 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:48.052+0000 7fdde935d700 1 Processor -- start 2023-06-09T04:41:48.057 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:48.052+0000 7fdde935d700 1 -- start start 2023-06-09T04:41:48.060 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:48.056+0000 7fdde935d700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fdde4071830 0x7fdde40ca580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:48.061 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:48.056+0000 7fdde935d700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fdde406c000 0x7fdde4069820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:48.061 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:48.056+0000 7fdde935d700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdde40caac0 con 0x7fdde406f8c0 2023-06-09T04:41:48.062 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:48.056+0000 7fdde935d700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdde40b4340 con 0x7fdde406c000 2023-06-09T04:41:48.062 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:48.056+0000 7fdde935d700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdde4071c00 con 0x7fdde4071830 2023-06-09T04:41:48.062 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:48.056+0000 7fdde37fe700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fdde406c000 0x7fdde4069820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:48.062 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:48.056+0000 7fdde37fe700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fdde406c000 0x7fdde4069820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:55754/0 (socket says 172.21.15.90:55754) 2023-06-09T04:41:48.062 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:48.056+0000 7fdde37fe700 1 -- 172.21.15.90:0/4160629117 learned_addr learned my addr 172.21.15.90:0/4160629117 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:41:48.062 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:48.056+0000 7fdde2ffd700 1 --2- 172.21.15.90:0/4160629117 >> v2:172.21.15.174:3300/0 conn(0x7fdde4071830 0x7fdde40ca580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:48.063 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:48.056+0000 7fdde37fe700 1 -- 172.21.15.90:0/4160629117 >> v2:172.21.15.174:3300/0 conn(0x7fdde4071830 msgr2=0x7fdde40ca580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:48.063 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:48.056+0000 7fdde37fe700 1 --2- 172.21.15.90:0/4160629117 >> v2:172.21.15.174:3300/0 conn(0x7fdde4071830 0x7fdde40ca580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:48.063 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:48.056+0000 7fdde37fe700 1 -- 172.21.15.90:0/4160629117 >> v1:172.21.15.174:6789/0 conn(0x7fdde406f8c0 legacy=0x7fdde406b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:48.063 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:48.056+0000 7fdde37fe700 1 -- 172.21.15.90:0/4160629117 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdde415d870 con 0x7fdde406c000 2023-06-09T04:41:48.063 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:48.056+0000 7fdde2ffd700 1 --2- 172.21.15.90:0/4160629117 >> v2:172.21.15.174:3300/0 conn(0x7fdde4071830 0x7fdde40ca580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:41:48.064 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:48.056+0000 7fdde37fe700 1 --2- 172.21.15.90:0/4160629117 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdde406c000 0x7fdde4069820 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fdde406e9f0 tx=0x7fdddc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f1a4a9b71c88b99 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:48.064 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:48.056+0000 7fdde1ffb700 1 -- 172.21.15.90:0/4160629117 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdddc00e070 con 0x7fdde406c000 2023-06-09T04:41:48.065 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:48.060+0000 7fdde1ffb700 1 -- 172.21.15.90:0/4160629117 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdddc00b9c0 con 0x7fdde406c000 2023-06-09T04:41:48.065 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:48.060+0000 7fdde1ffb700 1 -- 172.21.15.90:0/4160629117 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdddc00bd70 con 0x7fdde406c000 2023-06-09T04:41:48.065 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:48.060+0000 7fdde935d700 1 -- 172.21.15.90:0/4160629117 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdde406c000 msgr2=0x7fdde4069820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:48.065 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:48.060+0000 7fdde935d700 1 --2- 172.21.15.90:0/4160629117 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdde406c000 0x7fdde4069820 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fdde406e9f0 tx=0x7fdddc00b330 comp rx=0 tx=0).stop 2023-06-09T04:41:48.065 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:48.060+0000 7fdde935d700 1 -- 172.21.15.90:0/4160629117 shutdown_connections 2023-06-09T04:41:48.065 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:48.060+0000 7fdde935d700 1 --2- 172.21.15.90:0/4160629117 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdde406c000 0x7fdde4069820 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:48.065 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:48.060+0000 7fdde935d700 1 --2- 172.21.15.90:0/4160629117 >> v2:172.21.15.174:3300/0 conn(0x7fdde4071830 0x7fdde40ca580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:48.066 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:48.060+0000 7fdde935d700 1 -- 172.21.15.90:0/4160629117 >> 172.21.15.90:0/4160629117 conn(0x7fdde40b0b20 msgr2=0x7fdde40ce300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:48.066 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:48.060+0000 7fdde935d700 1 -- 172.21.15.90:0/4160629117 shutdown_connections 2023-06-09T04:41:48.066 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:48.060+0000 7fdde935d700 1 -- 172.21.15.90:0/4160629117 wait complete. 2023-06-09T04:41:48.067 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:48.064+0000 7fdde935d700 1 Processor -- start 2023-06-09T04:41:48.068 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:48.064+0000 7fdde935d700 1 -- start start 2023-06-09T04:41:48.069 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:48.064+0000 7fdde935d700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdde406c000 0x7fdde40af340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:48.069 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:48.064+0000 7fdde935d700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdde406f8c0 0x7fdde40c6370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:48.069 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:48.064+0000 7fdde935d700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdde4071830 0x7fdde41f4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:48.069 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:48.064+0000 7fdde935d700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdde40af880 con 0x7fdde4071830 2023-06-09T04:41:48.069 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:48.064+0000 7fdde935d700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdde40c6c70 con 0x7fdde406c000 2023-06-09T04:41:48.070 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:48.064+0000 7fdde935d700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdde40c1ed0 con 0x7fdde406f8c0 2023-06-09T04:41:48.070 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:48.064+0000 7fdde37fe700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdde4071830 0x7fdde41f4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:48.070 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:48.064+0000 7fdde37fe700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdde4071830 0x7fdde41f4eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:55762/0 (socket says 172.21.15.90:55762) 2023-06-09T04:41:48.070 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:48.064+0000 7fdde37fe700 1 -- 172.21.15.90:0/4214267616 learned_addr learned my addr 172.21.15.90:0/4214267616 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:41:48.070 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:48.064+0000 7fdde2ffd700 1 --2- 172.21.15.90:0/4214267616 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdde406c000 0x7fdde40af340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:48.071 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:48.064+0000 7fdde27fc700 1 --2- 172.21.15.90:0/4214267616 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdde406f8c0 0x7fdde40c6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:48.073 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:48.064+0000 7fdde37fe700 1 -- 172.21.15.90:0/4214267616 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdde406f8c0 msgr2=0x7fdde40c6370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:48.073 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:48.064+0000 7fdde37fe700 1 --2- 172.21.15.90:0/4214267616 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdde406f8c0 0x7fdde40c6370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:48.073 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:48.064+0000 7fdde37fe700 1 -- 172.21.15.90:0/4214267616 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdde406c000 msgr2=0x7fdde40af340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:48.073 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:48.064+0000 7fdde37fe700 1 --2- 172.21.15.90:0/4214267616 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdde406c000 0x7fdde40af340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:48.074 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:48.064+0000 7fdde37fe700 1 -- 172.21.15.90:0/4214267616 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdddc009b30 con 0x7fdde4071830 2023-06-09T04:41:48.074 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:48.064+0000 7fdde37fe700 1 --2- 172.21.15.90:0/4214267616 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdde4071830 0x7fdde41f4eb0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fdde406daa0 tx=0x7fdddc004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:48.074 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:48.064+0000 7fddcb7fe700 1 -- 172.21.15.90:0/4214267616 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdddc004930 con 0x7fdde4071830 2023-06-09T04:41:48.075 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:48.064+0000 7fddcb7fe700 1 -- 172.21.15.90:0/4214267616 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdddc0099b0 con 0x7fdde4071830 2023-06-09T04:41:48.075 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:48.064+0000 7fdde935d700 1 -- 172.21.15.90:0/4214267616 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdde40c21b0 con 0x7fdde4071830 2023-06-09T04:41:48.075 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:48.064+0000 7fddcb7fe700 1 -- 172.21.15.90:0/4214267616 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdddc01c680 con 0x7fdde4071830 2023-06-09T04:41:48.075 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:48.064+0000 7fdde935d700 1 -- 172.21.15.90:0/4214267616 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdde40c2770 con 0x7fdde4071830 2023-06-09T04:41:48.076 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:48.068+0000 7fdde935d700 1 -- 172.21.15.90:0/4214267616 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdde40ca3f0 con 0x7fdde4071830 2023-06-09T04:41:48.076 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:48.068+0000 7fddcb7fe700 1 -- 172.21.15.90:0/4214267616 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fdddc01c7e0 con 0x7fdde4071830 2023-06-09T04:41:48.076 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:48.072+0000 7fddcb7fe700 1 --2- 172.21.15.90:0/4214267616 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fddd00662f0 0x7fddd00687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:48.077 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:48.072+0000 7fddcb7fe700 1 -- 172.21.15.90:0/4214267616 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5199+0+0 (secure 0 0 0) 0x7fdddc0855c0 con 0x7fdde4071830 2023-06-09T04:41:48.077 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:48.072+0000 7fdde2ffd700 1 --2- 172.21.15.90:0/4214267616 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fddd00662f0 0x7fddd00687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:48.077 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:48.072+0000 7fdde2ffd700 1 --2- 172.21.15.90:0/4214267616 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fddd00662f0 0x7fddd00687a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fddd400c960 tx=0x7fddd4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:48.081 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:48.076+0000 7fddcb7fe700 1 -- 172.21.15.90:0/4214267616 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fdddc052e30 con 0x7fdde4071830 2023-06-09T04:41:48.249 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:48.244+0000 7fdde935d700 1 -- 172.21.15.90:0/4214267616 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fdde404db30 con 0x7fdde4071830 2023-06-09T04:41:48.867 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:48.864+0000 7fddcb7fe700 1 -- 172.21.15.90:0/4214267616 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v19) v1 ==== 173+0+0 (secure 0 0 0) 0x7fdddc056450 con 0x7fdde4071830 2023-06-09T04:41:48.873 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:48.868+0000 7fdde935d700 1 -- 172.21.15.90:0/4214267616 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fddd00662f0 msgr2=0x7fddd00687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:48.874 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:48.868+0000 7fdde935d700 1 --2- 172.21.15.90:0/4214267616 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fddd00662f0 0x7fddd00687a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fddd400c960 tx=0x7fddd4008040 comp rx=0 tx=0).stop 2023-06-09T04:41:48.874 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:48.868+0000 7fdde935d700 1 -- 172.21.15.90:0/4214267616 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdde4071830 msgr2=0x7fdde41f4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:48.874 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:48.868+0000 7fdde935d700 1 --2- 172.21.15.90:0/4214267616 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdde4071830 0x7fdde41f4eb0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fdde406daa0 tx=0x7fdddc004af0 comp rx=0 tx=0).stop 2023-06-09T04:41:48.874 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:48.868+0000 7fdde935d700 1 -- 172.21.15.90:0/4214267616 shutdown_connections 2023-06-09T04:41:48.874 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:48.868+0000 7fdde935d700 1 --2- 172.21.15.90:0/4214267616 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fddd00662f0 0x7fddd00687a0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:48.875 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:48.868+0000 7fdde935d700 1 --2- 172.21.15.90:0/4214267616 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdde4071830 0x7fdde41f4eb0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:48.875 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:48.868+0000 7fdde935d700 1 --2- 172.21.15.90:0/4214267616 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdde406f8c0 0x7fdde40c6370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:48.875 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:48.868+0000 7fdde935d700 1 --2- 172.21.15.90:0/4214267616 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdde406c000 0x7fdde40af340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:48.875 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:48.868+0000 7fdde935d700 1 -- 172.21.15.90:0/4214267616 >> 172.21.15.90:0/4214267616 conn(0x7fdde40b0b20 msgr2=0x7fdde406b8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:48.875 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:48.868+0000 7fdde935d700 1 -- 172.21.15.90:0/4214267616 shutdown_connections 2023-06-09T04:41:48.875 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:48.868+0000 7fdde935d700 1 -- 172.21.15.90:0/4214267616 wait complete. 2023-06-09T04:41:48.876 INFO:teuthology.orchestra.run.smithi090.stderr:enabled application 'rbd' on pool 'rbd' 2023-06-09T04:41:48.895 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-06-09T04:41:48.896 INFO:tasks.ceph.mds.a:Restarting daemon 2023-06-09T04:41:48.896 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-06-09T04:41:48.902 INFO:tasks.ceph.mds.a:Started 2023-06-09T04:41:48.902 INFO:tasks.ceph.mds.c:Restarting daemon 2023-06-09T04:41:48.903 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-06-09T04:41:48.907 INFO:tasks.ceph.mds.c:Started 2023-06-09T04:41:48.908 INFO:tasks.ceph.mds.b:Restarting daemon 2023-06-09T04:41:48.908 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-06-09T04:41:48.916 INFO:tasks.ceph.mds.b:Started 2023-06-09T04:41:48.916 INFO:tasks.ceph.mds.d:Restarting daemon 2023-06-09T04:41:48.917 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-06-09T04:41:48.921 INFO:tasks.ceph.mds.d:Started 2023-06-09T04:41:48.921 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-06-09T04:41:48.922 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T04:41:49.018 INFO:tasks.ceph.mds.a.smithi090.stdout:starting mds.a at 2023-06-09T04:41:49.025 INFO:tasks.ceph.mds.c.smithi090.stdout:starting mds.c at 2023-06-09T04:41:49.042 INFO:tasks.ceph.mds.d.smithi174.stdout:starting mds.d at 2023-06-09T04:41:49.043 INFO:tasks.ceph.mds.b.smithi174.stdout:starting mds.b at 2023-06-09T04:41:49.101 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.096+0000 7f51dd997700 1 Processor -- start 2023-06-09T04:41:49.101 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.096+0000 7f51dd997700 1 -- start start 2023-06-09T04:41:49.104 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.100+0000 7f51dd997700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f51d80cb030 0x7f51d8160610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:49.104 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.100+0000 7f51dd997700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f51d80cb400 0x7f51d8070a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:49.104 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.100+0000 7f51dd997700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51d8160b50 con 0x7f51d80ce170 2023-06-09T04:41:49.104 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.100+0000 7f51dd997700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51d80ce730 con 0x7f51d80cb400 2023-06-09T04:41:49.104 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.100+0000 7f51dd997700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51d80cea10 con 0x7f51d80cb030 2023-06-09T04:41:49.105 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.100+0000 7f51d7fff700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f51d80cb400 0x7f51d8070a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:49.105 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.100+0000 7f51dc995700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f51d80cb030 0x7f51d8160610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:49.105 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.100+0000 7f51d7fff700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f51d80cb400 0x7f51d8070a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:55816/0 (socket says 172.21.15.90:55816) 2023-06-09T04:41:49.106 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.100+0000 7f51d7fff700 1 -- 172.21.15.90:0/4230094195 learned_addr learned my addr 172.21.15.90:0/4230094195 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:41:49.106 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.100+0000 7f51dd196700 1 --1- 172.21.15.90:0/4230094195 >> v1:172.21.15.174:6789/0 conn(0x7f51d80ce170 0x7f51d80ccf50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.90:46822/0 (socket says 172.21.15.90:46822) 2023-06-09T04:41:49.106 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.100+0000 7f51d7fff700 1 -- 172.21.15.90:0/4230094195 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f51d80cb030 msgr2=0x7f51d8160610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:49.106 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.100+0000 7f51d7fff700 1 --2- 172.21.15.90:0/4230094195 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f51d80cb030 0x7f51d8160610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:49.107 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.100+0000 7f51d7fff700 1 -- 172.21.15.90:0/4230094195 >> v1:172.21.15.174:6789/0 conn(0x7f51d80ce170 legacy=0x7f51d80ccf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:49.107 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.100+0000 7f51d77fe700 1 -- 172.21.15.90:0/4230094195 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 655784733 0 0) 0x7f51d8160b50 con 0x7f51d80ce170 2023-06-09T04:41:49.107 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.100+0000 7f51d7fff700 1 -- 172.21.15.90:0/4230094195 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51d80cecf0 con 0x7f51d80cb400 2023-06-09T04:41:49.107 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.100+0000 7f51d7fff700 1 --2- 172.21.15.90:0/4230094195 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f51d80cb400 0x7f51d8070a00 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f51c4009910 tx=0x7f51c4009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98f71bee2abb86e4 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:49.107 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.104+0000 7f51d77fe700 1 -- 172.21.15.90:0/4230094195 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51c4011830 con 0x7f51d80cb400 2023-06-09T04:41:49.107 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.104+0000 7f51d77fe700 1 -- 172.21.15.90:0/4230094195 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51c4011990 con 0x7f51d80cb400 2023-06-09T04:41:49.108 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.104+0000 7f51d77fe700 1 -- 172.21.15.90:0/4230094195 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51c4011d40 con 0x7f51d80cb400 2023-06-09T04:41:49.108 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.104+0000 7f51dd997700 1 -- 172.21.15.90:0/4230094195 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f51d80cb400 msgr2=0x7f51d8070a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:49.109 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.104+0000 7f51dd997700 1 --2- 172.21.15.90:0/4230094195 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f51d80cb400 0x7f51d8070a00 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f51c4009910 tx=0x7f51c4009c20 comp rx=0 tx=0).stop 2023-06-09T04:41:49.109 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.104+0000 7f51dd997700 1 -- 172.21.15.90:0/4230094195 shutdown_connections 2023-06-09T04:41:49.109 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.104+0000 7f51dd997700 1 --2- 172.21.15.90:0/4230094195 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f51d80cb400 0x7f51d8070a00 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:49.109 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.104+0000 7f51dd997700 1 --2- 172.21.15.90:0/4230094195 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f51d80cb030 0x7f51d8160610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:49.109 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.104+0000 7f51dd997700 1 -- 172.21.15.90:0/4230094195 >> 172.21.15.90:0/4230094195 conn(0x7f51d80b1b50 msgr2=0x7f51d80cf380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:49.109 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.104+0000 7f51dd997700 1 -- 172.21.15.90:0/4230094195 shutdown_connections 2023-06-09T04:41:49.109 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.104+0000 7f51dd997700 1 -- 172.21.15.90:0/4230094195 wait complete. 2023-06-09T04:41:49.110 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.104+0000 7f51dd997700 1 Processor -- start 2023-06-09T04:41:49.110 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.104+0000 7f51dd997700 1 -- start start 2023-06-09T04:41:49.111 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.108+0000 7f51dd997700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f51d80cb030 0x7f51d81f1480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:49.112 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.108+0000 7f51dd997700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f51d80cb400 0x7f51d815f050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:49.112 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.108+0000 7f51dd997700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f51d80ce170 0x7f51d81f5940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:49.112 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.108+0000 7f51dd997700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51d81f5e80 con 0x7f51d80cb030 2023-06-09T04:41:49.112 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.108+0000 7f51dd997700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51d81f28d0 con 0x7f51d80cb400 2023-06-09T04:41:49.112 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.108+0000 7f51dd997700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51d81f1b10 con 0x7f51d80ce170 2023-06-09T04:41:49.114 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.108+0000 7f51dc995700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f51d80cb030 0x7f51d81f1480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:49.114 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.108+0000 7f51dc995700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f51d80cb030 0x7f51d81f1480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:55832/0 (socket says 172.21.15.90:55832) 2023-06-09T04:41:49.114 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.108+0000 7f51dc995700 1 -- 172.21.15.90:0/1850054474 learned_addr learned my addr 172.21.15.90:0/1850054474 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:41:49.114 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.108+0000 7f51dd196700 1 --2- 172.21.15.90:0/1850054474 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f51d80ce170 0x7f51d81f5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:49.114 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.108+0000 7f51d7fff700 1 --2- 172.21.15.90:0/1850054474 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f51d80cb400 0x7f51d815f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:49.114 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.108+0000 7f51dc995700 1 -- 172.21.15.90:0/1850054474 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f51d80ce170 msgr2=0x7f51d81f5940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:49.115 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.108+0000 7f51dc995700 1 --2- 172.21.15.90:0/1850054474 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f51d80ce170 0x7f51d81f5940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:49.115 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.108+0000 7f51dc995700 1 -- 172.21.15.90:0/1850054474 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f51d80cb400 msgr2=0x7f51d815f050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:49.115 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.108+0000 7f51dc995700 1 --2- 172.21.15.90:0/1850054474 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f51d80cb400 0x7f51d815f050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:49.115 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.108+0000 7f51dc995700 1 -- 172.21.15.90:0/1850054474 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51c4009570 con 0x7f51d80cb030 2023-06-09T04:41:49.116 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.108+0000 7f51d7fff700 1 --2- 172.21.15.90:0/1850054474 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f51d80cb400 0x7f51d815f050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:41:49.116 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.108+0000 7f51dd196700 1 --2- 172.21.15.90:0/1850054474 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f51d80ce170 0x7f51d81f5940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:41:49.116 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.108+0000 7f51dc995700 1 --2- 172.21.15.90:0/1850054474 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f51d80cb030 0x7f51d81f1480 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f51cc00e9d0 tx=0x7f51cc00ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:49.116 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.108+0000 7f51d57fa700 1 -- 172.21.15.90:0/1850054474 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51cc009720 con 0x7f51d80cb030 2023-06-09T04:41:49.116 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.108+0000 7f51d57fa700 1 -- 172.21.15.90:0/1850054474 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51cc00c850 con 0x7f51d80cb030 2023-06-09T04:41:49.116 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.108+0000 7f51d57fa700 1 -- 172.21.15.90:0/1850054474 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51cc00cbc0 con 0x7f51d80cb030 2023-06-09T04:41:49.116 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.108+0000 7f51dd997700 1 -- 172.21.15.90:0/1850054474 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51d81f1df0 con 0x7f51d80cb030 2023-06-09T04:41:49.117 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.108+0000 7f51dd997700 1 -- 172.21.15.90:0/1850054474 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51d81f23b0 con 0x7f51d80cb030 2023-06-09T04:41:49.117 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.112+0000 7f51dd997700 1 -- 172.21.15.90:0/1850054474 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51d804e380 con 0x7f51d80cb030 2023-06-09T04:41:49.117 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.112+0000 7f51d57fa700 1 -- 172.21.15.90:0/1850054474 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f51cc00cd20 con 0x7f51d80cb030 2023-06-09T04:41:49.119 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.116+0000 7f51d57fa700 1 --2- 172.21.15.90:0/1850054474 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f51bc0662f0 0x7f51bc0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:49.119 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.116+0000 7f51d57fa700 1 -- 172.21.15.90:0/1850054474 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f51cc083bf0 con 0x7f51d80cb030 2023-06-09T04:41:49.120 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.116+0000 7f51d7fff700 1 --2- 172.21.15.90:0/1850054474 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f51bc0662f0 0x7f51bc0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:49.121 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.116+0000 7f51d7fff700 1 --2- 172.21.15.90:0/1850054474 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f51bc0662f0 0x7f51bc0687a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f51d80cb830 tx=0x7f51c4008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:49.123 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.120+0000 7f51d57fa700 1 -- 172.21.15.90:0/1850054474 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f51cc051320 con 0x7f51d80cb030 2023-06-09T04:41:49.294 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.288+0000 7f51dd997700 1 -- 172.21.15.90:0/1850054474 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f51d8071da0 con 0x7f51d80cb030 2023-06-09T04:41:49.296 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.292+0000 7f51d57fa700 1 -- 172.21.15.90:0/1850054474 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+14649 (secure 0 0 0) 0x7f51cc017090 con 0x7f51d80cb030 2023-06-09T04:41:49.296 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:41:49.297 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":19,"fsid":"700369c0-a111-43b4-9415-844ad1742b70","created":"2023-06-09T04:41:28.180311+0000","modified":"2023-06-09T04:41:48.853687+0000","last_up_change":"2023-06-09T04:41:40.746475+0000","last_in_change":"2023-06-09T04:41:31.262765+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-09T04:41:42.402564+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-09T04:41:47.607323+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"46a4a7c5-babd-4ef3-9830-51487cff5eb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":2780271267},{"type":"v1","addr":"172.21.15.90:6809","nonce":2780271267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2780271267},{"type":"v1","addr":"172.21.15.90:6811","nonce":2780271267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2780271267},{"type":"v1","addr":"172.21.15.90:6815","nonce":2780271267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2780271267},{"type":"v1","addr":"172.21.15.90:6813","nonce":2780271267}]},"public_addr":"172.21.15.90:6809/2780271267","cluster_addr":"172.21.15.90:6811/2780271267","heartbeat_back_addr":"172.21.15.90:6815/2780271267","heartbeat_front_addr":"172.21.15.90:6813/2780271267","state":["exists","up"]},{"osd":1,"uuid":"1543988f-c498-494a-a6f9-fac8413db6ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":3064028136},{"type":"v1","addr":"172.21.15.90:6801","nonce":3064028136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":3064028136},{"type":"v1","addr":"172.21.15.90:6803","nonce":3064028136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":3064028136},{"type":"v1","addr":"172.21.15.90:6807","nonce":3064028136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":3064028136},{"type":"v1","addr":"172.21.15.90:6805","nonce":3064028136}]},"public_addr":"172.21.15.90:6801/3064028136","cluster_addr":"172.21.15.90:6803/3064028136","heartbeat_back_addr":"172.21.15.90:6807/3064028136","heartbeat_front_addr":"172.21.15.90:6805/3064028136","state":["exists","up"]},{"osd":2,"uuid":"79669dd6-ffc8-4197-b9f7-b3b372b2b9b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":3713146326},{"type":"v1","addr":"172.21.15.90:6825","nonce":3713146326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":3713146326},{"type":"v1","addr":"172.21.15.90:6827","nonce":3713146326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":3713146326},{"type":"v1","addr":"172.21.15.90:6831","nonce":3713146326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":3713146326},{"type":"v1","addr":"172.21.15.90:6829","nonce":3713146326}]},"public_addr":"172.21.15.90:6825/3713146326","cluster_addr":"172.21.15.90:6827/3713146326","heartbeat_back_addr":"172.21.15.90:6831/3713146326","heartbeat_front_addr":"172.21.15.90:6829/3713146326","state":["exists","up"]},{"osd":3,"uuid":"4062ab6f-ce40-450a-aa17-b10098766c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":3499839122},{"type":"v1","addr":"172.21.15.90:6817","nonce":3499839122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":3499839122},{"type":"v1","addr":"172.21.15.90:6819","nonce":3499839122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":3499839122},{"type":"v1","addr":"172.21.15.90:6823","nonce":3499839122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":3499839122},{"type":"v1","addr":"172.21.15.90:6821","nonce":3499839122}]},"public_addr":"172.21.15.90:6817/3499839122","cluster_addr":"172.21.15.90:6819/3499839122","heartbeat_back_addr":"172.21.15.90:6823/3499839122","heartbeat_front_addr":"172.21.15.90:6821/3499839122","state":["exists","up"]},{"osd":4,"uuid":"a10820e4-b348-4d92-9796-3b01484ace1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6817","nonce":1138565854},{"type":"v1","addr":"172.21.15.174:6819","nonce":1138565854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6821","nonce":1138565854},{"type":"v1","addr":"172.21.15.174:6823","nonce":1138565854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":1138565854},{"type":"v1","addr":"172.21.15.174:6831","nonce":1138565854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":1138565854},{"type":"v1","addr":"172.21.15.174:6829","nonce":1138565854}]},"public_addr":"172.21.15.174:6819/1138565854","cluster_addr":"172.21.15.174:6823/1138565854","heartbeat_back_addr":"172.21.15.174:6831/1138565854","heartbeat_front_addr":"172.21.15.174:6829/1138565854","state":["exists","up"]},{"osd":5,"uuid":"b4da1c32-be05-420b-9346-90d91aa70569","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":1707702879},{"type":"v1","addr":"172.21.15.174:6818","nonce":1707702879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":1707702879},{"type":"v1","addr":"172.21.15.174:6822","nonce":1707702879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6827","nonce":1707702879},{"type":"v1","addr":"172.21.15.174:6828","nonce":1707702879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":1707702879},{"type":"v1","addr":"172.21.15.174:6825","nonce":1707702879}]},"public_addr":"172.21.15.174:6818/1707702879","cluster_addr":"172.21.15.174:6822/1707702879","heartbeat_back_addr":"172.21.15.174:6828/1707702879","heartbeat_front_addr":"172.21.15.174:6825/1707702879","state":["exists","up"]},{"osd":6,"uuid":"d1b98041-d243-4355-bd0a-e22cf9875b32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":864450534},{"type":"v1","addr":"172.21.15.174:6801","nonce":864450534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":864450534},{"type":"v1","addr":"172.21.15.174:6803","nonce":864450534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":864450534},{"type":"v1","addr":"172.21.15.174:6807","nonce":864450534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":864450534},{"type":"v1","addr":"172.21.15.174:6805","nonce":864450534}]},"public_addr":"172.21.15.174:6801/864450534","cluster_addr":"172.21.15.174:6803/864450534","heartbeat_back_addr":"172.21.15.174:6807/864450534","heartbeat_front_addr":"172.21.15.174:6805/864450534","state":["exists","up"]},{"osd":7,"uuid":"5a207936-f89f-416b-b79b-34ec96f77c8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":2527640659},{"type":"v1","addr":"172.21.15.174:6809","nonce":2527640659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":2527640659},{"type":"v1","addr":"172.21.15.174:6811","nonce":2527640659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":2527640659},{"type":"v1","addr":"172.21.15.174:6815","nonce":2527640659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":2527640659},{"type":"v1","addr":"172.21.15.174:6813","nonce":2527640659}]},"public_addr":"172.21.15.174:6809/2527640659","cluster_addr":"172.21.15.174:6811/2527640659","heartbeat_back_addr":"172.21.15.174:6815/2527640659","heartbeat_front_addr":"172.21.15.174:6813/2527640659","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:36.972152+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:36.984561+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:36.998817+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:37.054944+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:37.085014+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:37.115125+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:36.854608+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:36.971685+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:41:49.299 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.296+0000 7f51dd997700 1 -- 172.21.15.90:0/1850054474 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f51bc0662f0 msgr2=0x7f51bc0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:49.299 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.296+0000 7f51dd997700 1 --2- 172.21.15.90:0/1850054474 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f51bc0662f0 0x7f51bc0687a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f51d80cb830 tx=0x7f51c4008030 comp rx=0 tx=0).stop 2023-06-09T04:41:49.299 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.296+0000 7f51dd997700 1 -- 172.21.15.90:0/1850054474 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f51d80cb030 msgr2=0x7f51d81f1480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:49.299 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.296+0000 7f51dd997700 1 --2- 172.21.15.90:0/1850054474 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f51d80cb030 0x7f51d81f1480 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f51cc00e9d0 tx=0x7f51cc00ed90 comp rx=0 tx=0).stop 2023-06-09T04:41:49.299 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.296+0000 7f51dd997700 1 -- 172.21.15.90:0/1850054474 shutdown_connections 2023-06-09T04:41:49.300 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.296+0000 7f51dd997700 1 --2- 172.21.15.90:0/1850054474 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f51bc0662f0 0x7f51bc0687a0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:49.300 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.296+0000 7f51dd997700 1 --2- 172.21.15.90:0/1850054474 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f51d80ce170 0x7f51d81f5940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:49.300 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.296+0000 7f51dd997700 1 --2- 172.21.15.90:0/1850054474 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f51d80cb400 0x7f51d815f050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:49.300 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.296+0000 7f51dd997700 1 --2- 172.21.15.90:0/1850054474 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f51d80cb030 0x7f51d81f1480 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:49.300 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.296+0000 7f51dd997700 1 -- 172.21.15.90:0/1850054474 >> 172.21.15.90:0/1850054474 conn(0x7f51d80b1b50 msgr2=0x7f51d80cc2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:49.301 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.296+0000 7f51dd997700 1 -- 172.21.15.90:0/1850054474 shutdown_connections 2023-06-09T04:41:49.301 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.296+0000 7f51dd997700 1 -- 172.21.15.90:0/1850054474 wait complete. 2023-06-09T04:41:49.320 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-09T04:41:42.402564+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-09T04:41:47.607323+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-09T04:41:49.320 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-09T04:41:49.491 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.488+0000 7f129a1a8700 1 Processor -- start 2023-06-09T04:41:49.492 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.488+0000 7f129a1a8700 1 -- start start 2023-06-09T04:41:49.494 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.488+0000 7f129a1a8700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f129415de00 0x7f12941612e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:49.494 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.488+0000 7f129a1a8700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12940cc230 con 0x7f12940c3170 2023-06-09T04:41:49.495 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.488+0000 7f129a1a8700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f129415e1d0 con 0x7f12940cda20 2023-06-09T04:41:49.495 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.488+0000 7f129a1a8700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12940cde90 con 0x7f129415de00 2023-06-09T04:41:49.495 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.492+0000 7f12999a7700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f12940c3170 0x7f1294069820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:46812/0 (socket says 172.21.15.90:46812) 2023-06-09T04:41:49.495 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.492+0000 7f12999a7700 1 -- 172.21.15.90:0/2751224932 learned_addr learned my addr 172.21.15.90:0/2751224932 (peer_addr_for_me v1:172.21.15.90:0/0) 2023-06-09T04:41:49.495 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.492+0000 7f12991a6700 1 --2- 172.21.15.90:0/2751224932 >> v2:172.21.15.90:3300/0 conn(0x7f129415de00 0x7f12941612e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:49.496 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.492+0000 7f128bfff700 1 -- 172.21.15.90:0/2751224932 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1568810895 0 0) 0x7f12940cc230 con 0x7f12940c3170 2023-06-09T04:41:49.496 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.492+0000 7f128bfff700 1 -- 172.21.15.90:0/2751224932 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f12800035d0 con 0x7f12940c3170 2023-06-09T04:41:49.496 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.492+0000 7f128bfff700 1 -- 172.21.15.90:0/2751224932 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1985995450 0 0) 0x7f129415e1d0 con 0x7f12940cda20 2023-06-09T04:41:49.496 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.492+0000 7f12991a6700 1 -- 172.21.15.90:0/2751224932 >> v1:172.21.15.174:6789/0 conn(0x7f12940cda20 legacy=0x7f12940c4640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:49.497 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.492+0000 7f12991a6700 1 -- 172.21.15.90:0/2751224932 >> v1:172.21.15.90:6789/0 conn(0x7f12940c3170 legacy=0x7f1294069820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:49.497 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.492+0000 7f12991a6700 1 -- 172.21.15.90:0/2751224932 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f129406ada0 con 0x7f129415de00 2023-06-09T04:41:49.497 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.492+0000 7f12991a6700 1 --2- 172.21.15.90:0/2751224932 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f129415de00 0x7f12941612e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f1290009850 tx=0x7f1290009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e779fd1055e9381 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:49.498 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.492+0000 7f128bfff700 1 -- 172.21.15.90:0/2751224932 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1290011830 con 0x7f129415de00 2023-06-09T04:41:49.498 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.492+0000 7f128bfff700 1 -- 172.21.15.90:0/2751224932 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1290011990 con 0x7f129415de00 2023-06-09T04:41:49.498 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.492+0000 7f128bfff700 1 -- 172.21.15.90:0/2751224932 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1290011d40 con 0x7f129415de00 2023-06-09T04:41:49.498 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.492+0000 7f129a1a8700 1 -- 172.21.15.90:0/2751224932 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f129415de00 msgr2=0x7f12941612e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:49.498 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.492+0000 7f129a1a8700 1 --2- 172.21.15.90:0/2751224932 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f129415de00 0x7f12941612e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f1290009850 tx=0x7f1290009b60 comp rx=0 tx=0).stop 2023-06-09T04:41:49.499 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.492+0000 7f129a1a8700 1 -- 172.21.15.90:0/2751224932 shutdown_connections 2023-06-09T04:41:49.499 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.492+0000 7f129a1a8700 1 --2- 172.21.15.90:0/2751224932 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f129415de00 0x7f12941612e0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:49.499 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.492+0000 7f129a1a8700 1 -- 172.21.15.90:0/2751224932 >> 172.21.15.90:0/2751224932 conn(0x7f12940aff00 msgr2=0x7f12940b0300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:49.500 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.492+0000 7f129a1a8700 1 -- 172.21.15.90:0/2751224932 shutdown_connections 2023-06-09T04:41:49.500 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.492+0000 7f129a1a8700 1 -- 172.21.15.90:0/2751224932 wait complete. 2023-06-09T04:41:49.500 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.496+0000 7f129a1a8700 1 Processor -- start 2023-06-09T04:41:49.500 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.496+0000 7f129a1a8700 1 -- start start 2023-06-09T04:41:49.502 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.496+0000 7f129a1a8700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f12940c3170 0x7f12941f53f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:49.502 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.496+0000 7f129a1a8700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f12940cda20 0x7f1294156d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:49.502 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.496+0000 7f129a1a8700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f129415de00 0x7f12940b1200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:49.502 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.496+0000 7f129a1a8700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1294157810 con 0x7f129415de00 2023-06-09T04:41:49.502 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.496+0000 7f129a1a8700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12940c93b0 con 0x7f12940c3170 2023-06-09T04:41:49.502 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.496+0000 7f129a1a8700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12940c8a80 con 0x7f12940cda20 2023-06-09T04:41:49.504 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.496+0000 7f12999a7700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f129415de00 0x7f12940b1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:49.504 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.496+0000 7f12999a7700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f129415de00 0x7f12940b1200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:55856/0 (socket says 172.21.15.90:55856) 2023-06-09T04:41:49.504 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.496+0000 7f12999a7700 1 -- 172.21.15.90:0/1425194139 learned_addr learned my addr 172.21.15.90:0/1425194139 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:41:49.504 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.496+0000 7f12991a6700 1 --2- 172.21.15.90:0/1425194139 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f12940c3170 0x7f12941f53f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:49.504 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.496+0000 7f12989a5700 1 --2- 172.21.15.90:0/1425194139 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f12940cda20 0x7f1294156d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:49.505 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.500+0000 7f12999a7700 1 -- 172.21.15.90:0/1425194139 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f12940cda20 msgr2=0x7f1294156d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:49.505 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.500+0000 7f12999a7700 1 --2- 172.21.15.90:0/1425194139 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f12940cda20 0x7f1294156d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:49.505 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.500+0000 7f12999a7700 1 -- 172.21.15.90:0/1425194139 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f12940c3170 msgr2=0x7f12941f53f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:49.505 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.500+0000 7f12999a7700 1 --2- 172.21.15.90:0/1425194139 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f12940c3170 0x7f12941f53f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:49.505 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.500+0000 7f12999a7700 1 -- 172.21.15.90:0/1425194139 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12900094b0 con 0x7f129415de00 2023-06-09T04:41:49.505 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.500+0000 7f12999a7700 1 --2- 172.21.15.90:0/1425194139 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f129415de00 0x7f12940b1200 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f128c00cb40 tx=0x7f128c00cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:49.505 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.500+0000 7f1289ffb700 1 -- 172.21.15.90:0/1425194139 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f128c00a7b0 con 0x7f129415de00 2023-06-09T04:41:49.506 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.500+0000 7f1289ffb700 1 -- 172.21.15.90:0/1425194139 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f128c00a910 con 0x7f129415de00 2023-06-09T04:41:49.506 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.500+0000 7f1289ffb700 1 -- 172.21.15.90:0/1425194139 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f128c00ac80 con 0x7f129415de00 2023-06-09T04:41:49.506 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.500+0000 7f129a1a8700 1 -- 172.21.15.90:0/1425194139 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12940c8d60 con 0x7f129415de00 2023-06-09T04:41:49.507 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.500+0000 7f129a1a8700 1 -- 172.21.15.90:0/1425194139 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12941f5930 con 0x7f129415de00 2023-06-09T04:41:49.507 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.500+0000 7f129a1a8700 1 -- 172.21.15.90:0/1425194139 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f129404e380 con 0x7f129415de00 2023-06-09T04:41:49.508 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.504+0000 7f1289ffb700 1 -- 172.21.15.90:0/1425194139 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f128c01b3b0 con 0x7f129415de00 2023-06-09T04:41:49.509 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.504+0000 7f1289ffb700 1 --2- 172.21.15.90:0/1425194139 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f12780662f0 0x7f12780687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:49.509 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.504+0000 7f1289ffb700 1 -- 172.21.15.90:0/1425194139 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f128c083320 con 0x7f129415de00 2023-06-09T04:41:49.509 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.504+0000 7f12991a6700 1 --2- 172.21.15.90:0/1425194139 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f12780662f0 0x7f12780687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:49.510 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.504+0000 7f12991a6700 1 --2- 172.21.15.90:0/1425194139 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f12780662f0 0x7f12780687a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f12900090b0 tx=0x7f129001c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:49.515 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.512+0000 7f1289ffb700 1 -- 172.21.15.90:0/1425194139 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f128c050b00 con 0x7f129415de00 2023-06-09T04:41:49.683 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.680+0000 7f129a1a8700 1 -- 172.21.15.90:0/1425194139 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f12940c94f0 con 0x7f129415de00 2023-06-09T04:41:49.684 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.680+0000 7f1289ffb700 1 -- 172.21.15.90:0/1425194139 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v19) v1 ==== 93+0+10 (secure 0 0 0) 0x7f128c054120 con 0x7f129415de00 2023-06-09T04:41:49.684 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 1 2023-06-09T04:41:49.688 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.684+0000 7f129a1a8700 1 -- 172.21.15.90:0/1425194139 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f12780662f0 msgr2=0x7f12780687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:49.689 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.684+0000 7f129a1a8700 1 --2- 172.21.15.90:0/1425194139 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f12780662f0 0x7f12780687a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f12900090b0 tx=0x7f129001c040 comp rx=0 tx=0).stop 2023-06-09T04:41:49.689 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.684+0000 7f129a1a8700 1 -- 172.21.15.90:0/1425194139 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f129415de00 msgr2=0x7f12940b1200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:49.689 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.684+0000 7f129a1a8700 1 --2- 172.21.15.90:0/1425194139 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f129415de00 0x7f12940b1200 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f128c00cb40 tx=0x7f128c00cb70 comp rx=0 tx=0).stop 2023-06-09T04:41:49.690 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.684+0000 7f129a1a8700 1 -- 172.21.15.90:0/1425194139 shutdown_connections 2023-06-09T04:41:49.690 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.684+0000 7f129a1a8700 1 --2- 172.21.15.90:0/1425194139 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f12780662f0 0x7f12780687a0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:49.690 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.684+0000 7f129a1a8700 1 --2- 172.21.15.90:0/1425194139 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f129415de00 0x7f12940b1200 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:49.690 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.684+0000 7f129a1a8700 1 --2- 172.21.15.90:0/1425194139 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f12940cda20 0x7f1294156d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:49.690 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.684+0000 7f129a1a8700 1 --2- 172.21.15.90:0/1425194139 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f12940c3170 0x7f12941f53f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:49.690 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.684+0000 7f129a1a8700 1 -- 172.21.15.90:0/1425194139 >> 172.21.15.90:0/1425194139 conn(0x7f12940aff00 msgr2=0x7f12940ce560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:49.691 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.684+0000 7f129a1a8700 1 -- 172.21.15.90:0/1425194139 shutdown_connections 2023-06-09T04:41:49.691 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.684+0000 7f129a1a8700 1 -- 172.21.15.90:0/1425194139 wait complete. 2023-06-09T04:41:49.711 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-09T04:41:49.891 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.884+0000 7f5a8562c700 1 Processor -- start 2023-06-09T04:41:49.891 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.888+0000 7f5a8562c700 1 -- start start 2023-06-09T04:41:49.892 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.888+0000 7f5a8562c700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5a800b1ca0 0x7f5a80160920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:49.892 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.888+0000 7f5a8562c700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5a800d2400 0x7f5a800d28a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:49.892 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.888+0000 7f5a8562c700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a8015c6b0 con 0x7f5a800b18d0 2023-06-09T04:41:49.893 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.888+0000 7f5a8562c700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a800d2de0 con 0x7f5a800b1ca0 2023-06-09T04:41:49.893 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.888+0000 7f5a8562c700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a800cf6a0 con 0x7f5a800d2400 2023-06-09T04:41:49.894 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.888+0000 7f5a7e7fc700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5a800b1ca0 0x7f5a80160920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:49.894 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.888+0000 7f5a7e7fc700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5a800b1ca0 0x7f5a80160920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:55862/0 (socket says 172.21.15.90:55862) 2023-06-09T04:41:49.894 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.888+0000 7f5a7e7fc700 1 -- 172.21.15.90:0/681386041 learned_addr learned my addr 172.21.15.90:0/681386041 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:41:49.894 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.888+0000 7f5a7f7fe700 1 --2- 172.21.15.90:0/681386041 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5a800d2400 0x7f5a800d28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:49.894 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.888+0000 7f5a7e7fc700 1 -- 172.21.15.90:0/681386041 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5a800d2400 msgr2=0x7f5a800d28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:49.895 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.888+0000 7f5a7e7fc700 1 --2- 172.21.15.90:0/681386041 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5a800d2400 0x7f5a800d28a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:49.895 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.888+0000 7f5a7e7fc700 1 -- 172.21.15.90:0/681386041 >> v1:172.21.15.174:6789/0 conn(0x7f5a800b18d0 legacy=0x7f5a800cee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:49.895 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.888+0000 7f5a7e7fc700 1 -- 172.21.15.90:0/681386041 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a800cf980 con 0x7f5a800b1ca0 2023-06-09T04:41:49.895 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.888+0000 7f5a7f7fe700 1 --2- 172.21.15.90:0/681386041 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5a800d2400 0x7f5a800d28a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:41:49.895 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.888+0000 7f5a7e7fc700 1 --2- 172.21.15.90:0/681386041 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5a800b1ca0 0x7f5a80160920 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5a74009910 tx=0x7f5a74009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=286a970a3a1a73a5 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:49.896 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.888+0000 7f5a7dffb700 1 -- 172.21.15.90:0/681386041 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a7400ba60 con 0x7f5a800b1ca0 2023-06-09T04:41:49.896 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.888+0000 7f5a7dffb700 1 -- 172.21.15.90:0/681386041 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a7400bbc0 con 0x7f5a800b1ca0 2023-06-09T04:41:49.896 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.888+0000 7f5a7dffb700 1 -- 172.21.15.90:0/681386041 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a74009e60 con 0x7f5a800b1ca0 2023-06-09T04:41:49.896 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.892+0000 7f5a8562c700 1 -- 172.21.15.90:0/681386041 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5a800b1ca0 msgr2=0x7f5a80160920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:49.897 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.892+0000 7f5a8562c700 1 --2- 172.21.15.90:0/681386041 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5a800b1ca0 0x7f5a80160920 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5a74009910 tx=0x7f5a74009c20 comp rx=0 tx=0).stop 2023-06-09T04:41:49.897 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.892+0000 7f5a8562c700 1 -- 172.21.15.90:0/681386041 shutdown_connections 2023-06-09T04:41:49.897 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.892+0000 7f5a8562c700 1 --2- 172.21.15.90:0/681386041 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5a800d2400 0x7f5a800d28a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:49.897 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.892+0000 7f5a8562c700 1 --2- 172.21.15.90:0/681386041 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5a800b1ca0 0x7f5a80160920 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:49.897 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.892+0000 7f5a8562c700 1 -- 172.21.15.90:0/681386041 >> 172.21.15.90:0/681386041 conn(0x7f5a8009b9b0 msgr2=0x7f5a800b55d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:49.897 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.892+0000 7f5a8562c700 1 -- 172.21.15.90:0/681386041 shutdown_connections 2023-06-09T04:41:49.897 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.892+0000 7f5a8562c700 1 -- 172.21.15.90:0/681386041 wait complete. 2023-06-09T04:41:49.898 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.892+0000 7f5a8562c700 1 Processor -- start 2023-06-09T04:41:49.898 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.892+0000 7f5a8562c700 1 -- start start 2023-06-09T04:41:49.900 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.896+0000 7f5a8562c700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5a800b18d0 0x7f5a8015f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:49.900 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.896+0000 7f5a8562c700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5a800b1ca0 0x7f5a80153de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:49.900 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.896+0000 7f5a8562c700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5a800d2400 0x7f5a801f4a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:49.900 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.896+0000 7f5a8562c700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a801f5a00 con 0x7f5a800d2400 2023-06-09T04:41:49.900 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.896+0000 7f5a8562c700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a800c8f00 con 0x7f5a800b18d0 2023-06-09T04:41:49.900 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.896+0000 7f5a8562c700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a801f5160 con 0x7f5a800b1ca0 2023-06-09T04:41:49.902 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.896+0000 7f5a7f7fe700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5a800d2400 0x7f5a801f4a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:49.902 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.896+0000 7f5a7f7fe700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5a800d2400 0x7f5a801f4a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:55874/0 (socket says 172.21.15.90:55874) 2023-06-09T04:41:49.902 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.896+0000 7f5a7f7fe700 1 -- 172.21.15.90:0/2633102579 learned_addr learned my addr 172.21.15.90:0/2633102579 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:41:49.902 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.896+0000 7f5a7effd700 1 --2- 172.21.15.90:0/2633102579 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5a800b18d0 0x7f5a8015f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:49.902 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.896+0000 7f5a7e7fc700 1 --2- 172.21.15.90:0/2633102579 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5a800b1ca0 0x7f5a80153de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:49.902 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.896+0000 7f5a7f7fe700 1 -- 172.21.15.90:0/2633102579 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5a800b1ca0 msgr2=0x7f5a80153de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:49.903 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.896+0000 7f5a7f7fe700 1 --2- 172.21.15.90:0/2633102579 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5a800b1ca0 0x7f5a80153de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:49.903 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.896+0000 7f5a7f7fe700 1 -- 172.21.15.90:0/2633102579 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5a800b18d0 msgr2=0x7f5a8015f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:49.903 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.896+0000 7f5a7f7fe700 1 --2- 172.21.15.90:0/2633102579 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5a800b18d0 0x7f5a8015f340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:49.903 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.896+0000 7f5a7f7fe700 1 -- 172.21.15.90:0/2633102579 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a74009570 con 0x7f5a800d2400 2023-06-09T04:41:49.903 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.896+0000 7f5a7e7fc700 1 --2- 172.21.15.90:0/2633102579 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5a800b1ca0 0x7f5a80153de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:41:49.903 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.896+0000 7f5a7f7fe700 1 --2- 172.21.15.90:0/2633102579 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5a800d2400 0x7f5a801f4a60 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5a78007df0 tx=0x7f5a7800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:49.903 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.896+0000 7f5a677fe700 1 -- 172.21.15.90:0/2633102579 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a7800ddd0 con 0x7f5a800d2400 2023-06-09T04:41:49.903 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.896+0000 7f5a677fe700 1 -- 172.21.15.90:0/2633102579 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a7800f040 con 0x7f5a800d2400 2023-06-09T04:41:49.904 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.896+0000 7f5a8562c700 1 -- 172.21.15.90:0/2633102579 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a801f5440 con 0x7f5a800d2400 2023-06-09T04:41:49.904 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.896+0000 7f5a677fe700 1 -- 172.21.15.90:0/2633102579 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a78003c80 con 0x7f5a800d2400 2023-06-09T04:41:49.904 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.896+0000 7f5a8562c700 1 -- 172.21.15.90:0/2633102579 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a8015ce70 con 0x7f5a800d2400 2023-06-09T04:41:49.904 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.900+0000 7f5a8562c700 1 -- 172.21.15.90:0/2633102579 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a8004e380 con 0x7f5a800d2400 2023-06-09T04:41:49.905 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.900+0000 7f5a677fe700 1 -- 172.21.15.90:0/2633102579 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5a78004030 con 0x7f5a800d2400 2023-06-09T04:41:49.906 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.900+0000 7f5a677fe700 1 --2- 172.21.15.90:0/2633102579 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f5a6c0662f0 0x7f5a6c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:49.906 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.900+0000 7f5a677fe700 1 -- 172.21.15.90:0/2633102579 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f5a78083ab0 con 0x7f5a800d2400 2023-06-09T04:41:49.907 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.904+0000 7f5a7effd700 1 --2- 172.21.15.90:0/2633102579 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f5a6c0662f0 0x7f5a6c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:49.908 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.904+0000 7f5a7effd700 1 --2- 172.21.15.90:0/2633102579 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f5a6c0662f0 0x7f5a6c0687a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f5a70000fb0 tx=0x7f5a70009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:49.912 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:49.908+0000 7f5a677fe700 1 -- 172.21.15.90:0/2633102579 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5a78051330 con 0x7f5a800d2400 2023-06-09T04:41:50.083 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:50.080+0000 7f5a8562c700 1 -- 172.21.15.90:0/2633102579 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f5a800d33d0 con 0x7f5a800d2400 2023-06-09T04:41:50.083 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:50.080+0000 7f5a677fe700 1 -- 172.21.15.90:0/2633102579 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v20) v1 ==== 92+0+10 (secure 0 0 0) 0x7f5a7801a0a0 con 0x7f5a800d2400 2023-06-09T04:41:50.084 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 8 2023-06-09T04:41:50.086 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:50.080+0000 7f5a8562c700 1 -- 172.21.15.90:0/2633102579 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f5a6c0662f0 msgr2=0x7f5a6c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:50.086 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:50.080+0000 7f5a8562c700 1 --2- 172.21.15.90:0/2633102579 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f5a6c0662f0 0x7f5a6c0687a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f5a70000fb0 tx=0x7f5a70009040 comp rx=0 tx=0).stop 2023-06-09T04:41:50.087 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:50.080+0000 7f5a8562c700 1 -- 172.21.15.90:0/2633102579 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5a800d2400 msgr2=0x7f5a801f4a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:50.087 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:50.080+0000 7f5a8562c700 1 --2- 172.21.15.90:0/2633102579 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5a800d2400 0x7f5a801f4a60 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5a78007df0 tx=0x7f5a7800d3b0 comp rx=0 tx=0).stop 2023-06-09T04:41:50.087 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:50.084+0000 7f5a8562c700 1 -- 172.21.15.90:0/2633102579 shutdown_connections 2023-06-09T04:41:50.087 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:50.084+0000 7f5a8562c700 1 --2- 172.21.15.90:0/2633102579 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f5a6c0662f0 0x7f5a6c0687a0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:50.088 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:50.084+0000 7f5a8562c700 1 --2- 172.21.15.90:0/2633102579 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5a800d2400 0x7f5a801f4a60 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:50.088 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:50.084+0000 7f5a8562c700 1 --2- 172.21.15.90:0/2633102579 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5a800b1ca0 0x7f5a80153de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:50.088 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:50.084+0000 7f5a8562c700 1 --2- 172.21.15.90:0/2633102579 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5a800b18d0 0x7f5a8015f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:50.088 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:50.084+0000 7f5a8562c700 1 -- 172.21.15.90:0/2633102579 >> 172.21.15.90:0/2633102579 conn(0x7f5a8009b9b0 msgr2=0x7f5a800af720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:50.088 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:50.084+0000 7f5a8562c700 1 -- 172.21.15.90:0/2633102579 shutdown_connections 2023-06-09T04:41:50.088 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:50.084+0000 7f5a8562c700 1 -- 172.21.15.90:0/2633102579 wait complete. 2023-06-09T04:41:50.110 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-09T04:41:50.278 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:50.272+0000 7f1767d01700 1 Processor -- start 2023-06-09T04:41:50.279 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:50.276+0000 7f1767d01700 1 -- start start 2023-06-09T04:41:50.280 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:50.276+0000 7f1767d01700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f17600d1220 0x7f1760160640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:50.281 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:50.276+0000 7f1767d01700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f17600b7840 0x7f17600b7cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:50.281 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:50.276+0000 7f1767d01700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17600d17e0 con 0x7f176006cc50 2023-06-09T04:41:50.281 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:50.276+0000 7f1767d01700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17600d0150 con 0x7f17600b7840 2023-06-09T04:41:50.281 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:50.276+0000 7f1767d01700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f176015c8b0 con 0x7f17600d1220 2023-06-09T04:41:50.282 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:50.276+0000 7f176629e700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f17600b7840 0x7f17600b7cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:50.282 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:50.276+0000 7f176629e700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f17600b7840 0x7f17600b7cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:55884/0 (socket says 172.21.15.90:55884) 2023-06-09T04:41:50.282 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:50.276+0000 7f176629e700 1 -- 172.21.15.90:0/2650577633 learned_addr learned my addr 172.21.15.90:0/2650577633 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:41:50.282 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:50.276+0000 7f176529c700 1 --2- 172.21.15.90:0/2650577633 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f17600d1220 0x7f1760160640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:50.283 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:50.276+0000 7f176629e700 1 -- 172.21.15.90:0/2650577633 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f17600d1220 msgr2=0x7f1760160640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:50.283 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:50.276+0000 7f176629e700 1 --2- 172.21.15.90:0/2650577633 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f17600d1220 0x7f1760160640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:50.283 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:50.276+0000 7f176629e700 1 -- 172.21.15.90:0/2650577633 >> v1:172.21.15.174:6789/0 conn(0x7f176006cc50 legacy=0x7f176015ff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:50.283 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:50.276+0000 7f176629e700 1 -- 172.21.15.90:0/2650577633 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17600cf390 con 0x7f17600b7840 2023-06-09T04:41:50.283 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:50.276+0000 7f176629e700 1 --2- 172.21.15.90:0/2650577633 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f17600b7840 0x7f17600b7cc0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1758009e80 tx=0x7f175800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5f90dde0c196405 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:50.284 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:50.276+0000 7f1764a9b700 1 -- 172.21.15.90:0/2650577633 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f175800e070 con 0x7f17600b7840 2023-06-09T04:41:50.284 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:50.276+0000 7f1764a9b700 1 -- 172.21.15.90:0/2650577633 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f175800b980 con 0x7f17600b7840 2023-06-09T04:41:50.284 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:50.276+0000 7f1764a9b700 1 -- 172.21.15.90:0/2650577633 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f175800bd30 con 0x7f17600b7840 2023-06-09T04:41:50.284 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:50.280+0000 7f1767d01700 1 -- 172.21.15.90:0/2650577633 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f17600b7840 msgr2=0x7f17600b7cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:50.284 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:50.280+0000 7f1767d01700 1 --2- 172.21.15.90:0/2650577633 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f17600b7840 0x7f17600b7cc0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1758009e80 tx=0x7f175800b330 comp rx=0 tx=0).stop 2023-06-09T04:41:50.284 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:50.280+0000 7f1767d01700 1 -- 172.21.15.90:0/2650577633 shutdown_connections 2023-06-09T04:41:50.285 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:50.280+0000 7f1767d01700 1 --2- 172.21.15.90:0/2650577633 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f17600b7840 0x7f17600b7cc0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:50.285 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:50.280+0000 7f1767d01700 1 --2- 172.21.15.90:0/2650577633 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f17600d1220 0x7f1760160640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:50.285 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:50.280+0000 7f1767d01700 1 -- 172.21.15.90:0/2650577633 >> 172.21.15.90:0/2650577633 conn(0x7f17600b57f0 msgr2=0x7f17600b5bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:50.285 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:50.280+0000 7f1767d01700 1 -- 172.21.15.90:0/2650577633 shutdown_connections 2023-06-09T04:41:50.286 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:50.280+0000 7f1767d01700 1 -- 172.21.15.90:0/2650577633 wait complete. 2023-06-09T04:41:50.286 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:50.280+0000 7f1767d01700 1 Processor -- start 2023-06-09T04:41:50.286 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:50.280+0000 7f1767d01700 1 -- start start 2023-06-09T04:41:50.288 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:50.284+0000 7f1767d01700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f176006cc50 0x7f1760151920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:50.288 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:50.284+0000 7f1767d01700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f17600b7840 0x7f17601e6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:50.288 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:50.284+0000 7f1767d01700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f17600d1220 0x7f17600b3100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:50.288 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:50.284+0000 7f1767d01700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1760151e60 con 0x7f17600b7840 2023-06-09T04:41:50.289 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:50.284+0000 7f1767d01700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17600c9290 con 0x7f176006cc50 2023-06-09T04:41:50.289 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:50.284+0000 7f1767d01700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17600c81f0 con 0x7f17600d1220 2023-06-09T04:41:50.290 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:50.284+0000 7f176529c700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f17600b7840 0x7f17601e6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:50.290 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:50.284+0000 7f176529c700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f17600b7840 0x7f17601e6160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:55894/0 (socket says 172.21.15.90:55894) 2023-06-09T04:41:50.290 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:50.284+0000 7f176529c700 1 -- 172.21.15.90:0/1733962104 learned_addr learned my addr 172.21.15.90:0/1733962104 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:41:50.290 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:50.284+0000 7f176629e700 1 --2- 172.21.15.90:0/1733962104 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f17600d1220 0x7f17600b3100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:50.290 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:50.284+0000 7f1765a9d700 1 --2- 172.21.15.90:0/1733962104 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f176006cc50 0x7f1760151920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:50.290 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:50.284+0000 7f176529c700 1 -- 172.21.15.90:0/1733962104 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f17600d1220 msgr2=0x7f17600b3100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:50.291 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:50.284+0000 7f176529c700 1 --2- 172.21.15.90:0/1733962104 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f17600d1220 0x7f17600b3100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:50.291 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:50.284+0000 7f176529c700 1 -- 172.21.15.90:0/1733962104 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f176006cc50 msgr2=0x7f1760151920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:50.291 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:50.284+0000 7f176529c700 1 --2- 172.21.15.90:0/1733962104 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f176006cc50 0x7f1760151920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:50.292 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:50.284+0000 7f176529c700 1 -- 172.21.15.90:0/1733962104 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1758009b30 con 0x7f17600b7840 2023-06-09T04:41:50.292 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:50.284+0000 7f176529c700 1 --2- 172.21.15.90:0/1733962104 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f17600b7840 0x7f17601e6160 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f175000e840 tx=0x7f175000eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:50.292 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:50.284+0000 7f17567fc700 1 -- 172.21.15.90:0/1733962104 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1750013610 con 0x7f17600b7840 2023-06-09T04:41:50.293 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:50.284+0000 7f17567fc700 1 -- 172.21.15.90:0/1733962104 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1750013770 con 0x7f17600b7840 2023-06-09T04:41:50.293 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:50.284+0000 7f1767d01700 1 -- 172.21.15.90:0/1733962104 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17600c84d0 con 0x7f17600b7840 2023-06-09T04:41:50.293 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:50.284+0000 7f17567fc700 1 -- 172.21.15.90:0/1733962104 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1750013b20 con 0x7f17600b7840 2023-06-09T04:41:50.293 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:50.284+0000 7f1767d01700 1 -- 172.21.15.90:0/1733962104 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17600c8a90 con 0x7f17600b7840 2023-06-09T04:41:50.293 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:50.288+0000 7f1767d01700 1 -- 172.21.15.90:0/1733962104 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f176004db30 con 0x7f17600b7840 2023-06-09T04:41:50.294 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:50.288+0000 7f17567fc700 1 -- 172.21.15.90:0/1733962104 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f1750013c80 con 0x7f17600b7840 2023-06-09T04:41:50.295 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:50.292+0000 7f17567fc700 1 --2- 172.21.15.90:0/1733962104 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f17440662f0 0x7f17440687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:50.295 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:50.292+0000 7f17567fc700 1 -- 172.21.15.90:0/1733962104 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f1750083540 con 0x7f17600b7840 2023-06-09T04:41:50.296 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:50.292+0000 7f1765a9d700 1 --2- 172.21.15.90:0/1733962104 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f17440662f0 0x7f17440687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:50.297 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:50.292+0000 7f1765a9d700 1 --2- 172.21.15.90:0/1733962104 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f17440662f0 0x7f17440687a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f175c000f60 tx=0x7f175c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:50.299 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:50.296+0000 7f17567fc700 1 -- 172.21.15.90:0/1733962104 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f17500547b0 con 0x7f17600b7840 2023-06-09T04:41:50.505 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:50.500+0000 7f1767d01700 1 -- 172.21.15.90:0/1733962104 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f17600b63d0 con 0x7f17600b7840 2023-06-09T04:41:50.506 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:50.500+0000 7f17567fc700 1 -- 172.21.15.90:0/1733962104 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3527 (secure 0 0 0) 0x7f1750054340 con 0x7f17600b7840 2023-06-09T04:41:50.506 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:41:50.507 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6836/271257743","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":271257743},{"type":"v1","addr":"172.21.15.174:6836","nonce":271257743}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4269,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6833/2861565528","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":2861565528},{"type":"v1","addr":"172.21.15.90:6833","nonce":2861565528}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/1212048840","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1212048840},{"type":"v1","addr":"172.21.15.90:6835","nonce":1212048840}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4306,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6837/2976585572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6835","nonce":2976585572},{"type":"v1","addr":"172.21.15.174:6837","nonce":2976585572}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2023-06-09T04:41:50.508 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:50.504+0000 7f1767d01700 1 -- 172.21.15.90:0/1733962104 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f17440662f0 msgr2=0x7f17440687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:50.509 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:50.504+0000 7f1767d01700 1 --2- 172.21.15.90:0/1733962104 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f17440662f0 0x7f17440687a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f175c000f60 tx=0x7f175c009040 comp rx=0 tx=0).stop 2023-06-09T04:41:50.509 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:50.504+0000 7f1767d01700 1 -- 172.21.15.90:0/1733962104 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f17600b7840 msgr2=0x7f17601e6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:50.509 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:50.504+0000 7f1767d01700 1 --2- 172.21.15.90:0/1733962104 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f17600b7840 0x7f17601e6160 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f175000e840 tx=0x7f175000eb50 comp rx=0 tx=0).stop 2023-06-09T04:41:50.509 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:50.504+0000 7f1767d01700 1 -- 172.21.15.90:0/1733962104 shutdown_connections 2023-06-09T04:41:50.510 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:50.504+0000 7f1767d01700 1 --2- 172.21.15.90:0/1733962104 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f17440662f0 0x7f17440687a0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:50.510 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:50.504+0000 7f1767d01700 1 --2- 172.21.15.90:0/1733962104 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f17600d1220 0x7f17600b3100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:50.510 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:50.504+0000 7f1767d01700 1 --2- 172.21.15.90:0/1733962104 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f17600b7840 0x7f17601e6160 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:50.510 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:50.504+0000 7f1767d01700 1 --2- 172.21.15.90:0/1733962104 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f176006cc50 0x7f1760151920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:50.510 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:50.504+0000 7f1767d01700 1 -- 172.21.15.90:0/1733962104 >> 172.21.15.90:0/1733962104 conn(0x7f17600b57f0 msgr2=0x7f17600b1020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:50.510 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:50.504+0000 7f1767d01700 1 -- 172.21.15.90:0/1733962104 shutdown_connections 2023-06-09T04:41:50.510 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:50.504+0000 7f1767d01700 1 -- 172.21.15.90:0/1733962104 wait complete. 2023-06-09T04:41:50.511 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 3 2023-06-09T04:41:50.530 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T04:41:50.699 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:50.696+0000 7fce99491700 1 Processor -- start 2023-06-09T04:41:50.700 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:50.696+0000 7fce99491700 1 -- start start 2023-06-09T04:41:50.701 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:50.696+0000 7fce99491700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fce940b18d0 0x7fce94160920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:50.701 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:50.696+0000 7fce99491700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fce940b1ca0 0x7fce940cee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:50.701 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:50.696+0000 7fce99491700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce9415c6b0 con 0x7fce940d2400 2023-06-09T04:41:50.702 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:50.696+0000 7fce99491700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce940cf3d0 con 0x7fce940b18d0 2023-06-09T04:41:50.702 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:50.696+0000 7fce99491700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce940cf6a0 con 0x7fce940b1ca0 2023-06-09T04:41:50.702 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:50.696+0000 7fce92ffd700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fce940b18d0 0x7fce94160920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:50.703 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:50.696+0000 7fce937fe700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7fce940d2400 0x7fce940d28a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.90:46876/0 (socket says 172.21.15.90:46876) 2023-06-09T04:41:50.703 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:50.696+0000 7fce937fe700 1 -- 172.21.15.90:0/3221829140 learned_addr learned my addr 172.21.15.90:0/3221829140 (peer_addr_for_me v1:172.21.15.90:0/0) 2023-06-09T04:41:50.703 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:50.696+0000 7fce927fc700 1 --2- 172.21.15.90:0/3221829140 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fce940b1ca0 0x7fce940cee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:50.704 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:50.700+0000 7fce91ffb700 1 -- 172.21.15.90:0/3221829140 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4188828835 0 0) 0x7fce9415c6b0 con 0x7fce940d2400 2023-06-09T04:41:50.704 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:50.700+0000 7fce91ffb700 1 -- 172.21.15.90:0/3221829140 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fce7c0035d0 con 0x7fce940d2400 2023-06-09T04:41:50.704 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:50.700+0000 7fce92ffd700 1 -- 172.21.15.90:0/3221829140 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fce940b1ca0 msgr2=0x7fce940cee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:50.704 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:50.700+0000 7fce92ffd700 1 --2- 172.21.15.90:0/3221829140 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fce940b1ca0 0x7fce940cee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:50.704 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:50.700+0000 7fce92ffd700 1 -- 172.21.15.90:0/3221829140 >> v1:172.21.15.174:6789/0 conn(0x7fce940d2400 legacy=0x7fce940d28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:50.704 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:50.700+0000 7fce92ffd700 1 -- 172.21.15.90:0/3221829140 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce940cf980 con 0x7fce940b18d0 2023-06-09T04:41:50.704 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:50.700+0000 7fce92ffd700 1 --2- 172.21.15.90:0/3221829140 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fce940b18d0 0x7fce94160920 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fce84009870 tx=0x7fce84009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=74a622d3bbda4d2e server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:50.705 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:50.700+0000 7fce91ffb700 1 -- 172.21.15.90:0/3221829140 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce84005e50 con 0x7fce940b18d0 2023-06-09T04:41:50.706 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:50.700+0000 7fce91ffb700 1 -- 172.21.15.90:0/3221829140 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce84006030 con 0x7fce940b18d0 2023-06-09T04:41:50.706 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:50.700+0000 7fce91ffb700 1 -- 172.21.15.90:0/3221829140 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce840063c0 con 0x7fce940b18d0 2023-06-09T04:41:50.706 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:50.700+0000 7fce99491700 1 -- 172.21.15.90:0/3221829140 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fce940b18d0 msgr2=0x7fce94160920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:50.706 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:50.700+0000 7fce99491700 1 --2- 172.21.15.90:0/3221829140 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fce940b18d0 0x7fce94160920 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fce84009870 tx=0x7fce84009b80 comp rx=0 tx=0).stop 2023-06-09T04:41:50.707 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:50.700+0000 7fce99491700 1 -- 172.21.15.90:0/3221829140 shutdown_connections 2023-06-09T04:41:50.707 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:50.700+0000 7fce99491700 1 --2- 172.21.15.90:0/3221829140 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fce940b1ca0 0x7fce940cee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:50.708 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:50.700+0000 7fce99491700 1 --2- 172.21.15.90:0/3221829140 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fce940b18d0 0x7fce94160920 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:50.708 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:50.700+0000 7fce99491700 1 -- 172.21.15.90:0/3221829140 >> 172.21.15.90:0/3221829140 conn(0x7fce9409b9b0 msgr2=0x7fce940b55d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:50.708 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:50.700+0000 7fce99491700 1 -- 172.21.15.90:0/3221829140 shutdown_connections 2023-06-09T04:41:50.708 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:50.700+0000 7fce99491700 1 -- 172.21.15.90:0/3221829140 wait complete. 2023-06-09T04:41:50.709 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:50.704+0000 7fce99491700 1 Processor -- start 2023-06-09T04:41:50.709 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:50.704+0000 7fce99491700 1 -- start start 2023-06-09T04:41:50.709 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:50.704+0000 7fce99491700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fce940b18d0 0x7fce940b24c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:50.710 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:50.704+0000 7fce99491700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fce940b1ca0 0x7fce940cc180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:50.710 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:50.704+0000 7fce99491700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fce940d2400 0x7fce941f0ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:50.710 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:50.704+0000 7fce99491700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce9415f700 con 0x7fce940b1ca0 2023-06-09T04:41:50.710 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:50.704+0000 7fce99491700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce941f11e0 con 0x7fce940b18d0 2023-06-09T04:41:50.710 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:50.704+0000 7fce99491700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce9415ccd0 con 0x7fce940d2400 2023-06-09T04:41:50.711 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:50.704+0000 7fce927fc700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fce940b1ca0 0x7fce940cc180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:50.711 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:50.704+0000 7fce927fc700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fce940b1ca0 0x7fce940cc180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:55904/0 (socket says 172.21.15.90:55904) 2023-06-09T04:41:50.711 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:50.704+0000 7fce927fc700 1 -- 172.21.15.90:0/730823970 learned_addr learned my addr 172.21.15.90:0/730823970 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:41:50.711 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:50.704+0000 7fce92ffd700 1 --2- 172.21.15.90:0/730823970 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fce940b18d0 0x7fce940b24c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:50.712 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:50.704+0000 7fce937fe700 1 --2- 172.21.15.90:0/730823970 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fce940d2400 0x7fce941f0ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:50.712 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:50.708+0000 7fce927fc700 1 -- 172.21.15.90:0/730823970 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fce940d2400 msgr2=0x7fce941f0ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:50.712 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:50.708+0000 7fce927fc700 1 --2- 172.21.15.90:0/730823970 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fce940d2400 0x7fce941f0ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:50.712 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:50.708+0000 7fce927fc700 1 -- 172.21.15.90:0/730823970 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fce940b18d0 msgr2=0x7fce940b24c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:50.712 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:50.708+0000 7fce927fc700 1 --2- 172.21.15.90:0/730823970 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fce940b18d0 0x7fce940b24c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:50.712 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:50.708+0000 7fce927fc700 1 -- 172.21.15.90:0/730823970 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce84009450 con 0x7fce940b1ca0 2023-06-09T04:41:50.713 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:50.708+0000 7fce927fc700 1 --2- 172.21.15.90:0/730823970 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fce940b1ca0 0x7fce940cc180 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fce8800e9a0 tx=0x7fce8800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:50.713 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:50.708+0000 7fce7b7fe700 1 -- 172.21.15.90:0/730823970 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce88009720 con 0x7fce940b1ca0 2023-06-09T04:41:50.713 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:50.708+0000 7fce7b7fe700 1 -- 172.21.15.90:0/730823970 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce8800c690 con 0x7fce940b1ca0 2023-06-09T04:41:50.713 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:50.708+0000 7fce99491700 1 -- 172.21.15.90:0/730823970 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce9415f420 con 0x7fce940b1ca0 2023-06-09T04:41:50.714 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:50.708+0000 7fce7b7fe700 1 -- 172.21.15.90:0/730823970 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce8800ca40 con 0x7fce940b1ca0 2023-06-09T04:41:50.714 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:50.708+0000 7fce99491700 1 -- 172.21.15.90:0/730823970 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce9415ecd0 con 0x7fce940b1ca0 2023-06-09T04:41:50.714 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:50.708+0000 7fce99491700 1 -- 172.21.15.90:0/730823970 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce9415cb30 con 0x7fce940b1ca0 2023-06-09T04:41:50.715 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:50.712+0000 7fce7b7fe700 1 -- 172.21.15.90:0/730823970 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fce8800cba0 con 0x7fce940b1ca0 2023-06-09T04:41:50.717 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:50.712+0000 7fce7b7fe700 1 --2- 172.21.15.90:0/730823970 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fce800662f0 0x7fce800687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:50.718 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:50.712+0000 7fce7b7fe700 1 -- 172.21.15.90:0/730823970 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fce88083a10 con 0x7fce940b1ca0 2023-06-09T04:41:50.718 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:50.712+0000 7fce92ffd700 1 --2- 172.21.15.90:0/730823970 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fce800662f0 0x7fce800687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:50.719 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:50.716+0000 7fce92ffd700 1 --2- 172.21.15.90:0/730823970 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fce800662f0 0x7fce800687a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fce84009bc0 tx=0x7fce84008070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:50.722 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:50.720+0000 7fce7b7fe700 1 -- 172.21.15.90:0/730823970 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fce9415cb30 con 0x7fce940b1ca0 2023-06-09T04:41:50.893 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:50.888+0000 7fce99491700 1 -- 172.21.15.90:0/730823970 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fce9415cb30 con 0x7fce940b1ca0 2023-06-09T04:41:50.894 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:50.888+0000 7fce7b7fe700 1 -- 172.21.15.90:0/730823970 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+14636 (secure 0 0 0) 0x7fce9415cb30 con 0x7fce940b1ca0 2023-06-09T04:41:50.895 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:41:50.895 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":20,"fsid":"700369c0-a111-43b4-9415-844ad1742b70","created":"2023-06-09T04:41:28.180311+0000","modified":"2023-06-09T04:41:49.864676+0000","last_up_change":"2023-06-09T04:41:40.746475+0000","last_in_change":"2023-06-09T04:41:31.262765+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-09T04:41:42.402564+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-09T04:41:47.607323+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"46a4a7c5-babd-4ef3-9830-51487cff5eb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":2780271267},{"type":"v1","addr":"172.21.15.90:6809","nonce":2780271267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2780271267},{"type":"v1","addr":"172.21.15.90:6811","nonce":2780271267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2780271267},{"type":"v1","addr":"172.21.15.90:6815","nonce":2780271267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2780271267},{"type":"v1","addr":"172.21.15.90:6813","nonce":2780271267}]},"public_addr":"172.21.15.90:6809/2780271267","cluster_addr":"172.21.15.90:6811/2780271267","heartbeat_back_addr":"172.21.15.90:6815/2780271267","heartbeat_front_addr":"172.21.15.90:6813/2780271267","state":["exists","up"]},{"osd":1,"uuid":"1543988f-c498-494a-a6f9-fac8413db6ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":3064028136},{"type":"v1","addr":"172.21.15.90:6801","nonce":3064028136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":3064028136},{"type":"v1","addr":"172.21.15.90:6803","nonce":3064028136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":3064028136},{"type":"v1","addr":"172.21.15.90:6807","nonce":3064028136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":3064028136},{"type":"v1","addr":"172.21.15.90:6805","nonce":3064028136}]},"public_addr":"172.21.15.90:6801/3064028136","cluster_addr":"172.21.15.90:6803/3064028136","heartbeat_back_addr":"172.21.15.90:6807/3064028136","heartbeat_front_addr":"172.21.15.90:6805/3064028136","state":["exists","up"]},{"osd":2,"uuid":"79669dd6-ffc8-4197-b9f7-b3b372b2b9b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":3713146326},{"type":"v1","addr":"172.21.15.90:6825","nonce":3713146326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":3713146326},{"type":"v1","addr":"172.21.15.90:6827","nonce":3713146326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":3713146326},{"type":"v1","addr":"172.21.15.90:6831","nonce":3713146326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":3713146326},{"type":"v1","addr":"172.21.15.90:6829","nonce":3713146326}]},"public_addr":"172.21.15.90:6825/3713146326","cluster_addr":"172.21.15.90:6827/3713146326","heartbeat_back_addr":"172.21.15.90:6831/3713146326","heartbeat_front_addr":"172.21.15.90:6829/3713146326","state":["exists","up"]},{"osd":3,"uuid":"4062ab6f-ce40-450a-aa17-b10098766c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":3499839122},{"type":"v1","addr":"172.21.15.90:6817","nonce":3499839122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":3499839122},{"type":"v1","addr":"172.21.15.90:6819","nonce":3499839122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":3499839122},{"type":"v1","addr":"172.21.15.90:6823","nonce":3499839122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":3499839122},{"type":"v1","addr":"172.21.15.90:6821","nonce":3499839122}]},"public_addr":"172.21.15.90:6817/3499839122","cluster_addr":"172.21.15.90:6819/3499839122","heartbeat_back_addr":"172.21.15.90:6823/3499839122","heartbeat_front_addr":"172.21.15.90:6821/3499839122","state":["exists","up"]},{"osd":4,"uuid":"a10820e4-b348-4d92-9796-3b01484ace1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6817","nonce":1138565854},{"type":"v1","addr":"172.21.15.174:6819","nonce":1138565854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6821","nonce":1138565854},{"type":"v1","addr":"172.21.15.174:6823","nonce":1138565854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":1138565854},{"type":"v1","addr":"172.21.15.174:6831","nonce":1138565854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":1138565854},{"type":"v1","addr":"172.21.15.174:6829","nonce":1138565854}]},"public_addr":"172.21.15.174:6819/1138565854","cluster_addr":"172.21.15.174:6823/1138565854","heartbeat_back_addr":"172.21.15.174:6831/1138565854","heartbeat_front_addr":"172.21.15.174:6829/1138565854","state":["exists","up"]},{"osd":5,"uuid":"b4da1c32-be05-420b-9346-90d91aa70569","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":1707702879},{"type":"v1","addr":"172.21.15.174:6818","nonce":1707702879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":1707702879},{"type":"v1","addr":"172.21.15.174:6822","nonce":1707702879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6827","nonce":1707702879},{"type":"v1","addr":"172.21.15.174:6828","nonce":1707702879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":1707702879},{"type":"v1","addr":"172.21.15.174:6825","nonce":1707702879}]},"public_addr":"172.21.15.174:6818/1707702879","cluster_addr":"172.21.15.174:6822/1707702879","heartbeat_back_addr":"172.21.15.174:6828/1707702879","heartbeat_front_addr":"172.21.15.174:6825/1707702879","state":["exists","up"]},{"osd":6,"uuid":"d1b98041-d243-4355-bd0a-e22cf9875b32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":864450534},{"type":"v1","addr":"172.21.15.174:6801","nonce":864450534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":864450534},{"type":"v1","addr":"172.21.15.174:6803","nonce":864450534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":864450534},{"type":"v1","addr":"172.21.15.174:6807","nonce":864450534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":864450534},{"type":"v1","addr":"172.21.15.174:6805","nonce":864450534}]},"public_addr":"172.21.15.174:6801/864450534","cluster_addr":"172.21.15.174:6803/864450534","heartbeat_back_addr":"172.21.15.174:6807/864450534","heartbeat_front_addr":"172.21.15.174:6805/864450534","state":["exists","up"]},{"osd":7,"uuid":"5a207936-f89f-416b-b79b-34ec96f77c8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":2527640659},{"type":"v1","addr":"172.21.15.174:6809","nonce":2527640659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":2527640659},{"type":"v1","addr":"172.21.15.174:6811","nonce":2527640659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":2527640659},{"type":"v1","addr":"172.21.15.174:6815","nonce":2527640659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":2527640659},{"type":"v1","addr":"172.21.15.174:6813","nonce":2527640659}]},"public_addr":"172.21.15.174:6809/2527640659","cluster_addr":"172.21.15.174:6811/2527640659","heartbeat_back_addr":"172.21.15.174:6815/2527640659","heartbeat_front_addr":"172.21.15.174:6813/2527640659","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:36.972152+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:36.984561+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:36.998817+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:37.054944+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:37.085014+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:37.115125+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:36.854608+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:36.971685+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:41:50.896 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:50.892+0000 7fce99491700 1 -- 172.21.15.90:0/730823970 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fce800662f0 msgr2=0x7fce800687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:50.897 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:50.892+0000 7fce99491700 1 --2- 172.21.15.90:0/730823970 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fce800662f0 0x7fce800687a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fce84009bc0 tx=0x7fce84008070 comp rx=0 tx=0).stop 2023-06-09T04:41:50.897 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:50.892+0000 7fce99491700 1 -- 172.21.15.90:0/730823970 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fce940b1ca0 msgr2=0x7fce940cc180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:50.897 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:50.892+0000 7fce99491700 1 --2- 172.21.15.90:0/730823970 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fce940b1ca0 0x7fce940cc180 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fce8800e9a0 tx=0x7fce8800ecb0 comp rx=0 tx=0).stop 2023-06-09T04:41:50.897 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:50.892+0000 7fce99491700 1 -- 172.21.15.90:0/730823970 shutdown_connections 2023-06-09T04:41:50.898 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:50.892+0000 7fce99491700 1 --2- 172.21.15.90:0/730823970 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fce800662f0 0x7fce800687a0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:50.898 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:50.892+0000 7fce99491700 1 --2- 172.21.15.90:0/730823970 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fce940d2400 0x7fce941f0ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:50.898 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:50.892+0000 7fce99491700 1 --2- 172.21.15.90:0/730823970 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fce940b1ca0 0x7fce940cc180 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:50.898 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:50.892+0000 7fce99491700 1 --2- 172.21.15.90:0/730823970 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fce940b18d0 0x7fce940b24c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:50.898 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:50.892+0000 7fce99491700 1 -- 172.21.15.90:0/730823970 >> 172.21.15.90:0/730823970 conn(0x7fce9409b9b0 msgr2=0x7fce9415ff10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:50.898 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:50.892+0000 7fce99491700 1 -- 172.21.15.90:0/730823970 shutdown_connections 2023-06-09T04:41:50.899 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:50.892+0000 7fce99491700 1 -- 172.21.15.90:0/730823970 wait complete. 2023-06-09T04:41:50.920 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-09T04:41:42.402564+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-09T04:41:47.607323+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-09T04:41:50.921 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-09T04:41:51.095 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.088+0000 7fa7ecdd2700 1 Processor -- start 2023-06-09T04:41:51.095 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.092+0000 7fa7ecdd2700 1 -- start start 2023-06-09T04:41:51.097 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.092+0000 7fa7ecdd2700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fa7e80cd450 0x7fa7e80cf060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:51.097 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.092+0000 7fa7ecdd2700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa7e806a0b0 0x7fa7e806a530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:51.097 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.092+0000 7fa7ecdd2700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7e815c480 con 0x7fa7e806cf10 2023-06-09T04:41:51.097 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.092+0000 7fa7ecdd2700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7e80cd9c0 con 0x7fa7e80cd450 2023-06-09T04:41:51.097 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.092+0000 7fa7ecdd2700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e80cdca0 con 0x7fa7e806a0b0 2023-06-09T04:41:51.098 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.092+0000 7fa7e6d9d700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa7e806a0b0 0x7fa7e806a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:51.099 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.092+0000 7fa7e659c700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7fa7e806cf10 0x7fa7e806d2e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.90:46882/0 (socket says 172.21.15.90:46882) 2023-06-09T04:41:51.099 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.092+0000 7fa7e659c700 1 -- 172.21.15.90:0/1861605801 learned_addr learned my addr 172.21.15.90:0/1861605801 (peer_addr_for_me v1:172.21.15.90:0/0) 2023-06-09T04:41:51.099 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.092+0000 7fa7dffff700 1 --2- 172.21.15.90:0/1861605801 >> v2:172.21.15.174:3300/0 conn(0x7fa7e80cd450 0x7fa7e80cf060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:51.099 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.092+0000 7fa7e6d9d700 1 -- 172.21.15.90:0/1861605801 >> v2:172.21.15.174:3300/0 conn(0x7fa7e80cd450 msgr2=0x7fa7e80cf060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:51.099 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.092+0000 7fa7e6d9d700 1 --2- 172.21.15.90:0/1861605801 >> v2:172.21.15.174:3300/0 conn(0x7fa7e80cd450 0x7fa7e80cf060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:51.099 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.092+0000 7fa7e6d9d700 1 -- 172.21.15.90:0/1861605801 >> v1:172.21.15.174:6789/0 conn(0x7fa7e806cf10 legacy=0x7fa7e806d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:51.099 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.092+0000 7fa7e6d9d700 1 -- 172.21.15.90:0/1861605801 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7e80cdf80 con 0x7fa7e806a0b0 2023-06-09T04:41:51.100 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.092+0000 7fa7dffff700 1 --2- 172.21.15.90:0/1861605801 >> v2:172.21.15.174:3300/0 conn(0x7fa7e80cd450 0x7fa7e80cf060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:41:51.100 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.096+0000 7fa7e6d9d700 1 --2- 172.21.15.90:0/1861605801 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa7e806a0b0 0x7fa7e806a530 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fa7e0009d90 tx=0x7fa7e000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3fc7b485211b43d0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:51.101 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.096+0000 7fa7e5d9b700 1 -- 172.21.15.90:0/1861605801 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7e000e070 con 0x7fa7e806a0b0 2023-06-09T04:41:51.101 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.096+0000 7fa7e5d9b700 1 -- 172.21.15.90:0/1861605801 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7e000bad0 con 0x7fa7e806a0b0 2023-06-09T04:41:51.101 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.096+0000 7fa7e5d9b700 1 -- 172.21.15.90:0/1861605801 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7e000be80 con 0x7fa7e806a0b0 2023-06-09T04:41:51.101 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.096+0000 7fa7ecdd2700 1 -- 172.21.15.90:0/1861605801 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa7e806a0b0 msgr2=0x7fa7e806a530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:51.101 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.096+0000 7fa7ecdd2700 1 --2- 172.21.15.90:0/1861605801 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa7e806a0b0 0x7fa7e806a530 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fa7e0009d90 tx=0x7fa7e000b330 comp rx=0 tx=0).stop 2023-06-09T04:41:51.101 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.096+0000 7fa7ecdd2700 1 -- 172.21.15.90:0/1861605801 shutdown_connections 2023-06-09T04:41:51.102 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.096+0000 7fa7ecdd2700 1 --2- 172.21.15.90:0/1861605801 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa7e806a0b0 0x7fa7e806a530 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:51.102 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.096+0000 7fa7ecdd2700 1 --2- 172.21.15.90:0/1861605801 >> v2:172.21.15.174:3300/0 conn(0x7fa7e80cd450 0x7fa7e80cf060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:51.102 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.096+0000 7fa7ecdd2700 1 -- 172.21.15.90:0/1861605801 >> 172.21.15.90:0/1861605801 conn(0x7fa7e80cf5e0 msgr2=0x7fa7e80cf9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:51.102 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.096+0000 7fa7ecdd2700 1 -- 172.21.15.90:0/1861605801 shutdown_connections 2023-06-09T04:41:51.102 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.096+0000 7fa7ecdd2700 1 -- 172.21.15.90:0/1861605801 wait complete. 2023-06-09T04:41:51.103 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.100+0000 7fa7ecdd2700 1 Processor -- start 2023-06-09T04:41:51.103 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.100+0000 7fa7ecdd2700 1 -- start start 2023-06-09T04:41:51.104 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.100+0000 7fa7ecdd2700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa7e806a0b0 0x7fa7e80abd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:51.104 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.100+0000 7fa7ecdd2700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa7e806cf10 0x7fa7e80afd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:51.104 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.100+0000 7fa7ecdd2700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa7e80cd450 0x7fa7e80b0240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:51.105 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.100+0000 7fa7ecdd2700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e80ad140 con 0x7fa7e806cf10 2023-06-09T04:41:51.105 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.100+0000 7fa7ecdd2700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e80c79d0 con 0x7fa7e806a0b0 2023-06-09T04:41:51.105 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.100+0000 7fa7ecdd2700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e80ac5c0 con 0x7fa7e80cd450 2023-06-09T04:41:51.106 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.100+0000 7fa7dffff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa7e806cf10 0x7fa7e80afd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:51.106 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.100+0000 7fa7dffff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa7e806cf10 0x7fa7e80afd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:55906/0 (socket says 172.21.15.90:55906) 2023-06-09T04:41:51.106 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.100+0000 7fa7dffff700 1 -- 172.21.15.90:0/1044264176 learned_addr learned my addr 172.21.15.90:0/1044264176 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:41:51.106 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.100+0000 7fa7e659c700 1 --2- 172.21.15.90:0/1044264176 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa7e806a0b0 0x7fa7e80abd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:51.106 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.100+0000 7fa7e6d9d700 1 --2- 172.21.15.90:0/1044264176 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa7e80cd450 0x7fa7e80b0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:51.107 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.100+0000 7fa7dffff700 1 -- 172.21.15.90:0/1044264176 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa7e80cd450 msgr2=0x7fa7e80b0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:51.107 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.100+0000 7fa7dffff700 1 --2- 172.21.15.90:0/1044264176 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa7e80cd450 0x7fa7e80b0240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:51.107 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.100+0000 7fa7dffff700 1 -- 172.21.15.90:0/1044264176 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa7e806a0b0 msgr2=0x7fa7e80abd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:51.107 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.100+0000 7fa7dffff700 1 --2- 172.21.15.90:0/1044264176 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa7e806a0b0 0x7fa7e80abd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:51.107 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.100+0000 7fa7dffff700 1 -- 172.21.15.90:0/1044264176 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7e0009a70 con 0x7fa7e806cf10 2023-06-09T04:41:51.107 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.100+0000 7fa7dffff700 1 --2- 172.21.15.90:0/1044264176 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa7e806cf10 0x7fa7e80afd00 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fa7d000e760 tx=0x7fa7d000ea70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:51.108 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.100+0000 7fa7deffd700 1 -- 172.21.15.90:0/1044264176 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7d000c070 con 0x7fa7e806cf10 2023-06-09T04:41:51.108 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.100+0000 7fa7deffd700 1 -- 172.21.15.90:0/1044264176 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7d0004250 con 0x7fa7e806cf10 2023-06-09T04:41:51.108 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.100+0000 7fa7ecdd2700 1 -- 172.21.15.90:0/1044264176 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7e80ac8a0 con 0x7fa7e806cf10 2023-06-09T04:41:51.108 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.100+0000 7fa7deffd700 1 -- 172.21.15.90:0/1044264176 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7d00036c0 con 0x7fa7e806cf10 2023-06-09T04:41:51.108 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.104+0000 7fa7ecdd2700 1 -- 172.21.15.90:0/1044264176 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7e80ace60 con 0x7fa7e806cf10 2023-06-09T04:41:51.109 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.104+0000 7fa7ecdd2700 1 -- 172.21.15.90:0/1044264176 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7e804db30 con 0x7fa7e806cf10 2023-06-09T04:41:51.111 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.108+0000 7fa7deffd700 1 -- 172.21.15.90:0/1044264176 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa7d0003820 con 0x7fa7e806cf10 2023-06-09T04:41:51.112 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.108+0000 7fa7deffd700 1 --2- 172.21.15.90:0/1044264176 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fa7c80662f0 0x7fa7c80687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:51.112 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.108+0000 7fa7deffd700 1 -- 172.21.15.90:0/1044264176 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fa7d00836e0 con 0x7fa7e806cf10 2023-06-09T04:41:51.113 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.108+0000 7fa7e659c700 1 --2- 172.21.15.90:0/1044264176 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fa7c80662f0 0x7fa7c80687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:51.114 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.108+0000 7fa7e659c700 1 --2- 172.21.15.90:0/1044264176 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fa7c80662f0 0x7fa7c80687a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa7d8000f60 tx=0x7fa7d8004a70 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:51.118 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.112+0000 7fa7deffd700 1 -- 172.21.15.90:0/1044264176 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa7d0050e10 con 0x7fa7e806cf10 2023-06-09T04:41:51.285 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.280+0000 7fa7ecdd2700 1 -- 172.21.15.90:0/1044264176 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa7e806ee60 con 0x7fa7e806cf10 2023-06-09T04:41:51.286 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.280+0000 7fa7deffd700 1 -- 172.21.15.90:0/1044264176 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa7d00094e0 con 0x7fa7e806cf10 2023-06-09T04:41:51.287 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 1 2023-06-09T04:41:51.292 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.288+0000 7fa7ecdd2700 1 -- 172.21.15.90:0/1044264176 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fa7c80662f0 msgr2=0x7fa7c80687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:51.292 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.288+0000 7fa7ecdd2700 1 --2- 172.21.15.90:0/1044264176 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fa7c80662f0 0x7fa7c80687a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa7d8000f60 tx=0x7fa7d8004a70 comp rx=0 tx=0).stop 2023-06-09T04:41:51.292 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.288+0000 7fa7ecdd2700 1 -- 172.21.15.90:0/1044264176 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa7e806cf10 msgr2=0x7fa7e80afd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:51.292 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.288+0000 7fa7ecdd2700 1 --2- 172.21.15.90:0/1044264176 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa7e806cf10 0x7fa7e80afd00 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fa7d000e760 tx=0x7fa7d000ea70 comp rx=0 tx=0).stop 2023-06-09T04:41:51.292 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.288+0000 7fa7ecdd2700 1 -- 172.21.15.90:0/1044264176 shutdown_connections 2023-06-09T04:41:51.292 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.288+0000 7fa7ecdd2700 1 --2- 172.21.15.90:0/1044264176 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fa7c80662f0 0x7fa7c80687a0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:51.293 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.288+0000 7fa7ecdd2700 1 --2- 172.21.15.90:0/1044264176 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa7e80cd450 0x7fa7e80b0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:51.293 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.288+0000 7fa7ecdd2700 1 --2- 172.21.15.90:0/1044264176 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa7e806cf10 0x7fa7e80afd00 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:51.293 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.288+0000 7fa7ecdd2700 1 --2- 172.21.15.90:0/1044264176 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa7e806a0b0 0x7fa7e80abd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:51.293 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.288+0000 7fa7ecdd2700 1 -- 172.21.15.90:0/1044264176 >> 172.21.15.90:0/1044264176 conn(0x7fa7e80cf5e0 msgr2=0x7fa7e80c9e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:51.293 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.288+0000 7fa7ecdd2700 1 -- 172.21.15.90:0/1044264176 shutdown_connections 2023-06-09T04:41:51.293 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.288+0000 7fa7ecdd2700 1 -- 172.21.15.90:0/1044264176 wait complete. 2023-06-09T04:41:51.313 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-09T04:41:51.490 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.484+0000 7faa4ebd9700 1 Processor -- start 2023-06-09T04:41:51.491 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.484+0000 7faa4ebd9700 1 -- start start 2023-06-09T04:41:51.493 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.488+0000 7faa4ebd9700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faa4806b290 0x7faa480c9c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:51.493 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.488+0000 7faa4ebd9700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7faa480702a0 0x7faa480706f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:51.493 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.488+0000 7faa4ebd9700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7faa4815d7d0 0x7faa4815dc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:51.494 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.488+0000 7faa4ebd9700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa48070c30 con 0x7faa480702a0 2023-06-09T04:41:51.494 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.488+0000 7faa4ebd9700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa4806d280 con 0x7faa4815d7d0 2023-06-09T04:41:51.494 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.488+0000 7faa4ebd9700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa4806d560 con 0x7faa4806b290 2023-06-09T04:41:51.495 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.488+0000 7faa4d3d6700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7faa480702a0 0x7faa480706f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:51.495 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.488+0000 7faa4d3d6700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7faa480702a0 0x7faa480706f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:55920/0 (socket says 172.21.15.90:55920) 2023-06-09T04:41:51.495 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.488+0000 7faa4d3d6700 1 -- 172.21.15.90:0/869095245 learned_addr learned my addr 172.21.15.90:0/869095245 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:41:51.495 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.488+0000 7faa4dbd7700 1 --2- 172.21.15.90:0/869095245 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faa4806b290 0x7faa480c9c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:51.496 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.488+0000 7faa4e3d8700 1 --2- 172.21.15.90:0/869095245 >> v2:172.21.15.174:3300/0 conn(0x7faa4815d7d0 0x7faa4815dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:51.496 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.492+0000 7faa4d3d6700 1 -- 172.21.15.90:0/869095245 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faa4806b290 msgr2=0x7faa480c9c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:51.496 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.492+0000 7faa4d3d6700 1 --2- 172.21.15.90:0/869095245 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faa4806b290 0x7faa480c9c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:51.496 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.492+0000 7faa4d3d6700 1 -- 172.21.15.90:0/869095245 >> v2:172.21.15.174:3300/0 conn(0x7faa4815d7d0 msgr2=0x7faa4815dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:51.496 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.492+0000 7faa4d3d6700 1 --2- 172.21.15.90:0/869095245 >> v2:172.21.15.174:3300/0 conn(0x7faa4815d7d0 0x7faa4815dc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:51.496 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.492+0000 7faa4d3d6700 1 -- 172.21.15.90:0/869095245 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa4806d840 con 0x7faa480702a0 2023-06-09T04:41:51.496 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.492+0000 7faa4dbd7700 1 --2- 172.21.15.90:0/869095245 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faa4806b290 0x7faa480c9c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:41:51.497 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.492+0000 7faa4d3d6700 1 --2- 172.21.15.90:0/869095245 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faa480702a0 0x7faa480706f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7faa48072070 tx=0x7faa38009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f892670bc510be94 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:51.498 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.492+0000 7faa4cbd5700 1 -- 172.21.15.90:0/869095245 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa3800b8a0 con 0x7faa480702a0 2023-06-09T04:41:51.498 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.492+0000 7faa4cbd5700 1 -- 172.21.15.90:0/869095245 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa3800ba00 con 0x7faa480702a0 2023-06-09T04:41:51.498 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.492+0000 7faa4cbd5700 1 -- 172.21.15.90:0/869095245 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa3800bd90 con 0x7faa480702a0 2023-06-09T04:41:51.498 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.492+0000 7faa4ebd9700 1 -- 172.21.15.90:0/869095245 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faa480702a0 msgr2=0x7faa480706f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:51.498 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.492+0000 7faa4ebd9700 1 --2- 172.21.15.90:0/869095245 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faa480702a0 0x7faa480706f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7faa48072070 tx=0x7faa38009bf0 comp rx=0 tx=0).stop 2023-06-09T04:41:51.498 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.492+0000 7faa4ebd9700 1 -- 172.21.15.90:0/869095245 shutdown_connections 2023-06-09T04:41:51.498 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.492+0000 7faa4ebd9700 1 --2- 172.21.15.90:0/869095245 >> v2:172.21.15.174:3300/0 conn(0x7faa4815d7d0 0x7faa4815dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:51.498 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.492+0000 7faa4ebd9700 1 --2- 172.21.15.90:0/869095245 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faa480702a0 0x7faa480706f0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:51.499 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.492+0000 7faa4ebd9700 1 --2- 172.21.15.90:0/869095245 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faa4806b290 0x7faa480c9c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:51.499 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.492+0000 7faa4ebd9700 1 -- 172.21.15.90:0/869095245 >> 172.21.15.90:0/869095245 conn(0x7faa480cebc0 msgr2=0x7faa480cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:51.499 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.492+0000 7faa4ebd9700 1 -- 172.21.15.90:0/869095245 shutdown_connections 2023-06-09T04:41:51.499 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.492+0000 7faa4ebd9700 1 -- 172.21.15.90:0/869095245 wait complete. 2023-06-09T04:41:51.500 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.496+0000 7faa4ebd9700 1 Processor -- start 2023-06-09T04:41:51.501 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.496+0000 7faa4ebd9700 1 -- start start 2023-06-09T04:41:51.503 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.500+0000 7faa4ebd9700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faa4806b290 0x7faa480c1ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:51.503 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.500+0000 7faa4ebd9700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faa480702a0 0x7faa48158070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:51.503 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.500+0000 7faa4ebd9700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faa4815d7d0 0x7faa480b0e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:51.503 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.500+0000 7faa4ebd9700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa48157380 con 0x7faa480702a0 2023-06-09T04:41:51.503 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.500+0000 7faa4ebd9700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa48157be0 con 0x7faa4815d7d0 2023-06-09T04:41:51.504 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.500+0000 7faa4ebd9700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa480c22c0 con 0x7faa4806b290 2023-06-09T04:41:51.504 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.500+0000 7faa4d3d6700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faa480702a0 0x7faa48158070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:51.505 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.500+0000 7faa4d3d6700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faa480702a0 0x7faa48158070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:55934/0 (socket says 172.21.15.90:55934) 2023-06-09T04:41:51.505 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.500+0000 7faa4d3d6700 1 -- 172.21.15.90:0/2277069509 learned_addr learned my addr 172.21.15.90:0/2277069509 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:41:51.505 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.500+0000 7faa4dbd7700 1 --2- 172.21.15.90:0/2277069509 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faa4806b290 0x7faa480c1ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:51.505 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.500+0000 7faa4e3d8700 1 --2- 172.21.15.90:0/2277069509 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faa4815d7d0 0x7faa480b0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:51.505 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.500+0000 7faa4d3d6700 1 -- 172.21.15.90:0/2277069509 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faa4806b290 msgr2=0x7faa480c1ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:51.505 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.500+0000 7faa4d3d6700 1 --2- 172.21.15.90:0/2277069509 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faa4806b290 0x7faa480c1ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:51.506 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.500+0000 7faa4d3d6700 1 -- 172.21.15.90:0/2277069509 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faa4815d7d0 msgr2=0x7faa480b0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:51.506 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.500+0000 7faa4d3d6700 1 --2- 172.21.15.90:0/2277069509 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faa4815d7d0 0x7faa480b0e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:51.506 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.500+0000 7faa4d3d6700 1 -- 172.21.15.90:0/2277069509 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa38009570 con 0x7faa480702a0 2023-06-09T04:41:51.506 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.500+0000 7faa4e3d8700 1 --2- 172.21.15.90:0/2277069509 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faa4815d7d0 0x7faa480b0e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:41:51.506 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.500+0000 7faa4d3d6700 1 --2- 172.21.15.90:0/2277069509 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faa480702a0 0x7faa48158070 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7faa4806ff10 tx=0x7faa38004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:51.507 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.500+0000 7faa3e7fc700 1 -- 172.21.15.90:0/2277069509 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa380036c0 con 0x7faa480702a0 2023-06-09T04:41:51.507 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.500+0000 7faa3e7fc700 1 -- 172.21.15.90:0/2277069509 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa3801f070 con 0x7faa480702a0 2023-06-09T04:41:51.507 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.500+0000 7faa4ebd9700 1 -- 172.21.15.90:0/2277069509 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa48157590 con 0x7faa480702a0 2023-06-09T04:41:51.507 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.500+0000 7faa3e7fc700 1 -- 172.21.15.90:0/2277069509 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa38003a80 con 0x7faa480702a0 2023-06-09T04:41:51.507 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.500+0000 7faa4ebd9700 1 -- 172.21.15.90:0/2277069509 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa480b1370 con 0x7faa480702a0 2023-06-09T04:41:51.507 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.500+0000 7faa4ebd9700 1 -- 172.21.15.90:0/2277069509 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa48067380 con 0x7faa480702a0 2023-06-09T04:41:51.508 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.504+0000 7faa3e7fc700 1 -- 172.21.15.90:0/2277069509 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7faa38021030 con 0x7faa480702a0 2023-06-09T04:41:51.510 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.504+0000 7faa3e7fc700 1 --2- 172.21.15.90:0/2277069509 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7faa2c0662f0 0x7faa2c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:51.510 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.508+0000 7faa3e7fc700 1 -- 172.21.15.90:0/2277069509 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7faa38085220 con 0x7faa480702a0 2023-06-09T04:41:51.511 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.508+0000 7faa4dbd7700 1 --2- 172.21.15.90:0/2277069509 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7faa2c0662f0 0x7faa2c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:51.512 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.508+0000 7faa4dbd7700 1 --2- 172.21.15.90:0/2277069509 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7faa2c0662f0 0x7faa2c0687a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7faa44003780 tx=0x7faa44008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:51.515 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.512+0000 7faa3e7fc700 1 -- 172.21.15.90:0/2277069509 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7faa380529f0 con 0x7faa480702a0 2023-06-09T04:41:51.683 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.676+0000 7faa4ebd9700 1 -- 172.21.15.90:0/2277069509 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7faa48159cf0 con 0x7faa480702a0 2023-06-09T04:41:51.683 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.680+0000 7faa3e7fc700 1 -- 172.21.15.90:0/2277069509 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v20) v1 ==== 92+0+10 (secure 0 0 0) 0x7faa38056010 con 0x7faa480702a0 2023-06-09T04:41:51.684 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 8 2023-06-09T04:41:51.687 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.684+0000 7faa4ebd9700 1 -- 172.21.15.90:0/2277069509 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7faa2c0662f0 msgr2=0x7faa2c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:51.687 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.684+0000 7faa4ebd9700 1 --2- 172.21.15.90:0/2277069509 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7faa2c0662f0 0x7faa2c0687a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7faa44003780 tx=0x7faa44008040 comp rx=0 tx=0).stop 2023-06-09T04:41:51.688 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.684+0000 7faa4ebd9700 1 -- 172.21.15.90:0/2277069509 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faa480702a0 msgr2=0x7faa48158070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:51.688 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.684+0000 7faa4ebd9700 1 --2- 172.21.15.90:0/2277069509 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faa480702a0 0x7faa48158070 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7faa4806ff10 tx=0x7faa38004770 comp rx=0 tx=0).stop 2023-06-09T04:41:51.688 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.684+0000 7faa4ebd9700 1 -- 172.21.15.90:0/2277069509 shutdown_connections 2023-06-09T04:41:51.689 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.684+0000 7faa4ebd9700 1 --2- 172.21.15.90:0/2277069509 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7faa2c0662f0 0x7faa2c0687a0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:51.689 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.684+0000 7faa4ebd9700 1 --2- 172.21.15.90:0/2277069509 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faa4815d7d0 0x7faa480b0e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:51.689 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.684+0000 7faa4ebd9700 1 --2- 172.21.15.90:0/2277069509 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faa480702a0 0x7faa48158070 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:51.689 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.684+0000 7faa4ebd9700 1 --2- 172.21.15.90:0/2277069509 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faa4806b290 0x7faa480c1ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:51.689 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.684+0000 7faa4ebd9700 1 -- 172.21.15.90:0/2277069509 >> 172.21.15.90:0/2277069509 conn(0x7faa480cebc0 msgr2=0x7faa4815c670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:51.689 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.684+0000 7faa4ebd9700 1 -- 172.21.15.90:0/2277069509 shutdown_connections 2023-06-09T04:41:51.689 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.684+0000 7faa4ebd9700 1 -- 172.21.15.90:0/2277069509 wait complete. 2023-06-09T04:41:51.708 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-06-09T04:41:51.883 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.880+0000 7f9510ab8700 1 Processor -- start 2023-06-09T04:41:51.883 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.880+0000 7f9510ab8700 1 -- start start 2023-06-09T04:41:51.884 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.880+0000 7f9510ab8700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f950c15bf60 0x7f950c06f960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:51.885 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.880+0000 7f9510ab8700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f950c0cc0f0 0x7f950c0cd750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:51.885 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.880+0000 7f9510ab8700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f950c06fea0 con 0x7f950c0cdc90 2023-06-09T04:41:51.885 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.880+0000 7f9510ab8700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f950c0cc6b0 con 0x7f950c15bf60 2023-06-09T04:41:51.885 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.880+0000 7f9510ab8700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f950c0cc990 con 0x7f950c0cc0f0 2023-06-09T04:41:51.886 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.880+0000 7f950b7fe700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f950c15bf60 0x7f950c06f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:51.886 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.880+0000 7f950b7fe700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f950c15bf60 0x7f950c06f960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:55944/0 (socket says 172.21.15.90:55944) 2023-06-09T04:41:51.886 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.880+0000 7f950b7fe700 1 -- 172.21.15.90:0/4219069142 learned_addr learned my addr 172.21.15.90:0/4219069142 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:41:51.886 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.880+0000 7f950affd700 1 --2- 172.21.15.90:0/4219069142 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f950c0cc0f0 0x7f950c0cd750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:51.886 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.880+0000 7f950b7fe700 1 -- 172.21.15.90:0/4219069142 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f950c0cc0f0 msgr2=0x7f950c0cd750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:51.887 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.880+0000 7f950b7fe700 1 --2- 172.21.15.90:0/4219069142 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f950c0cc0f0 0x7f950c0cd750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:51.887 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.880+0000 7f950b7fe700 1 -- 172.21.15.90:0/4219069142 >> v1:172.21.15.90:6789/0 conn(0x7f950c0cdc90 legacy=0x7f950c0ab890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:51.887 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.880+0000 7f950b7fe700 1 -- 172.21.15.90:0/4219069142 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f950c0ccc70 con 0x7f950c15bf60 2023-06-09T04:41:51.887 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.880+0000 7f950b7fe700 1 --2- 172.21.15.90:0/4219069142 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f950c15bf60 0x7f950c06f960 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f94fc009910 tx=0x7f94fc009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=944a4eafe3c13287 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:51.889 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.884+0000 7f950a7fc700 1 -- 172.21.15.90:0/4219069142 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94fc00ba60 con 0x7f950c15bf60 2023-06-09T04:41:51.890 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.884+0000 7f950a7fc700 1 -- 172.21.15.90:0/4219069142 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94fc00bbc0 con 0x7f950c15bf60 2023-06-09T04:41:51.890 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.884+0000 7f950a7fc700 1 -- 172.21.15.90:0/4219069142 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94fc009e60 con 0x7f950c15bf60 2023-06-09T04:41:51.890 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.888+0000 7f9510ab8700 1 -- 172.21.15.90:0/4219069142 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f950c15bf60 msgr2=0x7f950c06f960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:51.891 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.888+0000 7f9510ab8700 1 --2- 172.21.15.90:0/4219069142 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f950c15bf60 0x7f950c06f960 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f94fc009910 tx=0x7f94fc009c20 comp rx=0 tx=0).stop 2023-06-09T04:41:51.891 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.888+0000 7f9510ab8700 1 -- 172.21.15.90:0/4219069142 shutdown_connections 2023-06-09T04:41:51.892 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.888+0000 7f9510ab8700 1 --2- 172.21.15.90:0/4219069142 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f950c0cc0f0 0x7f950c0cd750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:51.892 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.888+0000 7f9510ab8700 1 --2- 172.21.15.90:0/4219069142 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f950c15bf60 0x7f950c06f960 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:51.892 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.888+0000 7f9510ab8700 1 -- 172.21.15.90:0/4219069142 >> 172.21.15.90:0/4219069142 conn(0x7f950c06c690 msgr2=0x7f950c0aff00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:51.892 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.888+0000 7f9510ab8700 1 -- 172.21.15.90:0/4219069142 shutdown_connections 2023-06-09T04:41:51.892 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.888+0000 7f9510ab8700 1 -- 172.21.15.90:0/4219069142 wait complete. 2023-06-09T04:41:51.893 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.888+0000 7f9510ab8700 1 Processor -- start 2023-06-09T04:41:51.894 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.888+0000 7f9510ab8700 1 -- start start 2023-06-09T04:41:51.895 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.892+0000 7f9510ab8700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f950c0cc0f0 0x7f950c0b3da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:51.896 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.892+0000 7f9510ab8700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f950c0cdc90 0x7f950c13d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:51.896 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.892+0000 7f9510ab8700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f950c15bf60 0x7f950c13f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:51.896 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.892+0000 7f9510ab8700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f950c150980 con 0x7f950c0cdc90 2023-06-09T04:41:51.896 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.892+0000 7f9510ab8700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f950c15cbf0 con 0x7f950c0cc0f0 2023-06-09T04:41:51.896 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.892+0000 7f9510ab8700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f950c15ced0 con 0x7f950c15bf60 2023-06-09T04:41:51.897 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.892+0000 7f950affd700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f950c0cdc90 0x7f950c13d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:51.897 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.892+0000 7f950affd700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f950c0cdc90 0x7f950c13d900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:55956/0 (socket says 172.21.15.90:55956) 2023-06-09T04:41:51.898 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.892+0000 7f950affd700 1 -- 172.21.15.90:0/294670048 learned_addr learned my addr 172.21.15.90:0/294670048 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:41:51.898 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.892+0000 7f950b7fe700 1 --2- 172.21.15.90:0/294670048 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f950c0cc0f0 0x7f950c0b3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:51.898 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.892+0000 7f950bfff700 1 --2- 172.21.15.90:0/294670048 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f950c15bf60 0x7f950c13f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:51.898 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.892+0000 7f950affd700 1 -- 172.21.15.90:0/294670048 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f950c15bf60 msgr2=0x7f950c13f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:51.898 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.892+0000 7f950affd700 1 --2- 172.21.15.90:0/294670048 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f950c15bf60 0x7f950c13f8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:51.898 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.892+0000 7f950affd700 1 -- 172.21.15.90:0/294670048 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f950c0cc0f0 msgr2=0x7f950c0b3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:51.898 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.892+0000 7f950affd700 1 --2- 172.21.15.90:0/294670048 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f950c0cc0f0 0x7f950c0b3da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:51.899 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.892+0000 7f950affd700 1 -- 172.21.15.90:0/294670048 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94fc009570 con 0x7f950c0cdc90 2023-06-09T04:41:51.899 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.892+0000 7f950b7fe700 1 --2- 172.21.15.90:0/294670048 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f950c0cc0f0 0x7f950c0b3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:41:51.899 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.892+0000 7f950affd700 1 --2- 172.21.15.90:0/294670048 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f950c0cdc90 0x7f950c13d900 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f950000d800 tx=0x7f950000dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:51.899 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.892+0000 7f94f3fff700 1 -- 172.21.15.90:0/294670048 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95000125f0 con 0x7f950c0cdc90 2023-06-09T04:41:51.899 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.892+0000 7f94f3fff700 1 -- 172.21.15.90:0/294670048 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9500012750 con 0x7f950c0cdc90 2023-06-09T04:41:51.899 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.892+0000 7f9510ab8700 1 -- 172.21.15.90:0/294670048 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f950c15d1b0 con 0x7f950c0cdc90 2023-06-09T04:41:51.899 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.892+0000 7f94f3fff700 1 -- 172.21.15.90:0/294670048 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9500012ac0 con 0x7f950c0cdc90 2023-06-09T04:41:51.900 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.892+0000 7f9510ab8700 1 -- 172.21.15.90:0/294670048 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f950c13de40 con 0x7f950c0cdc90 2023-06-09T04:41:51.900 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.896+0000 7f9510ab8700 1 -- 172.21.15.90:0/294670048 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f950c04e380 con 0x7f950c0cdc90 2023-06-09T04:41:51.900 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.896+0000 7f94f3fff700 1 -- 172.21.15.90:0/294670048 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9500012c20 con 0x7f950c0cdc90 2023-06-09T04:41:51.902 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.896+0000 7f94f3fff700 1 --2- 172.21.15.90:0/294670048 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f94f8066320 0x7f94f80687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:51.902 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.896+0000 7f94f3fff700 1 -- 172.21.15.90:0/294670048 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f9500083d80 con 0x7f950c0cdc90 2023-06-09T04:41:51.902 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.896+0000 7f950b7fe700 1 --2- 172.21.15.90:0/294670048 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f94f8066320 0x7f94f80687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:51.903 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.900+0000 7f950b7fe700 1 --2- 172.21.15.90:0/294670048 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f94f8066320 0x7f94f80687d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f94fc000c00 tx=0x7f94fc008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:51.908 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:51.904+0000 7f94f3fff700 1 -- 172.21.15.90:0/294670048 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9500054f40 con 0x7f950c0cdc90 2023-06-09T04:41:52.082 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:52.076+0000 7f9510ab8700 1 -- 172.21.15.90:0/294670048 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f950c06b310 con 0x7f950c0cdc90 2023-06-09T04:41:52.083 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:52.080+0000 7f94f3fff700 1 -- 172.21.15.90:0/294670048 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v20) v1 ==== 84+0+126 (secure 0 0 0) 0x7f9500012ed0 con 0x7f950c0cdc90 2023-06-09T04:41:52.083 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:41:52.083 INFO:teuthology.orchestra.run.smithi090.stdout:[ 2023-06-09T04:41:52.084 INFO:teuthology.orchestra.run.smithi090.stdout: { 2023-06-09T04:41:52.084 INFO:teuthology.orchestra.run.smithi090.stdout: "poolnum": 1, 2023-06-09T04:41:52.084 INFO:teuthology.orchestra.run.smithi090.stdout: "poolname": ".mgr" 2023-06-09T04:41:52.084 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2023-06-09T04:41:52.084 INFO:teuthology.orchestra.run.smithi090.stdout: { 2023-06-09T04:41:52.084 INFO:teuthology.orchestra.run.smithi090.stdout: "poolnum": 2, 2023-06-09T04:41:52.084 INFO:teuthology.orchestra.run.smithi090.stdout: "poolname": "rbd" 2023-06-09T04:41:52.085 INFO:teuthology.orchestra.run.smithi090.stdout: } 2023-06-09T04:41:52.085 INFO:teuthology.orchestra.run.smithi090.stdout:] 2023-06-09T04:41:52.085 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:52.080+0000 7f9510ab8700 1 -- 172.21.15.90:0/294670048 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f94f8066320 msgr2=0x7f94f80687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:52.086 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:52.080+0000 7f9510ab8700 1 --2- 172.21.15.90:0/294670048 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f94f8066320 0x7f94f80687d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f94fc000c00 tx=0x7f94fc008030 comp rx=0 tx=0).stop 2023-06-09T04:41:52.086 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:52.080+0000 7f9510ab8700 1 -- 172.21.15.90:0/294670048 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f950c0cdc90 msgr2=0x7f950c13d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:52.086 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:52.080+0000 7f9510ab8700 1 --2- 172.21.15.90:0/294670048 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f950c0cdc90 0x7f950c13d900 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f950000d800 tx=0x7f950000dbc0 comp rx=0 tx=0).stop 2023-06-09T04:41:52.086 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:52.080+0000 7f9510ab8700 1 -- 172.21.15.90:0/294670048 shutdown_connections 2023-06-09T04:41:52.086 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:52.080+0000 7f9510ab8700 1 --2- 172.21.15.90:0/294670048 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f94f8066320 0x7f94f80687d0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:52.086 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:52.080+0000 7f9510ab8700 1 --2- 172.21.15.90:0/294670048 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f950c15bf60 0x7f950c13f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:52.087 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:52.080+0000 7f9510ab8700 1 --2- 172.21.15.90:0/294670048 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f950c0cdc90 0x7f950c13d900 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:52.087 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:52.080+0000 7f9510ab8700 1 --2- 172.21.15.90:0/294670048 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f950c0cc0f0 0x7f950c0b3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:52.087 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:52.080+0000 7f9510ab8700 1 -- 172.21.15.90:0/294670048 >> 172.21.15.90:0/294670048 conn(0x7f950c06c690 msgr2=0x7f950c0acb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:52.087 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:52.080+0000 7f9510ab8700 1 -- 172.21.15.90:0/294670048 shutdown_connections 2023-06-09T04:41:52.087 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:52.080+0000 7f9510ab8700 1 -- 172.21.15.90:0/294670048 wait complete. 2023-06-09T04:41:52.108 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-06-09T04:41:52.109 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-06-09T04:41:52.283 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:52.280+0000 7f631940d700 1 Processor -- start 2023-06-09T04:41:52.284 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:52.280+0000 7f631940d700 1 -- start start 2023-06-09T04:41:52.287 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:52.284+0000 7f631940d700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f63140b60d0 0x7f631415c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:52.287 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:52.284+0000 7f631940d700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63141607e0 con 0x7f63140ce0d0 2023-06-09T04:41:52.287 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:52.284+0000 7f631940d700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63140b4570 con 0x7f63141599c0 2023-06-09T04:41:52.288 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:52.284+0000 7f631940d700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f631415f9c0 con 0x7f63140b60d0 2023-06-09T04:41:52.288 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:52.284+0000 7f63137fe700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f63140ce0d0 0x7f63140b59c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:46828/0 (socket says 172.21.15.90:46828) 2023-06-09T04:41:52.288 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:52.284+0000 7f63137fe700 1 -- 172.21.15.90:0/347303714 learned_addr learned my addr 172.21.15.90:0/347303714 (peer_addr_for_me v1:172.21.15.90:0/0) 2023-06-09T04:41:52.288 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:52.284+0000 7f6318c0c700 1 --2- 172.21.15.90:0/347303714 >> v2:172.21.15.174:3300/0 conn(0x7f63140b60d0 0x7f631415c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:52.289 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:52.284+0000 7f6318c0c700 1 -- 172.21.15.90:0/347303714 >> v1:172.21.15.174:6789/0 conn(0x7f63141599c0 legacy=0x7f63140b3e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:52.289 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:52.284+0000 7f6318c0c700 1 -- 172.21.15.90:0/347303714 >> v1:172.21.15.90:6789/0 conn(0x7f63140ce0d0 legacy=0x7f63140b59c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:52.289 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:52.284+0000 7f6318c0c700 1 -- 172.21.15.90:0/347303714 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f631415fbd0 con 0x7f63140b60d0 2023-06-09T04:41:52.290 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:52.284+0000 7f6312ffd700 1 -- 172.21.15.90:0/347303714 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1973815120 0 0) 0x7f63141607e0 con 0x7f63140ce0d0 2023-06-09T04:41:52.290 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:52.284+0000 7f6318c0c700 1 --2- 172.21.15.90:0/347303714 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f63140b60d0 0x7f631415c5f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f630c009d90 tx=0x7f630c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cd9742c0d4e5722a server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:52.290 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:52.284+0000 7f6312ffd700 1 -- 172.21.15.90:0/347303714 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f630c00e070 con 0x7f63140b60d0 2023-06-09T04:41:52.291 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:52.284+0000 7f6312ffd700 1 -- 172.21.15.90:0/347303714 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f630c00bbd0 con 0x7f63140b60d0 2023-06-09T04:41:52.291 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:52.284+0000 7f6312ffd700 1 -- 172.21.15.90:0/347303714 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f630c012430 con 0x7f63140b60d0 2023-06-09T04:41:52.291 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:52.284+0000 7f631940d700 1 -- 172.21.15.90:0/347303714 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f63140b60d0 msgr2=0x7f631415c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:52.291 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:52.284+0000 7f631940d700 1 --2- 172.21.15.90:0/347303714 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f63140b60d0 0x7f631415c5f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f630c009d90 tx=0x7f630c00b330 comp rx=0 tx=0).stop 2023-06-09T04:41:52.291 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:52.288+0000 7f631940d700 1 -- 172.21.15.90:0/347303714 shutdown_connections 2023-06-09T04:41:52.291 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:52.288+0000 7f631940d700 1 --2- 172.21.15.90:0/347303714 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f63140b60d0 0x7f631415c5f0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:52.292 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:52.288+0000 7f631940d700 1 -- 172.21.15.90:0/347303714 >> 172.21.15.90:0/347303714 conn(0x7f63140cdbd0 msgr2=0x7f63140d0500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:52.292 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:52.288+0000 7f631940d700 1 -- 172.21.15.90:0/347303714 shutdown_connections 2023-06-09T04:41:52.292 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:52.288+0000 7f631940d700 1 -- 172.21.15.90:0/347303714 wait complete. 2023-06-09T04:41:52.293 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:52.288+0000 7f631940d700 1 Processor -- start 2023-06-09T04:41:52.294 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:52.288+0000 7f631940d700 1 -- start start 2023-06-09T04:41:52.296 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:52.292+0000 7f631940d700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f63140b60d0 0x7f63141f8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:52.296 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:52.292+0000 7f631940d700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f63140ce0d0 0x7f63140c9730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:52.297 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:52.292+0000 7f631940d700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f63141599c0 0x7f63140c9c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:52.297 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:52.292+0000 7f631940d700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63140b29c0 con 0x7f63140ce0d0 2023-06-09T04:41:52.297 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:52.292+0000 7f631940d700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63140b1ac0 con 0x7f63140b60d0 2023-06-09T04:41:52.297 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:52.292+0000 7f631940d700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63140b1d40 con 0x7f63141599c0 2023-06-09T04:41:52.297 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:52.292+0000 7f63137fe700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f63140ce0d0 0x7f63140c9730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:52.297 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:52.292+0000 7f63137fe700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f63140ce0d0 0x7f63140c9730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:55968/0 (socket says 172.21.15.90:55968) 2023-06-09T04:41:52.297 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:52.292+0000 7f63137fe700 1 -- 172.21.15.90:0/116313511 learned_addr learned my addr 172.21.15.90:0/116313511 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:41:52.297 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:52.292+0000 7f6313fff700 1 --2- 172.21.15.90:0/116313511 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f63140b60d0 0x7f63141f8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:52.299 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:52.292+0000 7f6318c0c700 1 --2- 172.21.15.90:0/116313511 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f63141599c0 0x7f63140c9c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:52.299 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:52.292+0000 7f63137fe700 1 -- 172.21.15.90:0/116313511 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f63141599c0 msgr2=0x7f63140c9c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:52.299 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:52.292+0000 7f63137fe700 1 --2- 172.21.15.90:0/116313511 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f63141599c0 0x7f63140c9c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:52.299 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:52.292+0000 7f63137fe700 1 -- 172.21.15.90:0/116313511 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f63140b60d0 msgr2=0x7f63141f8af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:52.299 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:52.292+0000 7f63137fe700 1 --2- 172.21.15.90:0/116313511 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f63140b60d0 0x7f63141f8af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:52.299 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:52.292+0000 7f63137fe700 1 -- 172.21.15.90:0/116313511 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f630c009a70 con 0x7f63140ce0d0 2023-06-09T04:41:52.299 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:52.292+0000 7f63137fe700 1 --2- 172.21.15.90:0/116313511 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f63140ce0d0 0x7f63140c9730 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f630800c580 tx=0x7f630800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:52.300 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:52.292+0000 7f6310ff9700 1 -- 172.21.15.90:0/116313511 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6308004ca0 con 0x7f63140ce0d0 2023-06-09T04:41:52.300 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:52.292+0000 7f6310ff9700 1 -- 172.21.15.90:0/116313511 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6308004e20 con 0x7f63140ce0d0 2023-06-09T04:41:52.300 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:52.292+0000 7f631940d700 1 -- 172.21.15.90:0/116313511 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63140b2020 con 0x7f63140ce0d0 2023-06-09T04:41:52.300 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:52.292+0000 7f6310ff9700 1 -- 172.21.15.90:0/116313511 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6308007310 con 0x7f63140ce0d0 2023-06-09T04:41:52.300 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:52.292+0000 7f631940d700 1 -- 172.21.15.90:0/116313511 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63140b25e0 con 0x7f63140ce0d0 2023-06-09T04:41:52.301 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:52.296+0000 7f631940d700 1 -- 172.21.15.90:0/116313511 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f631404db30 con 0x7f63140ce0d0 2023-06-09T04:41:52.302 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:52.296+0000 7f6310ff9700 1 -- 172.21.15.90:0/116313511 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6308007470 con 0x7f63140ce0d0 2023-06-09T04:41:52.303 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:52.300+0000 7f6310ff9700 1 --2- 172.21.15.90:0/116313511 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f63000662f0 0x7f63000687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:52.304 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:52.300+0000 7f6310ff9700 1 -- 172.21.15.90:0/116313511 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f6308083830 con 0x7f63140ce0d0 2023-06-09T04:41:52.304 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:52.300+0000 7f6313fff700 1 --2- 172.21.15.90:0/116313511 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f63000662f0 0x7f63000687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:52.305 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:52.300+0000 7f6313fff700 1 --2- 172.21.15.90:0/116313511 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f63000662f0 0x7f63000687a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6304000f60 tx=0x7f6304009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:52.310 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:52.304+0000 7f6310ff9700 1 -- 172.21.15.90:0/116313511 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6308050ee0 con 0x7f63140ce0d0 2023-06-09T04:41:52.478 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:52.472+0000 7f631940d700 1 -- 172.21.15.90:0/116313511 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f63140b2b00 con 0x7f63140ce0d0 2023-06-09T04:41:52.908 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:52.904+0000 7f6310ff9700 1 -- 172.21.15.90:0/116313511 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v21) v1 ==== 138+0+0 (secure 0 0 0) 0x7f6308007720 con 0x7f63140ce0d0 2023-06-09T04:41:52.915 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:52.908+0000 7f631940d700 1 -- 172.21.15.90:0/116313511 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f63000662f0 msgr2=0x7f63000687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:52.915 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:52.908+0000 7f631940d700 1 --2- 172.21.15.90:0/116313511 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f63000662f0 0x7f63000687a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6304000f60 tx=0x7f6304009040 comp rx=0 tx=0).stop 2023-06-09T04:41:52.915 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:52.908+0000 7f631940d700 1 -- 172.21.15.90:0/116313511 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f63140ce0d0 msgr2=0x7f63140c9730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:52.915 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:52.908+0000 7f631940d700 1 --2- 172.21.15.90:0/116313511 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f63140ce0d0 0x7f63140c9730 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f630800c580 tx=0x7f630800c890 comp rx=0 tx=0).stop 2023-06-09T04:41:52.915 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:52.912+0000 7f631940d700 1 -- 172.21.15.90:0/116313511 shutdown_connections 2023-06-09T04:41:52.916 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:52.912+0000 7f631940d700 1 --2- 172.21.15.90:0/116313511 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f63000662f0 0x7f63000687a0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:52.916 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:52.912+0000 7f631940d700 1 --2- 172.21.15.90:0/116313511 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f63141599c0 0x7f63140c9c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:52.916 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:52.912+0000 7f631940d700 1 --2- 172.21.15.90:0/116313511 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f63140ce0d0 0x7f63140c9730 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:52.916 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:52.912+0000 7f631940d700 1 --2- 172.21.15.90:0/116313511 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f63140b60d0 0x7f63141f8af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:52.916 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:52.912+0000 7f631940d700 1 -- 172.21.15.90:0/116313511 >> 172.21.15.90:0/116313511 conn(0x7f63140cdbd0 msgr2=0x7f631415b440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:52.917 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:52.912+0000 7f631940d700 1 -- 172.21.15.90:0/116313511 shutdown_connections 2023-06-09T04:41:52.919 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:52.916+0000 7f631940d700 1 -- 172.21.15.90:0/116313511 wait complete. 2023-06-09T04:41:52.921 INFO:teuthology.orchestra.run.smithi090.stderr:pool 'cephfs_metadata' created 2023-06-09T04:41:52.939 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-06-09T04:41:53.128 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:53.124+0000 7f7900ff6700 1 Processor -- start 2023-06-09T04:41:53.129 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:53.124+0000 7f7900ff6700 1 -- start start 2023-06-09T04:41:53.132 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:53.128+0000 7f7900ff6700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f78fc0b18d0 0x7f78fc160920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:53.133 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:53.128+0000 7f7900ff6700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f78fc0d2400 0x7f78fc0d28a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:53.133 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:53.128+0000 7f7900ff6700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78fc15c6b0 con 0x7f78fc0b1ca0 2023-06-09T04:41:53.133 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:53.128+0000 7f7900ff6700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78fc0d2de0 con 0x7f78fc0d2400 2023-06-09T04:41:53.133 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:53.128+0000 7f7900ff6700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78fc0cf6a0 con 0x7f78fc0b18d0 2023-06-09T04:41:53.134 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:53.128+0000 7f78fbfff700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f78fc0d2400 0x7f78fc0d28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:53.134 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:53.128+0000 7f78fbfff700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f78fc0d2400 0x7f78fc0d28a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:55976/0 (socket says 172.21.15.90:55976) 2023-06-09T04:41:53.134 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:53.128+0000 7f78fbfff700 1 -- 172.21.15.90:0/3650821970 learned_addr learned my addr 172.21.15.90:0/3650821970 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:41:53.134 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:53.128+0000 7f78fb7fe700 1 --2- 172.21.15.90:0/3650821970 >> v2:172.21.15.174:3300/0 conn(0x7f78fc0b18d0 0x7f78fc160920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:53.136 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:53.128+0000 7f78fbfff700 1 -- 172.21.15.90:0/3650821970 >> v2:172.21.15.174:3300/0 conn(0x7f78fc0b18d0 msgr2=0x7f78fc160920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:53.137 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:53.128+0000 7f78fbfff700 1 --2- 172.21.15.90:0/3650821970 >> v2:172.21.15.174:3300/0 conn(0x7f78fc0b18d0 0x7f78fc160920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:53.137 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:53.128+0000 7f78fbfff700 1 -- 172.21.15.90:0/3650821970 >> v1:172.21.15.174:6789/0 conn(0x7f78fc0b1ca0 legacy=0x7f78fc0cee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:53.137 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:53.128+0000 7f78fbfff700 1 -- 172.21.15.90:0/3650821970 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78fc0cf980 con 0x7f78fc0d2400 2023-06-09T04:41:53.137 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:53.128+0000 7f78fbfff700 1 --2- 172.21.15.90:0/3650821970 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f78fc0d2400 0x7f78fc0d28a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f78fc066ca0 tx=0x7f78f400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31e5275b2f61a7c8 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:53.138 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:53.128+0000 7f78faffd700 1 -- 172.21.15.90:0/3650821970 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78f400e070 con 0x7f78fc0d2400 2023-06-09T04:41:53.138 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:53.128+0000 7f78faffd700 1 -- 172.21.15.90:0/3650821970 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78f400b910 con 0x7f78fc0d2400 2023-06-09T04:41:53.138 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:53.128+0000 7f78faffd700 1 -- 172.21.15.90:0/3650821970 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78f400bcc0 con 0x7f78fc0d2400 2023-06-09T04:41:53.138 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:53.132+0000 7f7900ff6700 1 -- 172.21.15.90:0/3650821970 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f78fc0d2400 msgr2=0x7f78fc0d28a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:53.138 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:53.132+0000 7f7900ff6700 1 --2- 172.21.15.90:0/3650821970 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f78fc0d2400 0x7f78fc0d28a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f78fc066ca0 tx=0x7f78f400b330 comp rx=0 tx=0).stop 2023-06-09T04:41:53.139 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:53.132+0000 7f7900ff6700 1 -- 172.21.15.90:0/3650821970 shutdown_connections 2023-06-09T04:41:53.139 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:53.132+0000 7f7900ff6700 1 --2- 172.21.15.90:0/3650821970 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f78fc0d2400 0x7f78fc0d28a0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:53.139 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:53.132+0000 7f7900ff6700 1 --2- 172.21.15.90:0/3650821970 >> v2:172.21.15.174:3300/0 conn(0x7f78fc0b18d0 0x7f78fc160920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:53.139 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:53.132+0000 7f7900ff6700 1 -- 172.21.15.90:0/3650821970 >> 172.21.15.90:0/3650821970 conn(0x7f78fc09b9b0 msgr2=0x7f78fc0b55d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:53.140 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:53.132+0000 7f7900ff6700 1 -- 172.21.15.90:0/3650821970 shutdown_connections 2023-06-09T04:41:53.140 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:53.132+0000 7f7900ff6700 1 -- 172.21.15.90:0/3650821970 wait complete. 2023-06-09T04:41:53.142 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:53.132+0000 7f7900ff6700 1 Processor -- start 2023-06-09T04:41:53.142 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:53.132+0000 7f7900ff6700 1 -- start start 2023-06-09T04:41:53.143 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:53.136+0000 7f7900ff6700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f78fc0b18d0 0x7f78fc157e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:53.143 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:53.136+0000 7f7900ff6700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f78fc0b1ca0 0x7f78fc1f4d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:53.143 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:53.136+0000 7f7900ff6700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f78fc0d2400 0x7f78fc1f5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:53.144 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:53.136+0000 7f7900ff6700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78fc0c9da0 con 0x7f78fc0b18d0 2023-06-09T04:41:53.144 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:53.136+0000 7f7900ff6700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78fc1583d0 con 0x7f78fc0d2400 2023-06-09T04:41:53.144 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:53.136+0000 7f7900ff6700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78fc06cc60 con 0x7f78fc0b1ca0 2023-06-09T04:41:53.144 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:53.136+0000 7f78fb7fe700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f78fc0b18d0 0x7f78fc157e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:53.145 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:53.136+0000 7f78fb7fe700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f78fc0b18d0 0x7f78fc157e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:55978/0 (socket says 172.21.15.90:55978) 2023-06-09T04:41:53.145 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:53.136+0000 7f78fb7fe700 1 -- 172.21.15.90:0/3547084568 learned_addr learned my addr 172.21.15.90:0/3547084568 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:41:53.145 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:53.136+0000 7f78fb7fe700 1 -- 172.21.15.90:0/3547084568 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f78fc0b1ca0 msgr2=0x7f78fc1f4d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:53.145 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:53.136+0000 7f78fb7fe700 1 --2- 172.21.15.90:0/3547084568 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f78fc0b1ca0 0x7f78fc1f4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:53.146 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:53.136+0000 7f78fb7fe700 1 -- 172.21.15.90:0/3547084568 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f78fc0d2400 msgr2=0x7f78fc1f5240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:53.146 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:53.136+0000 7f78fb7fe700 1 --2- 172.21.15.90:0/3547084568 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f78fc0d2400 0x7f78fc1f5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:53.146 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:53.136+0000 7f78fb7fe700 1 -- 172.21.15.90:0/3547084568 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78f4009b30 con 0x7f78fc0b18d0 2023-06-09T04:41:53.146 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:53.136+0000 7f78fb7fe700 1 --2- 172.21.15.90:0/3547084568 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f78fc0b18d0 0x7f78fc157e90 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f78ec00e9b0 tx=0x7f78ec00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:53.147 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:53.136+0000 7f78f8ff9700 1 -- 172.21.15.90:0/3547084568 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78ec00c850 con 0x7f78fc0b18d0 2023-06-09T04:41:53.147 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:53.136+0000 7f78f8ff9700 1 -- 172.21.15.90:0/3547084568 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78ec00c9b0 con 0x7f78fc0b18d0 2023-06-09T04:41:53.147 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:53.136+0000 7f7900ff6700 1 -- 172.21.15.90:0/3547084568 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78fc1f5870 con 0x7f78fc0b18d0 2023-06-09T04:41:53.147 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:53.136+0000 7f78f8ff9700 1 -- 172.21.15.90:0/3547084568 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78ec00cd20 con 0x7f78fc0b18d0 2023-06-09T04:41:53.147 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:53.136+0000 7f7900ff6700 1 -- 172.21.15.90:0/3547084568 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78fc0c9750 con 0x7f78fc0b18d0 2023-06-09T04:41:53.148 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:53.136+0000 7f7900ff6700 1 -- 172.21.15.90:0/3547084568 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78fc04e380 con 0x7f78fc0b18d0 2023-06-09T04:41:53.149 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:53.140+0000 7f78f8ff9700 1 -- 172.21.15.90:0/3547084568 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f78ec013470 con 0x7f78fc0b18d0 2023-06-09T04:41:53.149 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:53.140+0000 7f78f8ff9700 1 --2- 172.21.15.90:0/3547084568 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f78dc0662f0 0x7f78dc0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:53.149 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:53.140+0000 7f78f8ff9700 1 -- 172.21.15.90:0/3547084568 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5580+0+0 (secure 0 0 0) 0x7f78ec084010 con 0x7f78fc0b18d0 2023-06-09T04:41:53.150 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:53.140+0000 7f78f3fff700 1 --2- 172.21.15.90:0/3547084568 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f78dc0662f0 0x7f78dc0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:53.150 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:53.140+0000 7f78f3fff700 1 --2- 172.21.15.90:0/3547084568 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f78dc0662f0 0x7f78dc0687a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f78e4000f60 tx=0x7f78e4007a60 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:53.150 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:53.144+0000 7f78f8ff9700 1 -- 172.21.15.90:0/3547084568 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f78ec051670 con 0x7f78fc0b18d0 2023-06-09T04:41:53.317 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:53.312+0000 7f7900ff6700 1 -- 172.21.15.90:0/3547084568 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f78fc0d33d0 con 0x7f78fc0b18d0 2023-06-09T04:41:53.921 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:53.916+0000 7f78f8ff9700 1 -- 172.21.15.90:0/3547084568 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v22) v1 ==== 170+0+0 (secure 0 0 0) 0x7f78ec054c90 con 0x7f78fc0b18d0 2023-06-09T04:41:53.940 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:53.936+0000 7f7900ff6700 1 -- 172.21.15.90:0/3547084568 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f78dc0662f0 msgr2=0x7f78dc0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:53.940 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:53.936+0000 7f7900ff6700 1 --2- 172.21.15.90:0/3547084568 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f78dc0662f0 0x7f78dc0687a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f78e4000f60 tx=0x7f78e4007a60 comp rx=0 tx=0).stop 2023-06-09T04:41:53.941 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:53.936+0000 7f7900ff6700 1 -- 172.21.15.90:0/3547084568 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f78fc0b18d0 msgr2=0x7f78fc157e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:53.941 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:53.936+0000 7f7900ff6700 1 --2- 172.21.15.90:0/3547084568 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f78fc0b18d0 0x7f78fc157e90 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f78ec00e9b0 tx=0x7f78ec00ed70 comp rx=0 tx=0).stop 2023-06-09T04:41:53.941 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:53.936+0000 7f7900ff6700 1 -- 172.21.15.90:0/3547084568 shutdown_connections 2023-06-09T04:41:53.942 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:53.936+0000 7f7900ff6700 1 --2- 172.21.15.90:0/3547084568 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f78dc0662f0 0x7f78dc0687a0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:53.942 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:53.936+0000 7f7900ff6700 1 --2- 172.21.15.90:0/3547084568 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f78fc0d2400 0x7f78fc1f5240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:53.942 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:53.936+0000 7f7900ff6700 1 --2- 172.21.15.90:0/3547084568 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f78fc0b1ca0 0x7f78fc1f4d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:53.942 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:53.936+0000 7f7900ff6700 1 --2- 172.21.15.90:0/3547084568 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f78fc0b18d0 0x7f78fc157e90 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:53.942 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:53.936+0000 7f7900ff6700 1 -- 172.21.15.90:0/3547084568 >> 172.21.15.90:0/3547084568 conn(0x7f78fc09b9b0 msgr2=0x7f78fc0b0860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:53.942 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:53.936+0000 7f7900ff6700 1 -- 172.21.15.90:0/3547084568 shutdown_connections 2023-06-09T04:41:53.943 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:53.936+0000 7f7900ff6700 1 -- 172.21.15.90:0/3547084568 wait complete. 2023-06-09T04:41:53.949 INFO:teuthology.orchestra.run.smithi090.stderr:pool 'cephfs_data' created 2023-06-09T04:41:53.968 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-06-09T04:41:54.143 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.140+0000 7fd2af061700 1 Processor -- start 2023-06-09T04:41:54.144 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.140+0000 7fd2af061700 1 -- start start 2023-06-09T04:41:54.146 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.140+0000 7fd2af061700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fd2a815b850 0x7fd2a80cad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:54.146 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.140+0000 7fd2af061700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd2a806a830 0x7fd2a806ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:54.147 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.140+0000 7fd2af061700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2a806b1d0 con 0x7fd2a80c3d90 2023-06-09T04:41:54.147 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.140+0000 7fd2af061700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2a806f960 con 0x7fd2a815b850 2023-06-09T04:41:54.147 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.140+0000 7fd2af061700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2a806fc40 con 0x7fd2a806a830 2023-06-09T04:41:54.148 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.144+0000 7fd2ae05f700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fd2a815b850 0x7fd2a80cad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:54.148 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.144+0000 7fd2ae05f700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fd2a815b850 0x7fd2a80cad30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:55990/0 (socket says 172.21.15.90:55990) 2023-06-09T04:41:54.148 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.144+0000 7fd2ae05f700 1 -- 172.21.15.90:0/4250697075 learned_addr learned my addr 172.21.15.90:0/4250697075 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:41:54.148 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.144+0000 7fd2ae860700 1 --2- 172.21.15.90:0/4250697075 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd2a806a830 0x7fd2a806ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:54.148 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.144+0000 7fd2ae05f700 1 -- 172.21.15.90:0/4250697075 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd2a806a830 msgr2=0x7fd2a806ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:54.149 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.144+0000 7fd2ae05f700 1 --2- 172.21.15.90:0/4250697075 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd2a806a830 0x7fd2a806ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:54.149 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.144+0000 7fd2ae05f700 1 -- 172.21.15.90:0/4250697075 >> v1:172.21.15.174:6789/0 conn(0x7fd2a80c3d90 legacy=0x7fd2a80c41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:54.149 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.144+0000 7fd2ae05f700 1 -- 172.21.15.90:0/4250697075 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2a80c4a80 con 0x7fd2a815b850 2023-06-09T04:41:54.149 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.144+0000 7fd2ae860700 1 --2- 172.21.15.90:0/4250697075 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd2a806a830 0x7fd2a806ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:41:54.150 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.144+0000 7fd2ae05f700 1 --2- 172.21.15.90:0/4250697075 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd2a815b850 0x7fd2a80cad30 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd2a4009910 tx=0x7fd2a4009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c253e05f1812d048 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:54.151 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.144+0000 7fd2ad05d700 1 -- 172.21.15.90:0/4250697075 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2a400ba60 con 0x7fd2a815b850 2023-06-09T04:41:54.151 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.144+0000 7fd2ad05d700 1 -- 172.21.15.90:0/4250697075 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2a400bbc0 con 0x7fd2a815b850 2023-06-09T04:41:54.151 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.144+0000 7fd2ad05d700 1 -- 172.21.15.90:0/4250697075 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2a4009e60 con 0x7fd2a815b850 2023-06-09T04:41:54.151 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.144+0000 7fd2af061700 1 -- 172.21.15.90:0/4250697075 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd2a815b850 msgr2=0x7fd2a80cad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:54.152 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.144+0000 7fd2af061700 1 --2- 172.21.15.90:0/4250697075 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd2a815b850 0x7fd2a80cad30 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd2a4009910 tx=0x7fd2a4009c20 comp rx=0 tx=0).stop 2023-06-09T04:41:54.152 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.144+0000 7fd2af061700 1 -- 172.21.15.90:0/4250697075 shutdown_connections 2023-06-09T04:41:54.152 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.144+0000 7fd2af061700 1 --2- 172.21.15.90:0/4250697075 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd2a806a830 0x7fd2a806ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:54.153 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.144+0000 7fd2af061700 1 --2- 172.21.15.90:0/4250697075 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd2a815b850 0x7fd2a80cad30 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:54.153 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.144+0000 7fd2af061700 1 -- 172.21.15.90:0/4250697075 >> 172.21.15.90:0/4250697075 conn(0x7fd2a80aff00 msgr2=0x7fd2a80b0300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:54.153 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.144+0000 7fd2af061700 1 -- 172.21.15.90:0/4250697075 shutdown_connections 2023-06-09T04:41:54.154 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.148+0000 7fd2af061700 1 -- 172.21.15.90:0/4250697075 wait complete. 2023-06-09T04:41:54.155 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.148+0000 7fd2af061700 1 Processor -- start 2023-06-09T04:41:54.155 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.152+0000 7fd2af061700 1 -- start start 2023-06-09T04:41:54.158 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.152+0000 7fd2af061700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd2a806a830 0x7fd2a815ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:54.158 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.152+0000 7fd2af061700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd2a80c3d90 0x7fd2a814b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:54.159 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.152+0000 7fd2af061700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd2a815b850 0x7fd2a8159c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:54.159 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.152+0000 7fd2af061700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2a814bb20 con 0x7fd2a806a830 2023-06-09T04:41:54.159 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.152+0000 7fd2af061700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2a8152d60 con 0x7fd2a815b850 2023-06-09T04:41:54.159 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.152+0000 7fd2af061700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2a8153040 con 0x7fd2a80c3d90 2023-06-09T04:41:54.160 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.152+0000 7fd2ae05f700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd2a806a830 0x7fd2a815ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:54.160 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.152+0000 7fd2ae05f700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd2a806a830 0x7fd2a815ac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:56004/0 (socket says 172.21.15.90:56004) 2023-06-09T04:41:54.160 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.152+0000 7fd2ae05f700 1 -- 172.21.15.90:0/1903613322 learned_addr learned my addr 172.21.15.90:0/1903613322 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:41:54.161 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.152+0000 7fd2ae860700 1 --2- 172.21.15.90:0/1903613322 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd2a815b850 0x7fd2a8159c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:54.161 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.152+0000 7fd2ad85e700 1 --2- 172.21.15.90:0/1903613322 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd2a80c3d90 0x7fd2a814b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:54.161 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.152+0000 7fd2ae05f700 1 -- 172.21.15.90:0/1903613322 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd2a80c3d90 msgr2=0x7fd2a814b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:54.161 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.152+0000 7fd2ae05f700 1 --2- 172.21.15.90:0/1903613322 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd2a80c3d90 0x7fd2a814b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:54.161 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.152+0000 7fd2ae05f700 1 -- 172.21.15.90:0/1903613322 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd2a815b850 msgr2=0x7fd2a8159c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:54.161 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.152+0000 7fd2ae05f700 1 --2- 172.21.15.90:0/1903613322 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd2a815b850 0x7fd2a8159c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:54.162 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.152+0000 7fd2ae05f700 1 -- 172.21.15.90:0/1903613322 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2a4009570 con 0x7fd2a806a830 2023-06-09T04:41:54.162 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.152+0000 7fd2ad85e700 1 --2- 172.21.15.90:0/1903613322 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd2a80c3d90 0x7fd2a814b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:41:54.162 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.152+0000 7fd2ae860700 1 --2- 172.21.15.90:0/1903613322 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd2a815b850 0x7fd2a8159c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:41:54.162 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.152+0000 7fd2ae05f700 1 --2- 172.21.15.90:0/1903613322 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd2a806a830 0x7fd2a815ac10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd2a4000c00 tx=0x7fd2a4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:54.162 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.152+0000 7fd29effd700 1 -- 172.21.15.90:0/1903613322 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2a4004550 con 0x7fd2a806a830 2023-06-09T04:41:54.162 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.152+0000 7fd29effd700 1 -- 172.21.15.90:0/1903613322 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2a401f070 con 0x7fd2a806a830 2023-06-09T04:41:54.162 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.152+0000 7fd2af061700 1 -- 172.21.15.90:0/1903613322 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2a8159420 con 0x7fd2a806a830 2023-06-09T04:41:54.163 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.152+0000 7fd29effd700 1 -- 172.21.15.90:0/1903613322 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2a4003900 con 0x7fd2a806a830 2023-06-09T04:41:54.163 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.152+0000 7fd2af061700 1 -- 172.21.15.90:0/1903613322 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2a815a160 con 0x7fd2a806a830 2023-06-09T04:41:54.163 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.156+0000 7fd2af061700 1 -- 172.21.15.90:0/1903613322 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2a8159280 con 0x7fd2a806a830 2023-06-09T04:41:54.163 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.156+0000 7fd29effd700 1 -- 172.21.15.90:0/1903613322 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd2a4003a60 con 0x7fd2a806a830 2023-06-09T04:41:54.164 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.160+0000 7fd29effd700 1 --2- 172.21.15.90:0/1903613322 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fd28c0662f0 0x7fd28c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:54.164 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.160+0000 7fd29effd700 1 -- 172.21.15.90:0/1903613322 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5962+0+0 (secure 0 0 0) 0x7fd2a4021070 con 0x7fd2a806a830 2023-06-09T04:41:54.165 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.160+0000 7fd2ad85e700 1 --2- 172.21.15.90:0/1903613322 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fd28c0662f0 0x7fd28c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:54.166 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.160+0000 7fd2ad85e700 1 --2- 172.21.15.90:0/1903613322 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fd28c0662f0 0x7fd28c0687a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd2a80ca2e0 tx=0x7fd298009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:54.172 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.168+0000 7fd29effd700 1 -- 172.21.15.90:0/1903613322 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd2a40b5700 con 0x7fd2a806a830 2023-06-09T04:41:54.381 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.376+0000 7fd2af061700 1 -- 172.21.15.90:0/1903613322 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fd2a804e380 con 0x7fd2a806a830 2023-06-09T04:41:54.396 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.392+0000 7fd29effd700 1 -- 172.21.15.90:0/1903613322 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7fd2a8159280 con 0x7fd2a806a830 2023-06-09T04:41:54.404 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.400+0000 7fd2af061700 1 -- 172.21.15.90:0/1903613322 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fd28c0662f0 msgr2=0x7fd28c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:54.404 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.400+0000 7fd2af061700 1 --2- 172.21.15.90:0/1903613322 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fd28c0662f0 0x7fd28c0687a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd2a80ca2e0 tx=0x7fd298009040 comp rx=0 tx=0).stop 2023-06-09T04:41:54.404 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.400+0000 7fd2af061700 1 -- 172.21.15.90:0/1903613322 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd2a806a830 msgr2=0x7fd2a815ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:54.405 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.400+0000 7fd2af061700 1 --2- 172.21.15.90:0/1903613322 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd2a806a830 0x7fd2a815ac10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd2a4000c00 tx=0x7fd2a4004770 comp rx=0 tx=0).stop 2023-06-09T04:41:54.405 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.400+0000 7fd2af061700 1 -- 172.21.15.90:0/1903613322 shutdown_connections 2023-06-09T04:41:54.405 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.400+0000 7fd2af061700 1 --2- 172.21.15.90:0/1903613322 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fd28c0662f0 0x7fd28c0687a0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:54.405 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.400+0000 7fd2af061700 1 --2- 172.21.15.90:0/1903613322 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd2a815b850 0x7fd2a8159c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:54.405 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.400+0000 7fd2af061700 1 --2- 172.21.15.90:0/1903613322 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd2a80c3d90 0x7fd2a814b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:54.406 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.400+0000 7fd2af061700 1 --2- 172.21.15.90:0/1903613322 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd2a806a830 0x7fd2a815ac10 secure :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd2a4000c00 tx=0x7fd2a4004770 comp rx=0 tx=0).stop 2023-06-09T04:41:54.406 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.400+0000 7fd2af061700 1 -- 172.21.15.90:0/1903613322 >> 172.21.15.90:0/1903613322 conn(0x7fd2a80aff00 msgr2=0x7fd2a8157f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:54.406 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.400+0000 7fd2af061700 1 -- 172.21.15.90:0/1903613322 shutdown_connections 2023-06-09T04:41:54.406 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.400+0000 7fd2af061700 1 -- 172.21.15.90:0/1903613322 wait complete. 2023-06-09T04:41:54.415 INFO:teuthology.orchestra.run.smithi090.stderr:new fs with metadata pool 3 and data pool 4 2023-06-09T04:41:54.440 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T04:41:54.598 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.592+0000 7f685759e700 1 Processor -- start 2023-06-09T04:41:54.599 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.596+0000 7f685759e700 1 -- start start 2023-06-09T04:41:54.600 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.596+0000 7f685759e700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f68580cafb0 0x7f68580cc0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:54.601 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.596+0000 7f685759e700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68580cd8a0 con 0x7f6858154350 2023-06-09T04:41:54.601 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.596+0000 7f685759e700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68580cb420 con 0x7f685815deb0 2023-06-09T04:41:54.601 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.596+0000 7f685759e700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6858154720 con 0x7f68580cafb0 2023-06-09T04:41:54.601 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.596+0000 7f685659c700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f6858154350 0x7f685815d7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:46832/0 (socket says 172.21.15.90:46832) 2023-06-09T04:41:54.602 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.596+0000 7f685659c700 1 -- 172.21.15.90:0/2661010284 learned_addr learned my addr 172.21.15.90:0/2661010284 (peer_addr_for_me v1:172.21.15.90:0/0) 2023-06-09T04:41:54.602 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.596+0000 7f6855d9b700 1 --2- 172.21.15.90:0/2661010284 >> v2:172.21.15.174:3300/0 conn(0x7f68580cafb0 0x7f68580cc0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:54.602 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.596+0000 7f685559a700 1 -- 172.21.15.90:0/2661010284 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1042112178 0 0) 0x7f68580cd8a0 con 0x7f6858154350 2023-06-09T04:41:54.603 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.596+0000 7f685559a700 1 -- 172.21.15.90:0/2661010284 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f68400035d0 con 0x7f6858154350 2023-06-09T04:41:54.603 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.596+0000 7f6855d9b700 1 -- 172.21.15.90:0/2661010284 >> v1:172.21.15.174:6789/0 conn(0x7f685815deb0 legacy=0x7f6858069c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:54.603 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.596+0000 7f6855d9b700 1 -- 172.21.15.90:0/2661010284 >> v1:172.21.15.90:6789/0 conn(0x7f6858154350 legacy=0x7f685815d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:54.603 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.596+0000 7f685559a700 1 -- 172.21.15.90:0/2661010284 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 481850012 0 0) 0x7f68400035d0 con 0x7f6858154350 2023-06-09T04:41:54.603 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.596+0000 7f6855d9b700 1 -- 172.21.15.90:0/2661010284 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68580cdaf0 con 0x7f68580cafb0 2023-06-09T04:41:54.604 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.600+0000 7f6855d9b700 1 --2- 172.21.15.90:0/2661010284 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f68580cafb0 0x7f68580cc0f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f684c009850 tx=0x7f684c009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f70e31c9ad9891f2 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:54.604 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.600+0000 7f685559a700 1 -- 172.21.15.90:0/2661010284 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f684c011830 con 0x7f68580cafb0 2023-06-09T04:41:54.604 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.600+0000 7f685559a700 1 -- 172.21.15.90:0/2661010284 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f684c011990 con 0x7f68580cafb0 2023-06-09T04:41:54.604 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.600+0000 7f685559a700 1 -- 172.21.15.90:0/2661010284 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f684c011d00 con 0x7f68580cafb0 2023-06-09T04:41:54.605 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.600+0000 7f685759e700 1 -- 172.21.15.90:0/2661010284 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f68580cafb0 msgr2=0x7f68580cc0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:54.605 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.600+0000 7f685759e700 1 --2- 172.21.15.90:0/2661010284 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f68580cafb0 0x7f68580cc0f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f684c009850 tx=0x7f684c009b60 comp rx=0 tx=0).stop 2023-06-09T04:41:54.605 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.600+0000 7f685759e700 1 -- 172.21.15.90:0/2661010284 shutdown_connections 2023-06-09T04:41:54.605 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.600+0000 7f685759e700 1 --2- 172.21.15.90:0/2661010284 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f68580cafb0 0x7f68580cc0f0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:54.606 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.600+0000 7f685759e700 1 -- 172.21.15.90:0/2661010284 >> 172.21.15.90:0/2661010284 conn(0x7f685806c690 msgr2=0x7f68580aff00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:54.606 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.600+0000 7f685759e700 1 -- 172.21.15.90:0/2661010284 shutdown_connections 2023-06-09T04:41:54.606 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.600+0000 7f685759e700 1 -- 172.21.15.90:0/2661010284 wait complete. 2023-06-09T04:41:54.607 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.604+0000 7f685759e700 1 Processor -- start 2023-06-09T04:41:54.607 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.604+0000 7f685759e700 1 -- start start 2023-06-09T04:41:54.609 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.604+0000 7f685759e700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f68580cafb0 0x7f68581ef680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:54.609 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.604+0000 7f685759e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6858154350 0x7f685814f170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:54.609 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.604+0000 7f685759e700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f685815deb0 0x7f68581f2050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:54.609 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.604+0000 7f685759e700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6858152410 con 0x7f68580cafb0 2023-06-09T04:41:54.610 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.604+0000 7f685759e700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68581efbc0 con 0x7f685815deb0 2023-06-09T04:41:54.610 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.604+0000 7f685759e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6858151580 con 0x7f6858154350 2023-06-09T04:41:54.610 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.604+0000 7f685659c700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f68580cafb0 0x7f68581ef680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:54.610 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.604+0000 7f685659c700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f68580cafb0 0x7f68581ef680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:56020/0 (socket says 172.21.15.90:56020) 2023-06-09T04:41:54.610 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.604+0000 7f685659c700 1 -- 172.21.15.90:0/1871773027 learned_addr learned my addr 172.21.15.90:0/1871773027 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:41:54.611 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.604+0000 7f6855d9b700 1 --2- 172.21.15.90:0/1871773027 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6858154350 0x7f685814f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:54.611 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.604+0000 7f6856d9d700 1 --2- 172.21.15.90:0/1871773027 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f685815deb0 0x7f68581f2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:54.611 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.604+0000 7f685659c700 1 -- 172.21.15.90:0/1871773027 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6858154350 msgr2=0x7f685814f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:54.612 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.604+0000 7f685659c700 1 --2- 172.21.15.90:0/1871773027 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6858154350 0x7f685814f170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:54.612 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.604+0000 7f685659c700 1 -- 172.21.15.90:0/1871773027 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f685815deb0 msgr2=0x7f68581f2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:54.612 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.604+0000 7f685659c700 1 --2- 172.21.15.90:0/1871773027 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f685815deb0 0x7f68581f2050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:54.612 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.604+0000 7f685659c700 1 -- 172.21.15.90:0/1871773027 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f684c0094b0 con 0x7f68580cafb0 2023-06-09T04:41:54.612 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.604+0000 7f685659c700 1 --2- 172.21.15.90:0/1871773027 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f68580cafb0 0x7f68581ef680 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f684800c780 tx=0x7f684800ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:54.612 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.604+0000 7f6846ffd700 1 -- 172.21.15.90:0/1871773027 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6848005d90 con 0x7f68580cafb0 2023-06-09T04:41:54.612 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.604+0000 7f6846ffd700 1 -- 172.21.15.90:0/1871773027 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68480070d0 con 0x7f68580cafb0 2023-06-09T04:41:54.612 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.608+0000 7f6846ffd700 1 -- 172.21.15.90:0/1871773027 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6848007480 con 0x7f68580cafb0 2023-06-09T04:41:54.613 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.608+0000 7f685759e700 1 -- 172.21.15.90:0/1871773027 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68581517f0 con 0x7f68580cafb0 2023-06-09T04:41:54.613 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.608+0000 7f685759e700 1 -- 172.21.15.90:0/1871773027 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6858152030 con 0x7f68580cafb0 2023-06-09T04:41:54.613 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.608+0000 7f685759e700 1 -- 172.21.15.90:0/1871773027 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f685806b390 con 0x7f68580cafb0 2023-06-09T04:41:54.613 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.608+0000 7f6846ffd700 1 -- 172.21.15.90:0/1871773027 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f68480075e0 con 0x7f68580cafb0 2023-06-09T04:41:54.616 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.612+0000 7f6846ffd700 1 --2- 172.21.15.90:0/1871773027 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f68380662f0 0x7f68380687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:54.616 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.612+0000 7f6846ffd700 1 -- 172.21.15.90:0/1871773027 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f68480831f0 con 0x7f68580cafb0 2023-06-09T04:41:54.617 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.612+0000 7f6855d9b700 1 --2- 172.21.15.90:0/1871773027 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f68380662f0 0x7f68380687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:54.617 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.612+0000 7f6855d9b700 1 --2- 172.21.15.90:0/1871773027 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f68380662f0 0x7f68380687a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f684c0090b0 tx=0x7f684c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:54.622 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.616+0000 7f6846ffd700 1 -- 172.21.15.90:0/1871773027 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6848050660 con 0x7f68580cafb0 2023-06-09T04:41:54.790 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.784+0000 7f685759e700 1 -- 172.21.15.90:0/1871773027 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6858152550 con 0x7f68580cafb0 2023-06-09T04:41:54.793 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.788+0000 7f6846ffd700 1 -- 172.21.15.90:0/1871773027 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+18292 (secure 0 0 0) 0x7f6848053c80 con 0x7f68580cafb0 2023-06-09T04:41:54.794 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:41:54.794 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":23,"fsid":"700369c0-a111-43b4-9415-844ad1742b70","created":"2023-06-09T04:41:28.180311+0000","modified":"2023-06-09T04:41:54.382855+0000","last_up_change":"2023-06-09T04:41:40.746475+0000","last_in_change":"2023-06-09T04:41:31.262765+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-09T04:41:42.402564+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-09T04:41:47.607323+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-09T04:41:52.543474+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-09T04:41:53.382940+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"46a4a7c5-babd-4ef3-9830-51487cff5eb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":2780271267},{"type":"v1","addr":"172.21.15.90:6809","nonce":2780271267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2780271267},{"type":"v1","addr":"172.21.15.90:6811","nonce":2780271267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2780271267},{"type":"v1","addr":"172.21.15.90:6815","nonce":2780271267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2780271267},{"type":"v1","addr":"172.21.15.90:6813","nonce":2780271267}]},"public_addr":"172.21.15.90:6809/2780271267","cluster_addr":"172.21.15.90:6811/2780271267","heartbeat_back_addr":"172.21.15.90:6815/2780271267","heartbeat_front_addr":"172.21.15.90:6813/2780271267","state":["exists","up"]},{"osd":1,"uuid":"1543988f-c498-494a-a6f9-fac8413db6ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":3064028136},{"type":"v1","addr":"172.21.15.90:6801","nonce":3064028136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":3064028136},{"type":"v1","addr":"172.21.15.90:6803","nonce":3064028136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":3064028136},{"type":"v1","addr":"172.21.15.90:6807","nonce":3064028136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":3064028136},{"type":"v1","addr":"172.21.15.90:6805","nonce":3064028136}]},"public_addr":"172.21.15.90:6801/3064028136","cluster_addr":"172.21.15.90:6803/3064028136","heartbeat_back_addr":"172.21.15.90:6807/3064028136","heartbeat_front_addr":"172.21.15.90:6805/3064028136","state":["exists","up"]},{"osd":2,"uuid":"79669dd6-ffc8-4197-b9f7-b3b372b2b9b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":3713146326},{"type":"v1","addr":"172.21.15.90:6825","nonce":3713146326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":3713146326},{"type":"v1","addr":"172.21.15.90:6827","nonce":3713146326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":3713146326},{"type":"v1","addr":"172.21.15.90:6831","nonce":3713146326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":3713146326},{"type":"v1","addr":"172.21.15.90:6829","nonce":3713146326}]},"public_addr":"172.21.15.90:6825/3713146326","cluster_addr":"172.21.15.90:6827/3713146326","heartbeat_back_addr":"172.21.15.90:6831/3713146326","heartbeat_front_addr":"172.21.15.90:6829/3713146326","state":["exists","up"]},{"osd":3,"uuid":"4062ab6f-ce40-450a-aa17-b10098766c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":3499839122},{"type":"v1","addr":"172.21.15.90:6817","nonce":3499839122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":3499839122},{"type":"v1","addr":"172.21.15.90:6819","nonce":3499839122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":3499839122},{"type":"v1","addr":"172.21.15.90:6823","nonce":3499839122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":3499839122},{"type":"v1","addr":"172.21.15.90:6821","nonce":3499839122}]},"public_addr":"172.21.15.90:6817/3499839122","cluster_addr":"172.21.15.90:6819/3499839122","heartbeat_back_addr":"172.21.15.90:6823/3499839122","heartbeat_front_addr":"172.21.15.90:6821/3499839122","state":["exists","up"]},{"osd":4,"uuid":"a10820e4-b348-4d92-9796-3b01484ace1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6817","nonce":1138565854},{"type":"v1","addr":"172.21.15.174:6819","nonce":1138565854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6821","nonce":1138565854},{"type":"v1","addr":"172.21.15.174:6823","nonce":1138565854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":1138565854},{"type":"v1","addr":"172.21.15.174:6831","nonce":1138565854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":1138565854},{"type":"v1","addr":"172.21.15.174:6829","nonce":1138565854}]},"public_addr":"172.21.15.174:6819/1138565854","cluster_addr":"172.21.15.174:6823/1138565854","heartbeat_back_addr":"172.21.15.174:6831/1138565854","heartbeat_front_addr":"172.21.15.174:6829/1138565854","state":["exists","up"]},{"osd":5,"uuid":"b4da1c32-be05-420b-9346-90d91aa70569","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":1707702879},{"type":"v1","addr":"172.21.15.174:6818","nonce":1707702879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":1707702879},{"type":"v1","addr":"172.21.15.174:6822","nonce":1707702879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6827","nonce":1707702879},{"type":"v1","addr":"172.21.15.174:6828","nonce":1707702879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":1707702879},{"type":"v1","addr":"172.21.15.174:6825","nonce":1707702879}]},"public_addr":"172.21.15.174:6818/1707702879","cluster_addr":"172.21.15.174:6822/1707702879","heartbeat_back_addr":"172.21.15.174:6828/1707702879","heartbeat_front_addr":"172.21.15.174:6825/1707702879","state":["exists","up"]},{"osd":6,"uuid":"d1b98041-d243-4355-bd0a-e22cf9875b32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":864450534},{"type":"v1","addr":"172.21.15.174:6801","nonce":864450534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":864450534},{"type":"v1","addr":"172.21.15.174:6803","nonce":864450534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":864450534},{"type":"v1","addr":"172.21.15.174:6807","nonce":864450534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":864450534},{"type":"v1","addr":"172.21.15.174:6805","nonce":864450534}]},"public_addr":"172.21.15.174:6801/864450534","cluster_addr":"172.21.15.174:6803/864450534","heartbeat_back_addr":"172.21.15.174:6807/864450534","heartbeat_front_addr":"172.21.15.174:6805/864450534","state":["exists","up"]},{"osd":7,"uuid":"5a207936-f89f-416b-b79b-34ec96f77c8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":2527640659},{"type":"v1","addr":"172.21.15.174:6809","nonce":2527640659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":2527640659},{"type":"v1","addr":"172.21.15.174:6811","nonce":2527640659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":2527640659},{"type":"v1","addr":"172.21.15.174:6815","nonce":2527640659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":2527640659},{"type":"v1","addr":"172.21.15.174:6813","nonce":2527640659}]},"public_addr":"172.21.15.174:6809/2527640659","cluster_addr":"172.21.15.174:6811/2527640659","heartbeat_back_addr":"172.21.15.174:6815/2527640659","heartbeat_front_addr":"172.21.15.174:6813/2527640659","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:36.972152+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:36.984561+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:36.998817+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:37.054944+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:37.085014+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:37.115125+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:36.854608+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:36.971685+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:41:54.796 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.792+0000 7f685759e700 1 -- 172.21.15.90:0/1871773027 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f68380662f0 msgr2=0x7f68380687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:54.796 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.792+0000 7f685759e700 1 --2- 172.21.15.90:0/1871773027 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f68380662f0 0x7f68380687a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f684c0090b0 tx=0x7f684c008030 comp rx=0 tx=0).stop 2023-06-09T04:41:54.796 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.792+0000 7f685759e700 1 -- 172.21.15.90:0/1871773027 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f68580cafb0 msgr2=0x7f68581ef680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:54.797 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.792+0000 7f685759e700 1 --2- 172.21.15.90:0/1871773027 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f68580cafb0 0x7f68581ef680 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f684800c780 tx=0x7f684800ca90 comp rx=0 tx=0).stop 2023-06-09T04:41:54.797 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.792+0000 7f685759e700 1 -- 172.21.15.90:0/1871773027 shutdown_connections 2023-06-09T04:41:54.797 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.792+0000 7f685759e700 1 --2- 172.21.15.90:0/1871773027 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f68380662f0 0x7f68380687a0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:54.797 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.792+0000 7f685759e700 1 --2- 172.21.15.90:0/1871773027 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f685815deb0 0x7f68581f2050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:54.797 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.792+0000 7f685759e700 1 --2- 172.21.15.90:0/1871773027 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6858154350 0x7f685814f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:54.797 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.792+0000 7f685759e700 1 --2- 172.21.15.90:0/1871773027 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f68580cafb0 0x7f68581ef680 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:54.797 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.792+0000 7f685759e700 1 -- 172.21.15.90:0/1871773027 >> 172.21.15.90:0/1871773027 conn(0x7f685806c690 msgr2=0x7f68580cc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:54.797 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.792+0000 7f685759e700 1 -- 172.21.15.90:0/1871773027 shutdown_connections 2023-06-09T04:41:54.798 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.792+0000 7f685759e700 1 -- 172.21.15.90:0/1871773027 wait complete. 2023-06-09T04:41:54.820 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T04:41:54.993 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.988+0000 7f2900b34700 1 Processor -- start 2023-06-09T04:41:54.993 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.988+0000 7f2900b34700 1 -- start start 2023-06-09T04:41:54.995 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.992+0000 7f2900b34700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f28fc158b30 0x7f28fc15d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:54.995 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.992+0000 7f2900b34700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f28fc158f00 0x7f28fc070db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:54.996 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.992+0000 7f2900b34700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f28fc069820 0x7f28fc15c950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:54.996 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.992+0000 7f2900b34700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28fc0cd3a0 con 0x7f28fc069820 2023-06-09T04:41:54.996 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.992+0000 7f2900b34700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28fc0712f0 con 0x7f28fc158b30 2023-06-09T04:41:54.996 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.992+0000 7f2900b34700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28fc071550 con 0x7f28fc158f00 2023-06-09T04:41:54.997 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.992+0000 7f28fad9d700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f28fc069820 0x7f28fc15c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:54.997 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.992+0000 7f28fa59c700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f28fc158b30 0x7f28fc15d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:54.997 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.992+0000 7f28f3fff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f28fc158f00 0x7f28fc070db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:54.997 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.992+0000 7f28fad9d700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f28fc069820 0x7f28fc15c950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:56036/0 (socket says 172.21.15.90:56036) 2023-06-09T04:41:54.997 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.992+0000 7f28fad9d700 1 -- 172.21.15.90:0/435985964 learned_addr learned my addr 172.21.15.90:0/435985964 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:41:54.998 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.992+0000 7f28fad9d700 1 -- 172.21.15.90:0/435985964 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f28fc158f00 msgr2=0x7f28fc070db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:54.998 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.992+0000 7f28fad9d700 1 --2- 172.21.15.90:0/435985964 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f28fc158f00 0x7f28fc070db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:54.998 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.992+0000 7f28fad9d700 1 -- 172.21.15.90:0/435985964 >> v2:172.21.15.174:3300/0 conn(0x7f28fc158b30 msgr2=0x7f28fc15d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:54.998 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.992+0000 7f28fad9d700 1 --2- 172.21.15.90:0/435985964 >> v2:172.21.15.174:3300/0 conn(0x7f28fc158b30 0x7f28fc15d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:54.998 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.992+0000 7f28fad9d700 1 -- 172.21.15.90:0/435985964 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28fc071830 con 0x7f28fc069820 2023-06-09T04:41:54.999 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.992+0000 7f28fad9d700 1 --2- 172.21.15.90:0/435985964 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f28fc069820 0x7f28fc15c950 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f28fc06dee0 tx=0x7f28f400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a6083b9234f73d6 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:54.999 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.992+0000 7f28f9d9b700 1 -- 172.21.15.90:0/435985964 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28f400e070 con 0x7f28fc069820 2023-06-09T04:41:54.999 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.992+0000 7f28f9d9b700 1 -- 172.21.15.90:0/435985964 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28f400b910 con 0x7f28fc069820 2023-06-09T04:41:54.999 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.992+0000 7f28f9d9b700 1 -- 172.21.15.90:0/435985964 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28f400bcc0 con 0x7f28fc069820 2023-06-09T04:41:54.999 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.996+0000 7f2900b34700 1 -- 172.21.15.90:0/435985964 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f28fc069820 msgr2=0x7f28fc15c950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:54.999 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.996+0000 7f2900b34700 1 --2- 172.21.15.90:0/435985964 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f28fc069820 0x7f28fc15c950 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f28fc06dee0 tx=0x7f28f400b330 comp rx=0 tx=0).stop 2023-06-09T04:41:55.000 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.996+0000 7f2900b34700 1 -- 172.21.15.90:0/435985964 shutdown_connections 2023-06-09T04:41:55.000 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.996+0000 7f2900b34700 1 --2- 172.21.15.90:0/435985964 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f28fc069820 0x7f28fc15c950 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:55.000 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.996+0000 7f2900b34700 1 --2- 172.21.15.90:0/435985964 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f28fc158f00 0x7f28fc070db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:55.001 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.996+0000 7f2900b34700 1 --2- 172.21.15.90:0/435985964 >> v2:172.21.15.174:3300/0 conn(0x7f28fc158b30 0x7f28fc15d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:55.001 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.996+0000 7f2900b34700 1 -- 172.21.15.90:0/435985964 >> 172.21.15.90:0/435985964 conn(0x7f28fc06c810 msgr2=0x7f28fc0b0000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:55.001 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.996+0000 7f2900b34700 1 -- 172.21.15.90:0/435985964 shutdown_connections 2023-06-09T04:41:55.001 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.996+0000 7f2900b34700 1 -- 172.21.15.90:0/435985964 wait complete. 2023-06-09T04:41:55.001 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.996+0000 7f2900b34700 1 Processor -- start 2023-06-09T04:41:55.002 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:54.996+0000 7f2900b34700 1 -- start start 2023-06-09T04:41:55.003 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:55.000+0000 7f2900b34700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f28fc069820 0x7f28fc0ab8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:55.003 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:55.000+0000 7f2900b34700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f28fc158b30 0x7f28fc1f54a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:55.004 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:55.000+0000 7f2900b34700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f28fc158f00 0x7f28fc1ee800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:55.004 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:55.000+0000 7f2900b34700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28fc1f24c0 con 0x7f28fc158b30 2023-06-09T04:41:55.004 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:55.000+0000 7f2900b34700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28fc1f59e0 con 0x7f28fc069820 2023-06-09T04:41:55.004 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:55.000+0000 7f2900b34700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28fc0ad2a0 con 0x7f28fc158f00 2023-06-09T04:41:55.005 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:55.000+0000 7f28f3fff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f28fc158b30 0x7f28fc1f54a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:55.005 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:55.000+0000 7f28f3fff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f28fc158b30 0x7f28fc1f54a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:56046/0 (socket says 172.21.15.90:56046) 2023-06-09T04:41:55.006 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:55.000+0000 7f28f3fff700 1 -- 172.21.15.90:0/96909150 learned_addr learned my addr 172.21.15.90:0/96909150 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:41:55.006 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:55.000+0000 7f28fa59c700 1 --2- 172.21.15.90:0/96909150 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f28fc069820 0x7f28fc0ab8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:55.006 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:55.000+0000 7f28fad9d700 1 --2- 172.21.15.90:0/96909150 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f28fc158f00 0x7f28fc1ee800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:55.006 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:55.000+0000 7f28f3fff700 1 -- 172.21.15.90:0/96909150 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f28fc158f00 msgr2=0x7f28fc1ee800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:55.006 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:55.000+0000 7f28f3fff700 1 --2- 172.21.15.90:0/96909150 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f28fc158f00 0x7f28fc1ee800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:55.006 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:55.000+0000 7f28f3fff700 1 -- 172.21.15.90:0/96909150 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f28fc069820 msgr2=0x7f28fc0ab8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:55.006 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:55.000+0000 7f28f3fff700 1 --2- 172.21.15.90:0/96909150 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f28fc069820 0x7f28fc0ab8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:55.007 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:55.000+0000 7f28f3fff700 1 -- 172.21.15.90:0/96909150 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28f4009b30 con 0x7f28fc158b30 2023-06-09T04:41:55.007 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:55.000+0000 7f28f3fff700 1 --2- 172.21.15.90:0/96909150 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f28fc158b30 0x7f28fc1f54a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f28e400e9d0 tx=0x7f28e400ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:55.007 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:55.000+0000 7f28f2ffd700 1 -- 172.21.15.90:0/96909150 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28e4009720 con 0x7f28fc158b30 2023-06-09T04:41:55.007 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:55.000+0000 7f28f2ffd700 1 -- 172.21.15.90:0/96909150 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28e400ee70 con 0x7f28fc158b30 2023-06-09T04:41:55.007 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:55.000+0000 7f2900b34700 1 -- 172.21.15.90:0/96909150 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28fc1f1940 con 0x7f28fc158b30 2023-06-09T04:41:55.007 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:55.000+0000 7f28f2ffd700 1 -- 172.21.15.90:0/96909150 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28e400ca50 con 0x7f28fc158b30 2023-06-09T04:41:55.007 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:55.000+0000 7f2900b34700 1 -- 172.21.15.90:0/96909150 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28fc1f1f00 con 0x7f28fc158b30 2023-06-09T04:41:55.008 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:55.004+0000 7f2900b34700 1 -- 172.21.15.90:0/96909150 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28fc04db30 con 0x7f28fc158b30 2023-06-09T04:41:55.009 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:55.004+0000 7f28f2ffd700 1 -- 172.21.15.90:0/96909150 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f28e400cbb0 con 0x7f28fc158b30 2023-06-09T04:41:55.011 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:55.008+0000 7f28f2ffd700 1 --2- 172.21.15.90:0/96909150 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f28dc0662f0 0x7f28dc0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:55.011 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:55.008+0000 7f28f2ffd700 1 -- 172.21.15.90:0/96909150 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f28e4083d80 con 0x7f28fc158b30 2023-06-09T04:41:55.012 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:55.008+0000 7f28fa59c700 1 --2- 172.21.15.90:0/96909150 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f28dc0662f0 0x7f28dc0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:55.013 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:55.008+0000 7f28fa59c700 1 --2- 172.21.15.90:0/96909150 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f28dc0662f0 0x7f28dc0687a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f28ec009ad0 tx=0x7f28ec009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:55.016 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:55.012+0000 7f28f2ffd700 1 -- 172.21.15.90:0/96909150 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f28e4054c90 con 0x7f28fc158b30 2023-06-09T04:41:55.191 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:55.188+0000 7f2900b34700 1 -- 172.21.15.90:0/96909150 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f28fc0cd000 con 0x7f28fc158b30 2023-06-09T04:41:55.194 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:55.188+0000 7f28f2ffd700 1 -- 172.21.15.90:0/96909150 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+18292 (secure 0 0 0) 0x7f28e4017090 con 0x7f28fc158b30 2023-06-09T04:41:55.195 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:41:55.195 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":23,"fsid":"700369c0-a111-43b4-9415-844ad1742b70","created":"2023-06-09T04:41:28.180311+0000","modified":"2023-06-09T04:41:54.382855+0000","last_up_change":"2023-06-09T04:41:40.746475+0000","last_in_change":"2023-06-09T04:41:31.262765+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-09T04:41:42.402564+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-09T04:41:47.607323+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-09T04:41:52.543474+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-09T04:41:53.382940+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"46a4a7c5-babd-4ef3-9830-51487cff5eb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":2780271267},{"type":"v1","addr":"172.21.15.90:6809","nonce":2780271267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2780271267},{"type":"v1","addr":"172.21.15.90:6811","nonce":2780271267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2780271267},{"type":"v1","addr":"172.21.15.90:6815","nonce":2780271267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2780271267},{"type":"v1","addr":"172.21.15.90:6813","nonce":2780271267}]},"public_addr":"172.21.15.90:6809/2780271267","cluster_addr":"172.21.15.90:6811/2780271267","heartbeat_back_addr":"172.21.15.90:6815/2780271267","heartbeat_front_addr":"172.21.15.90:6813/2780271267","state":["exists","up"]},{"osd":1,"uuid":"1543988f-c498-494a-a6f9-fac8413db6ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":3064028136},{"type":"v1","addr":"172.21.15.90:6801","nonce":3064028136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":3064028136},{"type":"v1","addr":"172.21.15.90:6803","nonce":3064028136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":3064028136},{"type":"v1","addr":"172.21.15.90:6807","nonce":3064028136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":3064028136},{"type":"v1","addr":"172.21.15.90:6805","nonce":3064028136}]},"public_addr":"172.21.15.90:6801/3064028136","cluster_addr":"172.21.15.90:6803/3064028136","heartbeat_back_addr":"172.21.15.90:6807/3064028136","heartbeat_front_addr":"172.21.15.90:6805/3064028136","state":["exists","up"]},{"osd":2,"uuid":"79669dd6-ffc8-4197-b9f7-b3b372b2b9b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":3713146326},{"type":"v1","addr":"172.21.15.90:6825","nonce":3713146326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":3713146326},{"type":"v1","addr":"172.21.15.90:6827","nonce":3713146326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":3713146326},{"type":"v1","addr":"172.21.15.90:6831","nonce":3713146326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":3713146326},{"type":"v1","addr":"172.21.15.90:6829","nonce":3713146326}]},"public_addr":"172.21.15.90:6825/3713146326","cluster_addr":"172.21.15.90:6827/3713146326","heartbeat_back_addr":"172.21.15.90:6831/3713146326","heartbeat_front_addr":"172.21.15.90:6829/3713146326","state":["exists","up"]},{"osd":3,"uuid":"4062ab6f-ce40-450a-aa17-b10098766c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":3499839122},{"type":"v1","addr":"172.21.15.90:6817","nonce":3499839122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":3499839122},{"type":"v1","addr":"172.21.15.90:6819","nonce":3499839122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":3499839122},{"type":"v1","addr":"172.21.15.90:6823","nonce":3499839122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":3499839122},{"type":"v1","addr":"172.21.15.90:6821","nonce":3499839122}]},"public_addr":"172.21.15.90:6817/3499839122","cluster_addr":"172.21.15.90:6819/3499839122","heartbeat_back_addr":"172.21.15.90:6823/3499839122","heartbeat_front_addr":"172.21.15.90:6821/3499839122","state":["exists","up"]},{"osd":4,"uuid":"a10820e4-b348-4d92-9796-3b01484ace1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6817","nonce":1138565854},{"type":"v1","addr":"172.21.15.174:6819","nonce":1138565854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6821","nonce":1138565854},{"type":"v1","addr":"172.21.15.174:6823","nonce":1138565854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":1138565854},{"type":"v1","addr":"172.21.15.174:6831","nonce":1138565854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":1138565854},{"type":"v1","addr":"172.21.15.174:6829","nonce":1138565854}]},"public_addr":"172.21.15.174:6819/1138565854","cluster_addr":"172.21.15.174:6823/1138565854","heartbeat_back_addr":"172.21.15.174:6831/1138565854","heartbeat_front_addr":"172.21.15.174:6829/1138565854","state":["exists","up"]},{"osd":5,"uuid":"b4da1c32-be05-420b-9346-90d91aa70569","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":1707702879},{"type":"v1","addr":"172.21.15.174:6818","nonce":1707702879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":1707702879},{"type":"v1","addr":"172.21.15.174:6822","nonce":1707702879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6827","nonce":1707702879},{"type":"v1","addr":"172.21.15.174:6828","nonce":1707702879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":1707702879},{"type":"v1","addr":"172.21.15.174:6825","nonce":1707702879}]},"public_addr":"172.21.15.174:6818/1707702879","cluster_addr":"172.21.15.174:6822/1707702879","heartbeat_back_addr":"172.21.15.174:6828/1707702879","heartbeat_front_addr":"172.21.15.174:6825/1707702879","state":["exists","up"]},{"osd":6,"uuid":"d1b98041-d243-4355-bd0a-e22cf9875b32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":864450534},{"type":"v1","addr":"172.21.15.174:6801","nonce":864450534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":864450534},{"type":"v1","addr":"172.21.15.174:6803","nonce":864450534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":864450534},{"type":"v1","addr":"172.21.15.174:6807","nonce":864450534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":864450534},{"type":"v1","addr":"172.21.15.174:6805","nonce":864450534}]},"public_addr":"172.21.15.174:6801/864450534","cluster_addr":"172.21.15.174:6803/864450534","heartbeat_back_addr":"172.21.15.174:6807/864450534","heartbeat_front_addr":"172.21.15.174:6805/864450534","state":["exists","up"]},{"osd":7,"uuid":"5a207936-f89f-416b-b79b-34ec96f77c8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":2527640659},{"type":"v1","addr":"172.21.15.174:6809","nonce":2527640659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":2527640659},{"type":"v1","addr":"172.21.15.174:6811","nonce":2527640659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":2527640659},{"type":"v1","addr":"172.21.15.174:6815","nonce":2527640659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":2527640659},{"type":"v1","addr":"172.21.15.174:6813","nonce":2527640659}]},"public_addr":"172.21.15.174:6809/2527640659","cluster_addr":"172.21.15.174:6811/2527640659","heartbeat_back_addr":"172.21.15.174:6815/2527640659","heartbeat_front_addr":"172.21.15.174:6813/2527640659","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:36.972152+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:36.984561+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:36.998817+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:37.054944+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:37.085014+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:37.115125+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:36.854608+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:36.971685+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:41:55.197 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:55.192+0000 7f2900b34700 1 -- 172.21.15.90:0/96909150 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f28dc0662f0 msgr2=0x7f28dc0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:55.197 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:55.192+0000 7f2900b34700 1 --2- 172.21.15.90:0/96909150 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f28dc0662f0 0x7f28dc0687a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f28ec009ad0 tx=0x7f28ec009240 comp rx=0 tx=0).stop 2023-06-09T04:41:55.197 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:55.192+0000 7f2900b34700 1 -- 172.21.15.90:0/96909150 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f28fc158b30 msgr2=0x7f28fc1f54a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:55.197 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:55.192+0000 7f2900b34700 1 --2- 172.21.15.90:0/96909150 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f28fc158b30 0x7f28fc1f54a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f28e400e9d0 tx=0x7f28e400ece0 comp rx=0 tx=0).stop 2023-06-09T04:41:55.198 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:55.192+0000 7f2900b34700 1 -- 172.21.15.90:0/96909150 shutdown_connections 2023-06-09T04:41:55.198 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:55.192+0000 7f2900b34700 1 --2- 172.21.15.90:0/96909150 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f28dc0662f0 0x7f28dc0687a0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:55.198 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:55.192+0000 7f2900b34700 1 --2- 172.21.15.90:0/96909150 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f28fc158f00 0x7f28fc1ee800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:55.198 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:55.192+0000 7f2900b34700 1 --2- 172.21.15.90:0/96909150 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f28fc158b30 0x7f28fc1f54a0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:55.198 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:55.192+0000 7f2900b34700 1 --2- 172.21.15.90:0/96909150 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f28fc069820 0x7f28fc0ab8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:55.198 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:55.192+0000 7f2900b34700 1 -- 172.21.15.90:0/96909150 >> 172.21.15.90:0/96909150 conn(0x7f28fc06c810 msgr2=0x7f28fc0cdad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:55.199 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:55.192+0000 7f2900b34700 1 -- 172.21.15.90:0/96909150 shutdown_connections 2023-06-09T04:41:55.199 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:55.192+0000 7f2900b34700 1 -- 172.21.15.90:0/96909150 wait complete. 2023-06-09T04:41:55.220 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-06-09T04:41:55.394 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:55.388+0000 7f9d1d836700 1 Processor -- start 2023-06-09T04:41:55.394 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:55.388+0000 7f9d1d836700 1 -- start start 2023-06-09T04:41:55.396 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:55.392+0000 7f9d1d836700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9d180b18d0 0x7f9d18160920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:55.396 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:55.392+0000 7f9d1d836700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9d180b1ca0 0x7f9d180cee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:55.396 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:55.392+0000 7f9d1d836700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d1815c6b0 con 0x7f9d180d2400 2023-06-09T04:41:55.396 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:55.392+0000 7f9d1d836700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d180cf3d0 con 0x7f9d180b1ca0 2023-06-09T04:41:55.396 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:55.392+0000 7f9d1d836700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d180cf6a0 con 0x7f9d180b18d0 2023-06-09T04:41:55.397 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:55.392+0000 7f9d1c834700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9d180b18d0 0x7f9d18160920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:55.397 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:55.392+0000 7f9d17fff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9d180b1ca0 0x7f9d180cee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:55.398 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:55.392+0000 7f9d1c834700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9d180b18d0 0x7f9d18160920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.90:39078/0 (socket says 172.21.15.90:39078) 2023-06-09T04:41:55.398 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:55.392+0000 7f9d1c834700 1 -- 172.21.15.90:0/197662421 learned_addr learned my addr 172.21.15.90:0/197662421 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:41:55.398 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:55.392+0000 7f9d1d035700 1 --1- 172.21.15.90:0/197662421 >> v1:172.21.15.174:6789/0 conn(0x7f9d180d2400 0x7f9d180d28a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.90:46932/0 (socket says 172.21.15.90:46932) 2023-06-09T04:41:55.398 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:55.392+0000 7f9d1c834700 1 -- 172.21.15.90:0/197662421 >> v2:172.21.15.174:3300/0 conn(0x7f9d180b1ca0 msgr2=0x7f9d180cee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:55.398 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:55.392+0000 7f9d1c834700 1 --2- 172.21.15.90:0/197662421 >> v2:172.21.15.174:3300/0 conn(0x7f9d180b1ca0 0x7f9d180cee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:55.398 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:55.392+0000 7f9d1c834700 1 -- 172.21.15.90:0/197662421 >> v1:172.21.15.174:6789/0 conn(0x7f9d180d2400 legacy=0x7f9d180d28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:55.398 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:55.392+0000 7f9d1c834700 1 -- 172.21.15.90:0/197662421 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d180cf980 con 0x7f9d180b18d0 2023-06-09T04:41:55.398 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:55.392+0000 7f9d1c834700 1 --2- 172.21.15.90:0/197662421 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9d180b18d0 0x7f9d18160920 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f9d0c009940 tx=0x7f9d0c009c50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bbfbf400c4b3d94e server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:55.400 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:55.396+0000 7f9d177fe700 1 -- 172.21.15.90:0/197662421 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d0c005e50 con 0x7f9d180b18d0 2023-06-09T04:41:55.400 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:55.396+0000 7f9d177fe700 1 -- 172.21.15.90:0/197662421 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d0c006030 con 0x7f9d180b18d0 2023-06-09T04:41:55.400 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:55.396+0000 7f9d177fe700 1 -- 172.21.15.90:0/197662421 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d0c0063c0 con 0x7f9d180b18d0 2023-06-09T04:41:55.401 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:55.396+0000 7f9d1d836700 1 -- 172.21.15.90:0/197662421 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9d180b18d0 msgr2=0x7f9d18160920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:55.401 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:55.396+0000 7f9d1d836700 1 --2- 172.21.15.90:0/197662421 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9d180b18d0 0x7f9d18160920 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f9d0c009940 tx=0x7f9d0c009c50 comp rx=0 tx=0).stop 2023-06-09T04:41:55.402 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:55.396+0000 7f9d1d836700 1 -- 172.21.15.90:0/197662421 shutdown_connections 2023-06-09T04:41:55.402 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:55.396+0000 7f9d1d836700 1 --2- 172.21.15.90:0/197662421 >> v2:172.21.15.174:3300/0 conn(0x7f9d180b1ca0 0x7f9d180cee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:55.402 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:55.396+0000 7f9d1d836700 1 --2- 172.21.15.90:0/197662421 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9d180b18d0 0x7f9d18160920 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:55.402 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:55.396+0000 7f9d1d836700 1 -- 172.21.15.90:0/197662421 >> 172.21.15.90:0/197662421 conn(0x7f9d1809b9b0 msgr2=0x7f9d180b55d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:55.402 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:55.396+0000 7f9d1d836700 1 -- 172.21.15.90:0/197662421 shutdown_connections 2023-06-09T04:41:55.403 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:55.396+0000 7f9d1d836700 1 -- 172.21.15.90:0/197662421 wait complete. 2023-06-09T04:41:55.405 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:55.400+0000 7f9d1d836700 1 Processor -- start 2023-06-09T04:41:55.405 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:55.400+0000 7f9d1d836700 1 -- start start 2023-06-09T04:41:55.407 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:55.404+0000 7f9d1d836700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9d180b18d0 0x7f9d1815e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:55.407 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:55.404+0000 7f9d1d836700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9d180b1ca0 0x7f9d180b05f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:55.407 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:55.404+0000 7f9d1d836700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9d180d2400 0x7f9d181f2540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:55.407 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:55.404+0000 7f9d1d836700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d1815e6d0 con 0x7f9d180b1ca0 2023-06-09T04:41:55.408 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:55.404+0000 7f9d1d836700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d18154610 con 0x7f9d180d2400 2023-06-09T04:41:55.408 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:55.404+0000 7f9d1d836700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d180cbd00 con 0x7f9d180b18d0 2023-06-09T04:41:55.409 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:55.404+0000 7f9d17fff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9d180b1ca0 0x7f9d180b05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:55.409 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:55.404+0000 7f9d17fff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9d180b1ca0 0x7f9d180b05f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:56060/0 (socket says 172.21.15.90:56060) 2023-06-09T04:41:55.409 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:55.404+0000 7f9d17fff700 1 -- 172.21.15.90:0/3757027110 learned_addr learned my addr 172.21.15.90:0/3757027110 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:41:55.409 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:55.404+0000 7f9d1d035700 1 --2- 172.21.15.90:0/3757027110 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9d180d2400 0x7f9d181f2540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:55.410 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:55.404+0000 7f9d1c834700 1 --2- 172.21.15.90:0/3757027110 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9d180b18d0 0x7f9d1815e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:55.410 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:55.404+0000 7f9d17fff700 1 -- 172.21.15.90:0/3757027110 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9d180b18d0 msgr2=0x7f9d1815e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:55.410 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:55.404+0000 7f9d17fff700 1 --2- 172.21.15.90:0/3757027110 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9d180b18d0 0x7f9d1815e190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:55.410 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:55.404+0000 7f9d17fff700 1 -- 172.21.15.90:0/3757027110 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9d180d2400 msgr2=0x7f9d181f2540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:55.410 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:55.404+0000 7f9d17fff700 1 --2- 172.21.15.90:0/3757027110 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9d180d2400 0x7f9d181f2540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:55.410 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:55.404+0000 7f9d17fff700 1 -- 172.21.15.90:0/3757027110 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d0c009520 con 0x7f9d180b1ca0 2023-06-09T04:41:55.411 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:55.404+0000 7f9d1c834700 1 --2- 172.21.15.90:0/3757027110 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9d180b18d0 0x7f9d1815e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:41:55.411 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:55.404+0000 7f9d1d035700 1 --2- 172.21.15.90:0/3757027110 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9d180d2400 0x7f9d181f2540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:41:55.411 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:55.404+0000 7f9d17fff700 1 --2- 172.21.15.90:0/3757027110 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9d180b1ca0 0x7f9d180b05f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f9d0400e9a0 tx=0x7f9d0400ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:55.411 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:55.404+0000 7f9d157fa700 1 -- 172.21.15.90:0/3757027110 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d04009720 con 0x7f9d180b1ca0 2023-06-09T04:41:55.411 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:55.404+0000 7f9d157fa700 1 -- 172.21.15.90:0/3757027110 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d0400c850 con 0x7f9d180b1ca0 2023-06-09T04:41:55.411 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:55.404+0000 7f9d1d836700 1 -- 172.21.15.90:0/3757027110 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d180cbfe0 con 0x7f9d180b1ca0 2023-06-09T04:41:55.411 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:55.404+0000 7f9d157fa700 1 -- 172.21.15.90:0/3757027110 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d0400cc00 con 0x7f9d180b1ca0 2023-06-09T04:41:55.412 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:55.404+0000 7f9d1d836700 1 -- 172.21.15.90:0/3757027110 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d180cc5a0 con 0x7f9d180b1ca0 2023-06-09T04:41:55.412 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:55.408+0000 7f9d1d836700 1 -- 172.21.15.90:0/3757027110 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d180d04e0 con 0x7f9d180b1ca0 2023-06-09T04:41:55.412 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:55.408+0000 7f9d157fa700 1 -- 172.21.15.90:0/3757027110 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9d04013470 con 0x7f9d180b1ca0 2023-06-09T04:41:55.413 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:55.408+0000 7f9d157fa700 1 --2- 172.21.15.90:0/3757027110 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f9cfc0662f0 0x7f9cfc0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:55.413 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:55.408+0000 7f9d157fa700 1 -- 172.21.15.90:0/3757027110 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9d04083e90 con 0x7f9d180b1ca0 2023-06-09T04:41:55.414 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:55.408+0000 7f9d1c834700 1 --2- 172.21.15.90:0/3757027110 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f9cfc0662f0 0x7f9cfc0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:55.414 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:55.408+0000 7f9d1c834700 1 --2- 172.21.15.90:0/3757027110 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f9cfc0662f0 0x7f9cfc0687a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9d0c009fd0 tx=0x7f9d0c008070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:55.417 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:55.412+0000 7f9d157fa700 1 -- 172.21.15.90:0/3757027110 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9d180d04e0 con 0x7f9d180b1ca0 2023-06-09T04:41:55.635 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:55.632+0000 7f9d1d836700 1 -- 172.21.15.90:0/3757027110 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f9d180d04e0 con 0x7f9d180b1ca0 2023-06-09T04:41:56.408 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:56.404+0000 7f9d157fa700 1 -- 172.21.15.90:0/3757027110 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7f9d180d04e0 con 0x7f9d180b1ca0 2023-06-09T04:41:56.413 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:56.408+0000 7f9d1d836700 1 -- 172.21.15.90:0/3757027110 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f9cfc0662f0 msgr2=0x7f9cfc0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:56.414 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:56.408+0000 7f9d1d836700 1 --2- 172.21.15.90:0/3757027110 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f9cfc0662f0 0x7f9cfc0687a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9d0c009fd0 tx=0x7f9d0c008070 comp rx=0 tx=0).stop 2023-06-09T04:41:56.414 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:56.408+0000 7f9d1d836700 1 -- 172.21.15.90:0/3757027110 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9d180b1ca0 msgr2=0x7f9d180b05f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:56.414 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:56.408+0000 7f9d1d836700 1 --2- 172.21.15.90:0/3757027110 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9d180b1ca0 0x7f9d180b05f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f9d0400e9a0 tx=0x7f9d0400ed60 comp rx=0 tx=0).stop 2023-06-09T04:41:56.414 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:56.408+0000 7f9d1d836700 1 -- 172.21.15.90:0/3757027110 shutdown_connections 2023-06-09T04:41:56.414 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:56.408+0000 7f9d1d836700 1 --2- 172.21.15.90:0/3757027110 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f9cfc0662f0 0x7f9cfc0687a0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:56.414 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:56.408+0000 7f9d1d836700 1 --2- 172.21.15.90:0/3757027110 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9d180d2400 0x7f9d181f2540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:56.414 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:56.408+0000 7f9d1d836700 1 --2- 172.21.15.90:0/3757027110 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9d180b1ca0 0x7f9d180b05f0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:56.415 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:56.408+0000 7f9d1d836700 1 --2- 172.21.15.90:0/3757027110 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9d180b18d0 0x7f9d1815e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:56.415 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:56.408+0000 7f9d1d836700 1 -- 172.21.15.90:0/3757027110 >> 172.21.15.90:0/3757027110 conn(0x7f9d1809b9b0 msgr2=0x7f9d1815a5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:56.415 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:56.408+0000 7f9d1d836700 1 -- 172.21.15.90:0/3757027110 shutdown_connections 2023-06-09T04:41:56.415 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:56.408+0000 7f9d1d836700 1 -- 172.21.15.90:0/3757027110 wait complete. 2023-06-09T04:41:56.439 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-06-09T04:41:56.439 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-06-09T04:41:56.613 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:56.608+0000 7ff08562c700 1 Processor -- start 2023-06-09T04:41:56.613 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:56.608+0000 7ff08562c700 1 -- start start 2023-06-09T04:41:56.616 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:56.612+0000 7ff08562c700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ff080158d00 0x7ff08006a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:56.616 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:56.612+0000 7ff08562c700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff0800cc460 0x7ff0800ca4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:56.617 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:56.612+0000 7ff08562c700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0800ca050 con 0x7ff0800cad00 2023-06-09T04:41:56.617 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:56.612+0000 7ff08562c700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0801590d0 con 0x7ff080158d00 2023-06-09T04:41:56.617 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:56.612+0000 7ff08562c700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0800c91c0 con 0x7ff0800cc460 2023-06-09T04:41:56.618 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:56.612+0000 7ff07e7fc700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff0800cc460 0x7ff0800ca4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:56.618 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:56.612+0000 7ff07e7fc700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff0800cc460 0x7ff0800ca4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.90:37168/0 (socket says 172.21.15.90:37168) 2023-06-09T04:41:56.618 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:56.612+0000 7ff07e7fc700 1 -- 172.21.15.90:0/3518409523 learned_addr learned my addr 172.21.15.90:0/3518409523 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:41:56.618 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:56.612+0000 7ff07effd700 1 --2- 172.21.15.90:0/3518409523 >> v2:172.21.15.174:3300/0 conn(0x7ff080158d00 0x7ff08006a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:56.618 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:56.612+0000 7ff07e7fc700 1 -- 172.21.15.90:0/3518409523 >> v2:172.21.15.174:3300/0 conn(0x7ff080158d00 msgr2=0x7ff08006a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:56.619 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:56.612+0000 7ff07e7fc700 1 --2- 172.21.15.90:0/3518409523 >> v2:172.21.15.174:3300/0 conn(0x7ff080158d00 0x7ff08006a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:56.619 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:56.612+0000 7ff07e7fc700 1 -- 172.21.15.90:0/3518409523 >> v1:172.21.15.174:6789/0 conn(0x7ff0800cad00 legacy=0x7ff0800c3170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:56.619 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:56.612+0000 7ff07e7fc700 1 -- 172.21.15.90:0/3518409523 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0800c9440 con 0x7ff0800cc460 2023-06-09T04:41:56.619 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:56.612+0000 7ff07e7fc700 1 --2- 172.21.15.90:0/3518409523 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff0800cc460 0x7ff0800ca4e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7ff074009910 tx=0x7ff074009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=745c38e453c71f27 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:56.620 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:56.616+0000 7ff07dffb700 1 -- 172.21.15.90:0/3518409523 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff07400ba60 con 0x7ff0800cc460 2023-06-09T04:41:56.620 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:56.616+0000 7ff07dffb700 1 -- 172.21.15.90:0/3518409523 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff07400bbc0 con 0x7ff0800cc460 2023-06-09T04:41:56.620 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:56.616+0000 7ff07dffb700 1 -- 172.21.15.90:0/3518409523 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff074009e60 con 0x7ff0800cc460 2023-06-09T04:41:56.621 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:56.616+0000 7ff08562c700 1 -- 172.21.15.90:0/3518409523 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff0800cc460 msgr2=0x7ff0800ca4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:56.621 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:56.616+0000 7ff08562c700 1 --2- 172.21.15.90:0/3518409523 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff0800cc460 0x7ff0800ca4e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7ff074009910 tx=0x7ff074009c20 comp rx=0 tx=0).stop 2023-06-09T04:41:56.621 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:56.616+0000 7ff08562c700 1 -- 172.21.15.90:0/3518409523 shutdown_connections 2023-06-09T04:41:56.621 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:56.616+0000 7ff08562c700 1 --2- 172.21.15.90:0/3518409523 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff0800cc460 0x7ff0800ca4e0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:56.621 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:56.616+0000 7ff08562c700 1 --2- 172.21.15.90:0/3518409523 >> v2:172.21.15.174:3300/0 conn(0x7ff080158d00 0x7ff08006a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:56.621 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:56.616+0000 7ff08562c700 1 -- 172.21.15.90:0/3518409523 >> 172.21.15.90:0/3518409523 conn(0x7ff0800aff00 msgr2=0x7ff0800b0300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:56.621 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:56.616+0000 7ff08562c700 1 -- 172.21.15.90:0/3518409523 shutdown_connections 2023-06-09T04:41:56.622 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:56.616+0000 7ff08562c700 1 -- 172.21.15.90:0/3518409523 wait complete. 2023-06-09T04:41:56.623 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:56.620+0000 7ff08562c700 1 Processor -- start 2023-06-09T04:41:56.623 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:56.620+0000 7ff08562c700 1 -- start start 2023-06-09T04:41:56.625 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:56.620+0000 7ff08562c700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff0800cad00 0x7ff080151250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:56.625 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:56.620+0000 7ff08562c700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff0800cc460 0x7ff080151790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:56.625 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:56.620+0000 7ff08562c700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff080158d00 0x7ff0801f5c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:56.625 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:56.620+0000 7ff08562c700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff08015bfd0 con 0x7ff0800cc460 2023-06-09T04:41:56.625 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:56.620+0000 7ff08562c700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff080151dc0 con 0x7ff0800cad00 2023-06-09T04:41:56.626 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:56.620+0000 7ff08562c700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0801520a0 con 0x7ff080158d00 2023-06-09T04:41:56.626 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:56.620+0000 7ff07e7fc700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff0800cc460 0x7ff080151790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:56.627 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:56.620+0000 7ff07e7fc700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff0800cc460 0x7ff080151790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:33306/0 (socket says 172.21.15.90:33306) 2023-06-09T04:41:56.627 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:56.620+0000 7ff07e7fc700 1 -- 172.21.15.90:0/2567629368 learned_addr learned my addr 172.21.15.90:0/2567629368 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:41:56.627 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:56.620+0000 7ff07effd700 1 --2- 172.21.15.90:0/2567629368 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff0800cad00 0x7ff080151250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:56.627 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:56.620+0000 7ff07f7fe700 1 --2- 172.21.15.90:0/2567629368 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff080158d00 0x7ff0801f5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:56.627 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:56.620+0000 7ff07e7fc700 1 -- 172.21.15.90:0/2567629368 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff080158d00 msgr2=0x7ff0801f5c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:56.627 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:56.620+0000 7ff07e7fc700 1 --2- 172.21.15.90:0/2567629368 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff080158d00 0x7ff0801f5c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:56.627 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:56.620+0000 7ff07e7fc700 1 -- 172.21.15.90:0/2567629368 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff0800cad00 msgr2=0x7ff080151250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:56.628 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:56.620+0000 7ff07e7fc700 1 --2- 172.21.15.90:0/2567629368 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff0800cad00 0x7ff080151250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:56.628 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:56.620+0000 7ff07e7fc700 1 -- 172.21.15.90:0/2567629368 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff074009570 con 0x7ff0800cc460 2023-06-09T04:41:56.628 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:56.620+0000 7ff07effd700 1 --2- 172.21.15.90:0/2567629368 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff0800cad00 0x7ff080151250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:41:56.628 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:56.624+0000 7ff07e7fc700 1 --2- 172.21.15.90:0/2567629368 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff0800cc460 0x7ff080151790 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff074015000 tx=0x7ff074004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:56.629 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:56.624+0000 7ff0677fe700 1 -- 172.21.15.90:0/2567629368 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0740038c0 con 0x7ff0800cc460 2023-06-09T04:41:56.629 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:56.624+0000 7ff0677fe700 1 -- 172.21.15.90:0/2567629368 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff074003a40 con 0x7ff0800cc460 2023-06-09T04:41:56.629 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:56.624+0000 7ff0677fe700 1 -- 172.21.15.90:0/2567629368 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff074003df0 con 0x7ff0800cc460 2023-06-09T04:41:56.629 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:56.624+0000 7ff08562c700 1 -- 172.21.15.90:0/2567629368 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff080152380 con 0x7ff0800cc460 2023-06-09T04:41:56.629 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:56.624+0000 7ff08562c700 1 -- 172.21.15.90:0/2567629368 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff080152940 con 0x7ff0800cc460 2023-06-09T04:41:56.630 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:56.624+0000 7ff08562c700 1 -- 172.21.15.90:0/2567629368 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff080152b30 con 0x7ff0800cc460 2023-06-09T04:41:56.631 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:56.628+0000 7ff0677fe700 1 -- 172.21.15.90:0/2567629368 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff07402c440 con 0x7ff0800cc460 2023-06-09T04:41:56.632 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:56.628+0000 7ff0677fe700 1 --2- 172.21.15.90:0/2567629368 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7ff06c0662f0 0x7ff06c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:56.633 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:56.628+0000 7ff0677fe700 1 -- 172.21.15.90:0/2567629368 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff0740851b0 con 0x7ff0800cc460 2023-06-09T04:41:56.633 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:56.628+0000 7ff07effd700 1 --2- 172.21.15.90:0/2567629368 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7ff06c0662f0 0x7ff06c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:56.634 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:56.632+0000 7ff07effd700 1 --2- 172.21.15.90:0/2567629368 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7ff06c0662f0 0x7ff06c0687a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff0800c8380 tx=0x7ff070008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:56.640 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:56.636+0000 7ff0677fe700 1 -- 172.21.15.90:0/2567629368 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff074052640 con 0x7ff0800cc460 2023-06-09T04:41:56.847 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:56.844+0000 7ff08562c700 1 -- 172.21.15.90:0/2567629368 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7ff08004e380 con 0x7ff0800cc460 2023-06-09T04:41:57.413 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:57.408+0000 7ff0677fe700 1 -- 172.21.15.90:0/2567629368 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7ff074055c60 con 0x7ff0800cc460 2023-06-09T04:41:57.418 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:57.412+0000 7ff08562c700 1 -- 172.21.15.90:0/2567629368 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7ff06c0662f0 msgr2=0x7ff06c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:57.418 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:57.412+0000 7ff08562c700 1 --2- 172.21.15.90:0/2567629368 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7ff06c0662f0 0x7ff06c0687a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff0800c8380 tx=0x7ff070008040 comp rx=0 tx=0).stop 2023-06-09T04:41:57.418 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:57.412+0000 7ff08562c700 1 -- 172.21.15.90:0/2567629368 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff0800cc460 msgr2=0x7ff080151790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:57.418 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:57.412+0000 7ff08562c700 1 --2- 172.21.15.90:0/2567629368 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff0800cc460 0x7ff080151790 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff074015000 tx=0x7ff074004770 comp rx=0 tx=0).stop 2023-06-09T04:41:57.418 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:57.412+0000 7ff08562c700 1 -- 172.21.15.90:0/2567629368 shutdown_connections 2023-06-09T04:41:57.419 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:57.412+0000 7ff08562c700 1 --2- 172.21.15.90:0/2567629368 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7ff06c0662f0 0x7ff06c0687a0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:57.419 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:57.412+0000 7ff08562c700 1 --2- 172.21.15.90:0/2567629368 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff080158d00 0x7ff0801f5c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:57.419 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:57.412+0000 7ff08562c700 1 --2- 172.21.15.90:0/2567629368 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff0800cc460 0x7ff080151790 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:57.419 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:57.412+0000 7ff08562c700 1 --2- 172.21.15.90:0/2567629368 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff0800cad00 0x7ff080151250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:57.419 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:57.412+0000 7ff08562c700 1 -- 172.21.15.90:0/2567629368 >> 172.21.15.90:0/2567629368 conn(0x7ff0800aff00 msgr2=0x7ff0800ae1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:57.419 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:57.412+0000 7ff08562c700 1 -- 172.21.15.90:0/2567629368 shutdown_connections 2023-06-09T04:41:57.419 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:57.412+0000 7ff08562c700 1 -- 172.21.15.90:0/2567629368 wait complete. 2023-06-09T04:41:57.440 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-06-09T04:41:57.441 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-09T04:41:57.614 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:57.608+0000 7f400150e700 1 Processor -- start 2023-06-09T04:41:57.614 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:57.608+0000 7f400150e700 1 -- start start 2023-06-09T04:41:57.615 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:57.612+0000 7f400150e700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f3ffc1574c0 0x7f3ffc0cdb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:57.616 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:57.612+0000 7f400150e700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ffc1618e0 con 0x7f3ffc0cac00 2023-06-09T04:41:57.616 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:57.612+0000 7f400150e700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ffc1647b0 con 0x7f3ffc0cb050 2023-06-09T04:41:57.616 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:57.612+0000 7f400150e700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ffc157890 con 0x7f3ffc1574c0 2023-06-09T04:41:57.617 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:57.612+0000 7f3ff37fe700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f3ffc0cac00 0x7f3ffc069820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:46448/0 (socket says 172.21.15.90:46448) 2023-06-09T04:41:57.617 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:57.612+0000 7f3ff37fe700 1 -- 172.21.15.90:0/1499237502 learned_addr learned my addr 172.21.15.90:0/1499237502 (peer_addr_for_me v1:172.21.15.90:0/0) 2023-06-09T04:41:57.617 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:57.612+0000 7f3ffbfff700 1 --2- 172.21.15.90:0/1499237502 >> v2:172.21.15.174:3300/0 conn(0x7f3ffc1574c0 0x7f3ffc0cdb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:57.617 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:57.612+0000 7f3ffb7fe700 1 -- 172.21.15.90:0/1499237502 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 20587622 0 0) 0x7f3ffc1618e0 con 0x7f3ffc0cac00 2023-06-09T04:41:57.617 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:57.612+0000 7f3ffb7fe700 1 -- 172.21.15.90:0/1499237502 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3fe80035d0 con 0x7f3ffc0cac00 2023-06-09T04:41:57.618 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:57.612+0000 7f3ffbfff700 1 -- 172.21.15.90:0/1499237502 >> v1:172.21.15.174:6789/0 conn(0x7f3ffc0cb050 legacy=0x7f3ffc069f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:57.618 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:57.612+0000 7f3ffbfff700 1 -- 172.21.15.90:0/1499237502 >> v1:172.21.15.90:6789/0 conn(0x7f3ffc0cac00 legacy=0x7f3ffc069820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:57.618 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:57.612+0000 7f3ffbfff700 1 -- 172.21.15.90:0/1499237502 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ffc0ce040 con 0x7f3ffc1574c0 2023-06-09T04:41:57.618 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:57.612+0000 7f3ffbfff700 1 --2- 172.21.15.90:0/1499237502 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3ffc1574c0 0x7f3ffc0cdb00 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f3fec009850 tx=0x7f3fec009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ed1d3e06813506bc server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:57.619 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:57.612+0000 7f3ffb7fe700 1 -- 172.21.15.90:0/1499237502 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fec011830 con 0x7f3ffc1574c0 2023-06-09T04:41:57.619 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:57.612+0000 7f3ffb7fe700 1 -- 172.21.15.90:0/1499237502 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fec011990 con 0x7f3ffc1574c0 2023-06-09T04:41:57.619 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:57.612+0000 7f3ffb7fe700 1 -- 172.21.15.90:0/1499237502 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fec011d40 con 0x7f3ffc1574c0 2023-06-09T04:41:57.620 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:57.616+0000 7f400150e700 1 -- 172.21.15.90:0/1499237502 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3ffc1574c0 msgr2=0x7f3ffc0cdb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:57.620 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:57.616+0000 7f400150e700 1 --2- 172.21.15.90:0/1499237502 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3ffc1574c0 0x7f3ffc0cdb00 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f3fec009850 tx=0x7f3fec009b60 comp rx=0 tx=0).stop 2023-06-09T04:41:57.620 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:57.616+0000 7f400150e700 1 -- 172.21.15.90:0/1499237502 shutdown_connections 2023-06-09T04:41:57.620 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:57.616+0000 7f400150e700 1 --2- 172.21.15.90:0/1499237502 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3ffc1574c0 0x7f3ffc0cdb00 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:57.620 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:57.616+0000 7f400150e700 1 -- 172.21.15.90:0/1499237502 >> 172.21.15.90:0/1499237502 conn(0x7f3ffc06c690 msgr2=0x7f3ffc0aff00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:57.620 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:57.616+0000 7f400150e700 1 -- 172.21.15.90:0/1499237502 shutdown_connections 2023-06-09T04:41:57.620 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:57.616+0000 7f400150e700 1 -- 172.21.15.90:0/1499237502 wait complete. 2023-06-09T04:41:57.623 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:57.620+0000 7f400150e700 1 Processor -- start 2023-06-09T04:41:57.623 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:57.620+0000 7f400150e700 1 -- start start 2023-06-09T04:41:57.625 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:57.620+0000 7f400150e700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3ffc0cac00 0x7f3ffc159b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:57.625 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:57.620+0000 7f400150e700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3ffc0cb050 0x7f3ffc15af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:57.626 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:57.620+0000 7f400150e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3ffc1574c0 0x7f3ffc15b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:57.626 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:57.620+0000 7f400150e700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ffc15c7f0 con 0x7f3ffc0cac00 2023-06-09T04:41:57.626 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:57.620+0000 7f400150e700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ffc15bbe0 con 0x7f3ffc0cb050 2023-06-09T04:41:57.626 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:57.620+0000 7f400150e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ffc15bec0 con 0x7f3ffc1574c0 2023-06-09T04:41:57.627 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:57.620+0000 7f3ffbfff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3ffc0cac00 0x7f3ffc159b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:57.627 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:57.620+0000 7f3ffbfff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3ffc0cac00 0x7f3ffc159b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:33316/0 (socket says 172.21.15.90:33316) 2023-06-09T04:41:57.627 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:57.620+0000 7f3ffbfff700 1 -- 172.21.15.90:0/358870863 learned_addr learned my addr 172.21.15.90:0/358870863 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:41:57.627 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:57.620+0000 7f3ff37fe700 1 --2- 172.21.15.90:0/358870863 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3ffc0cb050 0x7f3ffc15af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:57.628 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:57.620+0000 7f4000d0d700 1 --2- 172.21.15.90:0/358870863 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3ffc1574c0 0x7f3ffc15b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:57.628 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:57.624+0000 7f3ffbfff700 1 -- 172.21.15.90:0/358870863 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3ffc1574c0 msgr2=0x7f3ffc15b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:57.628 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:57.624+0000 7f3ffbfff700 1 --2- 172.21.15.90:0/358870863 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3ffc1574c0 0x7f3ffc15b4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:57.628 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:57.624+0000 7f3ffbfff700 1 -- 172.21.15.90:0/358870863 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3ffc0cb050 msgr2=0x7f3ffc15af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:57.628 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:57.624+0000 7f3ffbfff700 1 --2- 172.21.15.90:0/358870863 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3ffc0cb050 0x7f3ffc15af90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:57.628 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:57.624+0000 7f3ffbfff700 1 -- 172.21.15.90:0/358870863 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fec0094b0 con 0x7f3ffc0cac00 2023-06-09T04:41:57.628 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:57.624+0000 7f3ffbfff700 1 --2- 172.21.15.90:0/358870863 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3ffc0cac00 0x7f3ffc159b40 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f3fec014040 tx=0x7f3fec004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:57.629 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:57.624+0000 7f3ff97fa700 1 -- 172.21.15.90:0/358870863 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fec019ab0 con 0x7f3ffc0cac00 2023-06-09T04:41:57.629 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:57.624+0000 7f3ff97fa700 1 -- 172.21.15.90:0/358870863 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fec01e070 con 0x7f3ffc0cac00 2023-06-09T04:41:57.629 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:57.624+0000 7f3ff97fa700 1 -- 172.21.15.90:0/358870863 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fec019e50 con 0x7f3ffc0cac00 2023-06-09T04:41:57.630 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:57.624+0000 7f400150e700 1 -- 172.21.15.90:0/358870863 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ffc15c1a0 con 0x7f3ffc0cac00 2023-06-09T04:41:57.630 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:57.624+0000 7f400150e700 1 -- 172.21.15.90:0/358870863 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ffc15a080 con 0x7f3ffc0cac00 2023-06-09T04:41:57.630 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:57.624+0000 7f400150e700 1 -- 172.21.15.90:0/358870863 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ffc06b390 con 0x7f3ffc0cac00 2023-06-09T04:41:57.631 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:57.628+0000 7f3ff97fa700 1 -- 172.21.15.90:0/358870863 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f3fec02d450 con 0x7f3ffc0cac00 2023-06-09T04:41:57.632 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:57.628+0000 7f3ff97fa700 1 --2- 172.21.15.90:0/358870863 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f3fdc0662f0 0x7f3fdc0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:57.633 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:57.628+0000 7f3ff97fa700 1 -- 172.21.15.90:0/358870863 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3fec084dc0 con 0x7f3ffc0cac00 2023-06-09T04:41:57.633 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:57.628+0000 7f3ff37fe700 1 --2- 172.21.15.90:0/358870863 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f3fdc0662f0 0x7f3fdc0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:57.634 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:57.628+0000 7f3ff37fe700 1 --2- 172.21.15.90:0/358870863 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f3fdc0662f0 0x7f3fdc0687a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3ffc148f60 tx=0x7f3fe4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:57.640 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:57.636+0000 7f3ff97fa700 1 -- 172.21.15.90:0/358870863 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3fec0521b0 con 0x7f3ffc0cac00 2023-06-09T04:41:57.855 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:57.852+0000 7f400150e700 1 -- 172.21.15.90:0/358870863 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3ffc04e380 con 0x7f3ffc0cac00 2023-06-09T04:41:57.856 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:57.852+0000 7f3ff97fa700 1 -- 172.21.15.90:0/358870863 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4668 (secure 0 0 0) 0x7f3fec015090 con 0x7f3ffc0cac00 2023-06-09T04:41:57.856 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:41:57.857 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6836/271257743","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":271257743},{"type":"v1","addr":"172.21.15.174:6836","nonce":271257743}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4269,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6833/2861565528","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":2861565528},{"type":"v1","addr":"172.21.15.90:6833","nonce":2861565528}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/1212048840","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1212048840},{"type":"v1","addr":"172.21.15.90:6835","nonce":1212048840}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-09T04:41:54.383738+0000","modified":"2023-06-09T04:41:57.405504+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4306},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4306":{"gid":4306,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.174:6837/2976585572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6835","nonce":2976585572},{"type":"v1","addr":"172.21.15.174:6837","nonce":2976585572}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-06-09T04:41:57.858 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:57.852+0000 7f400150e700 1 -- 172.21.15.90:0/358870863 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f3fdc0662f0 msgr2=0x7f3fdc0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:57.859 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:57.852+0000 7f400150e700 1 --2- 172.21.15.90:0/358870863 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f3fdc0662f0 0x7f3fdc0687a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3ffc148f60 tx=0x7f3fe4009040 comp rx=0 tx=0).stop 2023-06-09T04:41:57.859 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:57.852+0000 7f400150e700 1 -- 172.21.15.90:0/358870863 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3ffc0cac00 msgr2=0x7f3ffc159b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:57.859 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:57.852+0000 7f400150e700 1 --2- 172.21.15.90:0/358870863 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3ffc0cac00 0x7f3ffc159b40 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f3fec014040 tx=0x7f3fec004770 comp rx=0 tx=0).stop 2023-06-09T04:41:57.859 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:57.856+0000 7f400150e700 1 -- 172.21.15.90:0/358870863 shutdown_connections 2023-06-09T04:41:57.860 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:57.856+0000 7f400150e700 1 --2- 172.21.15.90:0/358870863 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f3fdc0662f0 0x7f3fdc0687a0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:57.860 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:57.856+0000 7f400150e700 1 --2- 172.21.15.90:0/358870863 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3ffc1574c0 0x7f3ffc15b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:57.860 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:57.856+0000 7f400150e700 1 --2- 172.21.15.90:0/358870863 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3ffc0cb050 0x7f3ffc15af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:57.860 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:57.856+0000 7f400150e700 1 --2- 172.21.15.90:0/358870863 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3ffc0cac00 0x7f3ffc159b40 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:57.860 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:57.856+0000 7f400150e700 1 -- 172.21.15.90:0/358870863 >> 172.21.15.90:0/358870863 conn(0x7f3ffc06c690 msgr2=0x7f3ffc069820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:57.860 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:57.856+0000 7f400150e700 1 -- 172.21.15.90:0/358870863 shutdown_connections 2023-06-09T04:41:57.860 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:57.856+0000 7f400150e700 1 -- 172.21.15.90:0/358870863 wait complete. 2023-06-09T04:41:57.861 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 8 2023-06-09T04:41:57.880 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T04:41:58.053 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.048+0000 7f2adcd7a700 1 Processor -- start 2023-06-09T04:41:58.053 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.048+0000 7f2adcd7a700 1 -- start start 2023-06-09T04:41:58.056 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.052+0000 7f2adcd7a700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f2ad8160660 0x7f2ad80c8b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:58.056 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.052+0000 7f2adcd7a700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2ad80cc7d0 0x7f2ad8069c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:58.056 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.052+0000 7f2adcd7a700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ad80cb140 con 0x7f2ad80cd600 2023-06-09T04:41:58.056 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.052+0000 7f2adcd7a700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ad806fb00 con 0x7f2ad8160660 2023-06-09T04:41:58.056 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.052+0000 7f2adcd7a700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad80cdb70 con 0x7f2ad80cc7d0 2023-06-09T04:41:58.057 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.052+0000 7f2ad659c700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f2ad8160660 0x7f2ad80c8b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:58.057 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.052+0000 7f2ad6d9d700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2ad80cc7d0 0x7f2ad8069c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:58.057 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.052+0000 7f2ad6d9d700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2ad80cc7d0 0x7f2ad8069c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.90:37214/0 (socket says 172.21.15.90:37214) 2023-06-09T04:41:58.057 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.052+0000 7f2ad659c700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f2ad8160660 0x7f2ad80c8b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.90:38214/0 (socket says 172.21.15.90:38214) 2023-06-09T04:41:58.057 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.052+0000 7f2ad6d9d700 1 -- 172.21.15.90:0/3057220366 learned_addr learned my addr 172.21.15.90:0/3057220366 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:41:58.058 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.052+0000 7f2ad6d9d700 1 -- 172.21.15.90:0/3057220366 >> v2:172.21.15.174:3300/0 conn(0x7f2ad8160660 msgr2=0x7f2ad80c8b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:58.058 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.052+0000 7f2ad6d9d700 1 --2- 172.21.15.90:0/3057220366 >> v2:172.21.15.174:3300/0 conn(0x7f2ad8160660 0x7f2ad80c8b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:58.058 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.052+0000 7f2ad6d9d700 1 -- 172.21.15.90:0/3057220366 >> v1:172.21.15.174:6789/0 conn(0x7f2ad80cd600 legacy=0x7f2ad80cc0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:58.058 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.052+0000 7f2ad6d9d700 1 -- 172.21.15.90:0/3057220366 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ad80cb390 con 0x7f2ad80cc7d0 2023-06-09T04:41:58.059 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.052+0000 7f2ad6d9d700 1 --2- 172.21.15.90:0/3057220366 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2ad80cc7d0 0x7f2ad8069c00 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f2ad0009e50 tx=0x7f2ad000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ccfd5ea9e8b1bde6 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:58.059 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.056+0000 7f2ad559a700 1 -- 172.21.15.90:0/3057220366 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ad000e070 con 0x7f2ad80cc7d0 2023-06-09T04:41:58.059 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.056+0000 7f2ad559a700 1 -- 172.21.15.90:0/3057220366 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ad000b910 con 0x7f2ad80cc7d0 2023-06-09T04:41:58.059 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.056+0000 7f2ad559a700 1 -- 172.21.15.90:0/3057220366 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ad000bcc0 con 0x7f2ad80cc7d0 2023-06-09T04:41:58.060 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.056+0000 7f2adcd7a700 1 -- 172.21.15.90:0/3057220366 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2ad80cc7d0 msgr2=0x7f2ad8069c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:58.060 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.056+0000 7f2adcd7a700 1 --2- 172.21.15.90:0/3057220366 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2ad80cc7d0 0x7f2ad8069c00 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f2ad0009e50 tx=0x7f2ad000b330 comp rx=0 tx=0).stop 2023-06-09T04:41:58.061 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.056+0000 7f2adcd7a700 1 -- 172.21.15.90:0/3057220366 shutdown_connections 2023-06-09T04:41:58.061 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.056+0000 7f2adcd7a700 1 --2- 172.21.15.90:0/3057220366 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2ad80cc7d0 0x7f2ad8069c00 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:58.061 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.056+0000 7f2adcd7a700 1 --2- 172.21.15.90:0/3057220366 >> v2:172.21.15.174:3300/0 conn(0x7f2ad8160660 0x7f2ad80c8b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:58.061 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.056+0000 7f2adcd7a700 1 -- 172.21.15.90:0/3057220366 >> 172.21.15.90:0/3057220366 conn(0x7f2ad806c810 msgr2=0x7f2ad80b0000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:58.061 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.056+0000 7f2adcd7a700 1 -- 172.21.15.90:0/3057220366 shutdown_connections 2023-06-09T04:41:58.061 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.056+0000 7f2adcd7a700 1 -- 172.21.15.90:0/3057220366 wait complete. 2023-06-09T04:41:58.063 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.060+0000 7f2adcd7a700 1 Processor -- start 2023-06-09T04:41:58.064 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.060+0000 7f2adcd7a700 1 -- start start 2023-06-09T04:41:58.065 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.060+0000 7f2adcd7a700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2ad80cc7d0 0x7f2ad815ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:58.065 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.060+0000 7f2adcd7a700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2ad80cd600 0x7f2ad80c44c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:58.065 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.060+0000 7f2adcd7a700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2ad8160660 0x7f2ad814e990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:58.065 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.060+0000 7f2adcd7a700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad80c5870 con 0x7f2ad80cd600 2023-06-09T04:41:58.065 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.060+0000 7f2adcd7a700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad814eed0 con 0x7f2ad80cc7d0 2023-06-09T04:41:58.066 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.060+0000 7f2adcd7a700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad80c3420 con 0x7f2ad8160660 2023-06-09T04:41:58.066 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.060+0000 7f2ad5d9b700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2ad80cd600 0x7f2ad80c44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:58.067 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.060+0000 7f2ad5d9b700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2ad80cd600 0x7f2ad80c44c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:33326/0 (socket says 172.21.15.90:33326) 2023-06-09T04:41:58.067 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.060+0000 7f2ad5d9b700 1 -- 172.21.15.90:0/2874551976 learned_addr learned my addr 172.21.15.90:0/2874551976 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:41:58.067 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.060+0000 7f2ad6d9d700 1 --2- 172.21.15.90:0/2874551976 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2ad8160660 0x7f2ad814e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:58.067 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.060+0000 7f2ad659c700 1 --2- 172.21.15.90:0/2874551976 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2ad80cc7d0 0x7f2ad815ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:58.067 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.060+0000 7f2ad5d9b700 1 -- 172.21.15.90:0/2874551976 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2ad8160660 msgr2=0x7f2ad814e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:58.067 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.060+0000 7f2ad5d9b700 1 --2- 172.21.15.90:0/2874551976 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2ad8160660 0x7f2ad814e990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:58.067 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.060+0000 7f2ad5d9b700 1 -- 172.21.15.90:0/2874551976 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2ad80cc7d0 msgr2=0x7f2ad815ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:58.068 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.060+0000 7f2ad5d9b700 1 --2- 172.21.15.90:0/2874551976 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2ad80cc7d0 0x7f2ad815ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:58.068 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.060+0000 7f2ad5d9b700 1 -- 172.21.15.90:0/2874551976 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ad0009b30 con 0x7f2ad80cd600 2023-06-09T04:41:58.068 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.064+0000 7f2ad5d9b700 1 --2- 172.21.15.90:0/2874551976 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2ad80cd600 0x7f2ad80c44c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2acc00c500 tx=0x7f2acc00c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:58.068 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.064+0000 7f2ac6ffd700 1 -- 172.21.15.90:0/2874551976 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2acc0052d0 con 0x7f2ad80cd600 2023-06-09T04:41:58.069 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.064+0000 7f2ac6ffd700 1 -- 172.21.15.90:0/2874551976 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2acc005430 con 0x7f2ad80cd600 2023-06-09T04:41:58.069 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.064+0000 7f2ac6ffd700 1 -- 172.21.15.90:0/2874551976 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2acc0055a0 con 0x7f2ad80cd600 2023-06-09T04:41:58.069 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.064+0000 7f2adcd7a700 1 -- 172.21.15.90:0/2874551976 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ad80c3700 con 0x7f2ad80cd600 2023-06-09T04:41:58.069 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.064+0000 7f2adcd7a700 1 -- 172.21.15.90:0/2874551976 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ad80c3cc0 con 0x7f2ad80cd600 2023-06-09T04:41:58.069 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.064+0000 7f2adcd7a700 1 -- 172.21.15.90:0/2874551976 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ad80c4a00 con 0x7f2ad80cd600 2023-06-09T04:41:58.071 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.068+0000 7f2ac6ffd700 1 -- 172.21.15.90:0/2874551976 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2acc0038e0 con 0x7f2ad80cd600 2023-06-09T04:41:58.072 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.068+0000 7f2ac6ffd700 1 --2- 172.21.15.90:0/2874551976 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f2ab80662f0 0x7f2ab80687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:58.072 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.068+0000 7f2ac6ffd700 1 -- 172.21.15.90:0/2874551976 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2acc0830d0 con 0x7f2ad80cd600 2023-06-09T04:41:58.072 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.068+0000 7f2ad659c700 1 --2- 172.21.15.90:0/2874551976 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f2ab80662f0 0x7f2ab80687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:58.074 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.068+0000 7f2ad659c700 1 --2- 172.21.15.90:0/2874551976 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f2ab80662f0 0x7f2ab80687a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2ad815e170 tx=0x7f2ac8009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:58.078 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.072+0000 7f2ac6ffd700 1 -- 172.21.15.90:0/2874551976 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2acc050540 con 0x7f2ad80cd600 2023-06-09T04:41:58.249 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.244+0000 7f2adcd7a700 1 -- 172.21.15.90:0/2874551976 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2ad804db30 con 0x7f2ad80cd600 2023-06-09T04:41:58.251 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.248+0000 7f2ac6ffd700 1 -- 172.21.15.90:0/2874551976 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18279 (secure 0 0 0) 0x7f2acc053b60 con 0x7f2ad80cd600 2023-06-09T04:41:58.252 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:41:58.253 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":24,"fsid":"700369c0-a111-43b4-9415-844ad1742b70","created":"2023-06-09T04:41:28.180311+0000","modified":"2023-06-09T04:41:55.389425+0000","last_up_change":"2023-06-09T04:41:40.746475+0000","last_in_change":"2023-06-09T04:41:31.262765+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-09T04:41:42.402564+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-09T04:41:47.607323+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-09T04:41:52.543474+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-09T04:41:53.382940+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"46a4a7c5-babd-4ef3-9830-51487cff5eb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":2780271267},{"type":"v1","addr":"172.21.15.90:6809","nonce":2780271267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2780271267},{"type":"v1","addr":"172.21.15.90:6811","nonce":2780271267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2780271267},{"type":"v1","addr":"172.21.15.90:6815","nonce":2780271267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2780271267},{"type":"v1","addr":"172.21.15.90:6813","nonce":2780271267}]},"public_addr":"172.21.15.90:6809/2780271267","cluster_addr":"172.21.15.90:6811/2780271267","heartbeat_back_addr":"172.21.15.90:6815/2780271267","heartbeat_front_addr":"172.21.15.90:6813/2780271267","state":["exists","up"]},{"osd":1,"uuid":"1543988f-c498-494a-a6f9-fac8413db6ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":3064028136},{"type":"v1","addr":"172.21.15.90:6801","nonce":3064028136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":3064028136},{"type":"v1","addr":"172.21.15.90:6803","nonce":3064028136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":3064028136},{"type":"v1","addr":"172.21.15.90:6807","nonce":3064028136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":3064028136},{"type":"v1","addr":"172.21.15.90:6805","nonce":3064028136}]},"public_addr":"172.21.15.90:6801/3064028136","cluster_addr":"172.21.15.90:6803/3064028136","heartbeat_back_addr":"172.21.15.90:6807/3064028136","heartbeat_front_addr":"172.21.15.90:6805/3064028136","state":["exists","up"]},{"osd":2,"uuid":"79669dd6-ffc8-4197-b9f7-b3b372b2b9b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":3713146326},{"type":"v1","addr":"172.21.15.90:6825","nonce":3713146326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":3713146326},{"type":"v1","addr":"172.21.15.90:6827","nonce":3713146326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":3713146326},{"type":"v1","addr":"172.21.15.90:6831","nonce":3713146326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":3713146326},{"type":"v1","addr":"172.21.15.90:6829","nonce":3713146326}]},"public_addr":"172.21.15.90:6825/3713146326","cluster_addr":"172.21.15.90:6827/3713146326","heartbeat_back_addr":"172.21.15.90:6831/3713146326","heartbeat_front_addr":"172.21.15.90:6829/3713146326","state":["exists","up"]},{"osd":3,"uuid":"4062ab6f-ce40-450a-aa17-b10098766c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":3499839122},{"type":"v1","addr":"172.21.15.90:6817","nonce":3499839122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":3499839122},{"type":"v1","addr":"172.21.15.90:6819","nonce":3499839122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":3499839122},{"type":"v1","addr":"172.21.15.90:6823","nonce":3499839122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":3499839122},{"type":"v1","addr":"172.21.15.90:6821","nonce":3499839122}]},"public_addr":"172.21.15.90:6817/3499839122","cluster_addr":"172.21.15.90:6819/3499839122","heartbeat_back_addr":"172.21.15.90:6823/3499839122","heartbeat_front_addr":"172.21.15.90:6821/3499839122","state":["exists","up"]},{"osd":4,"uuid":"a10820e4-b348-4d92-9796-3b01484ace1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6817","nonce":1138565854},{"type":"v1","addr":"172.21.15.174:6819","nonce":1138565854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6821","nonce":1138565854},{"type":"v1","addr":"172.21.15.174:6823","nonce":1138565854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":1138565854},{"type":"v1","addr":"172.21.15.174:6831","nonce":1138565854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":1138565854},{"type":"v1","addr":"172.21.15.174:6829","nonce":1138565854}]},"public_addr":"172.21.15.174:6819/1138565854","cluster_addr":"172.21.15.174:6823/1138565854","heartbeat_back_addr":"172.21.15.174:6831/1138565854","heartbeat_front_addr":"172.21.15.174:6829/1138565854","state":["exists","up"]},{"osd":5,"uuid":"b4da1c32-be05-420b-9346-90d91aa70569","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":1707702879},{"type":"v1","addr":"172.21.15.174:6818","nonce":1707702879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":1707702879},{"type":"v1","addr":"172.21.15.174:6822","nonce":1707702879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6827","nonce":1707702879},{"type":"v1","addr":"172.21.15.174:6828","nonce":1707702879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":1707702879},{"type":"v1","addr":"172.21.15.174:6825","nonce":1707702879}]},"public_addr":"172.21.15.174:6818/1707702879","cluster_addr":"172.21.15.174:6822/1707702879","heartbeat_back_addr":"172.21.15.174:6828/1707702879","heartbeat_front_addr":"172.21.15.174:6825/1707702879","state":["exists","up"]},{"osd":6,"uuid":"d1b98041-d243-4355-bd0a-e22cf9875b32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":864450534},{"type":"v1","addr":"172.21.15.174:6801","nonce":864450534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":864450534},{"type":"v1","addr":"172.21.15.174:6803","nonce":864450534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":864450534},{"type":"v1","addr":"172.21.15.174:6807","nonce":864450534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":864450534},{"type":"v1","addr":"172.21.15.174:6805","nonce":864450534}]},"public_addr":"172.21.15.174:6801/864450534","cluster_addr":"172.21.15.174:6803/864450534","heartbeat_back_addr":"172.21.15.174:6807/864450534","heartbeat_front_addr":"172.21.15.174:6805/864450534","state":["exists","up"]},{"osd":7,"uuid":"5a207936-f89f-416b-b79b-34ec96f77c8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":2527640659},{"type":"v1","addr":"172.21.15.174:6809","nonce":2527640659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":2527640659},{"type":"v1","addr":"172.21.15.174:6811","nonce":2527640659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":2527640659},{"type":"v1","addr":"172.21.15.174:6815","nonce":2527640659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":2527640659},{"type":"v1","addr":"172.21.15.174:6813","nonce":2527640659}]},"public_addr":"172.21.15.174:6809/2527640659","cluster_addr":"172.21.15.174:6811/2527640659","heartbeat_back_addr":"172.21.15.174:6815/2527640659","heartbeat_front_addr":"172.21.15.174:6813/2527640659","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:36.972152+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:36.984561+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:36.998817+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:37.054944+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:37.085014+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:37.115125+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:36.854608+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:36.971685+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:41:58.255 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.252+0000 7f2adcd7a700 1 -- 172.21.15.90:0/2874551976 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f2ab80662f0 msgr2=0x7f2ab80687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:58.255 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.252+0000 7f2adcd7a700 1 --2- 172.21.15.90:0/2874551976 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f2ab80662f0 0x7f2ab80687a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2ad815e170 tx=0x7f2ac8009240 comp rx=0 tx=0).stop 2023-06-09T04:41:58.255 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.252+0000 7f2adcd7a700 1 -- 172.21.15.90:0/2874551976 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2ad80cd600 msgr2=0x7f2ad80c44c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:58.256 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.252+0000 7f2adcd7a700 1 --2- 172.21.15.90:0/2874551976 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2ad80cd600 0x7f2ad80c44c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2acc00c500 tx=0x7f2acc00c810 comp rx=0 tx=0).stop 2023-06-09T04:41:58.256 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.252+0000 7f2adcd7a700 1 -- 172.21.15.90:0/2874551976 shutdown_connections 2023-06-09T04:41:58.256 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.252+0000 7f2adcd7a700 1 --2- 172.21.15.90:0/2874551976 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f2ab80662f0 0x7f2ab80687a0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:58.256 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.252+0000 7f2adcd7a700 1 --2- 172.21.15.90:0/2874551976 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2ad8160660 0x7f2ad814e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:58.256 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.252+0000 7f2adcd7a700 1 --2- 172.21.15.90:0/2874551976 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2ad80cd600 0x7f2ad80c44c0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:58.256 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.252+0000 7f2adcd7a700 1 --2- 172.21.15.90:0/2874551976 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2ad80cc7d0 0x7f2ad815ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:58.256 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.252+0000 7f2adcd7a700 1 -- 172.21.15.90:0/2874551976 >> 172.21.15.90:0/2874551976 conn(0x7f2ad806c810 msgr2=0x7f2ad81640d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:58.257 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.252+0000 7f2adcd7a700 1 -- 172.21.15.90:0/2874551976 shutdown_connections 2023-06-09T04:41:58.257 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.252+0000 7f2adcd7a700 1 -- 172.21.15.90:0/2874551976 wait complete. 2023-06-09T04:41:58.277 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-06-09T04:41:58.278 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-09T04:41:58.442 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.436+0000 7fa432f5d700 1 Processor -- start 2023-06-09T04:41:58.442 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.436+0000 7fa432f5d700 1 -- start start 2023-06-09T04:41:58.444 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.440+0000 7fa432f5d700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fa42c154370 0x7fa42c0c8b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:58.444 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.440+0000 7fa432f5d700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fa42c15e120 0x7fa42c0ad920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:58.444 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.440+0000 7fa432f5d700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa42c0cae10 con 0x7fa42c0ca7a0 2023-06-09T04:41:58.445 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.440+0000 7fa432f5d700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa42c0cac20 con 0x7fa42c154370 2023-06-09T04:41:58.445 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.440+0000 7fa432f5d700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa42c0cb0f0 con 0x7fa42c15e120 2023-06-09T04:41:58.446 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.440+0000 7fa430cf9700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fa42c154370 0x7fa42c0c8b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:58.446 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.440+0000 7fa430cf9700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fa42c154370 0x7fa42c0c8b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:33330/0 (socket says 172.21.15.90:33330) 2023-06-09T04:41:58.446 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.440+0000 7fa430cf9700 1 -- 172.21.15.90:0/2896408320 learned_addr learned my addr 172.21.15.90:0/2896408320 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:41:58.446 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.440+0000 7fa4314fa700 1 --2- 172.21.15.90:0/2896408320 >> v2:172.21.15.174:3300/0 conn(0x7fa42c15e120 0x7fa42c0ad920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:58.446 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.440+0000 7fa430cf9700 1 -- 172.21.15.90:0/2896408320 >> v2:172.21.15.174:3300/0 conn(0x7fa42c15e120 msgr2=0x7fa42c0ad920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:58.446 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.440+0000 7fa430cf9700 1 --2- 172.21.15.90:0/2896408320 >> v2:172.21.15.174:3300/0 conn(0x7fa42c15e120 0x7fa42c0ad920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:58.446 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.440+0000 7fa430cf9700 1 -- 172.21.15.90:0/2896408320 >> v1:172.21.15.174:6789/0 conn(0x7fa42c0ca7a0 legacy=0x7fa42c15da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:58.447 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.440+0000 7fa430cf9700 1 -- 172.21.15.90:0/2896408320 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa42c0cb3d0 con 0x7fa42c154370 2023-06-09T04:41:58.447 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.440+0000 7fa430cf9700 1 --2- 172.21.15.90:0/2896408320 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa42c154370 0x7fa42c0c8b40 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa42c0cc050 tx=0x7fa420009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30615e30cf590217 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:58.447 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.444+0000 7fa42b7fe700 1 -- 172.21.15.90:0/2896408320 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa420011830 con 0x7fa42c154370 2023-06-09T04:41:58.448 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.444+0000 7fa42b7fe700 1 -- 172.21.15.90:0/2896408320 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa420011990 con 0x7fa42c154370 2023-06-09T04:41:58.448 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.444+0000 7fa42b7fe700 1 -- 172.21.15.90:0/2896408320 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa420011d20 con 0x7fa42c154370 2023-06-09T04:41:58.448 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.444+0000 7fa432f5d700 1 -- 172.21.15.90:0/2896408320 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa42c154370 msgr2=0x7fa42c0c8b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:58.448 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.444+0000 7fa432f5d700 1 --2- 172.21.15.90:0/2896408320 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa42c154370 0x7fa42c0c8b40 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa42c0cc050 tx=0x7fa420009bf0 comp rx=0 tx=0).stop 2023-06-09T04:41:58.449 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.444+0000 7fa432f5d700 1 -- 172.21.15.90:0/2896408320 shutdown_connections 2023-06-09T04:41:58.449 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.444+0000 7fa432f5d700 1 --2- 172.21.15.90:0/2896408320 >> v2:172.21.15.174:3300/0 conn(0x7fa42c15e120 0x7fa42c0ad920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:58.449 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.444+0000 7fa432f5d700 1 --2- 172.21.15.90:0/2896408320 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa42c154370 0x7fa42c0c8b40 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:58.449 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.444+0000 7fa432f5d700 1 -- 172.21.15.90:0/2896408320 >> 172.21.15.90:0/2896408320 conn(0x7fa42c06c810 msgr2=0x7fa42c0b0000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:58.449 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.444+0000 7fa432f5d700 1 -- 172.21.15.90:0/2896408320 shutdown_connections 2023-06-09T04:41:58.449 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.444+0000 7fa432f5d700 1 -- 172.21.15.90:0/2896408320 wait complete. 2023-06-09T04:41:58.451 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.448+0000 7fa432f5d700 1 Processor -- start 2023-06-09T04:41:58.451 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.448+0000 7fa432f5d700 1 -- start start 2023-06-09T04:41:58.453 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.448+0000 7fa432f5d700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa42c0ca7a0 0x7fa42c0b1c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:58.453 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.448+0000 7fa432f5d700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa42c154370 0x7fa42c157fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:58.453 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.448+0000 7fa432f5d700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa42c15e120 0x7fa42c1534b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:58.454 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.448+0000 7fa432f5d700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa42c159530 con 0x7fa42c0ca7a0 2023-06-09T04:41:58.454 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.448+0000 7fa432f5d700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa42c158920 con 0x7fa42c154370 2023-06-09T04:41:58.454 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.448+0000 7fa432f5d700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa42c158c00 con 0x7fa42c15e120 2023-06-09T04:41:58.454 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.448+0000 7fa430cf9700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa42c0ca7a0 0x7fa42c0b1c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:58.454 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.448+0000 7fa430cf9700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa42c0ca7a0 0x7fa42c0b1c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:33332/0 (socket says 172.21.15.90:33332) 2023-06-09T04:41:58.454 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.448+0000 7fa430cf9700 1 -- 172.21.15.90:0/2866142356 learned_addr learned my addr 172.21.15.90:0/2866142356 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:41:58.455 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.448+0000 7fa42bfff700 1 --2- 172.21.15.90:0/2866142356 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa42c154370 0x7fa42c157fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:58.456 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.448+0000 7fa4314fa700 1 --2- 172.21.15.90:0/2866142356 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa42c15e120 0x7fa42c1534b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:58.456 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.448+0000 7fa430cf9700 1 -- 172.21.15.90:0/2866142356 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa42c15e120 msgr2=0x7fa42c1534b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:58.456 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.448+0000 7fa430cf9700 1 --2- 172.21.15.90:0/2866142356 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa42c15e120 0x7fa42c1534b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:58.456 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.448+0000 7fa430cf9700 1 -- 172.21.15.90:0/2866142356 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa42c154370 msgr2=0x7fa42c157fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:58.456 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.448+0000 7fa430cf9700 1 --2- 172.21.15.90:0/2866142356 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa42c154370 0x7fa42c157fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:58.456 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.448+0000 7fa430cf9700 1 -- 172.21.15.90:0/2866142356 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa420009570 con 0x7fa42c0ca7a0 2023-06-09T04:41:58.457 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.448+0000 7fa42bfff700 1 --2- 172.21.15.90:0/2866142356 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa42c154370 0x7fa42c157fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:41:58.457 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.448+0000 7fa430cf9700 1 --2- 172.21.15.90:0/2866142356 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa42c0ca7a0 0x7fa42c0b1c80 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa42c06ddd0 tx=0x7fa420004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:58.457 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.452+0000 7fa4297fa700 1 -- 172.21.15.90:0/2866142356 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa420004550 con 0x7fa42c0ca7a0 2023-06-09T04:41:58.457 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.452+0000 7fa4297fa700 1 -- 172.21.15.90:0/2866142356 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa42001f070 con 0x7fa42c0ca7a0 2023-06-09T04:41:58.457 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.452+0000 7fa432f5d700 1 -- 172.21.15.90:0/2866142356 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa42c1548c0 con 0x7fa42c0ca7a0 2023-06-09T04:41:58.457 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.452+0000 7fa4297fa700 1 -- 172.21.15.90:0/2866142356 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa420003900 con 0x7fa42c0ca7a0 2023-06-09T04:41:58.457 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.452+0000 7fa432f5d700 1 -- 172.21.15.90:0/2866142356 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa42c1591c0 con 0x7fa42c0ca7a0 2023-06-09T04:41:58.458 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.452+0000 7fa432f5d700 1 -- 172.21.15.90:0/2866142356 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa42c1599a0 con 0x7fa42c0ca7a0 2023-06-09T04:41:58.458 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.452+0000 7fa4297fa700 1 -- 172.21.15.90:0/2866142356 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa420003a60 con 0x7fa42c0ca7a0 2023-06-09T04:41:58.458 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.452+0000 7fa4297fa700 1 --2- 172.21.15.90:0/2866142356 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fa410066320 0x7fa4100687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:58.459 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.452+0000 7fa4297fa700 1 -- 172.21.15.90:0/2866142356 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa420021070 con 0x7fa42c0ca7a0 2023-06-09T04:41:58.459 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.456+0000 7fa42bfff700 1 --2- 172.21.15.90:0/2866142356 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fa410066320 0x7fa4100687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:58.460 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.456+0000 7fa42bfff700 1 --2- 172.21.15.90:0/2866142356 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fa410066320 0x7fa4100687d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa418000f60 tx=0x7fa418009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:58.465 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.460+0000 7fa4297fa700 1 -- 172.21.15.90:0/2866142356 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa420052750 con 0x7fa42c0ca7a0 2023-06-09T04:41:58.633 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.628+0000 7fa432f5d700 1 -- 172.21.15.90:0/2866142356 --> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa42c154740 con 0x7fa410066320 2023-06-09T04:41:58.651 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.644+0000 7fa4297fa700 1 -- 172.21.15.90:0/2866142356 <== mgr.4104 v2:172.21.15.174:6832/1389974754 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286536 (secure 0 0 0) 0x7fa418001d70 con 0x7fa410066320 2023-06-09T04:41:58.656 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:41:58.658 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.652+0000 7fa432f5d700 1 -- 172.21.15.90:0/2866142356 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fa410066320 msgr2=0x7fa4100687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:58.658 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.652+0000 7fa432f5d700 1 --2- 172.21.15.90:0/2866142356 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fa410066320 0x7fa4100687d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa418000f60 tx=0x7fa418009040 comp rx=0 tx=0).stop 2023-06-09T04:41:58.658 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.652+0000 7fa432f5d700 1 -- 172.21.15.90:0/2866142356 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa42c0ca7a0 msgr2=0x7fa42c0b1c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:58.659 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.652+0000 7fa432f5d700 1 --2- 172.21.15.90:0/2866142356 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa42c0ca7a0 0x7fa42c0b1c80 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa42c06ddd0 tx=0x7fa420004770 comp rx=0 tx=0).stop 2023-06-09T04:41:58.659 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.652+0000 7fa432f5d700 1 -- 172.21.15.90:0/2866142356 shutdown_connections 2023-06-09T04:41:58.659 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.652+0000 7fa432f5d700 1 --2- 172.21.15.90:0/2866142356 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fa410066320 0x7fa4100687d0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:58.659 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.652+0000 7fa432f5d700 1 --2- 172.21.15.90:0/2866142356 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa42c15e120 0x7fa42c1534b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:58.659 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.652+0000 7fa432f5d700 1 --2- 172.21.15.90:0/2866142356 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa42c154370 0x7fa42c157fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:58.660 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.652+0000 7fa432f5d700 1 --2- 172.21.15.90:0/2866142356 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa42c0ca7a0 0x7fa42c0b1c80 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:58.660 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.652+0000 7fa432f5d700 1 -- 172.21.15.90:0/2866142356 >> 172.21.15.90:0/2866142356 conn(0x7fa42c06c810 msgr2=0x7fa42c0c9a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:58.660 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.652+0000 7fa432f5d700 1 -- 172.21.15.90:0/2866142356 shutdown_connections 2023-06-09T04:41:58.660 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.652+0000 7fa432f5d700 1 -- 172.21.15.90:0/2866142356 wait complete. 2023-06-09T04:41:58.661 INFO:teuthology.orchestra.run.smithi090.stderr:dumped all 2023-06-09T04:41:58.680 INFO:teuthology.orchestra.run.smithi090.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2023-06-09T04:41:58.312101+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":177,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218800,"kb_used_data":3184,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754755920,"statfs":{"total":773094113280,"available":772870062080,"internally_reserved":0,"allocated":3260416,"data_stored":1926314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":41,"apply_latency_ms":41,"commit_latency_ns":41000000,"apply_latency_ns":41000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.410358"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.406944+0000","last_change":"2023-06-09T04:41:54.403483+0000","last_active":"2023-06-09T04:41:55.406944+0000","last_peered":"2023-06-09T04:41:55.406944+0000","last_clean":"2023-06-09T04:41:55.406944+0000","last_became_active":"2023-06-09T04:41:54.403189+0000","last_became_peered":"2023-06-09T04:41:54.403189+0000","last_unstale":"2023-06-09T04:41:55.406944+0000","last_undegraded":"2023-06-09T04:41:55.406944+0000","last_fullsized":"2023-06-09T04:41:55.406944+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:45:23.237006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.874307+0000","last_change":"2023-06-09T04:41:54.417816+0000","last_active":"2023-06-09T04:41:55.874307+0000","last_peered":"2023-06-09T04:41:55.874307+0000","last_clean":"2023-06-09T04:41:55.874307+0000","last_became_active":"2023-06-09T04:41:54.417523+0000","last_became_peered":"2023-06-09T04:41:54.417523+0000","last_unstale":"2023-06-09T04:41:55.874307+0000","last_undegraded":"2023-06-09T04:41:55.874307+0000","last_fullsized":"2023-06-09T04:41:55.874307+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:02:15.067018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.408132+0000","last_change":"2023-06-09T04:41:54.434121+0000","last_active":"2023-06-09T04:41:55.408132+0000","last_peered":"2023-06-09T04:41:55.408132+0000","last_clean":"2023-06-09T04:41:55.408132+0000","last_became_active":"2023-06-09T04:41:54.433774+0000","last_became_peered":"2023-06-09T04:41:54.433774+0000","last_unstale":"2023-06-09T04:41:55.408132+0000","last_undegraded":"2023-06-09T04:41:55.408132+0000","last_fullsized":"2023-06-09T04:41:55.408132+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:50:09.575767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.406854+0000","last_change":"2023-06-09T04:41:54.424411+0000","last_active":"2023-06-09T04:41:55.406854+0000","last_peered":"2023-06-09T04:41:55.406854+0000","last_clean":"2023-06-09T04:41:55.406854+0000","last_became_active":"2023-06-09T04:41:54.423966+0000","last_became_peered":"2023-06-09T04:41:54.423966+0000","last_unstale":"2023-06-09T04:41:55.406854+0000","last_undegraded":"2023-06-09T04:41:55.406854+0000","last_fullsized":"2023-06-09T04:41:55.406854+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:45:08.259045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.873607+0000","last_change":"2023-06-09T04:41:54.414192+0000","last_active":"2023-06-09T04:41:55.873607+0000","last_peered":"2023-06-09T04:41:55.873607+0000","last_clean":"2023-06-09T04:41:55.873607+0000","last_became_active":"2023-06-09T04:41:54.413938+0000","last_became_peered":"2023-06-09T04:41:54.413938+0000","last_unstale":"2023-06-09T04:41:55.873607+0000","last_undegraded":"2023-06-09T04:41:55.873607+0000","last_fullsized":"2023-06-09T04:41:55.873607+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:34:10.329381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.407620+0000","last_change":"2023-06-09T04:41:54.434214+0000","last_active":"2023-06-09T04:41:55.407620+0000","last_peered":"2023-06-09T04:41:55.407620+0000","last_clean":"2023-06-09T04:41:55.407620+0000","last_became_active":"2023-06-09T04:41:54.433495+0000","last_became_peered":"2023-06-09T04:41:54.433495+0000","last_unstale":"2023-06-09T04:41:55.407620+0000","last_undegraded":"2023-06-09T04:41:55.407620+0000","last_fullsized":"2023-06-09T04:41:55.407620+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:55:02.127077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.872502+0000","last_change":"2023-06-09T04:41:54.419655+0000","last_active":"2023-06-09T04:41:55.872502+0000","last_peered":"2023-06-09T04:41:55.872502+0000","last_clean":"2023-06-09T04:41:55.872502+0000","last_became_active":"2023-06-09T04:41:54.419050+0000","last_became_peered":"2023-06-09T04:41:54.419050+0000","last_unstale":"2023-06-09T04:41:55.872502+0000","last_undegraded":"2023-06-09T04:41:55.872502+0000","last_fullsized":"2023-06-09T04:41:55.872502+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:50:09.575767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.873689+0000","last_change":"2023-06-09T04:41:54.437218+0000","last_active":"2023-06-09T04:41:55.873689+0000","last_peered":"2023-06-09T04:41:55.873689+0000","last_clean":"2023-06-09T04:41:55.873689+0000","last_became_active":"2023-06-09T04:41:54.436898+0000","last_became_peered":"2023-06-09T04:41:54.436898+0000","last_unstale":"2023-06-09T04:41:55.873689+0000","last_undegraded":"2023-06-09T04:41:55.873689+0000","last_fullsized":"2023-06-09T04:41:55.873689+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:34:10.329381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.873735+0000","last_change":"2023-06-09T04:41:54.417378+0000","last_active":"2023-06-09T04:41:55.873735+0000","last_peered":"2023-06-09T04:41:55.873735+0000","last_clean":"2023-06-09T04:41:55.873735+0000","last_became_active":"2023-06-09T04:41:54.416459+0000","last_became_peered":"2023-06-09T04:41:54.416459+0000","last_unstale":"2023-06-09T04:41:55.873735+0000","last_undegraded":"2023-06-09T04:41:55.873735+0000","last_fullsized":"2023-06-09T04:41:55.873735+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:55:02.127077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.874681+0000","last_change":"2023-06-09T04:41:54.417848+0000","last_active":"2023-06-09T04:41:55.874681+0000","last_peered":"2023-06-09T04:41:55.874681+0000","last_clean":"2023-06-09T04:41:55.874681+0000","last_became_active":"2023-06-09T04:41:54.417560+0000","last_became_peered":"2023-06-09T04:41:54.417560+0000","last_unstale":"2023-06-09T04:41:55.874681+0000","last_undegraded":"2023-06-09T04:41:55.874681+0000","last_fullsized":"2023-06-09T04:41:55.874681+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:46:21.659594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.408404+0000","last_change":"2023-06-09T04:41:54.434090+0000","last_active":"2023-06-09T04:41:55.408404+0000","last_peered":"2023-06-09T04:41:55.408404+0000","last_clean":"2023-06-09T04:41:55.408404+0000","last_became_active":"2023-06-09T04:41:54.433687+0000","last_became_peered":"2023-06-09T04:41:54.433687+0000","last_unstale":"2023-06-09T04:41:55.408404+0000","last_undegraded":"2023-06-09T04:41:55.408404+0000","last_fullsized":"2023-06-09T04:41:55.408404+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:44:36.362428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.406772+0000","last_change":"2023-06-09T04:41:54.437425+0000","last_active":"2023-06-09T04:41:55.406772+0000","last_peered":"2023-06-09T04:41:55.406772+0000","last_clean":"2023-06-09T04:41:55.406772+0000","last_became_active":"2023-06-09T04:41:54.437149+0000","last_became_peered":"2023-06-09T04:41:54.437149+0000","last_unstale":"2023-06-09T04:41:55.406772+0000","last_undegraded":"2023-06-09T04:41:55.406772+0000","last_fullsized":"2023-06-09T04:41:55.406772+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:44:39.043853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.406611+0000","last_change":"2023-06-09T04:41:54.406715+0000","last_active":"2023-06-09T04:41:55.406611+0000","last_peered":"2023-06-09T04:41:55.406611+0000","last_clean":"2023-06-09T04:41:55.406611+0000","last_became_active":"2023-06-09T04:41:54.406316+0000","last_became_peered":"2023-06-09T04:41:54.406316+0000","last_unstale":"2023-06-09T04:41:55.406611+0000","last_undegraded":"2023-06-09T04:41:55.406611+0000","last_fullsized":"2023-06-09T04:41:55.406611+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:40:08.604981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.873902+0000","last_change":"2023-06-09T04:41:54.405717+0000","last_active":"2023-06-09T04:41:55.873902+0000","last_peered":"2023-06-09T04:41:55.873902+0000","last_clean":"2023-06-09T04:41:55.873902+0000","last_became_active":"2023-06-09T04:41:54.405412+0000","last_became_peered":"2023-06-09T04:41:54.405412+0000","last_unstale":"2023-06-09T04:41:55.873902+0000","last_undegraded":"2023-06-09T04:41:55.873902+0000","last_fullsized":"2023-06-09T04:41:55.873902+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:55:02.127077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.872713+0000","last_change":"2023-06-09T04:41:54.419861+0000","last_active":"2023-06-09T04:41:55.872713+0000","last_peered":"2023-06-09T04:41:55.872713+0000","last_clean":"2023-06-09T04:41:55.872713+0000","last_became_active":"2023-06-09T04:41:54.419404+0000","last_became_peered":"2023-06-09T04:41:54.419404+0000","last_unstale":"2023-06-09T04:41:55.872713+0000","last_undegraded":"2023-06-09T04:41:55.872713+0000","last_fullsized":"2023-06-09T04:41:55.872713+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:46:21.659594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.407159+0000","last_change":"2023-06-09T04:41:54.433128+0000","last_active":"2023-06-09T04:41:55.407159+0000","last_peered":"2023-06-09T04:41:55.407159+0000","last_clean":"2023-06-09T04:41:55.407159+0000","last_became_active":"2023-06-09T04:41:54.432642+0000","last_became_peered":"2023-06-09T04:41:54.432642+0000","last_unstale":"2023-06-09T04:41:55.407159+0000","last_undegraded":"2023-06-09T04:41:55.407159+0000","last_fullsized":"2023-06-09T04:41:55.407159+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:01:41.876981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.873916+0000","last_change":"2023-06-09T04:41:54.416438+0000","last_active":"2023-06-09T04:41:55.873916+0000","last_peered":"2023-06-09T04:41:55.873916+0000","last_clean":"2023-06-09T04:41:55.873916+0000","last_became_active":"2023-06-09T04:41:54.416180+0000","last_became_peered":"2023-06-09T04:41:54.416180+0000","last_unstale":"2023-06-09T04:41:55.873916+0000","last_undegraded":"2023-06-09T04:41:55.873916+0000","last_fullsized":"2023-06-09T04:41:55.873916+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:35:38.355296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.408577+0000","last_change":"2023-06-09T04:41:54.433381+0000","last_active":"2023-06-09T04:41:55.408577+0000","last_peered":"2023-06-09T04:41:55.408577+0000","last_clean":"2023-06-09T04:41:55.408577+0000","last_became_active":"2023-06-09T04:41:54.433196+0000","last_became_peered":"2023-06-09T04:41:54.433196+0000","last_unstale":"2023-06-09T04:41:55.408577+0000","last_undegraded":"2023-06-09T04:41:55.408577+0000","last_fullsized":"2023-06-09T04:41:55.408577+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:20:06.903346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.406837+0000","last_change":"2023-06-09T04:41:54.427593+0000","last_active":"2023-06-09T04:41:55.406837+0000","last_peered":"2023-06-09T04:41:55.406837+0000","last_clean":"2023-06-09T04:41:55.406837+0000","last_became_active":"2023-06-09T04:41:54.427307+0000","last_became_peered":"2023-06-09T04:41:54.427307+0000","last_unstale":"2023-06-09T04:41:55.406837+0000","last_undegraded":"2023-06-09T04:41:55.406837+0000","last_fullsized":"2023-06-09T04:41:55.406837+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:07:19.100918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.408060+0000","last_change":"2023-06-09T04:41:54.436029+0000","last_active":"2023-06-09T04:41:55.408060+0000","last_peered":"2023-06-09T04:41:55.408060+0000","last_clean":"2023-06-09T04:41:55.408060+0000","last_became_active":"2023-06-09T04:41:54.435786+0000","last_became_peered":"2023-06-09T04:41:54.435786+0000","last_unstale":"2023-06-09T04:41:55.408060+0000","last_undegraded":"2023-06-09T04:41:55.408060+0000","last_fullsized":"2023-06-09T04:41:55.408060+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:02:15.067018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.872831+0000","last_change":"2023-06-09T04:41:54.415714+0000","last_active":"2023-06-09T04:41:55.872831+0000","last_peered":"2023-06-09T04:41:55.872831+0000","last_clean":"2023-06-09T04:41:55.872831+0000","last_became_active":"2023-06-09T04:41:54.415422+0000","last_became_peered":"2023-06-09T04:41:54.415422+0000","last_unstale":"2023-06-09T04:41:55.872831+0000","last_undegraded":"2023-06-09T04:41:55.872831+0000","last_fullsized":"2023-06-09T04:41:55.872831+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:44:36.362428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.874142+0000","last_change":"2023-06-09T04:41:54.421187+0000","last_active":"2023-06-09T04:41:55.874142+0000","last_peered":"2023-06-09T04:41:55.874142+0000","last_clean":"2023-06-09T04:41:55.874142+0000","last_became_active":"2023-06-09T04:41:54.420916+0000","last_became_peered":"2023-06-09T04:41:54.420916+0000","last_unstale":"2023-06-09T04:41:55.874142+0000","last_undegraded":"2023-06-09T04:41:55.874142+0000","last_fullsized":"2023-06-09T04:41:55.874142+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:50:09.575767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.654195+0000","last_change":"2023-06-09T04:41:54.413591+0000","last_active":"2023-06-09T04:41:55.654195+0000","last_peered":"2023-06-09T04:41:55.654195+0000","last_clean":"2023-06-09T04:41:55.654195+0000","last_became_active":"2023-06-09T04:41:54.413258+0000","last_became_peered":"2023-06-09T04:41:54.413258+0000","last_unstale":"2023-06-09T04:41:55.654195+0000","last_undegraded":"2023-06-09T04:41:55.654195+0000","last_fullsized":"2023-06-09T04:41:55.654195+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:06:03.696521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.872978+0000","last_change":"2023-06-09T04:41:54.426948+0000","last_active":"2023-06-09T04:41:55.872978+0000","last_peered":"2023-06-09T04:41:55.872978+0000","last_clean":"2023-06-09T04:41:55.872978+0000","last_became_active":"2023-06-09T04:41:54.424537+0000","last_became_peered":"2023-06-09T04:41:54.424537+0000","last_unstale":"2023-06-09T04:41:55.872978+0000","last_undegraded":"2023-06-09T04:41:55.872978+0000","last_fullsized":"2023-06-09T04:41:55.872978+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:02:42.425459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.874331+0000","last_change":"2023-06-09T04:41:54.423154+0000","last_active":"2023-06-09T04:41:55.874331+0000","last_peered":"2023-06-09T04:41:55.874331+0000","last_clean":"2023-06-09T04:41:55.874331+0000","last_became_active":"2023-06-09T04:41:54.422890+0000","last_became_peered":"2023-06-09T04:41:54.422890+0000","last_unstale":"2023-06-09T04:41:55.874331+0000","last_undegraded":"2023-06-09T04:41:55.874331+0000","last_fullsized":"2023-06-09T04:41:55.874331+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:02:15.067018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.874778+0000","last_change":"2023-06-09T04:41:54.411853+0000","last_active":"2023-06-09T04:41:55.874778+0000","last_peered":"2023-06-09T04:41:55.874778+0000","last_clean":"2023-06-09T04:41:55.874778+0000","last_became_active":"2023-06-09T04:41:54.411513+0000","last_became_peered":"2023-06-09T04:41:54.411513+0000","last_unstale":"2023-06-09T04:41:55.874778+0000","last_undegraded":"2023-06-09T04:41:55.874778+0000","last_fullsized":"2023-06-09T04:41:55.874778+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:32:14.262842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.874581+0000","last_change":"2023-06-09T04:41:54.423403+0000","last_active":"2023-06-09T04:41:55.874581+0000","last_peered":"2023-06-09T04:41:55.874581+0000","last_clean":"2023-06-09T04:41:55.874581+0000","last_became_active":"2023-06-09T04:41:54.422935+0000","last_became_peered":"2023-06-09T04:41:54.422935+0000","last_unstale":"2023-06-09T04:41:55.874581+0000","last_undegraded":"2023-06-09T04:41:55.874581+0000","last_fullsized":"2023-06-09T04:41:55.874581+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:50:09.575767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.874025+0000","last_change":"2023-06-09T04:41:54.416963+0000","last_active":"2023-06-09T04:41:55.874025+0000","last_peered":"2023-06-09T04:41:55.874025+0000","last_clean":"2023-06-09T04:41:55.874025+0000","last_became_active":"2023-06-09T04:41:54.416720+0000","last_became_peered":"2023-06-09T04:41:54.416720+0000","last_unstale":"2023-06-09T04:41:55.874025+0000","last_undegraded":"2023-06-09T04:41:55.874025+0000","last_fullsized":"2023-06-09T04:41:55.874025+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:29:47.126124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.654421+0000","last_change":"2023-06-09T04:41:54.425010+0000","last_active":"2023-06-09T04:41:55.654421+0000","last_peered":"2023-06-09T04:41:55.654421+0000","last_clean":"2023-06-09T04:41:55.654421+0000","last_became_active":"2023-06-09T04:41:54.423548+0000","last_became_peered":"2023-06-09T04:41:54.423548+0000","last_unstale":"2023-06-09T04:41:55.654421+0000","last_undegraded":"2023-06-09T04:41:55.654421+0000","last_fullsized":"2023-06-09T04:41:55.654421+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:02:15.067018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.408322+0000","last_change":"2023-06-09T04:41:54.433955+0000","last_active":"2023-06-09T04:41:55.408322+0000","last_peered":"2023-06-09T04:41:55.408322+0000","last_clean":"2023-06-09T04:41:55.408322+0000","last_became_active":"2023-06-09T04:41:54.433402+0000","last_became_peered":"2023-06-09T04:41:54.433402+0000","last_unstale":"2023-06-09T04:41:55.408322+0000","last_undegraded":"2023-06-09T04:41:55.408322+0000","last_fullsized":"2023-06-09T04:41:55.408322+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:46:21.659594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.653882+0000","last_change":"2023-06-09T04:41:54.412120+0000","last_active":"2023-06-09T04:41:55.653882+0000","last_peered":"2023-06-09T04:41:55.653882+0000","last_clean":"2023-06-09T04:41:55.653882+0000","last_became_active":"2023-06-09T04:41:54.411844+0000","last_became_peered":"2023-06-09T04:41:54.411844+0000","last_unstale":"2023-06-09T04:41:55.653882+0000","last_undegraded":"2023-06-09T04:41:55.653882+0000","last_fullsized":"2023-06-09T04:41:55.653882+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:02:24.420270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.406356+0000","last_change":"2023-06-09T04:41:54.429251+0000","last_active":"2023-06-09T04:41:55.406356+0000","last_peered":"2023-06-09T04:41:55.406356+0000","last_clean":"2023-06-09T04:41:55.406356+0000","last_became_active":"2023-06-09T04:41:54.428359+0000","last_became_peered":"2023-06-09T04:41:54.428359+0000","last_unstale":"2023-06-09T04:41:55.406356+0000","last_undegraded":"2023-06-09T04:41:55.406356+0000","last_fullsized":"2023-06-09T04:41:55.406356+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:11:53.056966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.654119+0000","last_change":"2023-06-09T04:41:54.429333+0000","last_active":"2023-06-09T04:41:55.654119+0000","last_peered":"2023-06-09T04:41:55.654119+0000","last_clean":"2023-06-09T04:41:55.654119+0000","last_became_active":"2023-06-09T04:41:54.428962+0000","last_became_peered":"2023-06-09T04:41:54.428962+0000","last_unstale":"2023-06-09T04:41:55.654119+0000","last_undegraded":"2023-06-09T04:41:55.654119+0000","last_fullsized":"2023-06-09T04:41:55.654119+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:03:22.727998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"23'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.873117+0000","last_change":"2023-06-09T04:41:53.950213+0000","last_active":"2023-06-09T04:41:55.873117+0000","last_peered":"2023-06-09T04:41:55.873117+0000","last_clean":"2023-06-09T04:41:55.873117+0000","last_became_active":"2023-06-09T04:41:53.949956+0000","last_became_peered":"2023-06-09T04:41:53.949956+0000","last_unstale":"2023-06-09T04:41:55.873117+0000","last_undegraded":"2023-06-09T04:41:55.873117+0000","last_fullsized":"2023-06-09T04:41:55.873117+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_clean_scrub_stamp":"2023-06-09T04:41:52.888143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:20:05.889342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.874763+0000","last_change":"2023-06-09T04:41:54.423233+0000","last_active":"2023-06-09T04:41:55.874763+0000","last_peered":"2023-06-09T04:41:55.874763+0000","last_clean":"2023-06-09T04:41:55.874763+0000","last_became_active":"2023-06-09T04:41:54.422587+0000","last_became_peered":"2023-06-09T04:41:54.422587+0000","last_unstale":"2023-06-09T04:41:55.874763+0000","last_undegraded":"2023-06-09T04:41:55.874763+0000","last_fullsized":"2023-06-09T04:41:55.874763+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:01:04.929884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.874374+0000","last_change":"2023-06-09T04:41:53.944320+0000","last_active":"2023-06-09T04:41:55.874374+0000","last_peered":"2023-06-09T04:41:55.874374+0000","last_clean":"2023-06-09T04:41:55.874374+0000","last_became_active":"2023-06-09T04:41:53.944039+0000","last_became_peered":"2023-06-09T04:41:53.944039+0000","last_unstale":"2023-06-09T04:41:55.874374+0000","last_undegraded":"2023-06-09T04:41:55.874374+0000","last_fullsized":"2023-06-09T04:41:55.874374+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_clean_scrub_stamp":"2023-06-09T04:41:52.888143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:32:13.248839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.873809+0000","last_change":"2023-06-09T04:41:54.417754+0000","last_active":"2023-06-09T04:41:55.873809+0000","last_peered":"2023-06-09T04:41:55.873809+0000","last_clean":"2023-06-09T04:41:55.873809+0000","last_became_active":"2023-06-09T04:41:54.417462+0000","last_became_peered":"2023-06-09T04:41:54.417462+0000","last_unstale":"2023-06-09T04:41:55.873809+0000","last_undegraded":"2023-06-09T04:41:55.873809+0000","last_fullsized":"2023-06-09T04:41:55.873809+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:06:03.696521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.872806+0000","last_change":"2023-06-09T04:41:53.950199+0000","last_active":"2023-06-09T04:41:55.872806+0000","last_peered":"2023-06-09T04:41:55.872806+0000","last_clean":"2023-06-09T04:41:55.872806+0000","last_became_active":"2023-06-09T04:41:53.949846+0000","last_became_peered":"2023-06-09T04:41:53.949846+0000","last_unstale":"2023-06-09T04:41:55.872806+0000","last_undegraded":"2023-06-09T04:41:55.872806+0000","last_fullsized":"2023-06-09T04:41:55.872806+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_clean_scrub_stamp":"2023-06-09T04:41:52.888143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:37:16.212704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.654767+0000","last_change":"2023-06-09T04:41:54.423952+0000","last_active":"2023-06-09T04:41:55.654767+0000","last_peered":"2023-06-09T04:41:55.654767+0000","last_clean":"2023-06-09T04:41:55.654767+0000","last_became_active":"2023-06-09T04:41:54.423601+0000","last_became_peered":"2023-06-09T04:41:54.423601+0000","last_unstale":"2023-06-09T04:41:55.654767+0000","last_undegraded":"2023-06-09T04:41:55.654767+0000","last_fullsized":"2023-06-09T04:41:55.654767+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:46:21.659594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"23'8","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.406561+0000","last_change":"2023-06-09T04:41:53.945735+0000","last_active":"2023-06-09T04:41:55.406561+0000","last_peered":"2023-06-09T04:41:55.406561+0000","last_clean":"2023-06-09T04:41:55.406561+0000","last_became_active":"2023-06-09T04:41:53.945260+0000","last_became_peered":"2023-06-09T04:41:53.945260+0000","last_unstale":"2023-06-09T04:41:55.406561+0000","last_undegraded":"2023-06-09T04:41:55.406561+0000","last_fullsized":"2023-06-09T04:41:55.406561+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_clean_scrub_stamp":"2023-06-09T04:41:52.888143+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:48:52.910038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"23'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.873690+0000","last_change":"2023-06-09T04:41:53.950178+0000","last_active":"2023-06-09T04:41:55.873690+0000","last_peered":"2023-06-09T04:41:55.873690+0000","last_clean":"2023-06-09T04:41:55.873690+0000","last_became_active":"2023-06-09T04:41:53.949874+0000","last_became_peered":"2023-06-09T04:41:53.949874+0000","last_unstale":"2023-06-09T04:41:55.873690+0000","last_undegraded":"2023-06-09T04:41:55.873690+0000","last_fullsized":"2023-06-09T04:41:55.873690+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_clean_scrub_stamp":"2023-06-09T04:41:52.888143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:14:18.414303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.873991+0000","last_change":"2023-06-09T04:41:54.421270+0000","last_active":"2023-06-09T04:41:55.873991+0000","last_peered":"2023-06-09T04:41:55.873991+0000","last_clean":"2023-06-09T04:41:55.873991+0000","last_became_active":"2023-06-09T04:41:54.421019+0000","last_became_peered":"2023-06-09T04:41:54.421019+0000","last_unstale":"2023-06-09T04:41:55.873991+0000","last_undegraded":"2023-06-09T04:41:55.873991+0000","last_fullsized":"2023-06-09T04:41:55.873991+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:29:47.126124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"23'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.873655+0000","last_change":"2023-06-09T04:41:53.951880+0000","last_active":"2023-06-09T04:41:55.873655+0000","last_peered":"2023-06-09T04:41:55.873655+0000","last_clean":"2023-06-09T04:41:55.873655+0000","last_became_active":"2023-06-09T04:41:53.951460+0000","last_became_peered":"2023-06-09T04:41:53.951460+0000","last_unstale":"2023-06-09T04:41:55.873655+0000","last_undegraded":"2023-06-09T04:41:55.873655+0000","last_fullsized":"2023-06-09T04:41:55.873655+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_clean_scrub_stamp":"2023-06-09T04:41:52.888143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:35:48.907156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.407368+0000","last_change":"2023-06-09T04:41:54.432752+0000","last_active":"2023-06-09T04:41:55.407368+0000","last_peered":"2023-06-09T04:41:55.407368+0000","last_clean":"2023-06-09T04:41:55.407368+0000","last_became_active":"2023-06-09T04:41:54.432341+0000","last_became_peered":"2023-06-09T04:41:54.432341+0000","last_unstale":"2023-06-09T04:41:55.407368+0000","last_undegraded":"2023-06-09T04:41:55.407368+0000","last_fullsized":"2023-06-09T04:41:55.407368+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:02:24.420270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"23'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.873267+0000","last_change":"2023-06-09T04:41:53.943033+0000","last_active":"2023-06-09T04:41:55.873267+0000","last_peered":"2023-06-09T04:41:55.873267+0000","last_clean":"2023-06-09T04:41:55.873267+0000","last_became_active":"2023-06-09T04:41:53.942705+0000","last_became_peered":"2023-06-09T04:41:53.942705+0000","last_unstale":"2023-06-09T04:41:55.873267+0000","last_undegraded":"2023-06-09T04:41:55.873267+0000","last_fullsized":"2023-06-09T04:41:55.873267+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_clean_scrub_stamp":"2023-06-09T04:41:52.888143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:07:18.392407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.406357+0000","last_change":"2023-06-09T04:41:54.423994+0000","last_active":"2023-06-09T04:41:55.406357+0000","last_peered":"2023-06-09T04:41:55.406357+0000","last_clean":"2023-06-09T04:41:55.406357+0000","last_became_active":"2023-06-09T04:41:54.423563+0000","last_became_peered":"2023-06-09T04:41:54.423563+0000","last_unstale":"2023-06-09T04:41:55.406357+0000","last_undegraded":"2023-06-09T04:41:55.406357+0000","last_fullsized":"2023-06-09T04:41:55.406357+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:57:36.919960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.874564+0000","last_change":"2023-06-09T04:41:53.943463+0000","last_active":"2023-06-09T04:41:55.874564+0000","last_peered":"2023-06-09T04:41:55.874564+0000","last_clean":"2023-06-09T04:41:55.874564+0000","last_became_active":"2023-06-09T04:41:53.943156+0000","last_became_peered":"2023-06-09T04:41:53.943156+0000","last_unstale":"2023-06-09T04:41:55.874564+0000","last_undegraded":"2023-06-09T04:41:55.874564+0000","last_fullsized":"2023-06-09T04:41:55.874564+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_clean_scrub_stamp":"2023-06-09T04:41:52.888143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:48:33.879868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.872666+0000","last_change":"2023-06-09T04:41:54.421050+0000","last_active":"2023-06-09T04:41:55.872666+0000","last_peered":"2023-06-09T04:41:55.872666+0000","last_clean":"2023-06-09T04:41:55.872666+0000","last_became_active":"2023-06-09T04:41:54.420683+0000","last_became_peered":"2023-06-09T04:41:54.420683+0000","last_unstale":"2023-06-09T04:41:55.872666+0000","last_undegraded":"2023-06-09T04:41:55.872666+0000","last_fullsized":"2023-06-09T04:41:55.872666+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:01:41.876981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"23'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.654774+0000","last_change":"2023-06-09T04:41:53.946942+0000","last_active":"2023-06-09T04:41:55.654774+0000","last_peered":"2023-06-09T04:41:55.654774+0000","last_clean":"2023-06-09T04:41:55.654774+0000","last_became_active":"2023-06-09T04:41:53.946653+0000","last_became_peered":"2023-06-09T04:41:53.946653+0000","last_unstale":"2023-06-09T04:41:55.654774+0000","last_undegraded":"2023-06-09T04:41:55.654774+0000","last_fullsized":"2023-06-09T04:41:55.654774+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_clean_scrub_stamp":"2023-06-09T04:41:52.888143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:01:03.915881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.408152+0000","last_change":"2023-06-09T04:41:54.435489+0000","last_active":"2023-06-09T04:41:55.408152+0000","last_peered":"2023-06-09T04:41:55.408152+0000","last_clean":"2023-06-09T04:41:55.408152+0000","last_became_active":"2023-06-09T04:41:54.435221+0000","last_became_peered":"2023-06-09T04:41:54.435221+0000","last_unstale":"2023-06-09T04:41:55.408152+0000","last_undegraded":"2023-06-09T04:41:55.408152+0000","last_fullsized":"2023-06-09T04:41:55.408152+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:32:14.262842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.406707+0000","last_change":"2023-06-09T04:41:53.949739+0000","last_active":"2023-06-09T04:41:55.406707+0000","last_peered":"2023-06-09T04:41:55.406707+0000","last_clean":"2023-06-09T04:41:55.406707+0000","last_became_active":"2023-06-09T04:41:53.949424+0000","last_became_peered":"2023-06-09T04:41:53.949424+0000","last_unstale":"2023-06-09T04:41:55.406707+0000","last_undegraded":"2023-06-09T04:41:55.406707+0000","last_fullsized":"2023-06-09T04:41:55.406707+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_clean_scrub_stamp":"2023-06-09T04:41:52.888143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T04:56:37.643976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.408495+0000","last_change":"2023-06-09T04:41:54.432641+0000","last_active":"2023-06-09T04:41:55.408495+0000","last_peered":"2023-06-09T04:41:55.408495+0000","last_clean":"2023-06-09T04:41:55.408495+0000","last_became_active":"2023-06-09T04:41:54.432274+0000","last_became_peered":"2023-06-09T04:41:54.432274+0000","last_unstale":"2023-06-09T04:41:55.408495+0000","last_undegraded":"2023-06-09T04:41:55.408495+0000","last_fullsized":"2023-06-09T04:41:55.408495+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:02:42.425459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.408131+0000","last_change":"2023-06-09T04:41:53.941677+0000","last_active":"2023-06-09T04:41:55.408131+0000","last_peered":"2023-06-09T04:41:55.408131+0000","last_clean":"2023-06-09T04:41:55.408131+0000","last_became_active":"2023-06-09T04:41:53.940978+0000","last_became_peered":"2023-06-09T04:41:53.940978+0000","last_unstale":"2023-06-09T04:41:55.408131+0000","last_undegraded":"2023-06-09T04:41:55.408131+0000","last_fullsized":"2023-06-09T04:41:55.408131+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_clean_scrub_stamp":"2023-06-09T04:41:52.888143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:48:33.879868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.408415+0000","last_change":"2023-06-09T04:41:54.432635+0000","last_active":"2023-06-09T04:41:55.408415+0000","last_peered":"2023-06-09T04:41:55.408415+0000","last_clean":"2023-06-09T04:41:55.408415+0000","last_became_active":"2023-06-09T04:41:54.432242+0000","last_became_peered":"2023-06-09T04:41:54.432242+0000","last_unstale":"2023-06-09T04:41:55.408415+0000","last_undegraded":"2023-06-09T04:41:55.408415+0000","last_fullsized":"2023-06-09T04:41:55.408415+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:03:50.071570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.654432+0000","last_change":"2023-06-09T04:41:53.946859+0000","last_active":"2023-06-09T04:41:55.654432+0000","last_peered":"2023-06-09T04:41:55.654432+0000","last_clean":"2023-06-09T04:41:55.654432+0000","last_became_active":"2023-06-09T04:41:53.946579+0000","last_became_peered":"2023-06-09T04:41:53.946579+0000","last_unstale":"2023-06-09T04:41:55.654432+0000","last_undegraded":"2023-06-09T04:41:55.654432+0000","last_fullsized":"2023-06-09T04:41:55.654432+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_clean_scrub_stamp":"2023-06-09T04:41:52.888143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:48:33.879868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.874463+0000","last_change":"2023-06-09T04:41:54.412726+0000","last_active":"2023-06-09T04:41:55.874463+0000","last_peered":"2023-06-09T04:41:55.874463+0000","last_clean":"2023-06-09T04:41:55.874463+0000","last_became_active":"2023-06-09T04:41:54.410016+0000","last_became_peered":"2023-06-09T04:41:54.410016+0000","last_unstale":"2023-06-09T04:41:55.874463+0000","last_undegraded":"2023-06-09T04:41:55.874463+0000","last_fullsized":"2023-06-09T04:41:55.874463+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:48:34.893871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":175,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.872709+0000","last_change":"2023-06-09T04:41:43.997052+0000","last_active":"2023-06-09T04:41:55.872709+0000","last_peered":"2023-06-09T04:41:55.872709+0000","last_clean":"2023-06-09T04:41:55.872709+0000","last_became_active":"2023-06-09T04:41:43.993827+0000","last_became_peered":"2023-06-09T04:41:43.993827+0000","last_unstale":"2023-06-09T04:41:55.872709+0000","last_undegraded":"2023-06-09T04:41:55.872709+0000","last_fullsized":"2023-06-09T04:41:55.872709+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:42.777858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:42.777858+0000","last_clean_scrub_stamp":"2023-06-09T04:41:42.777858+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:03:38.947282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.874488+0000","last_change":"2023-06-09T04:41:48.873288+0000","last_active":"2023-06-09T04:41:55.874488+0000","last_peered":"2023-06-09T04:41:55.874488+0000","last_clean":"2023-06-09T04:41:55.874488+0000","last_became_active":"2023-06-09T04:41:48.872659+0000","last_became_peered":"2023-06-09T04:41:48.872659+0000","last_unstale":"2023-06-09T04:41:55.874488+0000","last_undegraded":"2023-06-09T04:41:55.874488+0000","last_fullsized":"2023-06-09T04:41:55.874488+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:47.838489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:47.838489+0000","last_clean_scrub_stamp":"2023-06-09T04:41:47.838489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:32:08.199185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.653752+0000","last_change":"2023-06-09T04:41:53.936424+0000","last_active":"2023-06-09T04:41:55.653752+0000","last_peered":"2023-06-09T04:41:55.653752+0000","last_clean":"2023-06-09T04:41:55.653752+0000","last_became_active":"2023-06-09T04:41:53.935818+0000","last_became_peered":"2023-06-09T04:41:53.935818+0000","last_unstale":"2023-06-09T04:41:55.653752+0000","last_undegraded":"2023-06-09T04:41:55.653752+0000","last_fullsized":"2023-06-09T04:41:55.653752+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_clean_scrub_stamp":"2023-06-09T04:41:52.888143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:01:40.862978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.406643+0000","last_change":"2023-06-09T04:41:54.435480+0000","last_active":"2023-06-09T04:41:55.406643+0000","last_peered":"2023-06-09T04:41:55.406643+0000","last_clean":"2023-06-09T04:41:55.406643+0000","last_became_active":"2023-06-09T04:41:54.435108+0000","last_became_peered":"2023-06-09T04:41:54.435108+0000","last_unstale":"2023-06-09T04:41:55.406643+0000","last_undegraded":"2023-06-09T04:41:55.406643+0000","last_fullsized":"2023-06-09T04:41:55.406643+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:23:54.068246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.872386+0000","last_change":"2023-06-09T04:41:48.880106+0000","last_active":"2023-06-09T04:41:55.872386+0000","last_peered":"2023-06-09T04:41:55.872386+0000","last_clean":"2023-06-09T04:41:55.872386+0000","last_became_active":"2023-06-09T04:41:48.879669+0000","last_became_peered":"2023-06-09T04:41:48.879669+0000","last_unstale":"2023-06-09T04:41:55.872386+0000","last_undegraded":"2023-06-09T04:41:55.872386+0000","last_fullsized":"2023-06-09T04:41:55.872386+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:47.838489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:47.838489+0000","last_clean_scrub_stamp":"2023-06-09T04:41:47.838489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:32:08.199185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.872214+0000","last_change":"2023-06-09T04:41:53.950810+0000","last_active":"2023-06-09T04:41:55.872214+0000","last_peered":"2023-06-09T04:41:55.872214+0000","last_clean":"2023-06-09T04:41:55.872214+0000","last_became_active":"2023-06-09T04:41:53.950443+0000","last_became_peered":"2023-06-09T04:41:53.950443+0000","last_unstale":"2023-06-09T04:41:55.872214+0000","last_undegraded":"2023-06-09T04:41:55.872214+0000","last_fullsized":"2023-06-09T04:41:55.872214+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_clean_scrub_stamp":"2023-06-09T04:41:52.888143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:02:21.285375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.873507+0000","last_change":"2023-06-09T04:41:54.424529+0000","last_active":"2023-06-09T04:41:55.873507+0000","last_peered":"2023-06-09T04:41:55.873507+0000","last_clean":"2023-06-09T04:41:55.873507+0000","last_became_active":"2023-06-09T04:41:54.424272+0000","last_became_peered":"2023-06-09T04:41:54.424272+0000","last_unstale":"2023-06-09T04:41:55.873507+0000","last_undegraded":"2023-06-09T04:41:55.873507+0000","last_fullsized":"2023-06-09T04:41:55.873507+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:03:22.727998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.406445+0000","last_change":"2023-06-09T04:41:48.966313+0000","last_active":"2023-06-09T04:41:55.406445+0000","last_peered":"2023-06-09T04:41:55.406445+0000","last_clean":"2023-06-09T04:41:55.406445+0000","last_became_active":"2023-06-09T04:41:48.965659+0000","last_became_peered":"2023-06-09T04:41:48.965659+0000","last_unstale":"2023-06-09T04:41:55.406445+0000","last_undegraded":"2023-06-09T04:41:55.406445+0000","last_fullsized":"2023-06-09T04:41:55.406445+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:47.838489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:47.838489+0000","last_clean_scrub_stamp":"2023-06-09T04:41:47.838489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:46:50.802354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.872660+0000","last_change":"2023-06-09T04:41:53.938212+0000","last_active":"2023-06-09T04:41:55.872660+0000","last_peered":"2023-06-09T04:41:55.872660+0000","last_clean":"2023-06-09T04:41:55.872660+0000","last_became_active":"2023-06-09T04:41:53.937944+0000","last_became_peered":"2023-06-09T04:41:53.937944+0000","last_unstale":"2023-06-09T04:41:55.872660+0000","last_undegraded":"2023-06-09T04:41:55.872660+0000","last_fullsized":"2023-06-09T04:41:55.872660+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_clean_scrub_stamp":"2023-06-09T04:41:52.888143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:37:52.478621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.874512+0000","last_change":"2023-06-09T04:41:54.419815+0000","last_active":"2023-06-09T04:41:55.874512+0000","last_peered":"2023-06-09T04:41:55.874512+0000","last_clean":"2023-06-09T04:41:55.874512+0000","last_became_active":"2023-06-09T04:41:54.419519+0000","last_became_peered":"2023-06-09T04:41:54.419519+0000","last_unstale":"2023-06-09T04:41:55.874512+0000","last_undegraded":"2023-06-09T04:41:55.874512+0000","last_fullsized":"2023-06-09T04:41:55.874512+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:50:09.575767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.873799+0000","last_change":"2023-06-09T04:41:48.873002+0000","last_active":"2023-06-09T04:41:55.873799+0000","last_peered":"2023-06-09T04:41:55.873799+0000","last_clean":"2023-06-09T04:41:55.873799+0000","last_became_active":"2023-06-09T04:41:48.872455+0000","last_became_peered":"2023-06-09T04:41:48.872455+0000","last_unstale":"2023-06-09T04:41:55.873799+0000","last_undegraded":"2023-06-09T04:41:55.873799+0000","last_fullsized":"2023-06-09T04:41:55.873799+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:47.838489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:47.838489+0000","last_clean_scrub_stamp":"2023-06-09T04:41:47.838489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:05:57.632864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.408311+0000","last_change":"2023-06-09T04:41:53.947015+0000","last_active":"2023-06-09T04:41:55.408311+0000","last_peered":"2023-06-09T04:41:55.408311+0000","last_clean":"2023-06-09T04:41:55.408311+0000","last_became_active":"2023-06-09T04:41:53.946714+0000","last_became_peered":"2023-06-09T04:41:53.946714+0000","last_unstale":"2023-06-09T04:41:55.408311+0000","last_undegraded":"2023-06-09T04:41:55.408311+0000","last_fullsized":"2023-06-09T04:41:55.408311+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_clean_scrub_stamp":"2023-06-09T04:41:52.888143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:01:03.915881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.873441+0000","last_change":"2023-06-09T04:41:54.411876+0000","last_active":"2023-06-09T04:41:55.873441+0000","last_peered":"2023-06-09T04:41:55.873441+0000","last_clean":"2023-06-09T04:41:55.873441+0000","last_became_active":"2023-06-09T04:41:54.411566+0000","last_became_peered":"2023-06-09T04:41:54.411566+0000","last_unstale":"2023-06-09T04:41:55.873441+0000","last_undegraded":"2023-06-09T04:41:55.873441+0000","last_fullsized":"2023-06-09T04:41:55.873441+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:02:24.420270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.874856+0000","last_change":"2023-06-09T04:41:53.936340+0000","last_active":"2023-06-09T04:41:55.874856+0000","last_peered":"2023-06-09T04:41:55.874856+0000","last_clean":"2023-06-09T04:41:55.874856+0000","last_became_active":"2023-06-09T04:41:53.936055+0000","last_became_peered":"2023-06-09T04:41:53.936055+0000","last_unstale":"2023-06-09T04:41:55.874856+0000","last_undegraded":"2023-06-09T04:41:55.874856+0000","last_fullsized":"2023-06-09T04:41:55.874856+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_clean_scrub_stamp":"2023-06-09T04:41:52.888143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:37:16.212704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.874174+0000","last_change":"2023-06-09T04:41:48.978389+0000","last_active":"2023-06-09T04:41:55.874174+0000","last_peered":"2023-06-09T04:41:55.874174+0000","last_clean":"2023-06-09T04:41:55.874174+0000","last_became_active":"2023-06-09T04:41:48.978021+0000","last_became_peered":"2023-06-09T04:41:48.978021+0000","last_unstale":"2023-06-09T04:41:55.874174+0000","last_undegraded":"2023-06-09T04:41:55.874174+0000","last_fullsized":"2023-06-09T04:41:55.874174+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:47.838489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:47.838489+0000","last_clean_scrub_stamp":"2023-06-09T04:41:47.838489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:35:32.291639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.873862+0000","last_change":"2023-06-09T04:41:54.419307+0000","last_active":"2023-06-09T04:41:55.873862+0000","last_peered":"2023-06-09T04:41:55.873862+0000","last_clean":"2023-06-09T04:41:55.873862+0000","last_became_active":"2023-06-09T04:41:54.419053+0000","last_became_peered":"2023-06-09T04:41:54.419053+0000","last_unstale":"2023-06-09T04:41:55.873862+0000","last_undegraded":"2023-06-09T04:41:55.873862+0000","last_fullsized":"2023-06-09T04:41:55.873862+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:06:03.696521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.873723+0000","last_change":"2023-06-09T04:41:53.939038+0000","last_active":"2023-06-09T04:41:55.873723+0000","last_peered":"2023-06-09T04:41:55.873723+0000","last_clean":"2023-06-09T04:41:55.873723+0000","last_became_active":"2023-06-09T04:41:53.938781+0000","last_became_peered":"2023-06-09T04:41:53.938781+0000","last_unstale":"2023-06-09T04:41:55.873723+0000","last_undegraded":"2023-06-09T04:41:55.873723+0000","last_fullsized":"2023-06-09T04:41:55.873723+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_clean_scrub_stamp":"2023-06-09T04:41:52.888143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:55:01.113074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.873352+0000","last_change":"2023-06-09T04:41:48.978235+0000","last_active":"2023-06-09T04:41:55.873352+0000","last_peered":"2023-06-09T04:41:55.873352+0000","last_clean":"2023-06-09T04:41:55.873352+0000","last_became_active":"2023-06-09T04:41:48.977568+0000","last_became_peered":"2023-06-09T04:41:48.977568+0000","last_unstale":"2023-06-09T04:41:55.873352+0000","last_undegraded":"2023-06-09T04:41:55.873352+0000","last_fullsized":"2023-06-09T04:41:55.873352+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:47.838489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:47.838489+0000","last_clean_scrub_stamp":"2023-06-09T04:41:47.838489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:32:35.516622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.872976+0000","last_change":"2023-06-09T04:41:54.422440+0000","last_active":"2023-06-09T04:41:55.872976+0000","last_peered":"2023-06-09T04:41:55.872976+0000","last_clean":"2023-06-09T04:41:55.872976+0000","last_became_active":"2023-06-09T04:41:54.421701+0000","last_became_peered":"2023-06-09T04:41:54.421701+0000","last_unstale":"2023-06-09T04:41:55.872976+0000","last_undegraded":"2023-06-09T04:41:55.872976+0000","last_fullsized":"2023-06-09T04:41:55.872976+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:37:53.492624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"23'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.654758+0000","last_change":"2023-06-09T04:41:53.943578+0000","last_active":"2023-06-09T04:41:55.654758+0000","last_peered":"2023-06-09T04:41:55.654758+0000","last_clean":"2023-06-09T04:41:55.654758+0000","last_became_active":"2023-06-09T04:41:53.943305+0000","last_became_peered":"2023-06-09T04:41:53.943305+0000","last_unstale":"2023-06-09T04:41:55.654758+0000","last_undegraded":"2023-06-09T04:41:55.654758+0000","last_fullsized":"2023-06-09T04:41:55.654758+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_clean_scrub_stamp":"2023-06-09T04:41:52.888143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:32:13.248839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.874764+0000","last_change":"2023-06-09T04:41:48.877786+0000","last_active":"2023-06-09T04:41:55.874764+0000","last_peered":"2023-06-09T04:41:55.874764+0000","last_clean":"2023-06-09T04:41:55.874764+0000","last_became_active":"2023-06-09T04:41:48.877370+0000","last_became_peered":"2023-06-09T04:41:48.877370+0000","last_unstale":"2023-06-09T04:41:55.874764+0000","last_undegraded":"2023-06-09T04:41:55.874764+0000","last_fullsized":"2023-06-09T04:41:55.874764+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:47.838489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:47.838489+0000","last_clean_scrub_stamp":"2023-06-09T04:41:47.838489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:46:15.595937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.653828+0000","last_change":"2023-06-09T04:41:54.424286+0000","last_active":"2023-06-09T04:41:55.653828+0000","last_peered":"2023-06-09T04:41:55.653828+0000","last_clean":"2023-06-09T04:41:55.653828+0000","last_became_active":"2023-06-09T04:41:54.424012+0000","last_became_peered":"2023-06-09T04:41:54.424012+0000","last_unstale":"2023-06-09T04:41:55.653828+0000","last_undegraded":"2023-06-09T04:41:55.653828+0000","last_fullsized":"2023-06-09T04:41:55.653828+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:37:53.492624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.874088+0000","last_change":"2023-06-09T04:41:53.947520+0000","last_active":"2023-06-09T04:41:55.874088+0000","last_peered":"2023-06-09T04:41:55.874088+0000","last_clean":"2023-06-09T04:41:55.874088+0000","last_became_active":"2023-06-09T04:41:53.947160+0000","last_became_peered":"2023-06-09T04:41:53.947160+0000","last_unstale":"2023-06-09T04:41:55.874088+0000","last_undegraded":"2023-06-09T04:41:55.874088+0000","last_fullsized":"2023-06-09T04:41:55.874088+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_clean_scrub_stamp":"2023-06-09T04:41:52.888143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:02:14.053015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.407151+0000","last_change":"2023-06-09T04:41:48.880094+0000","last_active":"2023-06-09T04:41:55.407151+0000","last_peered":"2023-06-09T04:41:55.407151+0000","last_clean":"2023-06-09T04:41:55.407151+0000","last_became_active":"2023-06-09T04:41:48.879506+0000","last_became_peered":"2023-06-09T04:41:48.879506+0000","last_unstale":"2023-06-09T04:41:55.407151+0000","last_undegraded":"2023-06-09T04:41:55.407151+0000","last_fullsized":"2023-06-09T04:41:55.407151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:47.838489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:47.838489+0000","last_clean_scrub_stamp":"2023-06-09T04:41:47.838489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:59:58.200203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.407606+0000","last_change":"2023-06-09T04:41:54.426906+0000","last_active":"2023-06-09T04:41:55.407606+0000","last_peered":"2023-06-09T04:41:55.407606+0000","last_clean":"2023-06-09T04:41:55.407606+0000","last_became_active":"2023-06-09T04:41:54.426543+0000","last_became_peered":"2023-06-09T04:41:54.426543+0000","last_unstale":"2023-06-09T04:41:55.407606+0000","last_undegraded":"2023-06-09T04:41:55.407606+0000","last_fullsized":"2023-06-09T04:41:55.407606+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:34:10.329381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.408027+0000","last_change":"2023-06-09T04:41:54.425437+0000","last_active":"2023-06-09T04:41:55.408027+0000","last_peered":"2023-06-09T04:41:55.408027+0000","last_clean":"2023-06-09T04:41:55.408027+0000","last_became_active":"2023-06-09T04:41:54.425093+0000","last_became_peered":"2023-06-09T04:41:54.425093+0000","last_unstale":"2023-06-09T04:41:55.408027+0000","last_undegraded":"2023-06-09T04:41:55.408027+0000","last_fullsized":"2023-06-09T04:41:55.408027+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:35:38.355296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"23'6","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.408353+0000","last_change":"2023-06-09T04:41:53.946445+0000","last_active":"2023-06-09T04:41:55.408353+0000","last_peered":"2023-06-09T04:41:55.408353+0000","last_clean":"2023-06-09T04:41:55.408353+0000","last_became_active":"2023-06-09T04:41:53.942330+0000","last_became_peered":"2023-06-09T04:41:53.942330+0000","last_unstale":"2023-06-09T04:41:55.408353+0000","last_undegraded":"2023-06-09T04:41:55.408353+0000","last_fullsized":"2023-06-09T04:41:55.408353+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_clean_scrub_stamp":"2023-06-09T04:41:52.888143+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:37:16.212704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.873568+0000","last_change":"2023-06-09T04:41:54.423048+0000","last_active":"2023-06-09T04:41:55.873568+0000","last_peered":"2023-06-09T04:41:55.873568+0000","last_clean":"2023-06-09T04:41:55.873568+0000","last_became_active":"2023-06-09T04:41:54.422813+0000","last_became_peered":"2023-06-09T04:41:54.422813+0000","last_unstale":"2023-06-09T04:41:55.873568+0000","last_undegraded":"2023-06-09T04:41:55.873568+0000","last_fullsized":"2023-06-09T04:41:55.873568+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:34:10.329381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"23'3","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.872749+0000","last_change":"2023-06-09T04:41:53.947478+0000","last_active":"2023-06-09T04:41:55.872749+0000","last_peered":"2023-06-09T04:41:55.872749+0000","last_clean":"2023-06-09T04:41:55.872749+0000","last_became_active":"2023-06-09T04:41:53.947126+0000","last_became_peered":"2023-06-09T04:41:53.947126+0000","last_unstale":"2023-06-09T04:41:55.872749+0000","last_undegraded":"2023-06-09T04:41:55.872749+0000","last_fullsized":"2023-06-09T04:41:55.872749+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_clean_scrub_stamp":"2023-06-09T04:41:52.888143+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:01:03.915881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.874913+0000","last_change":"2023-06-09T04:41:53.943073+0000","last_active":"2023-06-09T04:41:55.874913+0000","last_peered":"2023-06-09T04:41:55.874913+0000","last_clean":"2023-06-09T04:41:55.874913+0000","last_became_active":"2023-06-09T04:41:53.942802+0000","last_became_peered":"2023-06-09T04:41:53.942802+0000","last_unstale":"2023-06-09T04:41:55.874913+0000","last_undegraded":"2023-06-09T04:41:55.874913+0000","last_fullsized":"2023-06-09T04:41:55.874913+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_clean_scrub_stamp":"2023-06-09T04:41:52.888143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:44:35.348425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.654252+0000","last_change":"2023-06-09T04:41:54.424894+0000","last_active":"2023-06-09T04:41:55.654252+0000","last_peered":"2023-06-09T04:41:55.654252+0000","last_clean":"2023-06-09T04:41:55.654252+0000","last_became_active":"2023-06-09T04:41:54.423546+0000","last_became_peered":"2023-06-09T04:41:54.423546+0000","last_unstale":"2023-06-09T04:41:55.654252+0000","last_undegraded":"2023-06-09T04:41:55.654252+0000","last_fullsized":"2023-06-09T04:41:55.654252+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:29:47.126124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.874732+0000","last_change":"2023-06-09T04:41:53.945046+0000","last_active":"2023-06-09T04:41:55.874732+0000","last_peered":"2023-06-09T04:41:55.874732+0000","last_clean":"2023-06-09T04:41:55.874732+0000","last_became_active":"2023-06-09T04:41:53.944775+0000","last_became_peered":"2023-06-09T04:41:53.944775+0000","last_unstale":"2023-06-09T04:41:55.874732+0000","last_undegraded":"2023-06-09T04:41:55.874732+0000","last_fullsized":"2023-06-09T04:41:55.874732+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_clean_scrub_stamp":"2023-06-09T04:41:52.888143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:46:20.645591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.653741+0000","last_change":"2023-06-09T04:41:54.412545+0000","last_active":"2023-06-09T04:41:55.653741+0000","last_peered":"2023-06-09T04:41:55.653741+0000","last_clean":"2023-06-09T04:41:55.653741+0000","last_became_active":"2023-06-09T04:41:54.412243+0000","last_became_peered":"2023-06-09T04:41:54.412243+0000","last_unstale":"2023-06-09T04:41:55.653741+0000","last_undegraded":"2023-06-09T04:41:55.653741+0000","last_fullsized":"2023-06-09T04:41:55.653741+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:02:22.299378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.406954+0000","last_change":"2023-06-09T04:41:54.424839+0000","last_active":"2023-06-09T04:41:55.406954+0000","last_peered":"2023-06-09T04:41:55.406954+0000","last_clean":"2023-06-09T04:41:55.406954+0000","last_became_active":"2023-06-09T04:41:54.424393+0000","last_became_peered":"2023-06-09T04:41:54.424393+0000","last_unstale":"2023-06-09T04:41:55.406954+0000","last_undegraded":"2023-06-09T04:41:55.406954+0000","last_fullsized":"2023-06-09T04:41:55.406954+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:49:19.500921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.654122+0000","last_change":"2023-06-09T04:41:53.946167+0000","last_active":"2023-06-09T04:41:55.654122+0000","last_peered":"2023-06-09T04:41:55.654122+0000","last_clean":"2023-06-09T04:41:55.654122+0000","last_became_active":"2023-06-09T04:41:53.945851+0000","last_became_peered":"2023-06-09T04:41:53.945851+0000","last_unstale":"2023-06-09T04:41:55.654122+0000","last_undegraded":"2023-06-09T04:41:55.654122+0000","last_fullsized":"2023-06-09T04:41:55.654122+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_clean_scrub_stamp":"2023-06-09T04:41:52.888143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:34:09.315377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.873175+0000","last_change":"2023-06-09T04:41:54.422093+0000","last_active":"2023-06-09T04:41:55.873175+0000","last_peered":"2023-06-09T04:41:55.873175+0000","last_clean":"2023-06-09T04:41:55.873175+0000","last_became_active":"2023-06-09T04:41:54.421470+0000","last_became_peered":"2023-06-09T04:41:54.421470+0000","last_unstale":"2023-06-09T04:41:55.873175+0000","last_undegraded":"2023-06-09T04:41:55.873175+0000","last_fullsized":"2023-06-09T04:41:55.873175+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:02:24.420270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.873487+0000","last_change":"2023-06-09T04:41:53.948249+0000","last_active":"2023-06-09T04:41:55.873487+0000","last_peered":"2023-06-09T04:41:55.873487+0000","last_clean":"2023-06-09T04:41:55.873487+0000","last_became_active":"2023-06-09T04:41:53.947922+0000","last_became_peered":"2023-06-09T04:41:53.947922+0000","last_unstale":"2023-06-09T04:41:55.873487+0000","last_undegraded":"2023-06-09T04:41:55.873487+0000","last_fullsized":"2023-06-09T04:41:55.873487+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_clean_scrub_stamp":"2023-06-09T04:41:52.888143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:03:21.713995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.654127+0000","last_change":"2023-06-09T04:41:54.414099+0000","last_active":"2023-06-09T04:41:55.654127+0000","last_peered":"2023-06-09T04:41:55.654127+0000","last_clean":"2023-06-09T04:41:55.654127+0000","last_became_active":"2023-06-09T04:41:54.413814+0000","last_became_peered":"2023-06-09T04:41:54.413814+0000","last_unstale":"2023-06-09T04:41:55.654127+0000","last_undegraded":"2023-06-09T04:41:55.654127+0000","last_fullsized":"2023-06-09T04:41:55.654127+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:55:02.127077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"23'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.407877+0000","last_change":"2023-06-09T04:41:53.946921+0000","last_active":"2023-06-09T04:41:55.407877+0000","last_peered":"2023-06-09T04:41:55.407877+0000","last_clean":"2023-06-09T04:41:55.407877+0000","last_became_active":"2023-06-09T04:41:53.946528+0000","last_became_peered":"2023-06-09T04:41:53.946528+0000","last_unstale":"2023-06-09T04:41:55.407877+0000","last_undegraded":"2023-06-09T04:41:55.407877+0000","last_fullsized":"2023-06-09T04:41:55.407877+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_clean_scrub_stamp":"2023-06-09T04:41:52.888143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:29:46.112121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.406923+0000","last_change":"2023-06-09T04:41:54.414420+0000","last_active":"2023-06-09T04:41:55.406923+0000","last_peered":"2023-06-09T04:41:55.406923+0000","last_clean":"2023-06-09T04:41:55.406923+0000","last_became_active":"2023-06-09T04:41:54.413915+0000","last_became_peered":"2023-06-09T04:41:54.413915+0000","last_unstale":"2023-06-09T04:41:55.406923+0000","last_undegraded":"2023-06-09T04:41:55.406923+0000","last_fullsized":"2023-06-09T04:41:55.406923+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:17:24.443064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.873918+0000","last_change":"2023-06-09T04:41:53.950753+0000","last_active":"2023-06-09T04:41:55.873918+0000","last_peered":"2023-06-09T04:41:55.873918+0000","last_clean":"2023-06-09T04:41:55.873918+0000","last_became_active":"2023-06-09T04:41:53.950440+0000","last_became_peered":"2023-06-09T04:41:53.950440+0000","last_unstale":"2023-06-09T04:41:55.873918+0000","last_undegraded":"2023-06-09T04:41:55.873918+0000","last_fullsized":"2023-06-09T04:41:55.873918+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_clean_scrub_stamp":"2023-06-09T04:41:52.888143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:29:46.112121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.407721+0000","last_change":"2023-06-09T04:41:54.432857+0000","last_active":"2023-06-09T04:41:55.407721+0000","last_peered":"2023-06-09T04:41:55.407721+0000","last_clean":"2023-06-09T04:41:55.407721+0000","last_became_active":"2023-06-09T04:41:54.432285+0000","last_became_peered":"2023-06-09T04:41:54.432285+0000","last_unstale":"2023-06-09T04:41:55.407721+0000","last_undegraded":"2023-06-09T04:41:55.407721+0000","last_fullsized":"2023-06-09T04:41:55.407721+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:06:03.696521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"23'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.874167+0000","last_change":"2023-06-09T04:41:53.948741+0000","last_active":"2023-06-09T04:41:55.874167+0000","last_peered":"2023-06-09T04:41:55.874167+0000","last_clean":"2023-06-09T04:41:55.874167+0000","last_became_active":"2023-06-09T04:41:53.948401+0000","last_became_peered":"2023-06-09T04:41:53.948401+0000","last_unstale":"2023-06-09T04:41:55.874167+0000","last_undegraded":"2023-06-09T04:41:55.874167+0000","last_fullsized":"2023-06-09T04:41:55.874167+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_clean_scrub_stamp":"2023-06-09T04:41:52.888143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:35:37.341293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.407534+0000","last_change":"2023-06-09T04:41:54.434317+0000","last_active":"2023-06-09T04:41:55.407534+0000","last_peered":"2023-06-09T04:41:55.407534+0000","last_clean":"2023-06-09T04:41:55.407534+0000","last_became_active":"2023-06-09T04:41:54.433815+0000","last_became_peered":"2023-06-09T04:41:54.433815+0000","last_unstale":"2023-06-09T04:41:55.407534+0000","last_undegraded":"2023-06-09T04:41:55.407534+0000","last_fullsized":"2023-06-09T04:41:55.407534+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:03:22.727998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"23'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.874939+0000","last_change":"2023-06-09T04:41:53.949030+0000","last_active":"2023-06-09T04:41:55.874939+0000","last_peered":"2023-06-09T04:41:55.874939+0000","last_clean":"2023-06-09T04:41:55.874939+0000","last_became_active":"2023-06-09T04:41:53.948417+0000","last_became_peered":"2023-06-09T04:41:53.948417+0000","last_unstale":"2023-06-09T04:41:55.874939+0000","last_undegraded":"2023-06-09T04:41:55.874939+0000","last_fullsized":"2023-06-09T04:41:55.874939+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_clean_scrub_stamp":"2023-06-09T04:41:52.888143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:03:49.057567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.654457+0000","last_change":"2023-06-09T04:41:54.402200+0000","last_active":"2023-06-09T04:41:55.654457+0000","last_peered":"2023-06-09T04:41:55.654457+0000","last_clean":"2023-06-09T04:41:55.654457+0000","last_became_active":"2023-06-09T04:41:54.401955+0000","last_became_peered":"2023-06-09T04:41:54.401955+0000","last_unstale":"2023-06-09T04:41:55.654457+0000","last_undegraded":"2023-06-09T04:41:55.654457+0000","last_fullsized":"2023-06-09T04:41:55.654457+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:50:09.575767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"23'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.654265+0000","last_change":"2023-06-09T04:41:53.946110+0000","last_active":"2023-06-09T04:41:55.654265+0000","last_peered":"2023-06-09T04:41:55.654265+0000","last_clean":"2023-06-09T04:41:55.654265+0000","last_became_active":"2023-06-09T04:41:53.945780+0000","last_became_peered":"2023-06-09T04:41:53.945780+0000","last_unstale":"2023-06-09T04:41:55.654265+0000","last_undegraded":"2023-06-09T04:41:55.654265+0000","last_fullsized":"2023-06-09T04:41:55.654265+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_clean_scrub_stamp":"2023-06-09T04:41:52.888143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:35:37.341293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.407217+0000","last_change":"2023-06-09T04:41:54.424850+0000","last_active":"2023-06-09T04:41:55.407217+0000","last_peered":"2023-06-09T04:41:55.407217+0000","last_clean":"2023-06-09T04:41:55.407217+0000","last_became_active":"2023-06-09T04:41:54.424507+0000","last_became_peered":"2023-06-09T04:41:54.424507+0000","last_unstale":"2023-06-09T04:41:55.407217+0000","last_undegraded":"2023-06-09T04:41:55.407217+0000","last_fullsized":"2023-06-09T04:41:55.407217+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:37:53.492624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"23'4","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.874082+0000","last_change":"2023-06-09T04:41:53.940256+0000","last_active":"2023-06-09T04:41:55.874082+0000","last_peered":"2023-06-09T04:41:55.874082+0000","last_clean":"2023-06-09T04:41:55.874082+0000","last_became_active":"2023-06-09T04:41:53.939890+0000","last_became_peered":"2023-06-09T04:41:53.939890+0000","last_unstale":"2023-06-09T04:41:55.874082+0000","last_undegraded":"2023-06-09T04:41:55.874082+0000","last_fullsized":"2023-06-09T04:41:55.874082+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_clean_scrub_stamp":"2023-06-09T04:41:52.888143+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:48:33.879868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":856,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":876544,"data_stored":686418,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1719999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3049999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.256}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.349}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.206}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.419}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.72}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":253952,"data_stored":94270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76700000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0069999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2210000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3540000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4139999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.091}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4399999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":262144,"data_stored":94922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83099999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80600000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.48}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.075}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.359}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4159999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.306}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":274432,"data_stored":95890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4359999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.123}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4850000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0800000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.224}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5640000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.329}]}]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27204,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344636,"statfs":{"total":96636764160,"available":96608907264,"internally_reserved":0,"allocated":258048,"data_stored":94360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98499999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92400000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1950000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4339999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.115}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3899999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2430000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":253952,"data_stored":94270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70099999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.105}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5920000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4450000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.371}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5489999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7170000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27188,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344652,"statfs":{"total":96636764160,"available":96608923648,"internally_reserved":0,"allocated":241664,"data_stored":87617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93899999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4470000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.363}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4810000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.51}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8140000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27772,"kb_used_data":820,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344068,"statfs":{"total":96636764160,"available":96608325632,"internally_reserved":0,"allocated":839680,"data_stored":678567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0680000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2889999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0369999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.863}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9990000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.851}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8169999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-09T04:41:58.692 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-09T04:41:58.891 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.888+0000 7facff46f700 1 Processor -- start 2023-06-09T04:41:58.891 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.888+0000 7facff46f700 1 -- start start 2023-06-09T04:41:58.895 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.892+0000 7facff46f700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7facf8165250 0x7facf8167630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:58.895 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.892+0000 7facff46f700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facf8160d50 con 0x7facf80d1220 2023-06-09T04:41:58.895 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.892+0000 7facff46f700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facf80b8850 con 0x7facf806cc50 2023-06-09T04:41:58.896 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.892+0000 7facff46f700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facf80d0150 con 0x7facf8165250 2023-06-09T04:41:58.896 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.892+0000 7facfca0a700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7facf80d1220 0x7facf8160640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:46464/0 (socket says 172.21.15.90:46464) 2023-06-09T04:41:58.896 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.892+0000 7facfca0a700 1 -- 172.21.15.90:0/6420216 learned_addr learned my addr 172.21.15.90:0/6420216 (peer_addr_for_me v1:172.21.15.90:0/0) 2023-06-09T04:41:58.896 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.892+0000 7facfda0c700 1 --2- 172.21.15.90:0/6420216 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7facf8165250 0x7facf8167630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:58.897 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.892+0000 7faceffff700 1 -- 172.21.15.90:0/6420216 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2024845779 0 0) 0x7facf8160d50 con 0x7facf80d1220 2023-06-09T04:41:58.897 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.892+0000 7faceffff700 1 -- 172.21.15.90:0/6420216 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7face40035d0 con 0x7facf80d1220 2023-06-09T04:41:58.897 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.892+0000 7faceffff700 1 -- 172.21.15.90:0/6420216 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1673021133 0 0) 0x7facf80b8850 con 0x7facf806cc50 2023-06-09T04:41:58.898 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.892+0000 7faceffff700 1 -- 172.21.15.90:0/6420216 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7facf8160d50 con 0x7facf806cc50 2023-06-09T04:41:58.898 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.892+0000 7facfda0c700 1 -- 172.21.15.90:0/6420216 >> v1:172.21.15.174:6789/0 conn(0x7facf806cc50 legacy=0x7facf815ff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:58.898 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.892+0000 7facfda0c700 1 -- 172.21.15.90:0/6420216 >> v1:172.21.15.90:6789/0 conn(0x7facf80d1220 legacy=0x7facf8160640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:58.898 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.892+0000 7facfda0c700 1 -- 172.21.15.90:0/6420216 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facf80d17e0 con 0x7facf8165250 2023-06-09T04:41:58.899 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.892+0000 7facfda0c700 1 --2- 172.21.15.90:0/6420216 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7facf8165250 0x7facf8167630 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7facf0009dc0 tx=0x7facf000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=643c6e16e5cf0510 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:58.899 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.892+0000 7faceffff700 1 -- 172.21.15.90:0/6420216 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facf000e070 con 0x7facf8165250 2023-06-09T04:41:58.899 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.892+0000 7faceffff700 1 -- 172.21.15.90:0/6420216 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facf000bb20 con 0x7facf8165250 2023-06-09T04:41:58.899 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.892+0000 7faceffff700 1 -- 172.21.15.90:0/6420216 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facf0012430 con 0x7facf8165250 2023-06-09T04:41:58.899 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.896+0000 7facff46f700 1 -- 172.21.15.90:0/6420216 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7facf8165250 msgr2=0x7facf8167630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:58.899 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.896+0000 7facff46f700 1 --2- 172.21.15.90:0/6420216 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7facf8165250 0x7facf8167630 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7facf0009dc0 tx=0x7facf000b330 comp rx=0 tx=0).stop 2023-06-09T04:41:58.900 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.896+0000 7facff46f700 1 -- 172.21.15.90:0/6420216 shutdown_connections 2023-06-09T04:41:58.900 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.896+0000 7facff46f700 1 --2- 172.21.15.90:0/6420216 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7facf8165250 0x7facf8167630 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:58.900 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.896+0000 7facff46f700 1 -- 172.21.15.90:0/6420216 >> 172.21.15.90:0/6420216 conn(0x7facf80b57f0 msgr2=0x7facf80b5bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:58.900 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.896+0000 7facff46f700 1 -- 172.21.15.90:0/6420216 shutdown_connections 2023-06-09T04:41:58.901 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.896+0000 7facff46f700 1 -- 172.21.15.90:0/6420216 wait complete. 2023-06-09T04:41:58.901 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.896+0000 7facff46f700 1 Processor -- start 2023-06-09T04:41:58.902 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.896+0000 7facff46f700 1 -- start start 2023-06-09T04:41:58.903 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.900+0000 7facff46f700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7facf806cc50 0x7facf814c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:58.903 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.900+0000 7facff46f700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7facf80d1220 0x7facf80c6de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:58.903 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.900+0000 7facff46f700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7facf8165250 0x7facf815b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:58.903 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.900+0000 7facff46f700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facf8155b60 con 0x7facf806cc50 2023-06-09T04:41:58.903 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.900+0000 7facff46f700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facf8154ac0 con 0x7facf8165250 2023-06-09T04:41:58.903 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.900+0000 7facff46f700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facf8154da0 con 0x7facf80d1220 2023-06-09T04:41:58.904 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.900+0000 7facfd20b700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7facf806cc50 0x7facf814c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:58.904 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.900+0000 7facfd20b700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7facf806cc50 0x7facf814c890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:33342/0 (socket says 172.21.15.90:33342) 2023-06-09T04:41:58.904 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.900+0000 7facfd20b700 1 -- 172.21.15.90:0/1339248941 learned_addr learned my addr 172.21.15.90:0/1339248941 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:41:58.905 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.900+0000 7facfca0a700 1 --2- 172.21.15.90:0/1339248941 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7facf80d1220 0x7facf80c6de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:58.905 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.900+0000 7facfda0c700 1 --2- 172.21.15.90:0/1339248941 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7facf8165250 0x7facf815b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:58.905 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.900+0000 7facfd20b700 1 -- 172.21.15.90:0/1339248941 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7facf80d1220 msgr2=0x7facf80c6de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:58.905 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.900+0000 7facfd20b700 1 --2- 172.21.15.90:0/1339248941 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7facf80d1220 0x7facf80c6de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:58.905 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.900+0000 7facfd20b700 1 -- 172.21.15.90:0/1339248941 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7facf8165250 msgr2=0x7facf815b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:58.905 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.900+0000 7facfd20b700 1 --2- 172.21.15.90:0/1339248941 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7facf8165250 0x7facf815b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:58.905 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.900+0000 7facfd20b700 1 -- 172.21.15.90:0/1339248941 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facf0009a70 con 0x7facf806cc50 2023-06-09T04:41:58.906 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.900+0000 7facfd20b700 1 --2- 172.21.15.90:0/1339248941 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7facf806cc50 0x7facf814c890 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7facf400c490 tx=0x7facf400c7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:58.906 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.900+0000 7facedffb700 1 -- 172.21.15.90:0/1339248941 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facf400cea0 con 0x7facf806cc50 2023-06-09T04:41:58.906 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.900+0000 7facedffb700 1 -- 172.21.15.90:0/1339248941 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facf40052f0 con 0x7facf806cc50 2023-06-09T04:41:58.907 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.900+0000 7facff46f700 1 -- 172.21.15.90:0/1339248941 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facf8155080 con 0x7facf806cc50 2023-06-09T04:41:58.907 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.900+0000 7facedffb700 1 -- 172.21.15.90:0/1339248941 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facf40036a0 con 0x7facf806cc50 2023-06-09T04:41:58.907 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.900+0000 7facff46f700 1 -- 172.21.15.90:0/1339248941 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facf8155640 con 0x7facf806cc50 2023-06-09T04:41:58.907 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.904+0000 7facff46f700 1 -- 172.21.15.90:0/1339248941 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facf804db30 con 0x7facf806cc50 2023-06-09T04:41:58.908 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.904+0000 7facedffb700 1 -- 172.21.15.90:0/1339248941 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7facf4003800 con 0x7facf806cc50 2023-06-09T04:41:58.910 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.904+0000 7facedffb700 1 --2- 172.21.15.90:0/1339248941 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7facdc0662f0 0x7facdc0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:58.910 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.904+0000 7facedffb700 1 -- 172.21.15.90:0/1339248941 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7facf4083150 con 0x7facf806cc50 2023-06-09T04:41:58.910 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.908+0000 7facfca0a700 1 --2- 172.21.15.90:0/1339248941 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7facdc0662f0 0x7facdc0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:58.912 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.908+0000 7facfca0a700 1 --2- 172.21.15.90:0/1339248941 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7facdc0662f0 0x7facdc0687a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7facf80b2a40 tx=0x7face8007e00 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:58.916 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:58.912+0000 7facedffb700 1 -- 172.21.15.90:0/1339248941 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7facf4050530 con 0x7facf806cc50 2023-06-09T04:41:59.086 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:59.080+0000 7facff46f700 1 -- 172.21.15.90:0/1339248941 --> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7facf80cf390 con 0x7facdc0662f0 2023-06-09T04:41:59.105 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:59.100+0000 7facedffb700 1 -- 172.21.15.90:0/1339248941 <== mgr.4104 v2:172.21.15.174:6832/1389974754 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286536 (secure 0 0 0) 0x7face8006bd0 con 0x7facdc0662f0 2023-06-09T04:41:59.107 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:41:59.115 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:59.112+0000 7facff46f700 1 -- 172.21.15.90:0/1339248941 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7facdc0662f0 msgr2=0x7facdc0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:59.115 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:59.112+0000 7facff46f700 1 --2- 172.21.15.90:0/1339248941 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7facdc0662f0 0x7facdc0687a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7facf80b2a40 tx=0x7face8007e00 comp rx=0 tx=0).stop 2023-06-09T04:41:59.115 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:59.112+0000 7facff46f700 1 -- 172.21.15.90:0/1339248941 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7facf806cc50 msgr2=0x7facf814c890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:59.116 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:59.112+0000 7facff46f700 1 --2- 172.21.15.90:0/1339248941 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7facf806cc50 0x7facf814c890 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7facf400c490 tx=0x7facf400c7a0 comp rx=0 tx=0).stop 2023-06-09T04:41:59.116 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:59.112+0000 7facff46f700 1 -- 172.21.15.90:0/1339248941 shutdown_connections 2023-06-09T04:41:59.116 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:59.112+0000 7facff46f700 1 --2- 172.21.15.90:0/1339248941 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7facdc0662f0 0x7facdc0687a0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:59.116 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:59.112+0000 7facff46f700 1 --2- 172.21.15.90:0/1339248941 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7facf8165250 0x7facf815b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:59.116 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:59.112+0000 7facff46f700 1 --2- 172.21.15.90:0/1339248941 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7facf80d1220 0x7facf80c6de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:59.116 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:59.112+0000 7facff46f700 1 --2- 172.21.15.90:0/1339248941 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7facf806cc50 0x7facf814c890 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:59.116 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:59.112+0000 7facff46f700 1 -- 172.21.15.90:0/1339248941 >> 172.21.15.90:0/1339248941 conn(0x7facf80b57f0 msgr2=0x7facf80d0290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:59.116 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:59.112+0000 7facff46f700 1 -- 172.21.15.90:0/1339248941 shutdown_connections 2023-06-09T04:41:59.117 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:59.112+0000 7facff46f700 1 -- 172.21.15.90:0/1339248941 wait complete. 2023-06-09T04:41:59.117 INFO:teuthology.orchestra.run.smithi090.stderr:dumped all 2023-06-09T04:41:59.136 INFO:teuthology.orchestra.run.smithi090.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2023-06-09T04:41:58.312101+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":177,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218800,"kb_used_data":3184,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754755920,"statfs":{"total":773094113280,"available":772870062080,"internally_reserved":0,"allocated":3260416,"data_stored":1926314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":41,"apply_latency_ms":41,"commit_latency_ns":41000000,"apply_latency_ns":41000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.410358"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.406944+0000","last_change":"2023-06-09T04:41:54.403483+0000","last_active":"2023-06-09T04:41:55.406944+0000","last_peered":"2023-06-09T04:41:55.406944+0000","last_clean":"2023-06-09T04:41:55.406944+0000","last_became_active":"2023-06-09T04:41:54.403189+0000","last_became_peered":"2023-06-09T04:41:54.403189+0000","last_unstale":"2023-06-09T04:41:55.406944+0000","last_undegraded":"2023-06-09T04:41:55.406944+0000","last_fullsized":"2023-06-09T04:41:55.406944+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:45:23.237006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.874307+0000","last_change":"2023-06-09T04:41:54.417816+0000","last_active":"2023-06-09T04:41:55.874307+0000","last_peered":"2023-06-09T04:41:55.874307+0000","last_clean":"2023-06-09T04:41:55.874307+0000","last_became_active":"2023-06-09T04:41:54.417523+0000","last_became_peered":"2023-06-09T04:41:54.417523+0000","last_unstale":"2023-06-09T04:41:55.874307+0000","last_undegraded":"2023-06-09T04:41:55.874307+0000","last_fullsized":"2023-06-09T04:41:55.874307+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:02:15.067018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.408132+0000","last_change":"2023-06-09T04:41:54.434121+0000","last_active":"2023-06-09T04:41:55.408132+0000","last_peered":"2023-06-09T04:41:55.408132+0000","last_clean":"2023-06-09T04:41:55.408132+0000","last_became_active":"2023-06-09T04:41:54.433774+0000","last_became_peered":"2023-06-09T04:41:54.433774+0000","last_unstale":"2023-06-09T04:41:55.408132+0000","last_undegraded":"2023-06-09T04:41:55.408132+0000","last_fullsized":"2023-06-09T04:41:55.408132+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:50:09.575767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.406854+0000","last_change":"2023-06-09T04:41:54.424411+0000","last_active":"2023-06-09T04:41:55.406854+0000","last_peered":"2023-06-09T04:41:55.406854+0000","last_clean":"2023-06-09T04:41:55.406854+0000","last_became_active":"2023-06-09T04:41:54.423966+0000","last_became_peered":"2023-06-09T04:41:54.423966+0000","last_unstale":"2023-06-09T04:41:55.406854+0000","last_undegraded":"2023-06-09T04:41:55.406854+0000","last_fullsized":"2023-06-09T04:41:55.406854+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:45:08.259045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.873607+0000","last_change":"2023-06-09T04:41:54.414192+0000","last_active":"2023-06-09T04:41:55.873607+0000","last_peered":"2023-06-09T04:41:55.873607+0000","last_clean":"2023-06-09T04:41:55.873607+0000","last_became_active":"2023-06-09T04:41:54.413938+0000","last_became_peered":"2023-06-09T04:41:54.413938+0000","last_unstale":"2023-06-09T04:41:55.873607+0000","last_undegraded":"2023-06-09T04:41:55.873607+0000","last_fullsized":"2023-06-09T04:41:55.873607+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:34:10.329381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.407620+0000","last_change":"2023-06-09T04:41:54.434214+0000","last_active":"2023-06-09T04:41:55.407620+0000","last_peered":"2023-06-09T04:41:55.407620+0000","last_clean":"2023-06-09T04:41:55.407620+0000","last_became_active":"2023-06-09T04:41:54.433495+0000","last_became_peered":"2023-06-09T04:41:54.433495+0000","last_unstale":"2023-06-09T04:41:55.407620+0000","last_undegraded":"2023-06-09T04:41:55.407620+0000","last_fullsized":"2023-06-09T04:41:55.407620+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:55:02.127077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.872502+0000","last_change":"2023-06-09T04:41:54.419655+0000","last_active":"2023-06-09T04:41:55.872502+0000","last_peered":"2023-06-09T04:41:55.872502+0000","last_clean":"2023-06-09T04:41:55.872502+0000","last_became_active":"2023-06-09T04:41:54.419050+0000","last_became_peered":"2023-06-09T04:41:54.419050+0000","last_unstale":"2023-06-09T04:41:55.872502+0000","last_undegraded":"2023-06-09T04:41:55.872502+0000","last_fullsized":"2023-06-09T04:41:55.872502+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:50:09.575767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.873689+0000","last_change":"2023-06-09T04:41:54.437218+0000","last_active":"2023-06-09T04:41:55.873689+0000","last_peered":"2023-06-09T04:41:55.873689+0000","last_clean":"2023-06-09T04:41:55.873689+0000","last_became_active":"2023-06-09T04:41:54.436898+0000","last_became_peered":"2023-06-09T04:41:54.436898+0000","last_unstale":"2023-06-09T04:41:55.873689+0000","last_undegraded":"2023-06-09T04:41:55.873689+0000","last_fullsized":"2023-06-09T04:41:55.873689+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:34:10.329381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.873735+0000","last_change":"2023-06-09T04:41:54.417378+0000","last_active":"2023-06-09T04:41:55.873735+0000","last_peered":"2023-06-09T04:41:55.873735+0000","last_clean":"2023-06-09T04:41:55.873735+0000","last_became_active":"2023-06-09T04:41:54.416459+0000","last_became_peered":"2023-06-09T04:41:54.416459+0000","last_unstale":"2023-06-09T04:41:55.873735+0000","last_undegraded":"2023-06-09T04:41:55.873735+0000","last_fullsized":"2023-06-09T04:41:55.873735+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:55:02.127077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.874681+0000","last_change":"2023-06-09T04:41:54.417848+0000","last_active":"2023-06-09T04:41:55.874681+0000","last_peered":"2023-06-09T04:41:55.874681+0000","last_clean":"2023-06-09T04:41:55.874681+0000","last_became_active":"2023-06-09T04:41:54.417560+0000","last_became_peered":"2023-06-09T04:41:54.417560+0000","last_unstale":"2023-06-09T04:41:55.874681+0000","last_undegraded":"2023-06-09T04:41:55.874681+0000","last_fullsized":"2023-06-09T04:41:55.874681+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:46:21.659594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.408404+0000","last_change":"2023-06-09T04:41:54.434090+0000","last_active":"2023-06-09T04:41:55.408404+0000","last_peered":"2023-06-09T04:41:55.408404+0000","last_clean":"2023-06-09T04:41:55.408404+0000","last_became_active":"2023-06-09T04:41:54.433687+0000","last_became_peered":"2023-06-09T04:41:54.433687+0000","last_unstale":"2023-06-09T04:41:55.408404+0000","last_undegraded":"2023-06-09T04:41:55.408404+0000","last_fullsized":"2023-06-09T04:41:55.408404+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:44:36.362428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.406772+0000","last_change":"2023-06-09T04:41:54.437425+0000","last_active":"2023-06-09T04:41:55.406772+0000","last_peered":"2023-06-09T04:41:55.406772+0000","last_clean":"2023-06-09T04:41:55.406772+0000","last_became_active":"2023-06-09T04:41:54.437149+0000","last_became_peered":"2023-06-09T04:41:54.437149+0000","last_unstale":"2023-06-09T04:41:55.406772+0000","last_undegraded":"2023-06-09T04:41:55.406772+0000","last_fullsized":"2023-06-09T04:41:55.406772+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:44:39.043853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.406611+0000","last_change":"2023-06-09T04:41:54.406715+0000","last_active":"2023-06-09T04:41:55.406611+0000","last_peered":"2023-06-09T04:41:55.406611+0000","last_clean":"2023-06-09T04:41:55.406611+0000","last_became_active":"2023-06-09T04:41:54.406316+0000","last_became_peered":"2023-06-09T04:41:54.406316+0000","last_unstale":"2023-06-09T04:41:55.406611+0000","last_undegraded":"2023-06-09T04:41:55.406611+0000","last_fullsized":"2023-06-09T04:41:55.406611+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:40:08.604981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.873902+0000","last_change":"2023-06-09T04:41:54.405717+0000","last_active":"2023-06-09T04:41:55.873902+0000","last_peered":"2023-06-09T04:41:55.873902+0000","last_clean":"2023-06-09T04:41:55.873902+0000","last_became_active":"2023-06-09T04:41:54.405412+0000","last_became_peered":"2023-06-09T04:41:54.405412+0000","last_unstale":"2023-06-09T04:41:55.873902+0000","last_undegraded":"2023-06-09T04:41:55.873902+0000","last_fullsized":"2023-06-09T04:41:55.873902+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:55:02.127077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.872713+0000","last_change":"2023-06-09T04:41:54.419861+0000","last_active":"2023-06-09T04:41:55.872713+0000","last_peered":"2023-06-09T04:41:55.872713+0000","last_clean":"2023-06-09T04:41:55.872713+0000","last_became_active":"2023-06-09T04:41:54.419404+0000","last_became_peered":"2023-06-09T04:41:54.419404+0000","last_unstale":"2023-06-09T04:41:55.872713+0000","last_undegraded":"2023-06-09T04:41:55.872713+0000","last_fullsized":"2023-06-09T04:41:55.872713+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:46:21.659594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.407159+0000","last_change":"2023-06-09T04:41:54.433128+0000","last_active":"2023-06-09T04:41:55.407159+0000","last_peered":"2023-06-09T04:41:55.407159+0000","last_clean":"2023-06-09T04:41:55.407159+0000","last_became_active":"2023-06-09T04:41:54.432642+0000","last_became_peered":"2023-06-09T04:41:54.432642+0000","last_unstale":"2023-06-09T04:41:55.407159+0000","last_undegraded":"2023-06-09T04:41:55.407159+0000","last_fullsized":"2023-06-09T04:41:55.407159+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:01:41.876981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.873916+0000","last_change":"2023-06-09T04:41:54.416438+0000","last_active":"2023-06-09T04:41:55.873916+0000","last_peered":"2023-06-09T04:41:55.873916+0000","last_clean":"2023-06-09T04:41:55.873916+0000","last_became_active":"2023-06-09T04:41:54.416180+0000","last_became_peered":"2023-06-09T04:41:54.416180+0000","last_unstale":"2023-06-09T04:41:55.873916+0000","last_undegraded":"2023-06-09T04:41:55.873916+0000","last_fullsized":"2023-06-09T04:41:55.873916+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:35:38.355296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.408577+0000","last_change":"2023-06-09T04:41:54.433381+0000","last_active":"2023-06-09T04:41:55.408577+0000","last_peered":"2023-06-09T04:41:55.408577+0000","last_clean":"2023-06-09T04:41:55.408577+0000","last_became_active":"2023-06-09T04:41:54.433196+0000","last_became_peered":"2023-06-09T04:41:54.433196+0000","last_unstale":"2023-06-09T04:41:55.408577+0000","last_undegraded":"2023-06-09T04:41:55.408577+0000","last_fullsized":"2023-06-09T04:41:55.408577+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:20:06.903346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.406837+0000","last_change":"2023-06-09T04:41:54.427593+0000","last_active":"2023-06-09T04:41:55.406837+0000","last_peered":"2023-06-09T04:41:55.406837+0000","last_clean":"2023-06-09T04:41:55.406837+0000","last_became_active":"2023-06-09T04:41:54.427307+0000","last_became_peered":"2023-06-09T04:41:54.427307+0000","last_unstale":"2023-06-09T04:41:55.406837+0000","last_undegraded":"2023-06-09T04:41:55.406837+0000","last_fullsized":"2023-06-09T04:41:55.406837+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:07:19.100918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.408060+0000","last_change":"2023-06-09T04:41:54.436029+0000","last_active":"2023-06-09T04:41:55.408060+0000","last_peered":"2023-06-09T04:41:55.408060+0000","last_clean":"2023-06-09T04:41:55.408060+0000","last_became_active":"2023-06-09T04:41:54.435786+0000","last_became_peered":"2023-06-09T04:41:54.435786+0000","last_unstale":"2023-06-09T04:41:55.408060+0000","last_undegraded":"2023-06-09T04:41:55.408060+0000","last_fullsized":"2023-06-09T04:41:55.408060+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:02:15.067018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.872831+0000","last_change":"2023-06-09T04:41:54.415714+0000","last_active":"2023-06-09T04:41:55.872831+0000","last_peered":"2023-06-09T04:41:55.872831+0000","last_clean":"2023-06-09T04:41:55.872831+0000","last_became_active":"2023-06-09T04:41:54.415422+0000","last_became_peered":"2023-06-09T04:41:54.415422+0000","last_unstale":"2023-06-09T04:41:55.872831+0000","last_undegraded":"2023-06-09T04:41:55.872831+0000","last_fullsized":"2023-06-09T04:41:55.872831+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:44:36.362428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.874142+0000","last_change":"2023-06-09T04:41:54.421187+0000","last_active":"2023-06-09T04:41:55.874142+0000","last_peered":"2023-06-09T04:41:55.874142+0000","last_clean":"2023-06-09T04:41:55.874142+0000","last_became_active":"2023-06-09T04:41:54.420916+0000","last_became_peered":"2023-06-09T04:41:54.420916+0000","last_unstale":"2023-06-09T04:41:55.874142+0000","last_undegraded":"2023-06-09T04:41:55.874142+0000","last_fullsized":"2023-06-09T04:41:55.874142+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:50:09.575767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.654195+0000","last_change":"2023-06-09T04:41:54.413591+0000","last_active":"2023-06-09T04:41:55.654195+0000","last_peered":"2023-06-09T04:41:55.654195+0000","last_clean":"2023-06-09T04:41:55.654195+0000","last_became_active":"2023-06-09T04:41:54.413258+0000","last_became_peered":"2023-06-09T04:41:54.413258+0000","last_unstale":"2023-06-09T04:41:55.654195+0000","last_undegraded":"2023-06-09T04:41:55.654195+0000","last_fullsized":"2023-06-09T04:41:55.654195+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:06:03.696521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.872978+0000","last_change":"2023-06-09T04:41:54.426948+0000","last_active":"2023-06-09T04:41:55.872978+0000","last_peered":"2023-06-09T04:41:55.872978+0000","last_clean":"2023-06-09T04:41:55.872978+0000","last_became_active":"2023-06-09T04:41:54.424537+0000","last_became_peered":"2023-06-09T04:41:54.424537+0000","last_unstale":"2023-06-09T04:41:55.872978+0000","last_undegraded":"2023-06-09T04:41:55.872978+0000","last_fullsized":"2023-06-09T04:41:55.872978+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:02:42.425459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.874331+0000","last_change":"2023-06-09T04:41:54.423154+0000","last_active":"2023-06-09T04:41:55.874331+0000","last_peered":"2023-06-09T04:41:55.874331+0000","last_clean":"2023-06-09T04:41:55.874331+0000","last_became_active":"2023-06-09T04:41:54.422890+0000","last_became_peered":"2023-06-09T04:41:54.422890+0000","last_unstale":"2023-06-09T04:41:55.874331+0000","last_undegraded":"2023-06-09T04:41:55.874331+0000","last_fullsized":"2023-06-09T04:41:55.874331+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:02:15.067018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.874778+0000","last_change":"2023-06-09T04:41:54.411853+0000","last_active":"2023-06-09T04:41:55.874778+0000","last_peered":"2023-06-09T04:41:55.874778+0000","last_clean":"2023-06-09T04:41:55.874778+0000","last_became_active":"2023-06-09T04:41:54.411513+0000","last_became_peered":"2023-06-09T04:41:54.411513+0000","last_unstale":"2023-06-09T04:41:55.874778+0000","last_undegraded":"2023-06-09T04:41:55.874778+0000","last_fullsized":"2023-06-09T04:41:55.874778+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:32:14.262842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.874581+0000","last_change":"2023-06-09T04:41:54.423403+0000","last_active":"2023-06-09T04:41:55.874581+0000","last_peered":"2023-06-09T04:41:55.874581+0000","last_clean":"2023-06-09T04:41:55.874581+0000","last_became_active":"2023-06-09T04:41:54.422935+0000","last_became_peered":"2023-06-09T04:41:54.422935+0000","last_unstale":"2023-06-09T04:41:55.874581+0000","last_undegraded":"2023-06-09T04:41:55.874581+0000","last_fullsized":"2023-06-09T04:41:55.874581+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:50:09.575767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.874025+0000","last_change":"2023-06-09T04:41:54.416963+0000","last_active":"2023-06-09T04:41:55.874025+0000","last_peered":"2023-06-09T04:41:55.874025+0000","last_clean":"2023-06-09T04:41:55.874025+0000","last_became_active":"2023-06-09T04:41:54.416720+0000","last_became_peered":"2023-06-09T04:41:54.416720+0000","last_unstale":"2023-06-09T04:41:55.874025+0000","last_undegraded":"2023-06-09T04:41:55.874025+0000","last_fullsized":"2023-06-09T04:41:55.874025+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:29:47.126124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.654421+0000","last_change":"2023-06-09T04:41:54.425010+0000","last_active":"2023-06-09T04:41:55.654421+0000","last_peered":"2023-06-09T04:41:55.654421+0000","last_clean":"2023-06-09T04:41:55.654421+0000","last_became_active":"2023-06-09T04:41:54.423548+0000","last_became_peered":"2023-06-09T04:41:54.423548+0000","last_unstale":"2023-06-09T04:41:55.654421+0000","last_undegraded":"2023-06-09T04:41:55.654421+0000","last_fullsized":"2023-06-09T04:41:55.654421+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:02:15.067018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.408322+0000","last_change":"2023-06-09T04:41:54.433955+0000","last_active":"2023-06-09T04:41:55.408322+0000","last_peered":"2023-06-09T04:41:55.408322+0000","last_clean":"2023-06-09T04:41:55.408322+0000","last_became_active":"2023-06-09T04:41:54.433402+0000","last_became_peered":"2023-06-09T04:41:54.433402+0000","last_unstale":"2023-06-09T04:41:55.408322+0000","last_undegraded":"2023-06-09T04:41:55.408322+0000","last_fullsized":"2023-06-09T04:41:55.408322+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:46:21.659594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.653882+0000","last_change":"2023-06-09T04:41:54.412120+0000","last_active":"2023-06-09T04:41:55.653882+0000","last_peered":"2023-06-09T04:41:55.653882+0000","last_clean":"2023-06-09T04:41:55.653882+0000","last_became_active":"2023-06-09T04:41:54.411844+0000","last_became_peered":"2023-06-09T04:41:54.411844+0000","last_unstale":"2023-06-09T04:41:55.653882+0000","last_undegraded":"2023-06-09T04:41:55.653882+0000","last_fullsized":"2023-06-09T04:41:55.653882+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:02:24.420270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.406356+0000","last_change":"2023-06-09T04:41:54.429251+0000","last_active":"2023-06-09T04:41:55.406356+0000","last_peered":"2023-06-09T04:41:55.406356+0000","last_clean":"2023-06-09T04:41:55.406356+0000","last_became_active":"2023-06-09T04:41:54.428359+0000","last_became_peered":"2023-06-09T04:41:54.428359+0000","last_unstale":"2023-06-09T04:41:55.406356+0000","last_undegraded":"2023-06-09T04:41:55.406356+0000","last_fullsized":"2023-06-09T04:41:55.406356+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:11:53.056966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.654119+0000","last_change":"2023-06-09T04:41:54.429333+0000","last_active":"2023-06-09T04:41:55.654119+0000","last_peered":"2023-06-09T04:41:55.654119+0000","last_clean":"2023-06-09T04:41:55.654119+0000","last_became_active":"2023-06-09T04:41:54.428962+0000","last_became_peered":"2023-06-09T04:41:54.428962+0000","last_unstale":"2023-06-09T04:41:55.654119+0000","last_undegraded":"2023-06-09T04:41:55.654119+0000","last_fullsized":"2023-06-09T04:41:55.654119+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:03:22.727998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"23'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.873117+0000","last_change":"2023-06-09T04:41:53.950213+0000","last_active":"2023-06-09T04:41:55.873117+0000","last_peered":"2023-06-09T04:41:55.873117+0000","last_clean":"2023-06-09T04:41:55.873117+0000","last_became_active":"2023-06-09T04:41:53.949956+0000","last_became_peered":"2023-06-09T04:41:53.949956+0000","last_unstale":"2023-06-09T04:41:55.873117+0000","last_undegraded":"2023-06-09T04:41:55.873117+0000","last_fullsized":"2023-06-09T04:41:55.873117+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_clean_scrub_stamp":"2023-06-09T04:41:52.888143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:20:05.889342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.874763+0000","last_change":"2023-06-09T04:41:54.423233+0000","last_active":"2023-06-09T04:41:55.874763+0000","last_peered":"2023-06-09T04:41:55.874763+0000","last_clean":"2023-06-09T04:41:55.874763+0000","last_became_active":"2023-06-09T04:41:54.422587+0000","last_became_peered":"2023-06-09T04:41:54.422587+0000","last_unstale":"2023-06-09T04:41:55.874763+0000","last_undegraded":"2023-06-09T04:41:55.874763+0000","last_fullsized":"2023-06-09T04:41:55.874763+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:01:04.929884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.874374+0000","last_change":"2023-06-09T04:41:53.944320+0000","last_active":"2023-06-09T04:41:55.874374+0000","last_peered":"2023-06-09T04:41:55.874374+0000","last_clean":"2023-06-09T04:41:55.874374+0000","last_became_active":"2023-06-09T04:41:53.944039+0000","last_became_peered":"2023-06-09T04:41:53.944039+0000","last_unstale":"2023-06-09T04:41:55.874374+0000","last_undegraded":"2023-06-09T04:41:55.874374+0000","last_fullsized":"2023-06-09T04:41:55.874374+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_clean_scrub_stamp":"2023-06-09T04:41:52.888143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:32:13.248839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.873809+0000","last_change":"2023-06-09T04:41:54.417754+0000","last_active":"2023-06-09T04:41:55.873809+0000","last_peered":"2023-06-09T04:41:55.873809+0000","last_clean":"2023-06-09T04:41:55.873809+0000","last_became_active":"2023-06-09T04:41:54.417462+0000","last_became_peered":"2023-06-09T04:41:54.417462+0000","last_unstale":"2023-06-09T04:41:55.873809+0000","last_undegraded":"2023-06-09T04:41:55.873809+0000","last_fullsized":"2023-06-09T04:41:55.873809+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:06:03.696521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.872806+0000","last_change":"2023-06-09T04:41:53.950199+0000","last_active":"2023-06-09T04:41:55.872806+0000","last_peered":"2023-06-09T04:41:55.872806+0000","last_clean":"2023-06-09T04:41:55.872806+0000","last_became_active":"2023-06-09T04:41:53.949846+0000","last_became_peered":"2023-06-09T04:41:53.949846+0000","last_unstale":"2023-06-09T04:41:55.872806+0000","last_undegraded":"2023-06-09T04:41:55.872806+0000","last_fullsized":"2023-06-09T04:41:55.872806+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_clean_scrub_stamp":"2023-06-09T04:41:52.888143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:37:16.212704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.654767+0000","last_change":"2023-06-09T04:41:54.423952+0000","last_active":"2023-06-09T04:41:55.654767+0000","last_peered":"2023-06-09T04:41:55.654767+0000","last_clean":"2023-06-09T04:41:55.654767+0000","last_became_active":"2023-06-09T04:41:54.423601+0000","last_became_peered":"2023-06-09T04:41:54.423601+0000","last_unstale":"2023-06-09T04:41:55.654767+0000","last_undegraded":"2023-06-09T04:41:55.654767+0000","last_fullsized":"2023-06-09T04:41:55.654767+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:46:21.659594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"23'8","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.406561+0000","last_change":"2023-06-09T04:41:53.945735+0000","last_active":"2023-06-09T04:41:55.406561+0000","last_peered":"2023-06-09T04:41:55.406561+0000","last_clean":"2023-06-09T04:41:55.406561+0000","last_became_active":"2023-06-09T04:41:53.945260+0000","last_became_peered":"2023-06-09T04:41:53.945260+0000","last_unstale":"2023-06-09T04:41:55.406561+0000","last_undegraded":"2023-06-09T04:41:55.406561+0000","last_fullsized":"2023-06-09T04:41:55.406561+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_clean_scrub_stamp":"2023-06-09T04:41:52.888143+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:48:52.910038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"23'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.873690+0000","last_change":"2023-06-09T04:41:53.950178+0000","last_active":"2023-06-09T04:41:55.873690+0000","last_peered":"2023-06-09T04:41:55.873690+0000","last_clean":"2023-06-09T04:41:55.873690+0000","last_became_active":"2023-06-09T04:41:53.949874+0000","last_became_peered":"2023-06-09T04:41:53.949874+0000","last_unstale":"2023-06-09T04:41:55.873690+0000","last_undegraded":"2023-06-09T04:41:55.873690+0000","last_fullsized":"2023-06-09T04:41:55.873690+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_clean_scrub_stamp":"2023-06-09T04:41:52.888143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:14:18.414303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.873991+0000","last_change":"2023-06-09T04:41:54.421270+0000","last_active":"2023-06-09T04:41:55.873991+0000","last_peered":"2023-06-09T04:41:55.873991+0000","last_clean":"2023-06-09T04:41:55.873991+0000","last_became_active":"2023-06-09T04:41:54.421019+0000","last_became_peered":"2023-06-09T04:41:54.421019+0000","last_unstale":"2023-06-09T04:41:55.873991+0000","last_undegraded":"2023-06-09T04:41:55.873991+0000","last_fullsized":"2023-06-09T04:41:55.873991+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:29:47.126124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"23'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.873655+0000","last_change":"2023-06-09T04:41:53.951880+0000","last_active":"2023-06-09T04:41:55.873655+0000","last_peered":"2023-06-09T04:41:55.873655+0000","last_clean":"2023-06-09T04:41:55.873655+0000","last_became_active":"2023-06-09T04:41:53.951460+0000","last_became_peered":"2023-06-09T04:41:53.951460+0000","last_unstale":"2023-06-09T04:41:55.873655+0000","last_undegraded":"2023-06-09T04:41:55.873655+0000","last_fullsized":"2023-06-09T04:41:55.873655+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_clean_scrub_stamp":"2023-06-09T04:41:52.888143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:35:48.907156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.407368+0000","last_change":"2023-06-09T04:41:54.432752+0000","last_active":"2023-06-09T04:41:55.407368+0000","last_peered":"2023-06-09T04:41:55.407368+0000","last_clean":"2023-06-09T04:41:55.407368+0000","last_became_active":"2023-06-09T04:41:54.432341+0000","last_became_peered":"2023-06-09T04:41:54.432341+0000","last_unstale":"2023-06-09T04:41:55.407368+0000","last_undegraded":"2023-06-09T04:41:55.407368+0000","last_fullsized":"2023-06-09T04:41:55.407368+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:02:24.420270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"23'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.873267+0000","last_change":"2023-06-09T04:41:53.943033+0000","last_active":"2023-06-09T04:41:55.873267+0000","last_peered":"2023-06-09T04:41:55.873267+0000","last_clean":"2023-06-09T04:41:55.873267+0000","last_became_active":"2023-06-09T04:41:53.942705+0000","last_became_peered":"2023-06-09T04:41:53.942705+0000","last_unstale":"2023-06-09T04:41:55.873267+0000","last_undegraded":"2023-06-09T04:41:55.873267+0000","last_fullsized":"2023-06-09T04:41:55.873267+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_clean_scrub_stamp":"2023-06-09T04:41:52.888143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:07:18.392407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.406357+0000","last_change":"2023-06-09T04:41:54.423994+0000","last_active":"2023-06-09T04:41:55.406357+0000","last_peered":"2023-06-09T04:41:55.406357+0000","last_clean":"2023-06-09T04:41:55.406357+0000","last_became_active":"2023-06-09T04:41:54.423563+0000","last_became_peered":"2023-06-09T04:41:54.423563+0000","last_unstale":"2023-06-09T04:41:55.406357+0000","last_undegraded":"2023-06-09T04:41:55.406357+0000","last_fullsized":"2023-06-09T04:41:55.406357+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:57:36.919960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.874564+0000","last_change":"2023-06-09T04:41:53.943463+0000","last_active":"2023-06-09T04:41:55.874564+0000","last_peered":"2023-06-09T04:41:55.874564+0000","last_clean":"2023-06-09T04:41:55.874564+0000","last_became_active":"2023-06-09T04:41:53.943156+0000","last_became_peered":"2023-06-09T04:41:53.943156+0000","last_unstale":"2023-06-09T04:41:55.874564+0000","last_undegraded":"2023-06-09T04:41:55.874564+0000","last_fullsized":"2023-06-09T04:41:55.874564+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_clean_scrub_stamp":"2023-06-09T04:41:52.888143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:48:33.879868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.872666+0000","last_change":"2023-06-09T04:41:54.421050+0000","last_active":"2023-06-09T04:41:55.872666+0000","last_peered":"2023-06-09T04:41:55.872666+0000","last_clean":"2023-06-09T04:41:55.872666+0000","last_became_active":"2023-06-09T04:41:54.420683+0000","last_became_peered":"2023-06-09T04:41:54.420683+0000","last_unstale":"2023-06-09T04:41:55.872666+0000","last_undegraded":"2023-06-09T04:41:55.872666+0000","last_fullsized":"2023-06-09T04:41:55.872666+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:01:41.876981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"23'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.654774+0000","last_change":"2023-06-09T04:41:53.946942+0000","last_active":"2023-06-09T04:41:55.654774+0000","last_peered":"2023-06-09T04:41:55.654774+0000","last_clean":"2023-06-09T04:41:55.654774+0000","last_became_active":"2023-06-09T04:41:53.946653+0000","last_became_peered":"2023-06-09T04:41:53.946653+0000","last_unstale":"2023-06-09T04:41:55.654774+0000","last_undegraded":"2023-06-09T04:41:55.654774+0000","last_fullsized":"2023-06-09T04:41:55.654774+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_clean_scrub_stamp":"2023-06-09T04:41:52.888143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:01:03.915881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.408152+0000","last_change":"2023-06-09T04:41:54.435489+0000","last_active":"2023-06-09T04:41:55.408152+0000","last_peered":"2023-06-09T04:41:55.408152+0000","last_clean":"2023-06-09T04:41:55.408152+0000","last_became_active":"2023-06-09T04:41:54.435221+0000","last_became_peered":"2023-06-09T04:41:54.435221+0000","last_unstale":"2023-06-09T04:41:55.408152+0000","last_undegraded":"2023-06-09T04:41:55.408152+0000","last_fullsized":"2023-06-09T04:41:55.408152+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:32:14.262842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.406707+0000","last_change":"2023-06-09T04:41:53.949739+0000","last_active":"2023-06-09T04:41:55.406707+0000","last_peered":"2023-06-09T04:41:55.406707+0000","last_clean":"2023-06-09T04:41:55.406707+0000","last_became_active":"2023-06-09T04:41:53.949424+0000","last_became_peered":"2023-06-09T04:41:53.949424+0000","last_unstale":"2023-06-09T04:41:55.406707+0000","last_undegraded":"2023-06-09T04:41:55.406707+0000","last_fullsized":"2023-06-09T04:41:55.406707+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_clean_scrub_stamp":"2023-06-09T04:41:52.888143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T04:56:37.643976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.408495+0000","last_change":"2023-06-09T04:41:54.432641+0000","last_active":"2023-06-09T04:41:55.408495+0000","last_peered":"2023-06-09T04:41:55.408495+0000","last_clean":"2023-06-09T04:41:55.408495+0000","last_became_active":"2023-06-09T04:41:54.432274+0000","last_became_peered":"2023-06-09T04:41:54.432274+0000","last_unstale":"2023-06-09T04:41:55.408495+0000","last_undegraded":"2023-06-09T04:41:55.408495+0000","last_fullsized":"2023-06-09T04:41:55.408495+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:02:42.425459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.408131+0000","last_change":"2023-06-09T04:41:53.941677+0000","last_active":"2023-06-09T04:41:55.408131+0000","last_peered":"2023-06-09T04:41:55.408131+0000","last_clean":"2023-06-09T04:41:55.408131+0000","last_became_active":"2023-06-09T04:41:53.940978+0000","last_became_peered":"2023-06-09T04:41:53.940978+0000","last_unstale":"2023-06-09T04:41:55.408131+0000","last_undegraded":"2023-06-09T04:41:55.408131+0000","last_fullsized":"2023-06-09T04:41:55.408131+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_clean_scrub_stamp":"2023-06-09T04:41:52.888143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:48:33.879868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.408415+0000","last_change":"2023-06-09T04:41:54.432635+0000","last_active":"2023-06-09T04:41:55.408415+0000","last_peered":"2023-06-09T04:41:55.408415+0000","last_clean":"2023-06-09T04:41:55.408415+0000","last_became_active":"2023-06-09T04:41:54.432242+0000","last_became_peered":"2023-06-09T04:41:54.432242+0000","last_unstale":"2023-06-09T04:41:55.408415+0000","last_undegraded":"2023-06-09T04:41:55.408415+0000","last_fullsized":"2023-06-09T04:41:55.408415+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:03:50.071570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.654432+0000","last_change":"2023-06-09T04:41:53.946859+0000","last_active":"2023-06-09T04:41:55.654432+0000","last_peered":"2023-06-09T04:41:55.654432+0000","last_clean":"2023-06-09T04:41:55.654432+0000","last_became_active":"2023-06-09T04:41:53.946579+0000","last_became_peered":"2023-06-09T04:41:53.946579+0000","last_unstale":"2023-06-09T04:41:55.654432+0000","last_undegraded":"2023-06-09T04:41:55.654432+0000","last_fullsized":"2023-06-09T04:41:55.654432+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_clean_scrub_stamp":"2023-06-09T04:41:52.888143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:48:33.879868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.874463+0000","last_change":"2023-06-09T04:41:54.412726+0000","last_active":"2023-06-09T04:41:55.874463+0000","last_peered":"2023-06-09T04:41:55.874463+0000","last_clean":"2023-06-09T04:41:55.874463+0000","last_became_active":"2023-06-09T04:41:54.410016+0000","last_became_peered":"2023-06-09T04:41:54.410016+0000","last_unstale":"2023-06-09T04:41:55.874463+0000","last_undegraded":"2023-06-09T04:41:55.874463+0000","last_fullsized":"2023-06-09T04:41:55.874463+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:48:34.893871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":175,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.872709+0000","last_change":"2023-06-09T04:41:43.997052+0000","last_active":"2023-06-09T04:41:55.872709+0000","last_peered":"2023-06-09T04:41:55.872709+0000","last_clean":"2023-06-09T04:41:55.872709+0000","last_became_active":"2023-06-09T04:41:43.993827+0000","last_became_peered":"2023-06-09T04:41:43.993827+0000","last_unstale":"2023-06-09T04:41:55.872709+0000","last_undegraded":"2023-06-09T04:41:55.872709+0000","last_fullsized":"2023-06-09T04:41:55.872709+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:42.777858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:42.777858+0000","last_clean_scrub_stamp":"2023-06-09T04:41:42.777858+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:03:38.947282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.874488+0000","last_change":"2023-06-09T04:41:48.873288+0000","last_active":"2023-06-09T04:41:55.874488+0000","last_peered":"2023-06-09T04:41:55.874488+0000","last_clean":"2023-06-09T04:41:55.874488+0000","last_became_active":"2023-06-09T04:41:48.872659+0000","last_became_peered":"2023-06-09T04:41:48.872659+0000","last_unstale":"2023-06-09T04:41:55.874488+0000","last_undegraded":"2023-06-09T04:41:55.874488+0000","last_fullsized":"2023-06-09T04:41:55.874488+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:47.838489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:47.838489+0000","last_clean_scrub_stamp":"2023-06-09T04:41:47.838489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:32:08.199185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.653752+0000","last_change":"2023-06-09T04:41:53.936424+0000","last_active":"2023-06-09T04:41:55.653752+0000","last_peered":"2023-06-09T04:41:55.653752+0000","last_clean":"2023-06-09T04:41:55.653752+0000","last_became_active":"2023-06-09T04:41:53.935818+0000","last_became_peered":"2023-06-09T04:41:53.935818+0000","last_unstale":"2023-06-09T04:41:55.653752+0000","last_undegraded":"2023-06-09T04:41:55.653752+0000","last_fullsized":"2023-06-09T04:41:55.653752+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_clean_scrub_stamp":"2023-06-09T04:41:52.888143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:01:40.862978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.406643+0000","last_change":"2023-06-09T04:41:54.435480+0000","last_active":"2023-06-09T04:41:55.406643+0000","last_peered":"2023-06-09T04:41:55.406643+0000","last_clean":"2023-06-09T04:41:55.406643+0000","last_became_active":"2023-06-09T04:41:54.435108+0000","last_became_peered":"2023-06-09T04:41:54.435108+0000","last_unstale":"2023-06-09T04:41:55.406643+0000","last_undegraded":"2023-06-09T04:41:55.406643+0000","last_fullsized":"2023-06-09T04:41:55.406643+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:23:54.068246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.872386+0000","last_change":"2023-06-09T04:41:48.880106+0000","last_active":"2023-06-09T04:41:55.872386+0000","last_peered":"2023-06-09T04:41:55.872386+0000","last_clean":"2023-06-09T04:41:55.872386+0000","last_became_active":"2023-06-09T04:41:48.879669+0000","last_became_peered":"2023-06-09T04:41:48.879669+0000","last_unstale":"2023-06-09T04:41:55.872386+0000","last_undegraded":"2023-06-09T04:41:55.872386+0000","last_fullsized":"2023-06-09T04:41:55.872386+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:47.838489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:47.838489+0000","last_clean_scrub_stamp":"2023-06-09T04:41:47.838489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:32:08.199185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.872214+0000","last_change":"2023-06-09T04:41:53.950810+0000","last_active":"2023-06-09T04:41:55.872214+0000","last_peered":"2023-06-09T04:41:55.872214+0000","last_clean":"2023-06-09T04:41:55.872214+0000","last_became_active":"2023-06-09T04:41:53.950443+0000","last_became_peered":"2023-06-09T04:41:53.950443+0000","last_unstale":"2023-06-09T04:41:55.872214+0000","last_undegraded":"2023-06-09T04:41:55.872214+0000","last_fullsized":"2023-06-09T04:41:55.872214+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_clean_scrub_stamp":"2023-06-09T04:41:52.888143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:02:21.285375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.873507+0000","last_change":"2023-06-09T04:41:54.424529+0000","last_active":"2023-06-09T04:41:55.873507+0000","last_peered":"2023-06-09T04:41:55.873507+0000","last_clean":"2023-06-09T04:41:55.873507+0000","last_became_active":"2023-06-09T04:41:54.424272+0000","last_became_peered":"2023-06-09T04:41:54.424272+0000","last_unstale":"2023-06-09T04:41:55.873507+0000","last_undegraded":"2023-06-09T04:41:55.873507+0000","last_fullsized":"2023-06-09T04:41:55.873507+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:03:22.727998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.406445+0000","last_change":"2023-06-09T04:41:48.966313+0000","last_active":"2023-06-09T04:41:55.406445+0000","last_peered":"2023-06-09T04:41:55.406445+0000","last_clean":"2023-06-09T04:41:55.406445+0000","last_became_active":"2023-06-09T04:41:48.965659+0000","last_became_peered":"2023-06-09T04:41:48.965659+0000","last_unstale":"2023-06-09T04:41:55.406445+0000","last_undegraded":"2023-06-09T04:41:55.406445+0000","last_fullsized":"2023-06-09T04:41:55.406445+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:47.838489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:47.838489+0000","last_clean_scrub_stamp":"2023-06-09T04:41:47.838489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:46:50.802354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.872660+0000","last_change":"2023-06-09T04:41:53.938212+0000","last_active":"2023-06-09T04:41:55.872660+0000","last_peered":"2023-06-09T04:41:55.872660+0000","last_clean":"2023-06-09T04:41:55.872660+0000","last_became_active":"2023-06-09T04:41:53.937944+0000","last_became_peered":"2023-06-09T04:41:53.937944+0000","last_unstale":"2023-06-09T04:41:55.872660+0000","last_undegraded":"2023-06-09T04:41:55.872660+0000","last_fullsized":"2023-06-09T04:41:55.872660+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_clean_scrub_stamp":"2023-06-09T04:41:52.888143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:37:52.478621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.874512+0000","last_change":"2023-06-09T04:41:54.419815+0000","last_active":"2023-06-09T04:41:55.874512+0000","last_peered":"2023-06-09T04:41:55.874512+0000","last_clean":"2023-06-09T04:41:55.874512+0000","last_became_active":"2023-06-09T04:41:54.419519+0000","last_became_peered":"2023-06-09T04:41:54.419519+0000","last_unstale":"2023-06-09T04:41:55.874512+0000","last_undegraded":"2023-06-09T04:41:55.874512+0000","last_fullsized":"2023-06-09T04:41:55.874512+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:50:09.575767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.873799+0000","last_change":"2023-06-09T04:41:48.873002+0000","last_active":"2023-06-09T04:41:55.873799+0000","last_peered":"2023-06-09T04:41:55.873799+0000","last_clean":"2023-06-09T04:41:55.873799+0000","last_became_active":"2023-06-09T04:41:48.872455+0000","last_became_peered":"2023-06-09T04:41:48.872455+0000","last_unstale":"2023-06-09T04:41:55.873799+0000","last_undegraded":"2023-06-09T04:41:55.873799+0000","last_fullsized":"2023-06-09T04:41:55.873799+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:47.838489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:47.838489+0000","last_clean_scrub_stamp":"2023-06-09T04:41:47.838489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:05:57.632864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.408311+0000","last_change":"2023-06-09T04:41:53.947015+0000","last_active":"2023-06-09T04:41:55.408311+0000","last_peered":"2023-06-09T04:41:55.408311+0000","last_clean":"2023-06-09T04:41:55.408311+0000","last_became_active":"2023-06-09T04:41:53.946714+0000","last_became_peered":"2023-06-09T04:41:53.946714+0000","last_unstale":"2023-06-09T04:41:55.408311+0000","last_undegraded":"2023-06-09T04:41:55.408311+0000","last_fullsized":"2023-06-09T04:41:55.408311+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_clean_scrub_stamp":"2023-06-09T04:41:52.888143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:01:03.915881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.873441+0000","last_change":"2023-06-09T04:41:54.411876+0000","last_active":"2023-06-09T04:41:55.873441+0000","last_peered":"2023-06-09T04:41:55.873441+0000","last_clean":"2023-06-09T04:41:55.873441+0000","last_became_active":"2023-06-09T04:41:54.411566+0000","last_became_peered":"2023-06-09T04:41:54.411566+0000","last_unstale":"2023-06-09T04:41:55.873441+0000","last_undegraded":"2023-06-09T04:41:55.873441+0000","last_fullsized":"2023-06-09T04:41:55.873441+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:02:24.420270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.874856+0000","last_change":"2023-06-09T04:41:53.936340+0000","last_active":"2023-06-09T04:41:55.874856+0000","last_peered":"2023-06-09T04:41:55.874856+0000","last_clean":"2023-06-09T04:41:55.874856+0000","last_became_active":"2023-06-09T04:41:53.936055+0000","last_became_peered":"2023-06-09T04:41:53.936055+0000","last_unstale":"2023-06-09T04:41:55.874856+0000","last_undegraded":"2023-06-09T04:41:55.874856+0000","last_fullsized":"2023-06-09T04:41:55.874856+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_clean_scrub_stamp":"2023-06-09T04:41:52.888143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:37:16.212704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.874174+0000","last_change":"2023-06-09T04:41:48.978389+0000","last_active":"2023-06-09T04:41:55.874174+0000","last_peered":"2023-06-09T04:41:55.874174+0000","last_clean":"2023-06-09T04:41:55.874174+0000","last_became_active":"2023-06-09T04:41:48.978021+0000","last_became_peered":"2023-06-09T04:41:48.978021+0000","last_unstale":"2023-06-09T04:41:55.874174+0000","last_undegraded":"2023-06-09T04:41:55.874174+0000","last_fullsized":"2023-06-09T04:41:55.874174+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:47.838489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:47.838489+0000","last_clean_scrub_stamp":"2023-06-09T04:41:47.838489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:35:32.291639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.873862+0000","last_change":"2023-06-09T04:41:54.419307+0000","last_active":"2023-06-09T04:41:55.873862+0000","last_peered":"2023-06-09T04:41:55.873862+0000","last_clean":"2023-06-09T04:41:55.873862+0000","last_became_active":"2023-06-09T04:41:54.419053+0000","last_became_peered":"2023-06-09T04:41:54.419053+0000","last_unstale":"2023-06-09T04:41:55.873862+0000","last_undegraded":"2023-06-09T04:41:55.873862+0000","last_fullsized":"2023-06-09T04:41:55.873862+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:06:03.696521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.873723+0000","last_change":"2023-06-09T04:41:53.939038+0000","last_active":"2023-06-09T04:41:55.873723+0000","last_peered":"2023-06-09T04:41:55.873723+0000","last_clean":"2023-06-09T04:41:55.873723+0000","last_became_active":"2023-06-09T04:41:53.938781+0000","last_became_peered":"2023-06-09T04:41:53.938781+0000","last_unstale":"2023-06-09T04:41:55.873723+0000","last_undegraded":"2023-06-09T04:41:55.873723+0000","last_fullsized":"2023-06-09T04:41:55.873723+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_clean_scrub_stamp":"2023-06-09T04:41:52.888143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:55:01.113074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.873352+0000","last_change":"2023-06-09T04:41:48.978235+0000","last_active":"2023-06-09T04:41:55.873352+0000","last_peered":"2023-06-09T04:41:55.873352+0000","last_clean":"2023-06-09T04:41:55.873352+0000","last_became_active":"2023-06-09T04:41:48.977568+0000","last_became_peered":"2023-06-09T04:41:48.977568+0000","last_unstale":"2023-06-09T04:41:55.873352+0000","last_undegraded":"2023-06-09T04:41:55.873352+0000","last_fullsized":"2023-06-09T04:41:55.873352+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:47.838489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:47.838489+0000","last_clean_scrub_stamp":"2023-06-09T04:41:47.838489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:32:35.516622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.872976+0000","last_change":"2023-06-09T04:41:54.422440+0000","last_active":"2023-06-09T04:41:55.872976+0000","last_peered":"2023-06-09T04:41:55.872976+0000","last_clean":"2023-06-09T04:41:55.872976+0000","last_became_active":"2023-06-09T04:41:54.421701+0000","last_became_peered":"2023-06-09T04:41:54.421701+0000","last_unstale":"2023-06-09T04:41:55.872976+0000","last_undegraded":"2023-06-09T04:41:55.872976+0000","last_fullsized":"2023-06-09T04:41:55.872976+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:37:53.492624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"23'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.654758+0000","last_change":"2023-06-09T04:41:53.943578+0000","last_active":"2023-06-09T04:41:55.654758+0000","last_peered":"2023-06-09T04:41:55.654758+0000","last_clean":"2023-06-09T04:41:55.654758+0000","last_became_active":"2023-06-09T04:41:53.943305+0000","last_became_peered":"2023-06-09T04:41:53.943305+0000","last_unstale":"2023-06-09T04:41:55.654758+0000","last_undegraded":"2023-06-09T04:41:55.654758+0000","last_fullsized":"2023-06-09T04:41:55.654758+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_clean_scrub_stamp":"2023-06-09T04:41:52.888143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:32:13.248839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.874764+0000","last_change":"2023-06-09T04:41:48.877786+0000","last_active":"2023-06-09T04:41:55.874764+0000","last_peered":"2023-06-09T04:41:55.874764+0000","last_clean":"2023-06-09T04:41:55.874764+0000","last_became_active":"2023-06-09T04:41:48.877370+0000","last_became_peered":"2023-06-09T04:41:48.877370+0000","last_unstale":"2023-06-09T04:41:55.874764+0000","last_undegraded":"2023-06-09T04:41:55.874764+0000","last_fullsized":"2023-06-09T04:41:55.874764+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:47.838489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:47.838489+0000","last_clean_scrub_stamp":"2023-06-09T04:41:47.838489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:46:15.595937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.653828+0000","last_change":"2023-06-09T04:41:54.424286+0000","last_active":"2023-06-09T04:41:55.653828+0000","last_peered":"2023-06-09T04:41:55.653828+0000","last_clean":"2023-06-09T04:41:55.653828+0000","last_became_active":"2023-06-09T04:41:54.424012+0000","last_became_peered":"2023-06-09T04:41:54.424012+0000","last_unstale":"2023-06-09T04:41:55.653828+0000","last_undegraded":"2023-06-09T04:41:55.653828+0000","last_fullsized":"2023-06-09T04:41:55.653828+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:37:53.492624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.874088+0000","last_change":"2023-06-09T04:41:53.947520+0000","last_active":"2023-06-09T04:41:55.874088+0000","last_peered":"2023-06-09T04:41:55.874088+0000","last_clean":"2023-06-09T04:41:55.874088+0000","last_became_active":"2023-06-09T04:41:53.947160+0000","last_became_peered":"2023-06-09T04:41:53.947160+0000","last_unstale":"2023-06-09T04:41:55.874088+0000","last_undegraded":"2023-06-09T04:41:55.874088+0000","last_fullsized":"2023-06-09T04:41:55.874088+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_clean_scrub_stamp":"2023-06-09T04:41:52.888143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:02:14.053015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.407151+0000","last_change":"2023-06-09T04:41:48.880094+0000","last_active":"2023-06-09T04:41:55.407151+0000","last_peered":"2023-06-09T04:41:55.407151+0000","last_clean":"2023-06-09T04:41:55.407151+0000","last_became_active":"2023-06-09T04:41:48.879506+0000","last_became_peered":"2023-06-09T04:41:48.879506+0000","last_unstale":"2023-06-09T04:41:55.407151+0000","last_undegraded":"2023-06-09T04:41:55.407151+0000","last_fullsized":"2023-06-09T04:41:55.407151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:47.838489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:47.838489+0000","last_clean_scrub_stamp":"2023-06-09T04:41:47.838489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:59:58.200203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.407606+0000","last_change":"2023-06-09T04:41:54.426906+0000","last_active":"2023-06-09T04:41:55.407606+0000","last_peered":"2023-06-09T04:41:55.407606+0000","last_clean":"2023-06-09T04:41:55.407606+0000","last_became_active":"2023-06-09T04:41:54.426543+0000","last_became_peered":"2023-06-09T04:41:54.426543+0000","last_unstale":"2023-06-09T04:41:55.407606+0000","last_undegraded":"2023-06-09T04:41:55.407606+0000","last_fullsized":"2023-06-09T04:41:55.407606+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:34:10.329381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.408027+0000","last_change":"2023-06-09T04:41:54.425437+0000","last_active":"2023-06-09T04:41:55.408027+0000","last_peered":"2023-06-09T04:41:55.408027+0000","last_clean":"2023-06-09T04:41:55.408027+0000","last_became_active":"2023-06-09T04:41:54.425093+0000","last_became_peered":"2023-06-09T04:41:54.425093+0000","last_unstale":"2023-06-09T04:41:55.408027+0000","last_undegraded":"2023-06-09T04:41:55.408027+0000","last_fullsized":"2023-06-09T04:41:55.408027+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:35:38.355296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"23'6","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.408353+0000","last_change":"2023-06-09T04:41:53.946445+0000","last_active":"2023-06-09T04:41:55.408353+0000","last_peered":"2023-06-09T04:41:55.408353+0000","last_clean":"2023-06-09T04:41:55.408353+0000","last_became_active":"2023-06-09T04:41:53.942330+0000","last_became_peered":"2023-06-09T04:41:53.942330+0000","last_unstale":"2023-06-09T04:41:55.408353+0000","last_undegraded":"2023-06-09T04:41:55.408353+0000","last_fullsized":"2023-06-09T04:41:55.408353+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_clean_scrub_stamp":"2023-06-09T04:41:52.888143+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:37:16.212704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.873568+0000","last_change":"2023-06-09T04:41:54.423048+0000","last_active":"2023-06-09T04:41:55.873568+0000","last_peered":"2023-06-09T04:41:55.873568+0000","last_clean":"2023-06-09T04:41:55.873568+0000","last_became_active":"2023-06-09T04:41:54.422813+0000","last_became_peered":"2023-06-09T04:41:54.422813+0000","last_unstale":"2023-06-09T04:41:55.873568+0000","last_undegraded":"2023-06-09T04:41:55.873568+0000","last_fullsized":"2023-06-09T04:41:55.873568+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:34:10.329381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"23'3","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.872749+0000","last_change":"2023-06-09T04:41:53.947478+0000","last_active":"2023-06-09T04:41:55.872749+0000","last_peered":"2023-06-09T04:41:55.872749+0000","last_clean":"2023-06-09T04:41:55.872749+0000","last_became_active":"2023-06-09T04:41:53.947126+0000","last_became_peered":"2023-06-09T04:41:53.947126+0000","last_unstale":"2023-06-09T04:41:55.872749+0000","last_undegraded":"2023-06-09T04:41:55.872749+0000","last_fullsized":"2023-06-09T04:41:55.872749+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_clean_scrub_stamp":"2023-06-09T04:41:52.888143+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:01:03.915881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.874913+0000","last_change":"2023-06-09T04:41:53.943073+0000","last_active":"2023-06-09T04:41:55.874913+0000","last_peered":"2023-06-09T04:41:55.874913+0000","last_clean":"2023-06-09T04:41:55.874913+0000","last_became_active":"2023-06-09T04:41:53.942802+0000","last_became_peered":"2023-06-09T04:41:53.942802+0000","last_unstale":"2023-06-09T04:41:55.874913+0000","last_undegraded":"2023-06-09T04:41:55.874913+0000","last_fullsized":"2023-06-09T04:41:55.874913+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_clean_scrub_stamp":"2023-06-09T04:41:52.888143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:44:35.348425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.654252+0000","last_change":"2023-06-09T04:41:54.424894+0000","last_active":"2023-06-09T04:41:55.654252+0000","last_peered":"2023-06-09T04:41:55.654252+0000","last_clean":"2023-06-09T04:41:55.654252+0000","last_became_active":"2023-06-09T04:41:54.423546+0000","last_became_peered":"2023-06-09T04:41:54.423546+0000","last_unstale":"2023-06-09T04:41:55.654252+0000","last_undegraded":"2023-06-09T04:41:55.654252+0000","last_fullsized":"2023-06-09T04:41:55.654252+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:29:47.126124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.874732+0000","last_change":"2023-06-09T04:41:53.945046+0000","last_active":"2023-06-09T04:41:55.874732+0000","last_peered":"2023-06-09T04:41:55.874732+0000","last_clean":"2023-06-09T04:41:55.874732+0000","last_became_active":"2023-06-09T04:41:53.944775+0000","last_became_peered":"2023-06-09T04:41:53.944775+0000","last_unstale":"2023-06-09T04:41:55.874732+0000","last_undegraded":"2023-06-09T04:41:55.874732+0000","last_fullsized":"2023-06-09T04:41:55.874732+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_clean_scrub_stamp":"2023-06-09T04:41:52.888143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:46:20.645591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.653741+0000","last_change":"2023-06-09T04:41:54.412545+0000","last_active":"2023-06-09T04:41:55.653741+0000","last_peered":"2023-06-09T04:41:55.653741+0000","last_clean":"2023-06-09T04:41:55.653741+0000","last_became_active":"2023-06-09T04:41:54.412243+0000","last_became_peered":"2023-06-09T04:41:54.412243+0000","last_unstale":"2023-06-09T04:41:55.653741+0000","last_undegraded":"2023-06-09T04:41:55.653741+0000","last_fullsized":"2023-06-09T04:41:55.653741+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:02:22.299378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.406954+0000","last_change":"2023-06-09T04:41:54.424839+0000","last_active":"2023-06-09T04:41:55.406954+0000","last_peered":"2023-06-09T04:41:55.406954+0000","last_clean":"2023-06-09T04:41:55.406954+0000","last_became_active":"2023-06-09T04:41:54.424393+0000","last_became_peered":"2023-06-09T04:41:54.424393+0000","last_unstale":"2023-06-09T04:41:55.406954+0000","last_undegraded":"2023-06-09T04:41:55.406954+0000","last_fullsized":"2023-06-09T04:41:55.406954+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:49:19.500921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.654122+0000","last_change":"2023-06-09T04:41:53.946167+0000","last_active":"2023-06-09T04:41:55.654122+0000","last_peered":"2023-06-09T04:41:55.654122+0000","last_clean":"2023-06-09T04:41:55.654122+0000","last_became_active":"2023-06-09T04:41:53.945851+0000","last_became_peered":"2023-06-09T04:41:53.945851+0000","last_unstale":"2023-06-09T04:41:55.654122+0000","last_undegraded":"2023-06-09T04:41:55.654122+0000","last_fullsized":"2023-06-09T04:41:55.654122+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_clean_scrub_stamp":"2023-06-09T04:41:52.888143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:34:09.315377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.873175+0000","last_change":"2023-06-09T04:41:54.422093+0000","last_active":"2023-06-09T04:41:55.873175+0000","last_peered":"2023-06-09T04:41:55.873175+0000","last_clean":"2023-06-09T04:41:55.873175+0000","last_became_active":"2023-06-09T04:41:54.421470+0000","last_became_peered":"2023-06-09T04:41:54.421470+0000","last_unstale":"2023-06-09T04:41:55.873175+0000","last_undegraded":"2023-06-09T04:41:55.873175+0000","last_fullsized":"2023-06-09T04:41:55.873175+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:02:24.420270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.873487+0000","last_change":"2023-06-09T04:41:53.948249+0000","last_active":"2023-06-09T04:41:55.873487+0000","last_peered":"2023-06-09T04:41:55.873487+0000","last_clean":"2023-06-09T04:41:55.873487+0000","last_became_active":"2023-06-09T04:41:53.947922+0000","last_became_peered":"2023-06-09T04:41:53.947922+0000","last_unstale":"2023-06-09T04:41:55.873487+0000","last_undegraded":"2023-06-09T04:41:55.873487+0000","last_fullsized":"2023-06-09T04:41:55.873487+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_clean_scrub_stamp":"2023-06-09T04:41:52.888143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:03:21.713995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.654127+0000","last_change":"2023-06-09T04:41:54.414099+0000","last_active":"2023-06-09T04:41:55.654127+0000","last_peered":"2023-06-09T04:41:55.654127+0000","last_clean":"2023-06-09T04:41:55.654127+0000","last_became_active":"2023-06-09T04:41:54.413814+0000","last_became_peered":"2023-06-09T04:41:54.413814+0000","last_unstale":"2023-06-09T04:41:55.654127+0000","last_undegraded":"2023-06-09T04:41:55.654127+0000","last_fullsized":"2023-06-09T04:41:55.654127+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:55:02.127077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"23'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.407877+0000","last_change":"2023-06-09T04:41:53.946921+0000","last_active":"2023-06-09T04:41:55.407877+0000","last_peered":"2023-06-09T04:41:55.407877+0000","last_clean":"2023-06-09T04:41:55.407877+0000","last_became_active":"2023-06-09T04:41:53.946528+0000","last_became_peered":"2023-06-09T04:41:53.946528+0000","last_unstale":"2023-06-09T04:41:55.407877+0000","last_undegraded":"2023-06-09T04:41:55.407877+0000","last_fullsized":"2023-06-09T04:41:55.407877+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_clean_scrub_stamp":"2023-06-09T04:41:52.888143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:29:46.112121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.406923+0000","last_change":"2023-06-09T04:41:54.414420+0000","last_active":"2023-06-09T04:41:55.406923+0000","last_peered":"2023-06-09T04:41:55.406923+0000","last_clean":"2023-06-09T04:41:55.406923+0000","last_became_active":"2023-06-09T04:41:54.413915+0000","last_became_peered":"2023-06-09T04:41:54.413915+0000","last_unstale":"2023-06-09T04:41:55.406923+0000","last_undegraded":"2023-06-09T04:41:55.406923+0000","last_fullsized":"2023-06-09T04:41:55.406923+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:17:24.443064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.873918+0000","last_change":"2023-06-09T04:41:53.950753+0000","last_active":"2023-06-09T04:41:55.873918+0000","last_peered":"2023-06-09T04:41:55.873918+0000","last_clean":"2023-06-09T04:41:55.873918+0000","last_became_active":"2023-06-09T04:41:53.950440+0000","last_became_peered":"2023-06-09T04:41:53.950440+0000","last_unstale":"2023-06-09T04:41:55.873918+0000","last_undegraded":"2023-06-09T04:41:55.873918+0000","last_fullsized":"2023-06-09T04:41:55.873918+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_clean_scrub_stamp":"2023-06-09T04:41:52.888143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:29:46.112121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.407721+0000","last_change":"2023-06-09T04:41:54.432857+0000","last_active":"2023-06-09T04:41:55.407721+0000","last_peered":"2023-06-09T04:41:55.407721+0000","last_clean":"2023-06-09T04:41:55.407721+0000","last_became_active":"2023-06-09T04:41:54.432285+0000","last_became_peered":"2023-06-09T04:41:54.432285+0000","last_unstale":"2023-06-09T04:41:55.407721+0000","last_undegraded":"2023-06-09T04:41:55.407721+0000","last_fullsized":"2023-06-09T04:41:55.407721+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:06:03.696521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"23'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.874167+0000","last_change":"2023-06-09T04:41:53.948741+0000","last_active":"2023-06-09T04:41:55.874167+0000","last_peered":"2023-06-09T04:41:55.874167+0000","last_clean":"2023-06-09T04:41:55.874167+0000","last_became_active":"2023-06-09T04:41:53.948401+0000","last_became_peered":"2023-06-09T04:41:53.948401+0000","last_unstale":"2023-06-09T04:41:55.874167+0000","last_undegraded":"2023-06-09T04:41:55.874167+0000","last_fullsized":"2023-06-09T04:41:55.874167+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_clean_scrub_stamp":"2023-06-09T04:41:52.888143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:35:37.341293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.407534+0000","last_change":"2023-06-09T04:41:54.434317+0000","last_active":"2023-06-09T04:41:55.407534+0000","last_peered":"2023-06-09T04:41:55.407534+0000","last_clean":"2023-06-09T04:41:55.407534+0000","last_became_active":"2023-06-09T04:41:54.433815+0000","last_became_peered":"2023-06-09T04:41:54.433815+0000","last_unstale":"2023-06-09T04:41:55.407534+0000","last_undegraded":"2023-06-09T04:41:55.407534+0000","last_fullsized":"2023-06-09T04:41:55.407534+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:03:22.727998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"23'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.874939+0000","last_change":"2023-06-09T04:41:53.949030+0000","last_active":"2023-06-09T04:41:55.874939+0000","last_peered":"2023-06-09T04:41:55.874939+0000","last_clean":"2023-06-09T04:41:55.874939+0000","last_became_active":"2023-06-09T04:41:53.948417+0000","last_became_peered":"2023-06-09T04:41:53.948417+0000","last_unstale":"2023-06-09T04:41:55.874939+0000","last_undegraded":"2023-06-09T04:41:55.874939+0000","last_fullsized":"2023-06-09T04:41:55.874939+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_clean_scrub_stamp":"2023-06-09T04:41:52.888143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:03:49.057567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.654457+0000","last_change":"2023-06-09T04:41:54.402200+0000","last_active":"2023-06-09T04:41:55.654457+0000","last_peered":"2023-06-09T04:41:55.654457+0000","last_clean":"2023-06-09T04:41:55.654457+0000","last_became_active":"2023-06-09T04:41:54.401955+0000","last_became_peered":"2023-06-09T04:41:54.401955+0000","last_unstale":"2023-06-09T04:41:55.654457+0000","last_undegraded":"2023-06-09T04:41:55.654457+0000","last_fullsized":"2023-06-09T04:41:55.654457+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:50:09.575767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"23'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.654265+0000","last_change":"2023-06-09T04:41:53.946110+0000","last_active":"2023-06-09T04:41:55.654265+0000","last_peered":"2023-06-09T04:41:55.654265+0000","last_clean":"2023-06-09T04:41:55.654265+0000","last_became_active":"2023-06-09T04:41:53.945780+0000","last_became_peered":"2023-06-09T04:41:53.945780+0000","last_unstale":"2023-06-09T04:41:55.654265+0000","last_undegraded":"2023-06-09T04:41:55.654265+0000","last_fullsized":"2023-06-09T04:41:55.654265+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_clean_scrub_stamp":"2023-06-09T04:41:52.888143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:35:37.341293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.407217+0000","last_change":"2023-06-09T04:41:54.424850+0000","last_active":"2023-06-09T04:41:55.407217+0000","last_peered":"2023-06-09T04:41:55.407217+0000","last_clean":"2023-06-09T04:41:55.407217+0000","last_became_active":"2023-06-09T04:41:54.424507+0000","last_became_peered":"2023-06-09T04:41:54.424507+0000","last_unstale":"2023-06-09T04:41:55.407217+0000","last_undegraded":"2023-06-09T04:41:55.407217+0000","last_fullsized":"2023-06-09T04:41:55.407217+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:37:53.492624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"23'4","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.874082+0000","last_change":"2023-06-09T04:41:53.940256+0000","last_active":"2023-06-09T04:41:55.874082+0000","last_peered":"2023-06-09T04:41:55.874082+0000","last_clean":"2023-06-09T04:41:55.874082+0000","last_became_active":"2023-06-09T04:41:53.939890+0000","last_became_peered":"2023-06-09T04:41:53.939890+0000","last_unstale":"2023-06-09T04:41:55.874082+0000","last_undegraded":"2023-06-09T04:41:55.874082+0000","last_fullsized":"2023-06-09T04:41:55.874082+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_clean_scrub_stamp":"2023-06-09T04:41:52.888143+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:48:33.879868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":856,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":876544,"data_stored":686418,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1719999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3049999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.256}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.349}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.206}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.419}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.72}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":253952,"data_stored":94270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76700000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0069999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2210000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3540000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4139999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.091}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4399999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":262144,"data_stored":94922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83099999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80600000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.48}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.075}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.359}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4159999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.306}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":274432,"data_stored":95890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4359999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.123}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4850000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0800000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.224}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5640000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.329}]}]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27204,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344636,"statfs":{"total":96636764160,"available":96608907264,"internally_reserved":0,"allocated":258048,"data_stored":94360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98499999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92400000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1950000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4339999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.115}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3899999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2430000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":253952,"data_stored":94270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70099999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.105}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5920000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4450000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.371}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5489999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7170000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27188,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344652,"statfs":{"total":96636764160,"available":96608923648,"internally_reserved":0,"allocated":241664,"data_stored":87617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93899999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4470000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.363}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4810000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.51}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8140000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27772,"kb_used_data":820,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344068,"statfs":{"total":96636764160,"available":96608325632,"internally_reserved":0,"allocated":839680,"data_stored":678567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0680000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2889999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0369999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.863}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9990000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.851}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8169999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-09T04:41:59.142 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-06-09T04:41:59.143 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-06-09T04:41:59.143 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-06-09T04:41:59.143 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-06-09T04:41:59.144 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-06-09T04:41:59.352 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:59.348+0000 7fd0caba8700 1 Processor -- start 2023-06-09T04:41:59.353 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:59.348+0000 7fd0caba8700 1 -- start start 2023-06-09T04:41:59.353 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:59.348+0000 7fd0caba8700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fd0c40b18d0 0x7fd0c4160920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:59.354 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:59.348+0000 7fd0caba8700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fd0c40d2400 0x7fd0c40d28a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:59.354 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:59.348+0000 7fd0caba8700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0c415c6b0 con 0x7fd0c40b1ca0 2023-06-09T04:41:59.354 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:59.348+0000 7fd0caba8700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0c40d2de0 con 0x7fd0c40d2400 2023-06-09T04:41:59.354 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:59.348+0000 7fd0caba8700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0c40cf6a0 con 0x7fd0c40b18d0 2023-06-09T04:41:59.355 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:59.348+0000 7fd0ca3a7700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fd0c40d2400 0x7fd0c40d28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:59.355 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:59.348+0000 7fd0ca3a7700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fd0c40d2400 0x7fd0c40d28a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:33346/0 (socket says 172.21.15.90:33346) 2023-06-09T04:41:59.355 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:59.348+0000 7fd0ca3a7700 1 -- 172.21.15.90:0/3328616574 learned_addr learned my addr 172.21.15.90:0/3328616574 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:41:59.356 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:59.352+0000 7fd0c9ba6700 1 --2- 172.21.15.90:0/3328616574 >> v2:172.21.15.174:3300/0 conn(0x7fd0c40b18d0 0x7fd0c4160920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:59.356 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:59.352+0000 7fd0ca3a7700 1 -- 172.21.15.90:0/3328616574 >> v2:172.21.15.174:3300/0 conn(0x7fd0c40b18d0 msgr2=0x7fd0c4160920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:59.356 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:59.352+0000 7fd0ca3a7700 1 --2- 172.21.15.90:0/3328616574 >> v2:172.21.15.174:3300/0 conn(0x7fd0c40b18d0 0x7fd0c4160920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:59.356 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:59.352+0000 7fd0ca3a7700 1 -- 172.21.15.90:0/3328616574 >> v1:172.21.15.174:6789/0 conn(0x7fd0c40b1ca0 legacy=0x7fd0c40cee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:59.356 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:59.352+0000 7fd0ca3a7700 1 -- 172.21.15.90:0/3328616574 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0c40cf980 con 0x7fd0c40d2400 2023-06-09T04:41:59.357 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:59.352+0000 7fd0ca3a7700 1 --2- 172.21.15.90:0/3328616574 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd0c40d2400 0x7fd0c40d28a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd0c4066ca0 tx=0x7fd0bc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76ac0b655791fdd0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:59.357 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:59.352+0000 7fd0c8ba4700 1 -- 172.21.15.90:0/3328616574 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0bc00e070 con 0x7fd0c40d2400 2023-06-09T04:41:59.357 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:59.352+0000 7fd0c8ba4700 1 -- 172.21.15.90:0/3328616574 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0bc00b910 con 0x7fd0c40d2400 2023-06-09T04:41:59.357 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:59.352+0000 7fd0c8ba4700 1 -- 172.21.15.90:0/3328616574 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0bc00bcc0 con 0x7fd0c40d2400 2023-06-09T04:41:59.357 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:59.352+0000 7fd0caba8700 1 -- 172.21.15.90:0/3328616574 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd0c40d2400 msgr2=0x7fd0c40d28a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:59.358 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:59.352+0000 7fd0caba8700 1 --2- 172.21.15.90:0/3328616574 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd0c40d2400 0x7fd0c40d28a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd0c4066ca0 tx=0x7fd0bc00b330 comp rx=0 tx=0).stop 2023-06-09T04:41:59.358 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:59.352+0000 7fd0caba8700 1 -- 172.21.15.90:0/3328616574 shutdown_connections 2023-06-09T04:41:59.358 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:59.352+0000 7fd0caba8700 1 --2- 172.21.15.90:0/3328616574 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd0c40d2400 0x7fd0c40d28a0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:59.358 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:59.352+0000 7fd0caba8700 1 --2- 172.21.15.90:0/3328616574 >> v2:172.21.15.174:3300/0 conn(0x7fd0c40b18d0 0x7fd0c4160920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:59.359 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:59.352+0000 7fd0caba8700 1 -- 172.21.15.90:0/3328616574 >> 172.21.15.90:0/3328616574 conn(0x7fd0c409b9b0 msgr2=0x7fd0c40b55d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:59.359 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:59.352+0000 7fd0caba8700 1 -- 172.21.15.90:0/3328616574 shutdown_connections 2023-06-09T04:41:59.359 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:59.352+0000 7fd0caba8700 1 -- 172.21.15.90:0/3328616574 wait complete. 2023-06-09T04:41:59.361 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:59.356+0000 7fd0caba8700 1 Processor -- start 2023-06-09T04:41:59.361 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:59.356+0000 7fd0caba8700 1 -- start start 2023-06-09T04:41:59.364 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:59.356+0000 7fd0caba8700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd0c40b18d0 0x7fd0c4150c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:59.364 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:59.360+0000 7fd0caba8700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd0c40b1ca0 0x7fd0c41f1380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:59.365 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:59.360+0000 7fd0caba8700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd0c40d2400 0x7fd0c406b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:59.365 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:59.360+0000 7fd0caba8700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0c4151140 con 0x7fd0c40b18d0 2023-06-09T04:41:59.365 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:59.360+0000 7fd0caba8700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0c41f2540 con 0x7fd0c40b1ca0 2023-06-09T04:41:59.365 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:59.360+0000 7fd0caba8700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0c41f1e70 con 0x7fd0c40d2400 2023-06-09T04:41:59.365 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:59.360+0000 7fd0c9ba6700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd0c40b18d0 0x7fd0c4150c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:59.365 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:59.360+0000 7fd0c9ba6700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd0c40b18d0 0x7fd0c4150c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:33354/0 (socket says 172.21.15.90:33354) 2023-06-09T04:41:59.365 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:59.360+0000 7fd0c9ba6700 1 -- 172.21.15.90:0/3313203873 learned_addr learned my addr 172.21.15.90:0/3313203873 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:41:59.366 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:59.360+0000 7fd0c93a5700 1 --2- 172.21.15.90:0/3313203873 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd0c40b1ca0 0x7fd0c41f1380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:59.366 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:59.360+0000 7fd0c9ba6700 1 -- 172.21.15.90:0/3313203873 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd0c40d2400 msgr2=0x7fd0c406b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:59.366 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:59.360+0000 7fd0ca3a7700 1 --2- 172.21.15.90:0/3313203873 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd0c40d2400 0x7fd0c406b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:59.366 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:59.360+0000 7fd0c9ba6700 1 --2- 172.21.15.90:0/3313203873 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd0c40d2400 0x7fd0c406b9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:59.366 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:59.360+0000 7fd0c9ba6700 1 -- 172.21.15.90:0/3313203873 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd0c40b1ca0 msgr2=0x7fd0c41f1380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:59.366 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:59.360+0000 7fd0c9ba6700 1 --2- 172.21.15.90:0/3313203873 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd0c40b1ca0 0x7fd0c41f1380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:59.366 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:59.360+0000 7fd0c9ba6700 1 -- 172.21.15.90:0/3313203873 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0bc009b30 con 0x7fd0c40b18d0 2023-06-09T04:41:59.367 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:59.360+0000 7fd0ca3a7700 1 --2- 172.21.15.90:0/3313203873 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd0c40d2400 0x7fd0c406b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:41:59.367 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:59.360+0000 7fd0c93a5700 1 --2- 172.21.15.90:0/3313203873 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd0c40b1ca0 0x7fd0c41f1380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:41:59.367 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:59.360+0000 7fd0c9ba6700 1 --2- 172.21.15.90:0/3313203873 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd0c40b18d0 0x7fd0c4150c00 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd0c000e9b0 tx=0x7fd0c000ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:59.367 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:59.360+0000 7fd0ba7fc700 1 -- 172.21.15.90:0/3313203873 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0c0009710 con 0x7fd0c40b18d0 2023-06-09T04:41:59.367 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:59.360+0000 7fd0ba7fc700 1 -- 172.21.15.90:0/3313203873 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0c000c850 con 0x7fd0c40b18d0 2023-06-09T04:41:59.367 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:59.360+0000 7fd0ba7fc700 1 -- 172.21.15.90:0/3313203873 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0c000cbc0 con 0x7fd0c40b18d0 2023-06-09T04:41:59.367 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:59.360+0000 7fd0caba8700 1 -- 172.21.15.90:0/3313203873 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0c41f2150 con 0x7fd0c40b18d0 2023-06-09T04:41:59.368 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:59.360+0000 7fd0caba8700 1 -- 172.21.15.90:0/3313203873 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0c41f2a70 con 0x7fd0c40b18d0 2023-06-09T04:41:59.368 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:59.360+0000 7fd0caba8700 1 -- 172.21.15.90:0/3313203873 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0c404e380 con 0x7fd0c40b18d0 2023-06-09T04:41:59.368 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:59.364+0000 7fd0ba7fc700 1 -- 172.21.15.90:0/3313203873 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd0c000cd20 con 0x7fd0c40b18d0 2023-06-09T04:41:59.369 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:59.364+0000 7fd0ba7fc700 1 --2- 172.21.15.90:0/3313203873 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fd0a80662f0 0x7fd0a80687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:59.369 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:59.364+0000 7fd0ba7fc700 1 -- 172.21.15.90:0/3313203873 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd0c00841e0 con 0x7fd0c40b18d0 2023-06-09T04:41:59.369 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:59.364+0000 7fd0c93a5700 1 --2- 172.21.15.90:0/3313203873 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fd0a80662f0 0x7fd0a80687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:59.370 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:59.364+0000 7fd0c93a5700 1 --2- 172.21.15.90:0/3313203873 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fd0a80662f0 0x7fd0a80687a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd0c415ffa0 tx=0x7fd0b4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:59.376 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:59.372+0000 7fd0ba7fc700 1 -- 172.21.15.90:0/3313203873 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd0c00550e0 con 0x7fd0c40b18d0 2023-06-09T04:41:59.583 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:59.580+0000 7fd0caba8700 1 -- 172.21.15.90:0/3313203873 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fd0c40d33d0 con 0x7fd0c40b18d0 2023-06-09T04:41:59.586 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:59.580+0000 7fd0ba7fc700 1 -- 172.21.15.90:0/3313203873 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+164249 (secure 0 0 0) 0x7fd0c0054c70 con 0x7fd0c40b18d0 2023-06-09T04:41:59.588 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:41:59.592 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:59.588+0000 7fd0caba8700 1 -- 172.21.15.90:0/3313203873 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fd0a80662f0 msgr2=0x7fd0a80687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:59.592 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:59.588+0000 7fd0caba8700 1 --2- 172.21.15.90:0/3313203873 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fd0a80662f0 0x7fd0a80687a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd0c415ffa0 tx=0x7fd0b4009040 comp rx=0 tx=0).stop 2023-06-09T04:41:59.592 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:59.588+0000 7fd0caba8700 1 -- 172.21.15.90:0/3313203873 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd0c40b18d0 msgr2=0x7fd0c4150c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:59.592 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:59.588+0000 7fd0caba8700 1 --2- 172.21.15.90:0/3313203873 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd0c40b18d0 0x7fd0c4150c00 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd0c000e9b0 tx=0x7fd0c000ed70 comp rx=0 tx=0).stop 2023-06-09T04:41:59.592 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:59.588+0000 7fd0caba8700 1 -- 172.21.15.90:0/3313203873 shutdown_connections 2023-06-09T04:41:59.592 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:59.588+0000 7fd0caba8700 1 --2- 172.21.15.90:0/3313203873 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fd0a80662f0 0x7fd0a80687a0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:59.593 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:59.588+0000 7fd0caba8700 1 --2- 172.21.15.90:0/3313203873 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd0c40d2400 0x7fd0c406b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:59.593 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:59.588+0000 7fd0caba8700 1 --2- 172.21.15.90:0/3313203873 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd0c40b1ca0 0x7fd0c41f1380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:59.593 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:59.588+0000 7fd0caba8700 1 --2- 172.21.15.90:0/3313203873 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd0c40b18d0 0x7fd0c4150c00 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:59.593 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:59.588+0000 7fd0caba8700 1 -- 172.21.15.90:0/3313203873 >> 172.21.15.90:0/3313203873 conn(0x7fd0c409b9b0 msgr2=0x7fd0c40ce9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:59.593 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:59.588+0000 7fd0caba8700 1 -- 172.21.15.90:0/3313203873 shutdown_connections 2023-06-09T04:41:59.593 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:59.588+0000 7fd0caba8700 1 -- 172.21.15.90:0/3313203873 wait complete. 2023-06-09T04:41:59.612 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":5,"active_gid":4104,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":1389974754},{"type":"v1","addr":"172.21.15.174:6833","nonce":1389974754}]},"active_addr":"172.21.15.174:6833/1389974754","active_change":"2023-06-09T04:41:34.287352+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4113,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.174:0","nonce":2371352718}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.174:0","nonce":1864101172}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.174:0","nonce":2806948780}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.174:0","nonce":3541282335}]}]} 2023-06-09T04:41:59.616 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-06-09T04:41:59.617 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-06-09T04:41:59.617 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T04:41:59.786 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:59.780+0000 7f9e3f59e700 1 Processor -- start 2023-06-09T04:41:59.786 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:59.780+0000 7f9e3f59e700 1 -- start start 2023-06-09T04:41:59.789 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:59.784+0000 7f9e3f59e700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f9e40154350 0x7f9e400cc0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:59.789 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:59.784+0000 7f9e3f59e700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e400cd8a0 con 0x7f9e400cafb0 2023-06-09T04:41:59.789 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:59.784+0000 7f9e3f59e700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e400cb420 con 0x7f9e4015deb0 2023-06-09T04:41:59.790 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:59.784+0000 7f9e3f59e700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e40154720 con 0x7f9e40154350 2023-06-09T04:41:59.790 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:59.784+0000 7f9e3e59c700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f9e40154350 0x7f9e400cc0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:59.790 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:59.784+0000 7f9e3e59c700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f9e40154350 0x7f9e400cc0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:33362/0 (socket says 172.21.15.90:33362) 2023-06-09T04:41:59.790 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:59.784+0000 7f9e3e59c700 1 -- 172.21.15.90:0/4226384482 learned_addr learned my addr 172.21.15.90:0/4226384482 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:41:59.791 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:59.784+0000 7f9e3e59c700 1 -- 172.21.15.90:0/4226384482 >> v1:172.21.15.174:6789/0 conn(0x7f9e4015deb0 legacy=0x7f9e40069c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:59.791 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:59.784+0000 7f9e3e59c700 1 -- 172.21.15.90:0/4226384482 >> v1:172.21.15.90:6789/0 conn(0x7f9e400cafb0 legacy=0x7f9e4015d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:59.791 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:59.784+0000 7f9e3e59c700 1 -- 172.21.15.90:0/4226384482 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e400cdaf0 con 0x7f9e40154350 2023-06-09T04:41:59.791 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:59.788+0000 7f9e3e59c700 1 --2- 172.21.15.90:0/4226384482 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9e40154350 0x7f9e400cc0f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9e30009910 tx=0x7f9e30009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f859408775d5ce8c server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:59.792 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:59.788+0000 7f9e3d59a700 1 -- 172.21.15.90:0/4226384482 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e3000ba60 con 0x7f9e40154350 2023-06-09T04:41:59.792 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:59.788+0000 7f9e3d59a700 1 -- 172.21.15.90:0/4226384482 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e3000bbc0 con 0x7f9e40154350 2023-06-09T04:41:59.792 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:59.788+0000 7f9e3d59a700 1 -- 172.21.15.90:0/4226384482 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e30009e60 con 0x7f9e40154350 2023-06-09T04:41:59.792 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:59.788+0000 7f9e3f59e700 1 -- 172.21.15.90:0/4226384482 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9e40154350 msgr2=0x7f9e400cc0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:59.792 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:59.788+0000 7f9e3f59e700 1 --2- 172.21.15.90:0/4226384482 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9e40154350 0x7f9e400cc0f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9e30009910 tx=0x7f9e30009c20 comp rx=0 tx=0).stop 2023-06-09T04:41:59.793 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:59.788+0000 7f9e3f59e700 1 -- 172.21.15.90:0/4226384482 shutdown_connections 2023-06-09T04:41:59.793 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:59.788+0000 7f9e3f59e700 1 --2- 172.21.15.90:0/4226384482 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9e40154350 0x7f9e400cc0f0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:59.793 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:59.788+0000 7f9e3f59e700 1 -- 172.21.15.90:0/4226384482 >> 172.21.15.90:0/4226384482 conn(0x7f9e4006c690 msgr2=0x7f9e400aff00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:59.793 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:59.788+0000 7f9e3f59e700 1 -- 172.21.15.90:0/4226384482 shutdown_connections 2023-06-09T04:41:59.794 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:59.788+0000 7f9e3f59e700 1 -- 172.21.15.90:0/4226384482 wait complete. 2023-06-09T04:41:59.795 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:59.792+0000 7f9e3f59e700 1 Processor -- start 2023-06-09T04:41:59.795 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:59.792+0000 7f9e3f59e700 1 -- start start 2023-06-09T04:41:59.797 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:59.792+0000 7f9e3f59e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9e400cafb0 0x7f9e4014d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:59.797 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:59.792+0000 7f9e3f59e700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9e40154350 0x7f9e40158c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:59.797 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:59.792+0000 7f9e3f59e700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9e4015deb0 0x7f9e401591c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:59.797 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:59.792+0000 7f9e3f59e700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e40153a50 con 0x7f9e4015deb0 2023-06-09T04:41:59.797 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:59.792+0000 7f9e3f59e700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e401f1790 con 0x7f9e40154350 2023-06-09T04:41:59.798 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:59.792+0000 7f9e3f59e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e401f1a70 con 0x7f9e400cafb0 2023-06-09T04:41:59.799 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:59.792+0000 7f9e3ed9d700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9e4015deb0 0x7f9e401591c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:59.799 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:59.792+0000 7f9e3ed9d700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9e4015deb0 0x7f9e401591c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:33368/0 (socket says 172.21.15.90:33368) 2023-06-09T04:41:59.799 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:59.792+0000 7f9e3ed9d700 1 -- 172.21.15.90:0/326446415 learned_addr learned my addr 172.21.15.90:0/326446415 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:41:59.799 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:59.792+0000 7f9e3e59c700 1 --2- 172.21.15.90:0/326446415 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9e400cafb0 0x7f9e4014d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:59.800 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:59.792+0000 7f9e3dd9b700 1 --2- 172.21.15.90:0/326446415 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9e40154350 0x7f9e40158c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:59.800 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:59.792+0000 7f9e3ed9d700 1 -- 172.21.15.90:0/326446415 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9e400cafb0 msgr2=0x7f9e4014d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:59.800 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:59.792+0000 7f9e3ed9d700 1 --2- 172.21.15.90:0/326446415 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9e400cafb0 0x7f9e4014d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:59.800 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:59.792+0000 7f9e3ed9d700 1 -- 172.21.15.90:0/326446415 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9e40154350 msgr2=0x7f9e40158c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:59.800 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:59.792+0000 7f9e3ed9d700 1 --2- 172.21.15.90:0/326446415 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9e40154350 0x7f9e40158c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:59.800 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:59.792+0000 7f9e3ed9d700 1 -- 172.21.15.90:0/326446415 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e30009570 con 0x7f9e4015deb0 2023-06-09T04:41:59.800 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:59.792+0000 7f9e3dd9b700 1 --2- 172.21.15.90:0/326446415 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9e40154350 0x7f9e40158c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:41:59.801 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:59.796+0000 7f9e3ed9d700 1 --2- 172.21.15.90:0/326446415 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9e4015deb0 0x7f9e401591c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9e3800cbc0 tx=0x7f9e3800ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:59.801 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:59.796+0000 7f9e2effd700 1 -- 172.21.15.90:0/326446415 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e38003c20 con 0x7f9e4015deb0 2023-06-09T04:41:59.801 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:59.796+0000 7f9e2effd700 1 -- 172.21.15.90:0/326446415 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e38003d80 con 0x7f9e4015deb0 2023-06-09T04:41:59.801 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:59.796+0000 7f9e2effd700 1 -- 172.21.15.90:0/326446415 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e3800aae0 con 0x7f9e4015deb0 2023-06-09T04:41:59.801 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:59.796+0000 7f9e3f59e700 1 -- 172.21.15.90:0/326446415 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e401f1d50 con 0x7f9e4015deb0 2023-06-09T04:41:59.801 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:59.796+0000 7f9e3f59e700 1 -- 172.21.15.90:0/326446415 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e401f1410 con 0x7f9e4015deb0 2023-06-09T04:41:59.802 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:59.796+0000 7f9e3f59e700 1 -- 172.21.15.90:0/326446415 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e4006b390 con 0x7f9e4015deb0 2023-06-09T04:41:59.802 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:59.800+0000 7f9e2effd700 1 -- 172.21.15.90:0/326446415 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9e3800ac40 con 0x7f9e4015deb0 2023-06-09T04:41:59.804 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:59.800+0000 7f9e2effd700 1 --2- 172.21.15.90:0/326446415 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f9e200662f0 0x7f9e200687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:59.804 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:59.800+0000 7f9e2effd700 1 -- 172.21.15.90:0/326446415 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9e38083c40 con 0x7f9e4015deb0 2023-06-09T04:41:59.805 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:59.800+0000 7f9e3e59c700 1 --2- 172.21.15.90:0/326446415 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f9e200662f0 0x7f9e200687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:59.806 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:59.800+0000 7f9e3e59c700 1 --2- 172.21.15.90:0/326446415 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f9e200662f0 0x7f9e200687a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f9e30006f80 tx=0x7f9e30008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:59.808 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:59.804+0000 7f9e2effd700 1 -- 172.21.15.90:0/326446415 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9e380510b0 con 0x7f9e4015deb0 2023-06-09T04:41:59.978 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:59.972+0000 7f9e3f59e700 1 -- 172.21.15.90:0/326446415 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9e401f1f90 con 0x7f9e4015deb0 2023-06-09T04:41:59.981 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:59.976+0000 7f9e2effd700 1 -- 172.21.15.90:0/326446415 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18279 (secure 0 0 0) 0x7f9e401f1f90 con 0x7f9e4015deb0 2023-06-09T04:41:59.982 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:41:59.982 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":24,"fsid":"700369c0-a111-43b4-9415-844ad1742b70","created":"2023-06-09T04:41:28.180311+0000","modified":"2023-06-09T04:41:55.389425+0000","last_up_change":"2023-06-09T04:41:40.746475+0000","last_in_change":"2023-06-09T04:41:31.262765+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-09T04:41:42.402564+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-09T04:41:47.607323+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-09T04:41:52.543474+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-09T04:41:53.382940+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"46a4a7c5-babd-4ef3-9830-51487cff5eb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":2780271267},{"type":"v1","addr":"172.21.15.90:6809","nonce":2780271267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2780271267},{"type":"v1","addr":"172.21.15.90:6811","nonce":2780271267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2780271267},{"type":"v1","addr":"172.21.15.90:6815","nonce":2780271267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2780271267},{"type":"v1","addr":"172.21.15.90:6813","nonce":2780271267}]},"public_addr":"172.21.15.90:6809/2780271267","cluster_addr":"172.21.15.90:6811/2780271267","heartbeat_back_addr":"172.21.15.90:6815/2780271267","heartbeat_front_addr":"172.21.15.90:6813/2780271267","state":["exists","up"]},{"osd":1,"uuid":"1543988f-c498-494a-a6f9-fac8413db6ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":3064028136},{"type":"v1","addr":"172.21.15.90:6801","nonce":3064028136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":3064028136},{"type":"v1","addr":"172.21.15.90:6803","nonce":3064028136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":3064028136},{"type":"v1","addr":"172.21.15.90:6807","nonce":3064028136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":3064028136},{"type":"v1","addr":"172.21.15.90:6805","nonce":3064028136}]},"public_addr":"172.21.15.90:6801/3064028136","cluster_addr":"172.21.15.90:6803/3064028136","heartbeat_back_addr":"172.21.15.90:6807/3064028136","heartbeat_front_addr":"172.21.15.90:6805/3064028136","state":["exists","up"]},{"osd":2,"uuid":"79669dd6-ffc8-4197-b9f7-b3b372b2b9b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":3713146326},{"type":"v1","addr":"172.21.15.90:6825","nonce":3713146326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":3713146326},{"type":"v1","addr":"172.21.15.90:6827","nonce":3713146326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":3713146326},{"type":"v1","addr":"172.21.15.90:6831","nonce":3713146326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":3713146326},{"type":"v1","addr":"172.21.15.90:6829","nonce":3713146326}]},"public_addr":"172.21.15.90:6825/3713146326","cluster_addr":"172.21.15.90:6827/3713146326","heartbeat_back_addr":"172.21.15.90:6831/3713146326","heartbeat_front_addr":"172.21.15.90:6829/3713146326","state":["exists","up"]},{"osd":3,"uuid":"4062ab6f-ce40-450a-aa17-b10098766c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":3499839122},{"type":"v1","addr":"172.21.15.90:6817","nonce":3499839122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":3499839122},{"type":"v1","addr":"172.21.15.90:6819","nonce":3499839122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":3499839122},{"type":"v1","addr":"172.21.15.90:6823","nonce":3499839122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":3499839122},{"type":"v1","addr":"172.21.15.90:6821","nonce":3499839122}]},"public_addr":"172.21.15.90:6817/3499839122","cluster_addr":"172.21.15.90:6819/3499839122","heartbeat_back_addr":"172.21.15.90:6823/3499839122","heartbeat_front_addr":"172.21.15.90:6821/3499839122","state":["exists","up"]},{"osd":4,"uuid":"a10820e4-b348-4d92-9796-3b01484ace1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6817","nonce":1138565854},{"type":"v1","addr":"172.21.15.174:6819","nonce":1138565854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6821","nonce":1138565854},{"type":"v1","addr":"172.21.15.174:6823","nonce":1138565854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":1138565854},{"type":"v1","addr":"172.21.15.174:6831","nonce":1138565854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":1138565854},{"type":"v1","addr":"172.21.15.174:6829","nonce":1138565854}]},"public_addr":"172.21.15.174:6819/1138565854","cluster_addr":"172.21.15.174:6823/1138565854","heartbeat_back_addr":"172.21.15.174:6831/1138565854","heartbeat_front_addr":"172.21.15.174:6829/1138565854","state":["exists","up"]},{"osd":5,"uuid":"b4da1c32-be05-420b-9346-90d91aa70569","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":1707702879},{"type":"v1","addr":"172.21.15.174:6818","nonce":1707702879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":1707702879},{"type":"v1","addr":"172.21.15.174:6822","nonce":1707702879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6827","nonce":1707702879},{"type":"v1","addr":"172.21.15.174:6828","nonce":1707702879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":1707702879},{"type":"v1","addr":"172.21.15.174:6825","nonce":1707702879}]},"public_addr":"172.21.15.174:6818/1707702879","cluster_addr":"172.21.15.174:6822/1707702879","heartbeat_back_addr":"172.21.15.174:6828/1707702879","heartbeat_front_addr":"172.21.15.174:6825/1707702879","state":["exists","up"]},{"osd":6,"uuid":"d1b98041-d243-4355-bd0a-e22cf9875b32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":864450534},{"type":"v1","addr":"172.21.15.174:6801","nonce":864450534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":864450534},{"type":"v1","addr":"172.21.15.174:6803","nonce":864450534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":864450534},{"type":"v1","addr":"172.21.15.174:6807","nonce":864450534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":864450534},{"type":"v1","addr":"172.21.15.174:6805","nonce":864450534}]},"public_addr":"172.21.15.174:6801/864450534","cluster_addr":"172.21.15.174:6803/864450534","heartbeat_back_addr":"172.21.15.174:6807/864450534","heartbeat_front_addr":"172.21.15.174:6805/864450534","state":["exists","up"]},{"osd":7,"uuid":"5a207936-f89f-416b-b79b-34ec96f77c8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":2527640659},{"type":"v1","addr":"172.21.15.174:6809","nonce":2527640659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":2527640659},{"type":"v1","addr":"172.21.15.174:6811","nonce":2527640659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":2527640659},{"type":"v1","addr":"172.21.15.174:6815","nonce":2527640659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":2527640659},{"type":"v1","addr":"172.21.15.174:6813","nonce":2527640659}]},"public_addr":"172.21.15.174:6809/2527640659","cluster_addr":"172.21.15.174:6811/2527640659","heartbeat_back_addr":"172.21.15.174:6815/2527640659","heartbeat_front_addr":"172.21.15.174:6813/2527640659","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:36.972152+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:36.984561+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:36.998817+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:37.054944+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:37.085014+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:37.115125+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:36.854608+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:36.971685+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:41:59.986 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:59.980+0000 7f9e3f59e700 1 -- 172.21.15.90:0/326446415 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f9e200662f0 msgr2=0x7f9e200687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:59.986 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:59.980+0000 7f9e3f59e700 1 --2- 172.21.15.90:0/326446415 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f9e200662f0 0x7f9e200687a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f9e30006f80 tx=0x7f9e30008030 comp rx=0 tx=0).stop 2023-06-09T04:41:59.986 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:59.980+0000 7f9e3f59e700 1 -- 172.21.15.90:0/326446415 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9e4015deb0 msgr2=0x7f9e401591c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:59.987 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:59.980+0000 7f9e3f59e700 1 --2- 172.21.15.90:0/326446415 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9e4015deb0 0x7f9e401591c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9e3800cbc0 tx=0x7f9e3800ced0 comp rx=0 tx=0).stop 2023-06-09T04:41:59.987 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:59.980+0000 7f9e3f59e700 1 -- 172.21.15.90:0/326446415 shutdown_connections 2023-06-09T04:41:59.987 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:59.980+0000 7f9e3f59e700 1 --2- 172.21.15.90:0/326446415 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f9e200662f0 0x7f9e200687a0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:59.987 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:59.980+0000 7f9e3f59e700 1 --2- 172.21.15.90:0/326446415 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9e4015deb0 0x7f9e401591c0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:59.988 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:59.980+0000 7f9e3f59e700 1 --2- 172.21.15.90:0/326446415 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9e40154350 0x7f9e40158c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:59.988 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:59.980+0000 7f9e3f59e700 1 --2- 172.21.15.90:0/326446415 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9e400cafb0 0x7f9e4014d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:59.988 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:59.984+0000 7f9e3f59e700 1 -- 172.21.15.90:0/326446415 >> 172.21.15.90:0/326446415 conn(0x7f9e4006c690 msgr2=0x7f9e400add70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:59.988 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:59.984+0000 7f9e3f59e700 1 -- 172.21.15.90:0/326446415 shutdown_connections 2023-06-09T04:41:59.988 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:41:59.984+0000 7f9e3f59e700 1 -- 172.21.15.90:0/326446415 wait complete. 2023-06-09T04:42:00.008 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-06-09T04:42:00.008 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T04:42:00.055 INFO:tasks.ceph.mds.b.smithi174.stderr:2023-06-09T04:42:00.051+0000 7fc3ef4c4700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-06-09T04:42:00.177 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.171+0000 7ff0b061d700 1 Processor -- start 2023-06-09T04:42:00.177 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.171+0000 7ff0b061d700 1 -- start start 2023-06-09T04:42:00.180 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.175+0000 7ff0b061d700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7ff0a8158b30 0x7ff0a815d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:00.180 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.175+0000 7ff0b061d700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ff0a8158f00 0x7ff0a8070db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:00.180 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.175+0000 7ff0b061d700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff0a8069820 0x7ff0a815c950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:00.180 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.175+0000 7ff0b061d700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0a80cd3a0 con 0x7ff0a8158b30 2023-06-09T04:42:00.181 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.175+0000 7ff0b061d700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0a80712f0 con 0x7ff0a8158f00 2023-06-09T04:42:00.181 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.175+0000 7ff0b061d700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0a8071550 con 0x7ff0a8069820 2023-06-09T04:42:00.182 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.175+0000 7ff0aebba700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff0a8069820 0x7ff0a815c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:00.182 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.175+0000 7ff0ae3b9700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7ff0a8158b30 0x7ff0a815d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:00.182 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.175+0000 7ff0aebba700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff0a8069820 0x7ff0a815c950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.90:37276/0 (socket says 172.21.15.90:37276) 2023-06-09T04:42:00.182 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.175+0000 7ff0ae3b9700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7ff0a8158b30 0x7ff0a815d4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:33384/0 (socket says 172.21.15.90:33384) 2023-06-09T04:42:00.182 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.175+0000 7ff0ae3b9700 1 -- 172.21.15.90:0/1651886181 learned_addr learned my addr 172.21.15.90:0/1651886181 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:00.183 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.175+0000 7ff0adbb8700 1 --2- 172.21.15.90:0/1651886181 >> v2:172.21.15.174:3300/0 conn(0x7ff0a8158f00 0x7ff0a8070db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:00.183 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.175+0000 7ff0ae3b9700 1 -- 172.21.15.90:0/1651886181 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff0a8069820 msgr2=0x7ff0a815c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:00.183 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.175+0000 7ff0ae3b9700 1 --2- 172.21.15.90:0/1651886181 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff0a8069820 0x7ff0a815c950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:00.183 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.175+0000 7ff0ae3b9700 1 -- 172.21.15.90:0/1651886181 >> v2:172.21.15.174:3300/0 conn(0x7ff0a8158f00 msgr2=0x7ff0a8070db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:00.183 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.175+0000 7ff0ae3b9700 1 --2- 172.21.15.90:0/1651886181 >> v2:172.21.15.174:3300/0 conn(0x7ff0a8158f00 0x7ff0a8070db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:00.183 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.175+0000 7ff0ae3b9700 1 -- 172.21.15.90:0/1651886181 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0a8071830 con 0x7ff0a8158b30 2023-06-09T04:42:00.184 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.175+0000 7ff0ae3b9700 1 --2- 172.21.15.90:0/1651886181 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff0a8158b30 0x7ff0a815d4f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff0a80cc560 tx=0x7ff0a400d430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3e3f7842791e476 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:00.185 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.179+0000 7ff0ad3b7700 1 -- 172.21.15.90:0/1651886181 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0a4010070 con 0x7ff0a8158b30 2023-06-09T04:42:00.185 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.179+0000 7ff0ad3b7700 1 -- 172.21.15.90:0/1651886181 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0a400dce0 con 0x7ff0a8158b30 2023-06-09T04:42:00.185 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.179+0000 7ff0ad3b7700 1 -- 172.21.15.90:0/1651886181 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0a400b310 con 0x7ff0a8158b30 2023-06-09T04:42:00.185 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.179+0000 7ff0b061d700 1 -- 172.21.15.90:0/1651886181 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff0a8158b30 msgr2=0x7ff0a815d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:00.185 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.179+0000 7ff0b061d700 1 --2- 172.21.15.90:0/1651886181 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff0a8158b30 0x7ff0a815d4f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff0a80cc560 tx=0x7ff0a400d430 comp rx=0 tx=0).stop 2023-06-09T04:42:00.185 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.179+0000 7ff0b061d700 1 -- 172.21.15.90:0/1651886181 shutdown_connections 2023-06-09T04:42:00.185 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.179+0000 7ff0b061d700 1 --2- 172.21.15.90:0/1651886181 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff0a8069820 0x7ff0a815c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:00.186 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.179+0000 7ff0b061d700 1 --2- 172.21.15.90:0/1651886181 >> v2:172.21.15.174:3300/0 conn(0x7ff0a8158f00 0x7ff0a8070db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:00.186 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.179+0000 7ff0b061d700 1 --2- 172.21.15.90:0/1651886181 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff0a8158b30 0x7ff0a815d4f0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:00.186 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.179+0000 7ff0b061d700 1 -- 172.21.15.90:0/1651886181 >> 172.21.15.90:0/1651886181 conn(0x7ff0a806c810 msgr2=0x7ff0a80b0000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:00.186 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.179+0000 7ff0b061d700 1 -- 172.21.15.90:0/1651886181 shutdown_connections 2023-06-09T04:42:00.186 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.179+0000 7ff0b061d700 1 -- 172.21.15.90:0/1651886181 wait complete. 2023-06-09T04:42:00.187 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.183+0000 7ff0b061d700 1 Processor -- start 2023-06-09T04:42:00.187 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.183+0000 7ff0b061d700 1 -- start start 2023-06-09T04:42:00.189 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.183+0000 7ff0b061d700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff0a8069820 0x7ff0a80c11e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:00.189 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.183+0000 7ff0b061d700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff0a8158b30 0x7ff0a80b24a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:00.189 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.183+0000 7ff0b061d700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff0a8158f00 0x7ff0a806a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:00.189 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.183+0000 7ff0b061d700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0a80b3750 con 0x7ff0a8158b30 2023-06-09T04:42:00.189 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.183+0000 7ff0b061d700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0a81595d0 con 0x7ff0a8069820 2023-06-09T04:42:00.189 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.183+0000 7ff0b061d700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0a80b2eb0 con 0x7ff0a8158f00 2023-06-09T04:42:00.190 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.183+0000 7ff0adbb8700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff0a8158b30 0x7ff0a80b24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:00.191 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.183+0000 7ff0adbb8700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff0a8158b30 0x7ff0a80b24a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:33390/0 (socket says 172.21.15.90:33390) 2023-06-09T04:42:00.191 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.183+0000 7ff0adbb8700 1 -- 172.21.15.90:0/3725434716 learned_addr learned my addr 172.21.15.90:0/3725434716 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:00.191 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.183+0000 7ff0ae3b9700 1 --2- 172.21.15.90:0/3725434716 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff0a8069820 0x7ff0a80c11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:00.191 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.183+0000 7ff0aebba700 1 --2- 172.21.15.90:0/3725434716 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff0a8158f00 0x7ff0a806a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:00.192 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.183+0000 7ff0adbb8700 1 -- 172.21.15.90:0/3725434716 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff0a8158f00 msgr2=0x7ff0a806a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:00.192 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.183+0000 7ff0adbb8700 1 --2- 172.21.15.90:0/3725434716 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff0a8158f00 0x7ff0a806a070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:00.192 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.183+0000 7ff0adbb8700 1 -- 172.21.15.90:0/3725434716 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff0a8069820 msgr2=0x7ff0a80c11e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:00.193 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.183+0000 7ff0adbb8700 1 --2- 172.21.15.90:0/3725434716 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff0a8069820 0x7ff0a80c11e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:00.193 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.183+0000 7ff0adbb8700 1 -- 172.21.15.90:0/3725434716 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0a400bd40 con 0x7ff0a8158b30 2023-06-09T04:42:00.193 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.183+0000 7ff0adbb8700 1 --2- 172.21.15.90:0/3725434716 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff0a8158b30 0x7ff0a80b24a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff09800e870 tx=0x7ff09800eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:00.195 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.187+0000 7ff09effd700 1 -- 172.21.15.90:0/3725434716 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0980095a0 con 0x7ff0a8158b30 2023-06-09T04:42:00.195 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.187+0000 7ff09effd700 1 -- 172.21.15.90:0/3725434716 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff098013680 con 0x7ff0a8158b30 2023-06-09T04:42:00.195 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.187+0000 7ff09effd700 1 -- 172.21.15.90:0/3725434716 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0980139f0 con 0x7ff0a8158b30 2023-06-09T04:42:00.195 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.187+0000 7ff0b061d700 1 -- 172.21.15.90:0/3725434716 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0a80b3190 con 0x7ff0a8158b30 2023-06-09T04:42:00.196 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.187+0000 7ff0b061d700 1 -- 172.21.15.90:0/3725434716 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0a80c1720 con 0x7ff0a8158b30 2023-06-09T04:42:00.196 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.187+0000 7ff0b061d700 1 -- 172.21.15.90:0/3725434716 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0a804db30 con 0x7ff0a8158b30 2023-06-09T04:42:00.197 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.187+0000 7ff09effd700 1 -- 172.21.15.90:0/3725434716 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff098013b50 con 0x7ff0a8158b30 2023-06-09T04:42:00.198 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.191+0000 7ff09effd700 1 --2- 172.21.15.90:0/3725434716 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7ff08c0662f0 0x7ff08c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:00.198 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.191+0000 7ff09effd700 1 -- 172.21.15.90:0/3725434716 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff098083b80 con 0x7ff0a8158b30 2023-06-09T04:42:00.198 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.191+0000 7ff0ae3b9700 1 --2- 172.21.15.90:0/3725434716 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7ff08c0662f0 0x7ff08c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:00.199 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.191+0000 7ff0ae3b9700 1 --2- 172.21.15.90:0/3725434716 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7ff08c0662f0 0x7ff08c0687a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff0a4000f80 tx=0x7ff0a400b000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:00.202 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.195+0000 7ff09effd700 1 -- 172.21.15.90:0/3725434716 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff098054a80 con 0x7ff0a8158b30 2023-06-09T04:42:00.372 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.367+0000 7ff0b061d700 1 -- 172.21.15.90:0/3725434716 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff0a8159710 con 0x7ff0a8158b30 2023-06-09T04:42:00.375 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.371+0000 7ff09effd700 1 -- 172.21.15.90:0/3725434716 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18279 (secure 0 0 0) 0x7ff098054610 con 0x7ff0a8158b30 2023-06-09T04:42:00.376 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:42:00.376 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":24,"fsid":"700369c0-a111-43b4-9415-844ad1742b70","created":"2023-06-09T04:41:28.180311+0000","modified":"2023-06-09T04:41:55.389425+0000","last_up_change":"2023-06-09T04:41:40.746475+0000","last_in_change":"2023-06-09T04:41:31.262765+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-09T04:41:42.402564+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-09T04:41:47.607323+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-09T04:41:52.543474+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-09T04:41:53.382940+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"46a4a7c5-babd-4ef3-9830-51487cff5eb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":2780271267},{"type":"v1","addr":"172.21.15.90:6809","nonce":2780271267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2780271267},{"type":"v1","addr":"172.21.15.90:6811","nonce":2780271267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2780271267},{"type":"v1","addr":"172.21.15.90:6815","nonce":2780271267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2780271267},{"type":"v1","addr":"172.21.15.90:6813","nonce":2780271267}]},"public_addr":"172.21.15.90:6809/2780271267","cluster_addr":"172.21.15.90:6811/2780271267","heartbeat_back_addr":"172.21.15.90:6815/2780271267","heartbeat_front_addr":"172.21.15.90:6813/2780271267","state":["exists","up"]},{"osd":1,"uuid":"1543988f-c498-494a-a6f9-fac8413db6ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":3064028136},{"type":"v1","addr":"172.21.15.90:6801","nonce":3064028136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":3064028136},{"type":"v1","addr":"172.21.15.90:6803","nonce":3064028136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":3064028136},{"type":"v1","addr":"172.21.15.90:6807","nonce":3064028136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":3064028136},{"type":"v1","addr":"172.21.15.90:6805","nonce":3064028136}]},"public_addr":"172.21.15.90:6801/3064028136","cluster_addr":"172.21.15.90:6803/3064028136","heartbeat_back_addr":"172.21.15.90:6807/3064028136","heartbeat_front_addr":"172.21.15.90:6805/3064028136","state":["exists","up"]},{"osd":2,"uuid":"79669dd6-ffc8-4197-b9f7-b3b372b2b9b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":3713146326},{"type":"v1","addr":"172.21.15.90:6825","nonce":3713146326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":3713146326},{"type":"v1","addr":"172.21.15.90:6827","nonce":3713146326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":3713146326},{"type":"v1","addr":"172.21.15.90:6831","nonce":3713146326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":3713146326},{"type":"v1","addr":"172.21.15.90:6829","nonce":3713146326}]},"public_addr":"172.21.15.90:6825/3713146326","cluster_addr":"172.21.15.90:6827/3713146326","heartbeat_back_addr":"172.21.15.90:6831/3713146326","heartbeat_front_addr":"172.21.15.90:6829/3713146326","state":["exists","up"]},{"osd":3,"uuid":"4062ab6f-ce40-450a-aa17-b10098766c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":3499839122},{"type":"v1","addr":"172.21.15.90:6817","nonce":3499839122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":3499839122},{"type":"v1","addr":"172.21.15.90:6819","nonce":3499839122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":3499839122},{"type":"v1","addr":"172.21.15.90:6823","nonce":3499839122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":3499839122},{"type":"v1","addr":"172.21.15.90:6821","nonce":3499839122}]},"public_addr":"172.21.15.90:6817/3499839122","cluster_addr":"172.21.15.90:6819/3499839122","heartbeat_back_addr":"172.21.15.90:6823/3499839122","heartbeat_front_addr":"172.21.15.90:6821/3499839122","state":["exists","up"]},{"osd":4,"uuid":"a10820e4-b348-4d92-9796-3b01484ace1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6817","nonce":1138565854},{"type":"v1","addr":"172.21.15.174:6819","nonce":1138565854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6821","nonce":1138565854},{"type":"v1","addr":"172.21.15.174:6823","nonce":1138565854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":1138565854},{"type":"v1","addr":"172.21.15.174:6831","nonce":1138565854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":1138565854},{"type":"v1","addr":"172.21.15.174:6829","nonce":1138565854}]},"public_addr":"172.21.15.174:6819/1138565854","cluster_addr":"172.21.15.174:6823/1138565854","heartbeat_back_addr":"172.21.15.174:6831/1138565854","heartbeat_front_addr":"172.21.15.174:6829/1138565854","state":["exists","up"]},{"osd":5,"uuid":"b4da1c32-be05-420b-9346-90d91aa70569","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":1707702879},{"type":"v1","addr":"172.21.15.174:6818","nonce":1707702879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":1707702879},{"type":"v1","addr":"172.21.15.174:6822","nonce":1707702879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6827","nonce":1707702879},{"type":"v1","addr":"172.21.15.174:6828","nonce":1707702879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":1707702879},{"type":"v1","addr":"172.21.15.174:6825","nonce":1707702879}]},"public_addr":"172.21.15.174:6818/1707702879","cluster_addr":"172.21.15.174:6822/1707702879","heartbeat_back_addr":"172.21.15.174:6828/1707702879","heartbeat_front_addr":"172.21.15.174:6825/1707702879","state":["exists","up"]},{"osd":6,"uuid":"d1b98041-d243-4355-bd0a-e22cf9875b32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":864450534},{"type":"v1","addr":"172.21.15.174:6801","nonce":864450534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":864450534},{"type":"v1","addr":"172.21.15.174:6803","nonce":864450534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":864450534},{"type":"v1","addr":"172.21.15.174:6807","nonce":864450534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":864450534},{"type":"v1","addr":"172.21.15.174:6805","nonce":864450534}]},"public_addr":"172.21.15.174:6801/864450534","cluster_addr":"172.21.15.174:6803/864450534","heartbeat_back_addr":"172.21.15.174:6807/864450534","heartbeat_front_addr":"172.21.15.174:6805/864450534","state":["exists","up"]},{"osd":7,"uuid":"5a207936-f89f-416b-b79b-34ec96f77c8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":2527640659},{"type":"v1","addr":"172.21.15.174:6809","nonce":2527640659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":2527640659},{"type":"v1","addr":"172.21.15.174:6811","nonce":2527640659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":2527640659},{"type":"v1","addr":"172.21.15.174:6815","nonce":2527640659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":2527640659},{"type":"v1","addr":"172.21.15.174:6813","nonce":2527640659}]},"public_addr":"172.21.15.174:6809/2527640659","cluster_addr":"172.21.15.174:6811/2527640659","heartbeat_back_addr":"172.21.15.174:6815/2527640659","heartbeat_front_addr":"172.21.15.174:6813/2527640659","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:36.972152+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:36.984561+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:36.998817+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:37.054944+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:37.085014+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:37.115125+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:36.854608+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:36.971685+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:42:00.378 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.371+0000 7ff0b061d700 1 -- 172.21.15.90:0/3725434716 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7ff08c0662f0 msgr2=0x7ff08c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:00.378 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.371+0000 7ff0b061d700 1 --2- 172.21.15.90:0/3725434716 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7ff08c0662f0 0x7ff08c0687a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff0a4000f80 tx=0x7ff0a400b000 comp rx=0 tx=0).stop 2023-06-09T04:42:00.379 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.371+0000 7ff0b061d700 1 -- 172.21.15.90:0/3725434716 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff0a8158b30 msgr2=0x7ff0a80b24a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:00.379 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.371+0000 7ff0b061d700 1 --2- 172.21.15.90:0/3725434716 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff0a8158b30 0x7ff0a80b24a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff09800e870 tx=0x7ff09800eb80 comp rx=0 tx=0).stop 2023-06-09T04:42:00.379 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.371+0000 7ff0b061d700 1 -- 172.21.15.90:0/3725434716 shutdown_connections 2023-06-09T04:42:00.379 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.371+0000 7ff0b061d700 1 --2- 172.21.15.90:0/3725434716 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7ff08c0662f0 0x7ff08c0687a0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:00.380 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.371+0000 7ff0b061d700 1 --2- 172.21.15.90:0/3725434716 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff0a8158f00 0x7ff0a806a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:00.380 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.371+0000 7ff0b061d700 1 --2- 172.21.15.90:0/3725434716 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff0a8158b30 0x7ff0a80b24a0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:00.380 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.371+0000 7ff0b061d700 1 --2- 172.21.15.90:0/3725434716 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff0a8069820 0x7ff0a80c11e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:00.380 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.371+0000 7ff0b061d700 1 -- 172.21.15.90:0/3725434716 >> 172.21.15.90:0/3725434716 conn(0x7ff0a806c810 msgr2=0x7ff0a80c9720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:00.380 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.371+0000 7ff0b061d700 1 -- 172.21.15.90:0/3725434716 shutdown_connections 2023-06-09T04:42:00.380 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.371+0000 7ff0b061d700 1 -- 172.21.15.90:0/3725434716 wait complete. 2023-06-09T04:42:00.398 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-06-09T04:42:00.399 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-06-09T04:42:00.399 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-06-09T04:42:00.400 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-06-09T04:42:00.400 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-06-09T04:42:00.401 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-06-09T04:42:00.401 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-06-09T04:42:00.402 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-06-09T04:42:00.635 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.631+0000 7ff52651f700 1 Processor -- start 2023-06-09T04:42:00.636 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.631+0000 7f99d8c19700 1 Processor -- start 2023-06-09T04:42:00.636 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.631+0000 7ff52651f700 1 -- start start 2023-06-09T04:42:00.637 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.631+0000 7f99d8c19700 1 -- start start 2023-06-09T04:42:00.638 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.631+0000 7f99d8c19700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f99d40b5ff0 0x7f99d40b4040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:00.638 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.631+0000 7f99d8c19700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99d40cb7b0 con 0x7f99d40cb320 2023-06-09T04:42:00.638 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.631+0000 7f99d8c19700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99d40cba90 con 0x7f99d4159b90 2023-06-09T04:42:00.638 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.631+0000 7f99d8c19700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99d40cbd70 con 0x7f99d40b5ff0 2023-06-09T04:42:00.639 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.631+0000 7ff52651f700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7ff52006fb70 0x7ff52006ff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:00.639 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.631+0000 7ff52651f700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ff520069820 0x7ff520069ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:00.639 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.631+0000 7ff52651f700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff52006aa30 con 0x7ff5200cc5c0 2023-06-09T04:42:00.639 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.631+0000 7f99d37fe700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f99d4159b90 0x7f99d40b58e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.90:34908/0 (socket says 172.21.15.90:34908) 2023-06-09T04:42:00.640 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.631+0000 7f99d37fe700 1 -- 172.21.15.90:0/2156227406 learned_addr learned my addr 172.21.15.90:0/2156227406 (peer_addr_for_me v1:172.21.15.90:0/0) 2023-06-09T04:42:00.640 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.635+0000 7ff52551d700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7ff52006fb70 0x7ff52006ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:00.640 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.635+0000 7fa7a9484700 1 Processor -- start 2023-06-09T04:42:00.641 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.635+0000 7ff52551d700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7ff52006fb70 0x7ff52006ff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:33410/0 (socket says 172.21.15.90:33410) 2023-06-09T04:42:00.641 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.635+0000 7ff52551d700 1 -- 172.21.15.90:0/513200200 learned_addr learned my addr 172.21.15.90:0/513200200 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:00.641 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.635+0000 7f99d3fff700 1 --2- 172.21.15.90:0/2156227406 >> v2:172.21.15.90:3300/0 conn(0x7f99d40b5ff0 0x7f99d40b4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:00.642 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.635+0000 7fa7a9484700 1 -- start start 2023-06-09T04:42:00.642 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.635+0000 7ff524d1c700 1 --2- 172.21.15.90:0/513200200 >> v2:172.21.15.174:3300/0 conn(0x7ff520069820 0x7ff520069ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:00.642 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.635+0000 7ff52651f700 1 -- 172.21.15.90:0/513200200 --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff52006a1e0 con 0x7ff52006fb70 2023-06-09T04:42:00.643 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.635+0000 7f99d27fc700 1 -- 172.21.15.90:0/2156227406 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3208303004 0 0) 0x7f99d40cba90 con 0x7f99d4159b90 2023-06-09T04:42:00.643 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.635+0000 7f99d27fc700 1 -- 172.21.15.90:0/2156227406 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99bc0035d0 con 0x7f99d4159b90 2023-06-09T04:42:00.643 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.635+0000 7ff52651f700 1 -- 172.21.15.90:0/513200200 --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff520070480 con 0x7ff520069820 2023-06-09T04:42:00.643 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.635+0000 7ff52551d700 1 -- 172.21.15.90:0/513200200 >> v2:172.21.15.174:3300/0 conn(0x7ff520069820 msgr2=0x7ff520069ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:00.644 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.635+0000 7ff52551d700 1 --2- 172.21.15.90:0/513200200 >> v2:172.21.15.174:3300/0 conn(0x7ff520069820 0x7ff520069ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:00.644 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.635+0000 7ff52551d700 1 -- 172.21.15.90:0/513200200 >> v1:172.21.15.90:6789/0 conn(0x7ff5200cc5c0 legacy=0x7ff5200cc9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:00.644 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.635+0000 7ff52551d700 1 -- 172.21.15.90:0/513200200 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff52006a470 con 0x7ff52006fb70 2023-06-09T04:42:00.644 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.635+0000 7ff52551d700 1 --2- 172.21.15.90:0/513200200 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff52006fb70 0x7ff52006ff40 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff52006de70 tx=0x7ff51c00ad90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ad114fbfe2dc479 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:00.644 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.635+0000 7f99d27fc700 1 -- 172.21.15.90:0/2156227406 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 434539026 0 0) 0x7f99d40cb7b0 con 0x7f99d40cb320 2023-06-09T04:42:00.645 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.635+0000 7f99d27fc700 1 -- 172.21.15.90:0/2156227406 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99d40cba90 con 0x7f99d40cb320 2023-06-09T04:42:00.645 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.635+0000 7f99d27fc700 1 -- 172.21.15.90:0/2156227406 <== mon.1 v1:172.21.15.174:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 128000248 0 0) 0x7f99bc0035d0 con 0x7f99d4159b90 2023-06-09T04:42:00.645 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.635+0000 7f99d27fc700 1 -- 172.21.15.90:0/2156227406 >> v2:172.21.15.90:3300/0 conn(0x7f99d40b5ff0 msgr2=0x7f99d40b4040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:00.645 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.635+0000 7f99d27fc700 1 --2- 172.21.15.90:0/2156227406 >> v2:172.21.15.90:3300/0 conn(0x7f99d40b5ff0 0x7f99d40b4040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:00.645 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.635+0000 7f99d27fc700 1 -- 172.21.15.90:0/2156227406 >> v1:172.21.15.90:6789/0 conn(0x7f99d40cb320 legacy=0x7f99d40ce0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:00.645 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.635+0000 7f99d27fc700 1 -- 172.21.15.90:0/2156227406 --> v1:172.21.15.174:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99d40cc050 con 0x7f99d4159b90 2023-06-09T04:42:00.645 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.635+0000 7f99d27fc700 1 -- 172.21.15.90:0/2156227406 <== mon.1 v1:172.21.15.174:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3604404106 0 0) 0x7f99c40019f0 con 0x7f99d4159b90 2023-06-09T04:42:00.646 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.635+0000 7f99d27fc700 1 -- 172.21.15.90:0/2156227406 >> v1:172.21.15.174:6789/0 conn(0x7f99d4159b90 legacy=0x7f99d40b58e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:00.646 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.635+0000 7f99d27fc700 1 --2- 172.21.15.90:0/2156227406 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f99bc003bb0 0x7f99bc003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:00.646 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.635+0000 7f99d27fc700 1 --2- 172.21.15.90:0/2156227406 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f99bc004870 0x7f99bc004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:00.646 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.635+0000 7f99d27fc700 1 --2- 172.21.15.90:0/2156227406 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f99bc005220 0x7f99bc00ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:00.646 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.635+0000 7f99d27fc700 1 -- 172.21.15.90:0/2156227406 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99d40cbd70 con 0x7f99bc003bb0 2023-06-09T04:42:00.646 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.635+0000 7f99d27fc700 1 -- 172.21.15.90:0/2156227406 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99bc00c100 con 0x7f99bc004870 2023-06-09T04:42:00.646 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.635+0000 7f99d27fc700 1 -- 172.21.15.90:0/2156227406 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99bc00c2c0 con 0x7f99bc005220 2023-06-09T04:42:00.646 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.635+0000 7f99d37fe700 1 --2- 172.21.15.90:0/2156227406 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f99bc003bb0 0x7f99bc003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:00.647 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.635+0000 7f99d3fff700 1 --2- 172.21.15.90:0/2156227406 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f99bc005220 0x7f99bc00ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:00.647 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.635+0000 7f99d37fe700 1 -- 172.21.15.90:0/2156227406 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f99bc005220 msgr2=0x7f99bc00ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:00.647 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.635+0000 7f99d37fe700 1 --2- 172.21.15.90:0/2156227406 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f99bc005220 0x7f99bc00ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:00.647 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.635+0000 7f99d37fe700 1 -- 172.21.15.90:0/2156227406 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f99bc004870 msgr2=0x7f99bc004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:00.647 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.635+0000 7f99d37fe700 1 --2- 172.21.15.90:0/2156227406 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f99bc004870 0x7f99bc004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:00.647 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.635+0000 7f99d37fe700 1 -- 172.21.15.90:0/2156227406 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99bc0035d0 con 0x7f99bc003bb0 2023-06-09T04:42:00.647 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.635+0000 7f99d3fff700 1 -- 172.21.15.90:0/2156227406 reap_dead start 2023-06-09T04:42:00.648 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.635+0000 7fa7a9484700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa79c0e1230 0x7fa79c037ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:00.648 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.635+0000 7fa7a9484700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fa79c0e1600 0x7fa79c0e49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:00.648 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.635+0000 7fa7a9484700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fa79c0e4ee0 0x7fa79c036700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:00.648 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.635+0000 7fa7a2ffd700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa79c0e1230 0x7fa79c037ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:00.649 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.635+0000 7f99d37fe700 1 --2- 172.21.15.90:0/2156227406 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f99bc003bb0 0x7f99bc003f80 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f99c400a6e0 tx=0x7f99bc0058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=915b3f93b5ebbf2 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:00.649 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.635+0000 7fa7a2ffd700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa79c0e1230 0x7fa79c037ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.90:37302/0 (socket says 172.21.15.90:37302) 2023-06-09T04:42:00.649 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.635+0000 7fa7a2ffd700 1 -- 172.21.15.90:0/3858524682 learned_addr learned my addr 172.21.15.90:0/3858524682 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:00.650 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.635+0000 7f99d27fc700 1 -- 172.21.15.90:0/2156227406 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99c40070d0 con 0x7f99bc003bb0 2023-06-09T04:42:00.650 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.635+0000 7f99d27fc700 1 -- 172.21.15.90:0/2156227406 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99c4007230 con 0x7f99bc003bb0 2023-06-09T04:42:00.650 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.635+0000 7f99d27fc700 1 -- 172.21.15.90:0/2156227406 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99c40075e0 con 0x7f99bc003bb0 2023-06-09T04:42:00.650 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.635+0000 7ff517fff700 1 -- 172.21.15.90:0/513200200 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff51c00cb70 con 0x7ff52006fb70 2023-06-09T04:42:00.651 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.635+0000 7ff517fff700 1 -- 172.21.15.90:0/513200200 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff51c00ccd0 con 0x7ff52006fb70 2023-06-09T04:42:00.651 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.635+0000 7ff517fff700 1 -- 172.21.15.90:0/513200200 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff51c018620 con 0x7ff52006fb70 2023-06-09T04:42:00.651 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.635+0000 7fa7a27fc700 1 --2- 172.21.15.90:0/3858524682 >> v2:172.21.15.90:3300/0 conn(0x7fa79c0e1600 0x7fa79c0e49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:00.651 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.635+0000 7fa7a37fe700 1 --2- 172.21.15.90:0/3858524682 >> v2:172.21.15.174:3300/0 conn(0x7fa79c0e4ee0 0x7fa79c036700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:00.652 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.639+0000 7fa7a9484700 1 -- 172.21.15.90:0/3858524682 --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa79c0e4580 con 0x7fa79c0e1600 2023-06-09T04:42:00.652 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.639+0000 7fa7a9484700 1 -- 172.21.15.90:0/3858524682 --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa79c038010 con 0x7fa79c0e4ee0 2023-06-09T04:42:00.652 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.639+0000 7fa7a9484700 1 -- 172.21.15.90:0/3858524682 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa79c0e0a80 con 0x7fa79c0e1230 2023-06-09T04:42:00.652 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.639+0000 7f99d8c19700 1 -- 172.21.15.90:0/2156227406 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f99bc003bb0 msgr2=0x7f99bc003f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:00.653 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.639+0000 7f99d8c19700 1 --2- 172.21.15.90:0/2156227406 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f99bc003bb0 0x7f99bc003f80 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f99c400a6e0 tx=0x7f99bc0058a0 comp rx=0 tx=0).stop 2023-06-09T04:42:00.653 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.639+0000 7f99d8c19700 1 -- 172.21.15.90:0/2156227406 shutdown_connections 2023-06-09T04:42:00.653 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.639+0000 7f99d8c19700 1 --2- 172.21.15.90:0/2156227406 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f99bc003bb0 0x7f99bc003f80 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:00.653 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.639+0000 7f99d8c19700 1 -- 172.21.15.90:0/2156227406 >> 172.21.15.90:0/2156227406 conn(0x7f99d40d04d0 msgr2=0x7f99d40d08a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:00.653 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.639+0000 7f75f759e700 1 Processor -- start 2023-06-09T04:42:00.654 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.639+0000 7f99d8c19700 1 -- 172.21.15.90:0/2156227406 shutdown_connections 2023-06-09T04:42:00.654 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.639+0000 7f99d8c19700 1 -- 172.21.15.90:0/2156227406 wait complete. 2023-06-09T04:42:00.654 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.639+0000 7ff52651f700 1 -- 172.21.15.90:0/513200200 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff52006fb70 msgr2=0x7ff52006ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:00.654 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.639+0000 7ff52651f700 1 --2- 172.21.15.90:0/513200200 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff52006fb70 0x7ff52006ff40 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff52006de70 tx=0x7ff51c00ad90 comp rx=0 tx=0).stop 2023-06-09T04:42:00.655 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.639+0000 7f75f759e700 1 -- start start 2023-06-09T04:42:00.655 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.639+0000 7fa7a27fc700 1 -- 172.21.15.90:0/3858524682 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa79c0e1230 msgr2=0x7fa79c037ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:00.655 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.639+0000 7fa7a27fc700 1 --2- 172.21.15.90:0/3858524682 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa79c0e1230 0x7fa79c037ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:00.655 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.639+0000 7fa7a27fc700 1 -- 172.21.15.90:0/3858524682 >> v2:172.21.15.174:3300/0 conn(0x7fa79c0e4ee0 msgr2=0x7fa79c036700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:00.656 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.639+0000 7fa7a27fc700 1 --2- 172.21.15.90:0/3858524682 >> v2:172.21.15.174:3300/0 conn(0x7fa79c0e4ee0 0x7fa79c036700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:00.656 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.639+0000 7fa7a27fc700 1 -- 172.21.15.90:0/3858524682 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa79c050e90 con 0x7fa79c0e1600 2023-06-09T04:42:00.656 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.639+0000 7fa7a2ffd700 1 --2- 172.21.15.90:0/3858524682 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa79c0e1230 0x7fa79c037ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:42:00.656 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.639+0000 7fa7a27fc700 1 --2- 172.21.15.90:0/3858524682 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa79c0e1600 0x7fa79c0e49a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa79c0070f0 tx=0x7fa798009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac28b21196e52b57 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:00.656 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.639+0000 7ff52651f700 1 -- 172.21.15.90:0/513200200 shutdown_connections 2023-06-09T04:42:00.657 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.639+0000 7ff52651f700 1 --2- 172.21.15.90:0/513200200 >> v2:172.21.15.174:3300/0 conn(0x7ff520069820 0x7ff520069ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:00.657 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.639+0000 7ff52651f700 1 --2- 172.21.15.90:0/513200200 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff52006fb70 0x7ff52006ff40 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:00.657 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.639+0000 7ff52651f700 1 -- 172.21.15.90:0/513200200 >> 172.21.15.90:0/513200200 conn(0x7ff52006c690 msgr2=0x7ff5200aff00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:00.657 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.639+0000 7fa7a1ffb700 1 -- 172.21.15.90:0/3858524682 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa798014e90 con 0x7fa79c0e1600 2023-06-09T04:42:00.657 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.639+0000 7fa7a1ffb700 1 -- 172.21.15.90:0/3858524682 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa79801c440 con 0x7fa79c0e1600 2023-06-09T04:42:00.658 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.639+0000 7fa7a1ffb700 1 -- 172.21.15.90:0/3858524682 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa79801c7f0 con 0x7fa79c0e1600 2023-06-09T04:42:00.658 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.639+0000 7ff52651f700 1 -- 172.21.15.90:0/513200200 shutdown_connections 2023-06-09T04:42:00.658 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.639+0000 7fa7a9484700 1 -- 172.21.15.90:0/3858524682 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa79c0e1600 msgr2=0x7fa79c0e49a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:00.659 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.639+0000 7fa7a9484700 1 --2- 172.21.15.90:0/3858524682 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa79c0e1600 0x7fa79c0e49a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa79c0070f0 tx=0x7fa798009b30 comp rx=0 tx=0).stop 2023-06-09T04:42:00.659 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.639+0000 7f99d8c19700 1 Processor -- start 2023-06-09T04:42:00.659 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.639+0000 7f75f759e700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f75f81574c0 0x7f75f80cdb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:00.660 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.639+0000 7f75f759e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f75f80cb050 0x7f75f8069f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:00.660 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.639+0000 7f75f759e700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75f81618e0 con 0x7f75f80cac00 2023-06-09T04:42:00.660 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.639+0000 7f75f759e700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75f8157890 con 0x7f75f81574c0 2023-06-09T04:42:00.660 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.639+0000 7f75f759e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75f81647b0 con 0x7f75f80cb050 2023-06-09T04:42:00.660 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.643+0000 7fa7a9484700 1 -- 172.21.15.90:0/3858524682 shutdown_connections 2023-06-09T04:42:00.661 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.643+0000 7fa7a9484700 1 --2- 172.21.15.90:0/3858524682 >> v2:172.21.15.174:3300/0 conn(0x7fa79c0e4ee0 0x7fa79c036700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:00.661 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.643+0000 7fa7a9484700 1 --2- 172.21.15.90:0/3858524682 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa79c0e1600 0x7fa79c0e49a0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:00.661 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.643+0000 7f99d8c19700 1 -- start start 2023-06-09T04:42:00.661 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.643+0000 7fa7a9484700 1 --2- 172.21.15.90:0/3858524682 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa79c0e1230 0x7fa79c037ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:00.662 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.643+0000 7fa7a9484700 1 -- 172.21.15.90:0/3858524682 >> 172.21.15.90:0/3858524682 conn(0x7fa79c051700 msgr2=0x7fa79c051ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:00.662 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.643+0000 7f75f6d9d700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f75f80cb050 0x7f75f8069f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:00.662 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.643+0000 7f75f6d9d700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f75f80cb050 0x7f75f8069f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.90:37314/0 (socket says 172.21.15.90:37314) 2023-06-09T04:42:00.662 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.643+0000 7f75f6d9d700 1 -- 172.21.15.90:0/3265044579 learned_addr learned my addr 172.21.15.90:0/3265044579 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:00.663 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.643+0000 7fa7a9484700 1 -- 172.21.15.90:0/3858524682 shutdown_connections 2023-06-09T04:42:00.663 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.643+0000 7f75f659c700 1 --2- 172.21.15.90:0/3265044579 >> v2:172.21.15.174:3300/0 conn(0x7f75f81574c0 0x7f75f80cdb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:00.663 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.643+0000 7fdf51411700 1 Processor -- start 2023-06-09T04:42:00.664 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.639+0000 7ff52651f700 1 -- 172.21.15.90:0/513200200 wait complete. 2023-06-09T04:42:00.664 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.643+0000 7ff52651f700 1 Processor -- start 2023-06-09T04:42:00.664 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.643+0000 7fdf51411700 1 -- start start 2023-06-09T04:42:00.665 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.643+0000 7ff52651f700 1 -- start start 2023-06-09T04:42:00.665 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.643+0000 7fa7a9484700 1 -- 172.21.15.90:0/3858524682 wait complete. 2023-06-09T04:42:00.666 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.643+0000 7f75f6d9d700 1 -- 172.21.15.90:0/3265044579 >> v2:172.21.15.174:3300/0 conn(0x7f75f81574c0 msgr2=0x7f75f80cdb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:00.666 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.643+0000 7f75f6d9d700 1 --2- 172.21.15.90:0/3265044579 >> v2:172.21.15.174:3300/0 conn(0x7f75f81574c0 0x7f75f80cdb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:00.666 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.643+0000 7f75f6d9d700 1 -- 172.21.15.90:0/3265044579 >> v1:172.21.15.174:6789/0 conn(0x7f75f80cac00 legacy=0x7f75f8069820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:00.666 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.643+0000 7f75f6d9d700 1 -- 172.21.15.90:0/3265044579 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75f80ce040 con 0x7f75f80cb050 2023-06-09T04:42:00.666 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.643+0000 7f75f6d9d700 1 --2- 172.21.15.90:0/3265044579 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f75f80cb050 0x7f75f8069f30 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f75ec009910 tx=0x7f75ec009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b9205db0134eeff5 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:00.667 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.643+0000 7f99d8c19700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f99bc003bb0 0x7f99d40c9770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:00.667 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.643+0000 7f99d8c19700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f99d41f9780 0x7f99d406f910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:00.667 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.643+0000 7f99d37fe700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f99bc003bb0 0x7f99d40c9770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:00.667 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.643+0000 7f99d37fe700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f99bc003bb0 0x7f99d40c9770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.90:37316/0 (socket says 172.21.15.90:37316) 2023-06-09T04:42:00.667 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.643+0000 7f99d37fe700 1 -- 172.21.15.90:0/602020198 learned_addr learned my addr 172.21.15.90:0/602020198 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:00.668 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.643+0000 7f99d2ffd700 1 --2- 172.21.15.90:0/602020198 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f99d41f9780 0x7f99d406f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:00.668 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.643+0000 7fa7a9484700 1 Processor -- start 2023-06-09T04:42:00.668 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.643+0000 7ff52651f700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff520069820 0x7ff52014cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:00.669 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.643+0000 7fdf51411700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdf4c0b1750 0x7fdf4c0cd8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:00.669 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.643+0000 7fdf51411700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fdf4c0cf0b0 0x7fdf4c0caef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:00.669 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.643+0000 7fdf51411700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf4c0cdde0 con 0x7fdf4c0cce60 2023-06-09T04:42:00.669 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.643+0000 7fdf51411700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf4c0cec90 con 0x7fdf4c0cf0b0 2023-06-09T04:42:00.669 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.643+0000 7fdf51411700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf4c0cacb0 con 0x7fdf4c0b1750 2023-06-09T04:42:00.670 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.643+0000 7ff52651f700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff52006fb70 0x7ff52014f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:00.670 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.643+0000 7ff52651f700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff5200cc5c0 0x7ff5201fdf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:00.670 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.643+0000 7fa7a9484700 1 -- start start 2023-06-09T04:42:00.671 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.643+0000 7f99d8c19700 1 --2- 172.21.15.90:0/602020198 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f99d4155600 0x7f99d4155a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:00.671 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.643+0000 7f75f559a700 1 -- 172.21.15.90:0/3265044579 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75ec011830 con 0x7f75f80cb050 2023-06-09T04:42:00.671 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.643+0000 7f75f559a700 1 -- 172.21.15.90:0/3265044579 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75ec011990 con 0x7f75f80cb050 2023-06-09T04:42:00.672 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.643+0000 7f75f559a700 1 -- 172.21.15.90:0/3265044579 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75ec011d40 con 0x7f75f80cb050 2023-06-09T04:42:00.672 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.643+0000 7f75f759e700 1 -- 172.21.15.90:0/3265044579 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f75f80cb050 msgr2=0x7f75f8069f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:00.672 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.643+0000 7f75f759e700 1 --2- 172.21.15.90:0/3265044579 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f75f80cb050 0x7f75f8069f30 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f75ec009910 tx=0x7f75ec009c20 comp rx=0 tx=0).stop 2023-06-09T04:42:00.672 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.647+0000 7f99d8c19700 1 -- 172.21.15.90:0/602020198 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99d41f6920 con 0x7f99d41f9780 2023-06-09T04:42:00.672 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.647+0000 7f99d8c19700 1 -- 172.21.15.90:0/602020198 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99d41f7180 con 0x7f99d4155600 2023-06-09T04:42:00.673 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.647+0000 7f99d8c19700 1 -- 172.21.15.90:0/602020198 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99d4155fb0 con 0x7f99bc003bb0 2023-06-09T04:42:00.673 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.647+0000 7fdf4bfff700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fdf4c0cf0b0 0x7fdf4c0caef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:00.673 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.647+0000 7fdf4a7fc700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdf4c0b1750 0x7fdf4c0cd8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:00.674 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.647+0000 7fdf4a7fc700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdf4c0b1750 0x7fdf4c0cd8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.90:37324/0 (socket says 172.21.15.90:37324) 2023-06-09T04:42:00.674 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.647+0000 7ff52651f700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff52014d140 con 0x7ff52006fb70 2023-06-09T04:42:00.674 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.647+0000 7fdf4a7fc700 1 -- 172.21.15.90:0/562629458 learned_addr learned my addr 172.21.15.90:0/562629458 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:00.675 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.647+0000 7ff52651f700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff52014f890 con 0x7ff5200cc5c0 2023-06-09T04:42:00.675 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.647+0000 7f97231c1700 1 Processor -- start 2023-06-09T04:42:00.675 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.647+0000 7ff52651f700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5200b1570 con 0x7ff520069820 2023-06-09T04:42:00.676 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.647+0000 7ff52551d700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff520069820 0x7ff52014cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:00.676 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.647+0000 7f75f759e700 1 -- 172.21.15.90:0/3265044579 shutdown_connections 2023-06-09T04:42:00.676 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.647+0000 7f75f759e700 1 --2- 172.21.15.90:0/3265044579 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f75f80cb050 0x7f75f8069f30 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:00.676 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.647+0000 7f75f759e700 1 --2- 172.21.15.90:0/3265044579 >> v2:172.21.15.174:3300/0 conn(0x7f75f81574c0 0x7f75f80cdb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:00.676 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.647+0000 7f75f759e700 1 -- 172.21.15.90:0/3265044579 >> 172.21.15.90:0/3265044579 conn(0x7f75f806c690 msgr2=0x7f75f80aff00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:00.677 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.647+0000 7ff52551d700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff520069820 0x7ff52014cc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.90:37336/0 (socket says 172.21.15.90:37336) 2023-06-09T04:42:00.677 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.647+0000 7ff52551d700 1 -- 172.21.15.90:0/1393043232 learned_addr learned my addr 172.21.15.90:0/1393043232 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:00.677 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.647+0000 7ff525d1e700 1 --2- 172.21.15.90:0/1393043232 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff5200cc5c0 0x7ff5201fdf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:00.677 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.647+0000 7f99d3fff700 1 --2- 172.21.15.90:0/602020198 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f99d4155600 0x7f99d4155a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:00.678 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.647+0000 7ff524d1c700 1 --2- 172.21.15.90:0/1393043232 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff52006fb70 0x7ff52014f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:00.678 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.647+0000 7f75f759e700 1 -- 172.21.15.90:0/3265044579 shutdown_connections 2023-06-09T04:42:00.678 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.647+0000 7fa7a9484700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa79c0e1230 0x7fa79c0dda50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:00.679 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.647+0000 7fa7a9484700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa79c0e1600 0x7fa79c0d5d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:00.679 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.647+0000 7fa7a27fc700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa79c0e1600 0x7fa79c0d5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:00.679 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.647+0000 7fa7a27fc700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa79c0e1600 0x7fa79c0d5d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:33476/0 (socket says 172.21.15.90:33476) 2023-06-09T04:42:00.679 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.647+0000 7fa7a2ffd700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa79c0e1230 0x7fa79c0dda50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:00.680 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.647+0000 7ff525d1e700 1 -- 172.21.15.90:0/1393043232 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff520069820 msgr2=0x7ff52014cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:00.680 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.647+0000 7ff525d1e700 1 --2- 172.21.15.90:0/1393043232 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff520069820 0x7ff52014cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:00.680 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.647+0000 7ff525d1e700 1 -- 172.21.15.90:0/1393043232 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff52006fb70 msgr2=0x7ff52014f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:00.680 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.647+0000 7ff525d1e700 1 --2- 172.21.15.90:0/1393043232 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff52006fb70 0x7ff52014f350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:00.680 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.647+0000 7ff525d1e700 1 -- 172.21.15.90:0/1393043232 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff51c00a710 con 0x7ff5200cc5c0 2023-06-09T04:42:00.681 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.647+0000 7f99d2ffd700 1 -- 172.21.15.90:0/602020198 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f99bc003bb0 msgr2=0x7f99d40c9770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:00.681 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.647+0000 7f99d2ffd700 1 --2- 172.21.15.90:0/602020198 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f99bc003bb0 0x7f99d40c9770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:00.681 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.647+0000 7f99d2ffd700 1 -- 172.21.15.90:0/602020198 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f99d4155600 msgr2=0x7f99d4155a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:00.681 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.647+0000 7f99d2ffd700 1 --2- 172.21.15.90:0/602020198 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f99d4155600 0x7f99d4155a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:00.681 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.647+0000 7f99d2ffd700 1 -- 172.21.15.90:0/602020198 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99d40c9e30 con 0x7f99d41f9780 2023-06-09T04:42:00.681 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.647+0000 7f99d2ffd700 1 --2- 172.21.15.90:0/602020198 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f99d41f9780 0x7f99d406f910 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f99d4068540 tx=0x7f99c800c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:00.682 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.647+0000 7f97231c1700 1 -- start start 2023-06-09T04:42:00.682 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.647+0000 7fdf4a7fc700 1 -- 172.21.15.90:0/562629458 >> v2:172.21.15.90:3300/0 conn(0x7fdf4c0cf0b0 msgr2=0x7fdf4c0caef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:00.682 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.647+0000 7fdf4a7fc700 1 --2- 172.21.15.90:0/562629458 >> v2:172.21.15.90:3300/0 conn(0x7fdf4c0cf0b0 0x7fdf4c0caef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:00.683 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.647+0000 7fdf4a7fc700 1 -- 172.21.15.90:0/562629458 >> v1:172.21.15.174:6789/0 conn(0x7fdf4c0cce60 legacy=0x7fdf4c157ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:00.683 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.647+0000 7fdf4a7fc700 1 -- 172.21.15.90:0/562629458 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf4c0ce010 con 0x7fdf4c0b1750 2023-06-09T04:42:00.683 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.647+0000 7fdf4a7fc700 1 --2- 172.21.15.90:0/562629458 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdf4c0b1750 0x7fdf4c0cd8a0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fdf40009910 tx=0x7fdf40009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=240680a23db4bd14 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:00.683 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.647+0000 7fdf49ffb700 1 -- 172.21.15.90:0/562629458 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf4000ba60 con 0x7fdf4c0b1750 2023-06-09T04:42:00.683 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.647+0000 7fdf49ffb700 1 -- 172.21.15.90:0/562629458 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf4000bbc0 con 0x7fdf4c0b1750 2023-06-09T04:42:00.684 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.647+0000 7fdf49ffb700 1 -- 172.21.15.90:0/562629458 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf40009e60 con 0x7fdf4c0b1750 2023-06-09T04:42:00.684 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.647+0000 7fa7a2ffd700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa79c0e1230 0x7fa79c0dda50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.90:37352/0 (socket says 172.21.15.90:37352) 2023-06-09T04:42:00.684 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.647+0000 7fa7a27fc700 1 -- 172.21.15.90:0/1063553196 learned_addr learned my addr 172.21.15.90:0/1063553196 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:00.685 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.647+0000 7ff525d1e700 1 --2- 172.21.15.90:0/1393043232 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff5200cc5c0 0x7ff5201fdf90 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff51800cae0 tx=0x7ff51800cdf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:00.685 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.647+0000 7fa7a9484700 1 --2- 172.21.15.90:0/1063553196 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa79c0e4ee0 0x7fa79c0d07f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:00.685 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.647+0000 7f99bbfff700 1 -- 172.21.15.90:0/602020198 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99c80054e0 con 0x7f99d41f9780 2023-06-09T04:42:00.686 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.647+0000 7fa7a9484700 1 -- 172.21.15.90:0/1063553196 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa79c173a70 con 0x7fa79c0e1600 2023-06-09T04:42:00.686 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.647+0000 7ff515ffb700 1 -- 172.21.15.90:0/1393043232 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff518003c20 con 0x7ff5200cc5c0 2023-06-09T04:42:00.686 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.647+0000 7ff515ffb700 1 -- 172.21.15.90:0/1393043232 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff518003d80 con 0x7ff5200cc5c0 2023-06-09T04:42:00.686 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.647+0000 7fa7a9484700 1 -- 172.21.15.90:0/1063553196 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa79c0d3d70 con 0x7fa79c0e4ee0 2023-06-09T04:42:00.687 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.647+0000 7ff515ffb700 1 -- 172.21.15.90:0/1393043232 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff51800aa20 con 0x7ff5200cc5c0 2023-06-09T04:42:00.687 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.647+0000 7fa7a9484700 1 -- 172.21.15.90:0/1063553196 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa79c0487b0 con 0x7fa79c0e1230 2023-06-09T04:42:00.687 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.647+0000 7f99d8c19700 1 -- 172.21.15.90:0/602020198 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99d41f6b30 con 0x7f99d41f9780 2023-06-09T04:42:00.688 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.647+0000 7f99d8c19700 1 -- 172.21.15.90:0/602020198 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99d41f9bf0 con 0x7f99d41f9780 2023-06-09T04:42:00.688 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.647+0000 7f99bbfff700 1 -- 172.21.15.90:0/602020198 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99c80036a0 con 0x7f99d41f9780 2023-06-09T04:42:00.688 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.647+0000 7f99bbfff700 1 -- 172.21.15.90:0/602020198 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99c8003a50 con 0x7f99d41f9780 2023-06-09T04:42:00.688 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.647+0000 7fa7a37fe700 1 --2- 172.21.15.90:0/1063553196 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa79c0e4ee0 0x7fa79c0d07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:00.689 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.647+0000 7f97231c1700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f971c1574c0 0x7f971c0cdb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:00.689 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.647+0000 7f97231c1700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f971c0cac00 0x7f971c0cb050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:00.689 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.647+0000 7f97231c1700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f971c069820 0x7f971c069ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:00.689 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.647+0000 7f97231c1700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f971c157890 con 0x7f971c0cac00 2023-06-09T04:42:00.689 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.647+0000 7f97231c1700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f971c0cb590 con 0x7f971c1574c0 2023-06-09T04:42:00.689 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.647+0000 7f97231c1700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f971c1647b0 con 0x7f971c069820 2023-06-09T04:42:00.690 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.651+0000 7fa7a2ffd700 1 -- 172.21.15.90:0/1063553196 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa79c0e4ee0 msgr2=0x7fa79c0d07f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:00.690 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.651+0000 7fa7a2ffd700 1 --2- 172.21.15.90:0/1063553196 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa79c0e4ee0 0x7fa79c0d07f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:00.690 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.651+0000 7fa7a2ffd700 1 -- 172.21.15.90:0/1063553196 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa79c0e1600 msgr2=0x7fa79c0d5d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:00.690 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.651+0000 7fa7a2ffd700 1 --2- 172.21.15.90:0/1063553196 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa79c0e1600 0x7fa79c0d5d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:00.691 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.651+0000 7f9720f5d700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f971c1574c0 0x7f971c0cdb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:00.691 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.651+0000 7fdf51411700 1 -- 172.21.15.90:0/562629458 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdf4c0b1750 msgr2=0x7fdf4c0cd8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:00.691 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.651+0000 7fdf51411700 1 --2- 172.21.15.90:0/562629458 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdf4c0b1750 0x7fdf4c0cd8a0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fdf40009910 tx=0x7fdf40009c20 comp rx=0 tx=0).stop 2023-06-09T04:42:00.691 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.651+0000 7fa7a2ffd700 1 -- 172.21.15.90:0/1063553196 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7980094b0 con 0x7fa79c0e1230 2023-06-09T04:42:00.692 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.647+0000 7ff52651f700 1 -- 172.21.15.90:0/1393043232 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5200b1850 con 0x7ff5200cc5c0 2023-06-09T04:42:00.692 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.647+0000 7ff52651f700 1 -- 172.21.15.90:0/1393043232 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5200b1e10 con 0x7ff5200cc5c0 2023-06-09T04:42:00.692 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.651+0000 7f9720f5d700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f971c1574c0 0x7f971c0cdb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.90:38378/0 (socket says 172.21.15.90:38378) 2023-06-09T04:42:00.692 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.651+0000 7f9720f5d700 1 -- 172.21.15.90:0/3056854161 learned_addr learned my addr 172.21.15.90:0/3056854161 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:00.693 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.647+0000 7f75f759e700 1 -- 172.21.15.90:0/3265044579 wait complete. 2023-06-09T04:42:00.693 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.651+0000 7f75f759e700 1 Processor -- start 2023-06-09T04:42:00.693 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.651+0000 7fdf51411700 1 -- 172.21.15.90:0/562629458 shutdown_connections 2023-06-09T04:42:00.694 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.651+0000 7fdf51411700 1 --2- 172.21.15.90:0/562629458 >> v2:172.21.15.90:3300/0 conn(0x7fdf4c0cf0b0 0x7fdf4c0caef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:00.694 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.651+0000 7fdf51411700 1 --2- 172.21.15.90:0/562629458 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdf4c0b1750 0x7fdf4c0cd8a0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:00.694 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.651+0000 7fdf51411700 1 -- 172.21.15.90:0/562629458 >> 172.21.15.90:0/562629458 conn(0x7fdf4c06dfe0 msgr2=0x7fdf4c0cc750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:00.694 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.651+0000 7f972175e700 1 --2- 172.21.15.90:0/3056854161 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f971c069820 0x7f971c069ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:00.695 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.651+0000 7f971bfff700 1 --2- 172.21.15.90:0/3056854161 >> v2:172.21.15.90:3300/0 conn(0x7f971c0cac00 0x7f971c0cb050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:00.695 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.651+0000 7f9720f5d700 1 -- 172.21.15.90:0/3056854161 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f971c069820 msgr2=0x7f971c069ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:00.695 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.651+0000 7f9720f5d700 1 --2- 172.21.15.90:0/3056854161 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f971c069820 0x7f971c069ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:00.695 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.651+0000 7f9720f5d700 1 -- 172.21.15.90:0/3056854161 >> v2:172.21.15.90:3300/0 conn(0x7f971c0cac00 msgr2=0x7f971c0cb050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:00.695 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.651+0000 7fa7a2ffd700 1 --2- 172.21.15.90:0/1063553196 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa79c0e1230 0x7fa79c0dda50 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fa79400c7f0 tx=0x7fa79400cb00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:00.696 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.651+0000 7f99d8c19700 1 -- 172.21.15.90:0/602020198 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f99b4000fc0 con 0x7f99d41f9780 2023-06-09T04:42:00.696 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.651+0000 7fdf51411700 1 -- 172.21.15.90:0/562629458 shutdown_connections 2023-06-09T04:42:00.696 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.651+0000 7fdf51411700 1 -- 172.21.15.90:0/562629458 wait complete. 2023-06-09T04:42:00.697 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.651+0000 7f9720f5d700 1 --2- 172.21.15.90:0/3056854161 >> v2:172.21.15.90:3300/0 conn(0x7f971c0cac00 0x7f971c0cb050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:00.697 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.651+0000 7f9720f5d700 1 -- 172.21.15.90:0/3056854161 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f971c0ce040 con 0x7f971c1574c0 2023-06-09T04:42:00.697 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.651+0000 7f971bfff700 1 --2- 172.21.15.90:0/3056854161 >> v2:172.21.15.90:3300/0 conn(0x7f971c0cac00 0x7f971c0cb050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:42:00.697 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.651+0000 7fa78b7fe700 1 -- 172.21.15.90:0/1063553196 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa794011800 con 0x7fa79c0e1230 2023-06-09T04:42:00.697 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.651+0000 7fa78b7fe700 1 -- 172.21.15.90:0/1063553196 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa794011960 con 0x7fa79c0e1230 2023-06-09T04:42:00.698 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.651+0000 7fa78b7fe700 1 -- 172.21.15.90:0/1063553196 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa794011d10 con 0x7fa79c0e1230 2023-06-09T04:42:00.698 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.651+0000 7fa7a9484700 1 -- 172.21.15.90:0/1063553196 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa79c0d6270 con 0x7fa79c0e1230 2023-06-09T04:42:00.698 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.651+0000 7f9720f5d700 1 --2- 172.21.15.90:0/3056854161 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f971c1574c0 0x7f971c0cdb00 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f971c0cbd70 tx=0x7f971000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d97b653182770461 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:00.698 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.651+0000 7fa7a9484700 1 -- 172.21.15.90:0/1063553196 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa79c048a00 con 0x7fa79c0e1230 2023-06-09T04:42:00.699 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.651+0000 7f971b7fe700 1 -- 172.21.15.90:0/3056854161 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f971000e070 con 0x7f971c1574c0 2023-06-09T04:42:00.699 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.651+0000 7f971b7fe700 1 -- 172.21.15.90:0/3056854161 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f971000b9c0 con 0x7f971c1574c0 2023-06-09T04:42:00.699 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.651+0000 7f971b7fe700 1 -- 172.21.15.90:0/3056854161 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f971000bd70 con 0x7f971c1574c0 2023-06-09T04:42:00.700 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.651+0000 7f99bbfff700 1 -- 172.21.15.90:0/602020198 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f99c8003bb0 con 0x7f99d41f9780 2023-06-09T04:42:00.700 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.651+0000 7f97231c1700 1 -- 172.21.15.90:0/3056854161 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f971c1574c0 msgr2=0x7f971c0cdb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:00.701 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.651+0000 7f97231c1700 1 --2- 172.21.15.90:0/3056854161 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f971c1574c0 0x7f971c0cdb00 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f971c0cbd70 tx=0x7f971000b330 comp rx=0 tx=0).stop 2023-06-09T04:42:00.701 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.651+0000 7f97231c1700 1 -- 172.21.15.90:0/3056854161 shutdown_connections 2023-06-09T04:42:00.701 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.651+0000 7f97231c1700 1 --2- 172.21.15.90:0/3056854161 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f971c069820 0x7f971c069ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:00.701 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.651+0000 7f97231c1700 1 --2- 172.21.15.90:0/3056854161 >> v2:172.21.15.90:3300/0 conn(0x7f971c0cac00 0x7f971c0cb050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:00.701 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.651+0000 7f97231c1700 1 --2- 172.21.15.90:0/3056854161 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f971c1574c0 0x7f971c0cdb00 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:00.701 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.651+0000 7f97231c1700 1 -- 172.21.15.90:0/3056854161 >> 172.21.15.90:0/3056854161 conn(0x7f971c06c690 msgr2=0x7f971c0aff00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:00.701 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.651+0000 7f97231c1700 1 -- 172.21.15.90:0/3056854161 shutdown_connections 2023-06-09T04:42:00.702 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.651+0000 7f97231c1700 1 -- 172.21.15.90:0/3056854161 wait complete. 2023-06-09T04:42:00.702 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.655+0000 7ff515ffb700 1 -- 172.21.15.90:0/1393043232 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff51800ab80 con 0x7ff5200cc5c0 2023-06-09T04:42:00.703 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.655+0000 7f99bbfff700 1 --2- 172.21.15.90:0/602020198 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f99c0066340 0x7f99c00687f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:00.703 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.655+0000 7f99bbfff700 1 -- 172.21.15.90:0/602020198 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f99c8083190 con 0x7f99d41f9780 2023-06-09T04:42:00.703 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.655+0000 7fa7a9484700 1 -- 172.21.15.90:0/1063553196 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa79c0513c0 con 0x7fa79c0e1230 2023-06-09T04:42:00.703 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.655+0000 7ff52651f700 1 -- 172.21.15.90:0/1393043232 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff520159ba0 con 0x7ff5200cc5c0 2023-06-09T04:42:00.704 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.655+0000 7f99d37fe700 1 --2- 172.21.15.90:0/602020198 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f99c0066340 0x7f99c00687f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:00.704 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.655+0000 7f99bbfff700 1 --2- 172.21.15.90:0/602020198 >> [v2:172.21.15.90:6816/3499839122,v1:172.21.15.90:6817/3499839122] conn(0x7f99c006ebf0 0x7f99c0071000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:00.704 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.655+0000 7f99bbfff700 1 -- 172.21.15.90:0/602020198 --> [v2:172.21.15.90:6816/3499839122,v1:172.21.15.90:6817/3499839122] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f99c00716b0 con 0x7f99c006ebf0 2023-06-09T04:42:00.704 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.655+0000 7f99bbfff700 1 -- 172.21.15.90:0/602020198 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f99c8085770 con 0x7f99d41f9780 2023-06-09T04:42:00.705 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.655+0000 7fdf51411700 1 Processor -- start 2023-06-09T04:42:00.705 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.655+0000 7fdf51411700 1 -- start start 2023-06-09T04:42:00.705 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.655+0000 7f99d3fff700 1 --2- 172.21.15.90:0/602020198 >> [v2:172.21.15.90:6816/3499839122,v1:172.21.15.90:6817/3499839122] conn(0x7f99c006ebf0 0x7f99c0071000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:00.705 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.655+0000 7f75f759e700 1 -- start start 2023-06-09T04:42:00.706 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.655+0000 7ff515ffb700 1 --2- 172.21.15.90:0/1393043232 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7ff5040662f0 0x7ff5040687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:00.706 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.655+0000 7ff515ffb700 1 -- 172.21.15.90:0/1393043232 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff518083b90 con 0x7ff5200cc5c0 2023-06-09T04:42:00.706 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.655+0000 7f99d37fe700 1 --2- 172.21.15.90:0/602020198 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f99c0066340 0x7f99c00687f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f99c4007200 tx=0x7f99c4009000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:00.707 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.655+0000 7fdf51411700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdf4c0b1750 0x7fdf4c0cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:00.707 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.655+0000 7f99d3fff700 1 --2- 172.21.15.90:0/602020198 >> [v2:172.21.15.90:6816/3499839122,v1:172.21.15.90:6817/3499839122] conn(0x7f99c006ebf0 0x7f99c0071000 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:00.708 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.655+0000 7ff515ffb700 1 --2- 172.21.15.90:0/1393043232 >> [v2:172.21.15.90:6800/3064028136,v1:172.21.15.90:6801/3064028136] conn(0x7ff50406eb20 0x7ff504070f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:00.708 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.655+0000 7ff515ffb700 1 -- 172.21.15.90:0/1393043232 --> [v2:172.21.15.90:6800/3064028136,v1:172.21.15.90:6801/3064028136] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff5040715e0 con 0x7ff50406eb20 2023-06-09T04:42:00.708 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.655+0000 7ff515ffb700 1 -- 172.21.15.90:0/1393043232 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff5180882a0 con 0x7ff5200cc5c0 2023-06-09T04:42:00.708 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.655+0000 7fa78b7fe700 1 -- 172.21.15.90:0/1063553196 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa794018360 con 0x7fa79c0e1230 2023-06-09T04:42:00.709 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.655+0000 7f97231c1700 1 Processor -- start 2023-06-09T04:42:00.709 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.655+0000 7f2131770700 1 Processor -- start 2023-06-09T04:42:00.709 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.655+0000 7f2131770700 1 -- start start 2023-06-09T04:42:00.710 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.655+0000 7ff52551d700 1 --2- 172.21.15.90:0/1393043232 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7ff5040662f0 0x7ff5040687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:00.710 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.655+0000 7ff524d1c700 1 --2- 172.21.15.90:0/1393043232 >> [v2:172.21.15.90:6800/3064028136,v1:172.21.15.90:6801/3064028136] conn(0x7ff50406eb20 0x7ff504070f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:00.710 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.655+0000 7f97231c1700 1 -- start start 2023-06-09T04:42:00.711 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.655+0000 7fdf4affd700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdf4c0b1750 0x7fdf4c0cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:00.711 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.655+0000 7fdf4affd700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdf4c0b1750 0x7fdf4c0cfbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.90:37376/0 (socket says 172.21.15.90:37376) 2023-06-09T04:42:00.711 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.655+0000 7ff52551d700 1 --2- 172.21.15.90:0/1393043232 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7ff5040662f0 0x7ff5040687a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff51c00afd0 tx=0x7ff51c012000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:00.712 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.655+0000 7f99bbfff700 1 -- 172.21.15.90:0/602020198 <== osd.3 v2:172.21.15.90:6816/3499839122 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f99c00716b0 con 0x7f99c006ebf0 2023-06-09T04:42:00.712 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.659+0000 7fdf51411700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdf4c0cf0b0 0x7fdf4c0d0130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:00.712 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.659+0000 7fa78b7fe700 1 --2- 172.21.15.90:0/1063553196 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fa790066340 0x7fa7900687f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:00.713 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.655+0000 7ff524d1c700 1 --2- 172.21.15.90:0/1393043232 >> [v2:172.21.15.90:6800/3064028136,v1:172.21.15.90:6801/3064028136] conn(0x7ff50406eb20 0x7ff504070f30 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:00.713 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.659+0000 7f75f759e700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f75f80cac00 0x7f75f8158f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:00.713 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.659+0000 7f75f759e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f75f80cb050 0x7f75f815bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:00.713 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.659+0000 7fa78b7fe700 1 -- 172.21.15.90:0/1063553196 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa794083bc0 con 0x7fa79c0e1230 2023-06-09T04:42:00.714 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.659+0000 7f75f759e700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f75f81574c0 0x7f75f815c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:00.714 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.659+0000 7f75f759e700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75f81565f0 con 0x7f75f80cac00 2023-06-09T04:42:00.714 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.659+0000 7f75f759e700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75f815a5f0 con 0x7f75f81574c0 2023-06-09T04:42:00.714 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.659+0000 7f75f759e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75f8158480 con 0x7f75f80cb050 2023-06-09T04:42:00.715 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.659+0000 7f2131770700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f21240e2820 0x7f2124053690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:00.715 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.659+0000 7fa78b7fe700 1 --2- 172.21.15.90:0/1063553196 >> [v2:172.21.15.90:6808/2780271267,v1:172.21.15.90:6809/2780271267] conn(0x7fa79006ebf0 0x7fa790071000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:00.715 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.659+0000 7fa78b7fe700 1 -- 172.21.15.90:0/1063553196 --> [v2:172.21.15.90:6808/2780271267,v1:172.21.15.90:6809/2780271267] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa7900716b0 con 0x7fa79006ebf0 2023-06-09T04:42:00.715 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.659+0000 7fa78b7fe700 1 -- 172.21.15.90:0/1063553196 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa7940882a0 con 0x7fa79c0e1230 2023-06-09T04:42:00.716 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.659+0000 7f2131770700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f212403b1f0 0x7f212403beb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:00.716 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.659+0000 7f2131770700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2124007860 con 0x7f2124053bd0 2023-06-09T04:42:00.716 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.659+0000 7f2131770700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2124057650 con 0x7f212403b1f0 2023-06-09T04:42:00.716 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.659+0000 7f2131770700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2124057930 con 0x7f21240e2820 2023-06-09T04:42:00.716 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.659+0000 7fdf51411700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdf4c146140 0x7fdf4c1597e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:00.717 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.659+0000 7fdf51411700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf4c0c4530 con 0x7fdf4c0cf0b0 2023-06-09T04:42:00.717 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.659+0000 7fdf51411700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf4c159070 con 0x7fdf4c146140 2023-06-09T04:42:00.717 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.659+0000 7fdf51411700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf4c15b1d0 con 0x7fdf4c0b1750 2023-06-09T04:42:00.717 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.659+0000 7f212b7fe700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f212403b1f0 0x7f212403beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:00.717 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.659+0000 7fa7a27fc700 1 --2- 172.21.15.90:0/1063553196 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fa790066340 0x7fa7900687f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:00.718 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.659+0000 7f212b7fe700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f212403b1f0 0x7f212403beb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.90:38388/0 (socket says 172.21.15.90:38388) 2023-06-09T04:42:00.718 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.659+0000 7f212b7fe700 1 -- 172.21.15.90:0/3706331002 learned_addr learned my addr 172.21.15.90:0/3706331002 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:00.718 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.659+0000 7f75f5d9b700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f75f80cb050 0x7f75f815bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:00.718 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.659+0000 7f75f5d9b700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f75f80cb050 0x7f75f815bfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.90:37390/0 (socket says 172.21.15.90:37390) 2023-06-09T04:42:00.719 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.659+0000 7f75f5d9b700 1 -- 172.21.15.90:0/1781607525 learned_addr learned my addr 172.21.15.90:0/1781607525 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:00.719 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.659+0000 7f75f6d9d700 1 --2- 172.21.15.90:0/1781607525 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f75f81574c0 0x7f75f815c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:00.719 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.659+0000 7f212affd700 1 --2- 172.21.15.90:0/3706331002 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f21240e2820 0x7f2124053690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:00.719 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.659+0000 7f75f5d9b700 1 -- 172.21.15.90:0/1781607525 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f75f81574c0 msgr2=0x7f75f815c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:00.719 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.659+0000 7f75f5d9b700 1 --2- 172.21.15.90:0/1781607525 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f75f81574c0 0x7f75f815c510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:00.720 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.659+0000 7f75f5d9b700 1 -- 172.21.15.90:0/1781607525 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f75f80cac00 msgr2=0x7f75f8158f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:00.720 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.659+0000 7f75f5d9b700 1 --2- 172.21.15.90:0/1781607525 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f75f80cac00 0x7f75f8158f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:00.720 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.659+0000 7f75f5d9b700 1 -- 172.21.15.90:0/1781607525 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75ec009570 con 0x7f75f80cb050 2023-06-09T04:42:00.720 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.659+0000 7f2129ffb700 1 -- 172.21.15.90:0/3706331002 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1827938322 0 0) 0x7f2124007860 con 0x7f2124053bd0 2023-06-09T04:42:00.721 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.659+0000 7f2129ffb700 1 -- 172.21.15.90:0/3706331002 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f21140035d0 con 0x7f2124053bd0 2023-06-09T04:42:00.721 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.659+0000 7fa7a37fe700 1 --2- 172.21.15.90:0/1063553196 >> [v2:172.21.15.90:6808/2780271267,v1:172.21.15.90:6809/2780271267] conn(0x7fa79006ebf0 0x7fa790071000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:00.721 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.659+0000 7f75f5d9b700 1 --2- 172.21.15.90:0/1781607525 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f75f80cb050 0x7f75f815bfd0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f75e800c500 tx=0x7f75e800c810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:00.722 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.659+0000 7f2129ffb700 1 -- 172.21.15.90:0/3706331002 <== mon.1 v1:172.21.15.174:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1195739186 0 0) 0x7f21140035d0 con 0x7f2124053bd0 2023-06-09T04:42:00.722 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.659+0000 7f2129ffb700 1 -- 172.21.15.90:0/3706331002 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f21240e2820 msgr2=0x7f2124053690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:00.722 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.659+0000 7f2129ffb700 1 --2- 172.21.15.90:0/3706331002 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f21240e2820 0x7f2124053690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:00.722 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.659+0000 7fa7a27fc700 1 --2- 172.21.15.90:0/1063553196 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fa790066340 0x7fa7900687f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fa79c0df700 tx=0x7fa798018000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:00.723 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.659+0000 7f2129ffb700 1 -- 172.21.15.90:0/3706331002 >> v2:172.21.15.174:3300/0 conn(0x7f212403b1f0 msgr2=0x7f212403beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:00.723 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.659+0000 7f2129ffb700 1 --2- 172.21.15.90:0/3706331002 >> v2:172.21.15.174:3300/0 conn(0x7f212403b1f0 0x7f212403beb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:00.723 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.659+0000 7f2129ffb700 1 -- 172.21.15.90:0/3706331002 --> v1:172.21.15.174:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2124057c10 con 0x7f2124053bd0 2023-06-09T04:42:00.723 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.659+0000 7f2129ffb700 1 -- 172.21.15.90:0/3706331002 <== mon.1 v1:172.21.15.174:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3604404106 0 0) 0x7f2120001670 con 0x7f2124053bd0 2023-06-09T04:42:00.724 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.659+0000 7f97231c1700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f971c069820 0x7f971c162c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:00.724 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.659+0000 7f97231c1700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f971c0cac00 0x7f971c155ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:00.724 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.659+0000 7f97231c1700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f971c1574c0 0x7f971c159ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:00.724 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.659+0000 7f97231c1700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f971c1f9180 con 0x7f971c069820 2023-06-09T04:42:00.724 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.659+0000 7f97231c1700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f971c1f9390 con 0x7f971c1574c0 2023-06-09T04:42:00.724 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.659+0000 7f97231c1700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f971c1f9670 con 0x7f971c0cac00 2023-06-09T04:42:00.725 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.659+0000 7f2129ffb700 1 -- 172.21.15.90:0/3706331002 >> v1:172.21.15.174:6789/0 conn(0x7f2124053bd0 legacy=0x7f212403aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:00.725 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.659+0000 7f2129ffb700 1 --2- 172.21.15.90:0/3706331002 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2114003a20 0x7f2114003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:00.725 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.659+0000 7f2129ffb700 1 --2- 172.21.15.90:0/3706331002 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f21240e2820 0x7f2114004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:00.725 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.659+0000 7f2129ffb700 1 --2- 172.21.15.90:0/3706331002 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2114004db0 0x7f2114005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:00.726 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.659+0000 7f2129ffb700 1 -- 172.21.15.90:0/3706331002 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2124057650 con 0x7f2114004db0 2023-06-09T04:42:00.726 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.659+0000 7f2129ffb700 1 -- 172.21.15.90:0/3706331002 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2124057930 con 0x7f2114003a20 2023-06-09T04:42:00.726 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.659+0000 7f2129ffb700 1 -- 172.21.15.90:0/3706331002 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2114014240 con 0x7f21240e2820 2023-06-09T04:42:00.726 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.659+0000 7ff515ffb700 1 -- 172.21.15.90:0/1393043232 <== osd.1 v2:172.21.15.90:6800/3064028136 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7ff5040715e0 con 0x7ff50406eb20 2023-06-09T04:42:00.727 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.659+0000 7f9720f5d700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f971c069820 0x7f971c162c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:00.727 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.659+0000 7f9720f5d700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f971c069820 0x7f971c162c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:33506/0 (socket says 172.21.15.90:33506) 2023-06-09T04:42:00.727 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.659+0000 7f9720f5d700 1 -- 172.21.15.90:0/666598704 learned_addr learned my addr 172.21.15.90:0/666598704 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:00.728 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.659+0000 7fdf4a7fc700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdf4c0cf0b0 0x7fdf4c0d0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:00.728 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.659+0000 7fdf4a7fc700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdf4c0cf0b0 0x7fdf4c0d0130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:33492/0 (socket says 172.21.15.90:33492) 2023-06-09T04:42:00.728 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.659+0000 7fdf4a7fc700 1 -- 172.21.15.90:0/3364301073 learned_addr learned my addr 172.21.15.90:0/3364301073 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:00.728 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.659+0000 7fdf4bfff700 1 --2- 172.21.15.90:0/3364301073 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdf4c146140 0x7fdf4c1597e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:00.729 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.659+0000 7fdf4a7fc700 1 -- 172.21.15.90:0/3364301073 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdf4c0b1750 msgr2=0x7fdf4c0cfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:00.729 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.659+0000 7fdf4a7fc700 1 --2- 172.21.15.90:0/3364301073 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdf4c0b1750 0x7fdf4c0cfbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:00.729 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.659+0000 7fdf4a7fc700 1 -- 172.21.15.90:0/3364301073 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdf4c146140 msgr2=0x7fdf4c1597e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:00.730 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.659+0000 7fdf4a7fc700 1 --2- 172.21.15.90:0/3364301073 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdf4c146140 0x7fdf4c1597e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:00.730 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.659+0000 7fdf4a7fc700 1 -- 172.21.15.90:0/3364301073 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf40009570 con 0x7fdf4c0cf0b0 2023-06-09T04:42:00.730 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.659+0000 7fdf4bfff700 1 --2- 172.21.15.90:0/3364301073 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdf4c146140 0x7fdf4c1597e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:42:00.730 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.659+0000 7fdf4affd700 1 --2- 172.21.15.90:0/3364301073 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdf4c0b1750 0x7fdf4c0cfbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello state changed while learned_addr, mark_down or replacing must be happened just now 2023-06-09T04:42:00.731 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.659+0000 7f212a7fc700 1 --2- 172.21.15.90:0/3706331002 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f21240e2820 0x7f2114004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:00.731 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.659+0000 7f212affd700 1 --2- 172.21.15.90:0/3706331002 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2114003a20 0x7f2114003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:00.731 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.663+0000 7fc3cde4d700 1 Processor -- start 2023-06-09T04:42:00.731 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.659+0000 7f9720f5d700 1 -- 172.21.15.90:0/666598704 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f971c0cac00 msgr2=0x7f971c155ea0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-06-09T04:42:00.732 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.659+0000 7f9720f5d700 1 --2- 172.21.15.90:0/666598704 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f971c0cac00 0x7f971c155ea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:00.732 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.659+0000 7f9720f5d700 1 -- 172.21.15.90:0/666598704 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f971c1574c0 msgr2=0x7f971c159ba0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-06-09T04:42:00.732 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.659+0000 7f9720f5d700 1 --2- 172.21.15.90:0/666598704 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f971c1574c0 0x7f971c159ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:00.732 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.659+0000 7f9720f5d700 1 -- 172.21.15.90:0/666598704 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9710009b30 con 0x7f971c069820 2023-06-09T04:42:00.732 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.663+0000 7f9720f5d700 1 --2- 172.21.15.90:0/666598704 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f971c069820 0x7f971c162c60 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f971000b370 tx=0x7f9710004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:00.733 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.663+0000 7f212b7fe700 1 --2- 172.21.15.90:0/3706331002 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2114004db0 0x7f2114005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:00.733 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.663+0000 7f212affd700 1 -- 172.21.15.90:0/3706331002 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f21240e2820 msgr2=0x7f2114004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:00.733 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.663+0000 7f212affd700 1 --2- 172.21.15.90:0/3706331002 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f21240e2820 0x7f2114004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:00.733 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.663+0000 7f212affd700 1 -- 172.21.15.90:0/3706331002 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2114004db0 msgr2=0x7f2114005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:00.733 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.663+0000 7f212affd700 1 --2- 172.21.15.90:0/3706331002 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2114004db0 0x7f2114005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:00.733 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.663+0000 7f212affd700 1 -- 172.21.15.90:0/3706331002 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2124057c10 con 0x7f2114003a20 2023-06-09T04:42:00.734 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.663+0000 7f75e6ffd700 1 -- 172.21.15.90:0/1781607525 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75e80052d0 con 0x7f75f80cb050 2023-06-09T04:42:00.734 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.663+0000 7f75e6ffd700 1 -- 172.21.15.90:0/1781607525 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75e8005430 con 0x7f75f80cb050 2023-06-09T04:42:00.734 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.663+0000 7f75e6ffd700 1 -- 172.21.15.90:0/1781607525 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75e80055a0 con 0x7f75f80cb050 2023-06-09T04:42:00.734 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.663+0000 7f75f759e700 1 -- 172.21.15.90:0/1781607525 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75f8158760 con 0x7f75f80cb050 2023-06-09T04:42:00.735 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.663+0000 7f75f759e700 1 -- 172.21.15.90:0/1781607525 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75f815a8d0 con 0x7f75f80cb050 2023-06-09T04:42:00.735 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.663+0000 7f212b7fe700 1 --2- 172.21.15.90:0/3706331002 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2114004db0 0x7f2114005220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:42:00.735 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.663+0000 7fc3cde4d700 1 -- start start 2023-06-09T04:42:00.735 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.663+0000 7f212affd700 1 --2- 172.21.15.90:0/3706331002 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2114003a20 0x7f2114003e30 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f212c04f4a0 tx=0x7f21140058a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2002e4923bcd6c56 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:00.736 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.663+0000 7f97197fa700 1 -- 172.21.15.90:0/666598704 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97100042d0 con 0x7f971c069820 2023-06-09T04:42:00.736 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.663+0000 7f97197fa700 1 -- 172.21.15.90:0/666598704 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9710004430 con 0x7f971c069820 2023-06-09T04:42:00.736 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.663+0000 7fdf4a7fc700 1 --2- 172.21.15.90:0/3364301073 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdf4c0cf0b0 0x7fdf4c0d0130 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fdf40000c00 tx=0x7fdf40004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:00.737 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.663+0000 7f97197fa700 1 -- 172.21.15.90:0/666598704 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97100047e0 con 0x7f971c069820 2023-06-09T04:42:00.737 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.663+0000 7fa7a37fe700 1 --2- 172.21.15.90:0/1063553196 >> [v2:172.21.15.90:6808/2780271267,v1:172.21.15.90:6809/2780271267] conn(0x7fa79006ebf0 0x7fa790071000 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:00.737 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.663+0000 7f2129ffb700 1 -- 172.21.15.90:0/3706331002 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f212c08e070 con 0x7f2114003a20 2023-06-09T04:42:00.738 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.663+0000 7f2129ffb700 1 -- 172.21.15.90:0/3706331002 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f212c067280 con 0x7f2114003a20 2023-06-09T04:42:00.738 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.663+0000 7f2129ffb700 1 -- 172.21.15.90:0/3706331002 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f212c065b00 con 0x7f2114003a20 2023-06-09T04:42:00.738 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.663+0000 7fdf337fe700 1 -- 172.21.15.90:0/3364301073 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf40004510 con 0x7fdf4c0cf0b0 2023-06-09T04:42:00.738 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.663+0000 7fdf337fe700 1 -- 172.21.15.90:0/3364301073 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf400036c0 con 0x7fdf4c0cf0b0 2023-06-09T04:42:00.738 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.663+0000 7fdf337fe700 1 -- 172.21.15.90:0/3364301073 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf40003a70 con 0x7fdf4c0cf0b0 2023-06-09T04:42:00.739 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.663+0000 7fdf51411700 1 -- 172.21.15.90:0/3364301073 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf4c15b4b0 con 0x7fdf4c0cf0b0 2023-06-09T04:42:00.739 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.663+0000 7fdf51411700 1 -- 172.21.15.90:0/3364301073 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf4c1592c0 con 0x7fdf4c0cf0b0 2023-06-09T04:42:00.739 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.663+0000 7f97231c1700 1 -- 172.21.15.90:0/666598704 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f971c1f9950 con 0x7f971c069820 2023-06-09T04:42:00.739 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.663+0000 7f2131770700 1 -- 172.21.15.90:0/3706331002 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2114003a20 msgr2=0x7f2114003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:00.740 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.663+0000 7f2131770700 1 --2- 172.21.15.90:0/3706331002 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2114003a20 0x7f2114003e30 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f212c04f4a0 tx=0x7f21140058a0 comp rx=0 tx=0).stop 2023-06-09T04:42:00.740 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.663+0000 7f212b7fe700 1 -- 172.21.15.90:0/3706331002 reap_dead start 2023-06-09T04:42:00.740 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.663+0000 7fc3cde4d700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc3c8157d70 0x7fc3c80b3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:00.740 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.663+0000 7fc3cde4d700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fc3c8158140 0x7fc3c8069820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:00.740 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.663+0000 7fc3c77fe700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc3c8157d70 0x7fc3c80b3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:00.741 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.663+0000 7f97231c1700 1 -- 172.21.15.90:0/666598704 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f971c1631a0 con 0x7f971c069820 2023-06-09T04:42:00.741 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.663+0000 7fa78b7fe700 1 -- 172.21.15.90:0/1063553196 <== osd.0 v2:172.21.15.90:6808/2780271267 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fa7900716b0 con 0x7fa79006ebf0 2023-06-09T04:42:00.742 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.663+0000 7fc3cde4d700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc3c8069d60 0x7fc3c80c9c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:00.742 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.663+0000 7fc3cde4d700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3c80b0bc0 con 0x7fc3c8158140 2023-06-09T04:42:00.743 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.663+0000 7fc3cde4d700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3c806a1c0 con 0x7fc3c8157d70 2023-06-09T04:42:00.743 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.663+0000 7fc3cde4d700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3c80b41f0 con 0x7fc3c8069d60 2023-06-09T04:42:00.743 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.663+0000 7fc3c6ffd700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fc3c8158140 0x7fc3c8069820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:00.743 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.663+0000 7fc3c6ffd700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fc3c8158140 0x7fc3c8069820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:33516/0 (socket says 172.21.15.90:33516) 2023-06-09T04:42:00.743 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.663+0000 7fc3c6ffd700 1 -- 172.21.15.90:0/2104998425 learned_addr learned my addr 172.21.15.90:0/2104998425 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:00.743 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.667+0000 7fc3c6ffd700 1 -- 172.21.15.90:0/2104998425 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc3c8069d60 msgr2=0x7fc3c80c9c20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-06-09T04:42:00.743 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.667+0000 7fc3c6ffd700 1 --2- 172.21.15.90:0/2104998425 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc3c8069d60 0x7fc3c80c9c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:00.743 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.667+0000 7fc3c6ffd700 1 -- 172.21.15.90:0/2104998425 >> v2:172.21.15.174:3300/0 conn(0x7fc3c8157d70 msgr2=0x7fc3c80b3cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:00.744 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.667+0000 7fc3c6ffd700 1 --2- 172.21.15.90:0/2104998425 >> v2:172.21.15.174:3300/0 conn(0x7fc3c8157d70 0x7fc3c80b3cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:00.744 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.667+0000 7fc3c6ffd700 1 -- 172.21.15.90:0/2104998425 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3c80aff40 con 0x7fc3c8158140 2023-06-09T04:42:00.744 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.667+0000 7fc3c6ffd700 1 --2- 172.21.15.90:0/2104998425 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc3c8158140 0x7fc3c8069820 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc3c8070a40 tx=0x7fc3b4009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c83c73c8d0bdb7a server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:00.744 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.667+0000 7f2131770700 1 -- 172.21.15.90:0/3706331002 shutdown_connections 2023-06-09T04:42:00.745 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.667+0000 7f2131770700 1 -- 172.21.15.90:0/3706331002 >> 172.21.15.90:0/3706331002 conn(0x7f2124059060 msgr2=0x7f2124059460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:00.745 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.667+0000 7f97231c1700 1 -- 172.21.15.90:0/666598704 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f971c1f9500 con 0x7f971c069820 2023-06-09T04:42:00.745 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.667+0000 7f2131770700 1 -- 172.21.15.90:0/3706331002 shutdown_connections 2023-06-09T04:42:00.745 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.667+0000 7f97197fa700 1 -- 172.21.15.90:0/666598704 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f971001b430 con 0x7f971c069820 2023-06-09T04:42:00.746 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.667+0000 7f2131770700 1 -- 172.21.15.90:0/3706331002 wait complete. 2023-06-09T04:42:00.746 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.667+0000 7f75e6ffd700 1 -- 172.21.15.90:0/1781607525 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f75e80038c0 con 0x7f75f80cb050 2023-06-09T04:42:00.746 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.667+0000 7f75e6ffd700 1 --2- 172.21.15.90:0/1781607525 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f75d80663c0 0x7f75d8068870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:00.746 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.667+0000 7f75e6ffd700 1 -- 172.21.15.90:0/1781607525 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f75e8082fd0 con 0x7f75f80cb050 2023-06-09T04:42:00.747 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.667+0000 7f75f659c700 1 --2- 172.21.15.90:0/1781607525 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f75d80663c0 0x7f75d8068870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:00.747 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.667+0000 7fc3c67fc700 1 -- 172.21.15.90:0/2104998425 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3b400f940 con 0x7fc3c8158140 2023-06-09T04:42:00.747 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.667+0000 7fc3c67fc700 1 -- 172.21.15.90:0/2104998425 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3b400faa0 con 0x7fc3c8158140 2023-06-09T04:42:00.747 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.667+0000 7fc3cde4d700 1 -- 172.21.15.90:0/2104998425 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc3c8158140 msgr2=0x7fc3c8069820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:00.748 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.667+0000 7fc3cde4d700 1 --2- 172.21.15.90:0/2104998425 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc3c8158140 0x7fc3c8069820 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc3c8070a40 tx=0x7fc3b4009f90 comp rx=0 tx=0).stop 2023-06-09T04:42:00.748 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.667+0000 7f97197fa700 1 --2- 172.21.15.90:0/666598704 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f97080663f0 0x7f97080688a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:00.748 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.667+0000 7f97197fa700 1 -- 172.21.15.90:0/666598704 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9710084f30 con 0x7f971c069820 2023-06-09T04:42:00.748 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.671+0000 7fc3cde4d700 1 -- 172.21.15.90:0/2104998425 shutdown_connections 2023-06-09T04:42:00.749 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.671+0000 7fc3cde4d700 1 --2- 172.21.15.90:0/2104998425 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc3c8069d60 0x7fc3c80c9c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:00.749 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.671+0000 7fc3cde4d700 1 --2- 172.21.15.90:0/2104998425 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc3c8158140 0x7fc3c8069820 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:00.749 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.671+0000 7fc3cde4d700 1 --2- 172.21.15.90:0/2104998425 >> v2:172.21.15.174:3300/0 conn(0x7fc3c8157d70 0x7fc3c80b3cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:00.749 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.671+0000 7fc3cde4d700 1 -- 172.21.15.90:0/2104998425 >> 172.21.15.90:0/2104998425 conn(0x7fc3c80b1250 msgr2=0x7fc3c80b1650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:00.749 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.671+0000 7f97197fa700 1 --2- 172.21.15.90:0/666598704 >> [v2:172.21.15.174:6816/1707702879,v1:172.21.15.174:6818/1707702879] conn(0x7f970806eca0 0x7f97080710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:00.750 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.671+0000 7f97197fa700 1 -- 172.21.15.90:0/666598704 --> [v2:172.21.15.174:6816/1707702879,v1:172.21.15.174:6818/1707702879] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9708071760 con 0x7f970806eca0 2023-06-09T04:42:00.750 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.671+0000 7f97197fa700 1 -- 172.21.15.90:0/666598704 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9710087550 con 0x7f971c069820 2023-06-09T04:42:00.750 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.671+0000 7f971bfff700 1 --2- 172.21.15.90:0/666598704 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f97080663f0 0x7f97080688a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:00.750 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.671+0000 7f75f659c700 1 --2- 172.21.15.90:0/1781607525 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f75d80663c0 0x7f75d8068870 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f75f0009fa0 tx=0x7f75f000b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:00.751 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.671+0000 7f75f759e700 1 --2- 172.21.15.90:0/1781607525 >> [v2:172.21.15.90:6824/3713146326,v1:172.21.15.90:6825/3713146326] conn(0x7f75dc0015e0 0x7f75dc003a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:00.751 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.671+0000 7f75f759e700 1 -- 172.21.15.90:0/1781607525 --> [v2:172.21.15.90:6824/3713146326,v1:172.21.15.90:6825/3713146326] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f75dc006be0 con 0x7f75dc0015e0 2023-06-09T04:42:00.751 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.671+0000 7f2131770700 1 Processor -- start 2023-06-09T04:42:00.751 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.671+0000 7f972175e700 1 --2- 172.21.15.90:0/666598704 >> [v2:172.21.15.174:6816/1707702879,v1:172.21.15.174:6818/1707702879] conn(0x7f970806eca0 0x7f97080710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:00.752 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.671+0000 7fc3cde4d700 1 -- 172.21.15.90:0/2104998425 shutdown_connections 2023-06-09T04:42:00.752 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.671+0000 7fc3cde4d700 1 -- 172.21.15.90:0/2104998425 wait complete. 2023-06-09T04:42:00.752 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.671+0000 7f2131770700 1 -- start start 2023-06-09T04:42:00.753 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.671+0000 7f75f6d9d700 1 --2- 172.21.15.90:0/1781607525 >> [v2:172.21.15.90:6824/3713146326,v1:172.21.15.90:6825/3713146326] conn(0x7f75dc0015e0 0x7f75dc003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:00.753 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.671+0000 7f971bfff700 1 --2- 172.21.15.90:0/666598704 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f97080663f0 0x7f97080688a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f970c006fd0 tx=0x7f970c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:00.753 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.671+0000 7f972175e700 1 --2- 172.21.15.90:0/666598704 >> [v2:172.21.15.174:6816/1707702879,v1:172.21.15.174:6818/1707702879] conn(0x7f970806eca0 0x7f97080710b0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:00.754 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.671+0000 7f75f6d9d700 1 --2- 172.21.15.90:0/1781607525 >> [v2:172.21.15.90:6824/3713146326,v1:172.21.15.90:6825/3713146326] conn(0x7f75dc0015e0 0x7f75dc003a90 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:00.754 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.671+0000 7f2131770700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2114003a20 0x7f21240d4180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:00.754 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.671+0000 7fc3cde4d700 1 Processor -- start 2023-06-09T04:42:00.755 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.671+0000 7f2131770700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f21240e2e90 0x7f212404e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:00.755 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.671+0000 7f97197fa700 1 -- 172.21.15.90:0/666598704 <== osd.5 v2:172.21.15.174:6816/1707702879 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f9708071760 con 0x7f970806eca0 2023-06-09T04:42:00.755 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.671+0000 7f2131770700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f21240505f0 0x7f212403bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:00.755 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.675+0000 7f212affd700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2114003a20 0x7f21240d4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:00.756 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.675+0000 7f212affd700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2114003a20 0x7f21240d4180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.90:38438/0 (socket says 172.21.15.90:38438) 2023-06-09T04:42:00.756 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.675+0000 7f212a7fc700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f21240e2e90 0x7f212404e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:00.756 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.675+0000 7f212a7fc700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f21240e2e90 0x7f212404e6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.90:37412/0 (socket says 172.21.15.90:37412) 2023-06-09T04:42:00.756 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.675+0000 7f212b7fe700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f21240505f0 0x7f212403bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:00.756 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.675+0000 7f212b7fe700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f21240505f0 0x7f212403bf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:33520/0 (socket says 172.21.15.90:33520) 2023-06-09T04:42:00.757 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.675+0000 7fdf337fe700 1 -- 172.21.15.90:0/3364301073 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fdf40003bd0 con 0x7fdf4c0cf0b0 2023-06-09T04:42:00.757 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.675+0000 7fdf51411700 1 -- 172.21.15.90:0/3364301073 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fdf2c000fc0 con 0x7fdf4c0cf0b0 2023-06-09T04:42:00.757 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.671+0000 7fc3cde4d700 1 -- start start 2023-06-09T04:42:00.758 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.675+0000 7fc3cde4d700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc3c8069d60 0x7fc3c8156c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:00.758 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.675+0000 7fc3cde4d700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc3c8158140 0x7fc3c80c0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:00.758 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.675+0000 7fc3cde4d700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc3c80bcec0 0x7fc3c80bd330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:00.758 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.675+0000 7fc3cde4d700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3c80bd870 con 0x7fc3c80bcec0 2023-06-09T04:42:00.758 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.675+0000 7fc3cde4d700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3c80bfe40 con 0x7fc3c8158140 2023-06-09T04:42:00.758 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.675+0000 7fc3cde4d700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3c80c0120 con 0x7fc3c8069d60 2023-06-09T04:42:00.758 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.675+0000 7fc3c77fe700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc3c8069d60 0x7fc3c8156c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:00.759 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.675+0000 7fc3c77fe700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc3c8069d60 0x7fc3c8156c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.90:37414/0 (socket says 172.21.15.90:37414) 2023-06-09T04:42:00.759 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.675+0000 7fc3c77fe700 1 -- 172.21.15.90:0/2545790252 learned_addr learned my addr 172.21.15.90:0/2545790252 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:00.759 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.675+0000 7fc3c6ffd700 1 --2- 172.21.15.90:0/2545790252 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc3c8158140 0x7fc3c80c0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:00.759 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.675+0000 7fc3c77fe700 1 -- 172.21.15.90:0/2545790252 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc3c8158140 msgr2=0x7fc3c80c0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:00.759 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.675+0000 7fc3c77fe700 1 --2- 172.21.15.90:0/2545790252 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc3c8158140 0x7fc3c80c0ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:00.759 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.675+0000 7fc3c77fe700 1 -- 172.21.15.90:0/2545790252 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc3c80bcec0 msgr2=0x7fc3c80bd330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:00.759 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.675+0000 7fc3c77fe700 1 --2- 172.21.15.90:0/2545790252 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc3c80bcec0 0x7fc3c80bd330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:00.759 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.675+0000 7fc3c77fe700 1 -- 172.21.15.90:0/2545790252 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3b4009e00 con 0x7fc3c8069d60 2023-06-09T04:42:00.760 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.675+0000 7fdf337fe700 1 --2- 172.21.15.90:0/3364301073 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fdf38066370 0x7fdf38068820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:00.760 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.675+0000 7fdf337fe700 1 -- 172.21.15.90:0/3364301073 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fdf40084da0 con 0x7fdf4c0cf0b0 2023-06-09T04:42:00.760 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.675+0000 7fdf337fe700 1 --2- 172.21.15.90:0/3364301073 >> [v2:172.21.15.174:6800/864450534,v1:172.21.15.174:6801/864450534] conn(0x7fdf3806ec20 0x7fdf38071030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:00.761 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.675+0000 7fdf337fe700 1 -- 172.21.15.90:0/3364301073 --> [v2:172.21.15.174:6800/864450534,v1:172.21.15.174:6801/864450534] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fdf380716e0 con 0x7fdf3806ec20 2023-06-09T04:42:00.761 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.675+0000 7fdf337fe700 1 -- 172.21.15.90:0/3364301073 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdf400874b0 con 0x7fdf4c0cf0b0 2023-06-09T04:42:00.761 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.675+0000 7fdf4affd700 1 --2- 172.21.15.90:0/3364301073 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fdf38066370 0x7fdf38068820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:00.761 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.675+0000 7fc3c77fe700 1 --2- 172.21.15.90:0/2545790252 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc3c8069d60 0x7fc3c8156c10 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fc3bc00c820 tx=0x7fc3bc00cb30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:00.761 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.675+0000 7fdf4bfff700 1 --2- 172.21.15.90:0/3364301073 >> [v2:172.21.15.174:6800/864450534,v1:172.21.15.174:6801/864450534] conn(0x7fdf3806ec20 0x7fdf38071030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:00.762 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.671+0000 7f75e6ffd700 1 -- 172.21.15.90:0/1781607525 <== osd.2 v2:172.21.15.90:6824/3713146326 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f75dc006be0 con 0x7f75dc0015e0 2023-06-09T04:42:00.762 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.679+0000 7fdf4affd700 1 --2- 172.21.15.90:0/3364301073 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fdf38066370 0x7fdf38068820 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fdf3c000f60 tx=0x7fdf3c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:00.763 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.679+0000 7fdf4bfff700 1 --2- 172.21.15.90:0/3364301073 >> [v2:172.21.15.174:6800/864450534,v1:172.21.15.174:6801/864450534] conn(0x7fdf3806ec20 0x7fdf38071030 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:00.763 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.679+0000 7f212affd700 1 -- 172.21.15.90:0/3422166608 learned_addr learned my addr 172.21.15.90:0/3422166608 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:00.763 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.679+0000 7f2131770700 1 -- 172.21.15.90:0/3422166608 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21240e40d0 con 0x7f21240505f0 2023-06-09T04:42:00.763 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.679+0000 7f2131770700 1 -- 172.21.15.90:0/3422166608 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21240e3450 con 0x7f2114003a20 2023-06-09T04:42:00.764 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.679+0000 7f2131770700 1 -- 172.21.15.90:0/3422166608 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21240e3730 con 0x7f21240e2e90 2023-06-09T04:42:00.764 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.679+0000 7fc3b3fff700 1 -- 172.21.15.90:0/2545790252 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3bc011800 con 0x7fc3c8069d60 2023-06-09T04:42:00.765 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.679+0000 7f212affd700 1 -- 172.21.15.90:0/3422166608 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f21240e2e90 msgr2=0x7f212404e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:00.765 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.679+0000 7f212affd700 1 --2- 172.21.15.90:0/3422166608 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f21240e2e90 0x7f212404e6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:00.765 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.679+0000 7f212affd700 1 -- 172.21.15.90:0/3422166608 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f21240505f0 msgr2=0x7f212403bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:00.765 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.679+0000 7f212affd700 1 --2- 172.21.15.90:0/3422166608 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f21240505f0 0x7f212403bf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:00.765 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.679+0000 7f212affd700 1 -- 172.21.15.90:0/3422166608 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21240e3a10 con 0x7f2114003a20 2023-06-09T04:42:00.765 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.679+0000 7f212a7fc700 1 --2- 172.21.15.90:0/3422166608 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f21240e2e90 0x7f212404e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:42:00.766 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.679+0000 7fc3cde4d700 1 -- 172.21.15.90:0/2545790252 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3c80c0400 con 0x7fc3c8069d60 2023-06-09T04:42:00.766 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.679+0000 7fc3cde4d700 1 -- 172.21.15.90:0/2545790252 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3c80c09c0 con 0x7fc3c8069d60 2023-06-09T04:42:00.766 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.679+0000 7fc3b3fff700 1 -- 172.21.15.90:0/2545790252 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3bc011960 con 0x7fc3c8069d60 2023-06-09T04:42:00.766 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.679+0000 7fc3b3fff700 1 -- 172.21.15.90:0/2545790252 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3bc011cf0 con 0x7fc3c8069d60 2023-06-09T04:42:00.766 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.679+0000 7f212affd700 1 --2- 172.21.15.90:0/3422166608 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2114003a20 0x7f21240d4180 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f212c04e950 tx=0x7f212c069790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:00.767 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.679+0000 7f21137fe700 1 -- 172.21.15.90:0/3422166608 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f212c066010 con 0x7f2114003a20 2023-06-09T04:42:00.767 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.679+0000 7f21137fe700 1 -- 172.21.15.90:0/3422166608 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f212c066170 con 0x7f2114003a20 2023-06-09T04:42:00.767 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.679+0000 7f21137fe700 1 -- 172.21.15.90:0/3422166608 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f212c09c480 con 0x7f2114003a20 2023-06-09T04:42:00.767 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.679+0000 7f2131770700 1 -- 172.21.15.90:0/3422166608 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21240e3cf0 con 0x7f2114003a20 2023-06-09T04:42:00.767 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.679+0000 7fdf337fe700 1 -- 172.21.15.90:0/3364301073 <== osd.6 v2:172.21.15.174:6800/864450534 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fdf380716e0 con 0x7fdf3806ec20 2023-06-09T04:42:00.768 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.679+0000 7f2131770700 1 -- 172.21.15.90:0/3422166608 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2124050a60 con 0x7f2114003a20 2023-06-09T04:42:00.768 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.683+0000 7f21137fe700 1 -- 172.21.15.90:0/3422166608 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f212c093460 con 0x7f2114003a20 2023-06-09T04:42:00.768 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.683+0000 7fc3b3fff700 1 -- 172.21.15.90:0/2545790252 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc3bc018360 con 0x7fc3c8069d60 2023-06-09T04:42:00.769 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.683+0000 7fc3b3fff700 1 --2- 172.21.15.90:0/2545790252 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fc3ac0663c0 0x7fc3ac068870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:00.769 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.683+0000 7fc3b3fff700 1 -- 172.21.15.90:0/2545790252 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc3bc083be0 con 0x7fc3c8069d60 2023-06-09T04:42:00.769 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.683+0000 7fc3cde4d700 1 --2- 172.21.15.90:0/2545790252 >> [v2:172.21.15.174:6817/1138565854,v1:172.21.15.174:6819/1138565854] conn(0x7fc3a40015e0 0x7fc3a4003a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:00.769 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.683+0000 7f21137fe700 1 --2- 172.21.15.90:0/3422166608 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f21180662f0 0x7f21180687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:00.769 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.683+0000 7f21137fe700 1 -- 172.21.15.90:0/3422166608 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f212c0fe440 con 0x7f2114003a20 2023-06-09T04:42:00.770 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.687+0000 7fc3cde4d700 1 -- 172.21.15.90:0/2545790252 --> [v2:172.21.15.174:6817/1138565854,v1:172.21.15.174:6819/1138565854] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc3a4006be0 con 0x7fc3a40015e0 2023-06-09T04:42:00.770 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.687+0000 7f212a7fc700 1 --2- 172.21.15.90:0/3422166608 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f21180662f0 0x7f21180687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:00.770 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.687+0000 7fc3ccbeb700 1 --2- 172.21.15.90:0/2545790252 >> [v2:172.21.15.174:6817/1138565854,v1:172.21.15.174:6819/1138565854] conn(0x7fc3a40015e0 0x7fc3a4003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:00.770 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.687+0000 7fc3c6ffd700 1 --2- 172.21.15.90:0/2545790252 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fc3ac0663c0 0x7fc3ac068870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:00.771 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.687+0000 7f2131770700 1 --2- 172.21.15.90:0/3422166608 >> [v2:172.21.15.174:6808/2527640659,v1:172.21.15.174:6809/2527640659] conn(0x7f210c0015e0 0x7f210c003a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:00.771 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.687+0000 7f2131770700 1 -- 172.21.15.90:0/3422166608 --> [v2:172.21.15.174:6808/2527640659,v1:172.21.15.174:6809/2527640659] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f210c006be0 con 0x7f210c0015e0 2023-06-09T04:42:00.771 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.687+0000 7f99d8c19700 1 -- 172.21.15.90:0/602020198 --> [v2:172.21.15.90:6816/3499839122,v1:172.21.15.90:6817/3499839122] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f99b4002d60 con 0x7f99c006ebf0 2023-06-09T04:42:00.772 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.687+0000 7f212b7fe700 1 --2- 172.21.15.90:0/3422166608 >> [v2:172.21.15.174:6808/2527640659,v1:172.21.15.174:6809/2527640659] conn(0x7f210c0015e0 0x7f210c003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:00.772 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.687+0000 7f212a7fc700 1 --2- 172.21.15.90:0/3422166608 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f21180662f0 0x7f21180687a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f21200017e0 tx=0x7f2120009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:00.772 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.687+0000 7fc3ccbeb700 1 --2- 172.21.15.90:0/2545790252 >> [v2:172.21.15.174:6817/1138565854,v1:172.21.15.174:6819/1138565854] conn(0x7fc3a40015e0 0x7fc3a4003a90 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:00.772 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.687+0000 7f99bbfff700 1 -- 172.21.15.90:0/602020198 <== osd.3 v2:172.21.15.90:6816/3499839122 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f99b4002d60 con 0x7f99c006ebf0 2023-06-09T04:42:00.773 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.687+0000 7fc3c6ffd700 1 --2- 172.21.15.90:0/2545790252 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fc3ac0663c0 0x7fc3ac068870 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc3b4019040 tx=0x7fc3b4008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:00.773 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.687+0000 7f99d8c19700 1 -- 172.21.15.90:0/602020198 >> [v2:172.21.15.90:6816/3499839122,v1:172.21.15.90:6817/3499839122] conn(0x7f99c006ebf0 msgr2=0x7f99c0071000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:00.774 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.687+0000 7f99d8c19700 1 --2- 172.21.15.90:0/602020198 >> [v2:172.21.15.90:6816/3499839122,v1:172.21.15.90:6817/3499839122] conn(0x7f99c006ebf0 0x7f99c0071000 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:00.774 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.687+0000 7f212b7fe700 1 --2- 172.21.15.90:0/3422166608 >> [v2:172.21.15.174:6808/2527640659,v1:172.21.15.174:6809/2527640659] conn(0x7f210c0015e0 0x7f210c003a90 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:00.775 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.687+0000 7f99d8c19700 1 -- 172.21.15.90:0/602020198 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f99c0066340 msgr2=0x7f99c00687f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:00.775 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.687+0000 7f99d8c19700 1 --2- 172.21.15.90:0/602020198 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f99c0066340 0x7f99c00687f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f99c4007200 tx=0x7f99c4009000 comp rx=0 tx=0).stop 2023-06-09T04:42:00.775 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.687+0000 7f99d8c19700 1 -- 172.21.15.90:0/602020198 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f99d41f9780 msgr2=0x7f99d406f910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:00.775 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.687+0000 7f99d8c19700 1 --2- 172.21.15.90:0/602020198 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f99d41f9780 0x7f99d406f910 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f99d4068540 tx=0x7f99c800c9e0 comp rx=0 tx=0).stop 2023-06-09T04:42:00.775 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.687+0000 7f99d3fff700 1 -- 172.21.15.90:0/602020198 reap_dead start 2023-06-09T04:42:00.776 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.687+0000 7f99d8c19700 1 -- 172.21.15.90:0/602020198 shutdown_connections 2023-06-09T04:42:00.776 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.687+0000 7f99d8c19700 1 -- 172.21.15.90:0/602020198 >> 172.21.15.90:0/602020198 conn(0x7f99d40d04d0 msgr2=0x7f99d41588d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:00.776 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.691+0000 7fc3b3fff700 1 -- 172.21.15.90:0/2545790252 <== osd.4 v2:172.21.15.174:6817/1138565854 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fc3a4006be0 con 0x7fc3a40015e0 2023-06-09T04:42:00.776 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.691+0000 7f99d8c19700 1 -- 172.21.15.90:0/602020198 shutdown_connections 2023-06-09T04:42:00.777 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.691+0000 7f99d8c19700 1 -- 172.21.15.90:0/602020198 wait complete. 2023-06-09T04:42:00.777 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.691+0000 7f21137fe700 1 -- 172.21.15.90:0/3422166608 <== osd.7 v2:172.21.15.174:6808/2527640659 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f210c006be0 con 0x7f210c0015e0 2023-06-09T04:42:00.777 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.691+0000 7fa7a9484700 1 -- 172.21.15.90:0/1063553196 --> [v2:172.21.15.90:6808/2780271267,v1:172.21.15.90:6809/2780271267] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa79c0510e0 con 0x7fa79006ebf0 2023-06-09T04:42:00.778 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.695+0000 7fa78b7fe700 1 -- 172.21.15.90:0/1063553196 <== osd.0 v2:172.21.15.90:6808/2780271267 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fa7a4067840 con 0x7fa79006ebf0 2023-06-09T04:42:00.778 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.695+0000 7fa7a9484700 1 -- 172.21.15.90:0/1063553196 >> [v2:172.21.15.90:6808/2780271267,v1:172.21.15.90:6809/2780271267] conn(0x7fa79006ebf0 msgr2=0x7fa790071000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:00.778 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.695+0000 7fa7a9484700 1 --2- 172.21.15.90:0/1063553196 >> [v2:172.21.15.90:6808/2780271267,v1:172.21.15.90:6809/2780271267] conn(0x7fa79006ebf0 0x7fa790071000 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:00.779 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.695+0000 7fa7a9484700 1 -- 172.21.15.90:0/1063553196 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fa790066340 msgr2=0x7fa7900687f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:00.779 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.695+0000 7fa7a9484700 1 --2- 172.21.15.90:0/1063553196 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fa790066340 0x7fa7900687f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fa79c0df700 tx=0x7fa798018000 comp rx=0 tx=0).stop 2023-06-09T04:42:00.779 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.699+0000 7fa7a9484700 1 -- 172.21.15.90:0/1063553196 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa79c0e1230 msgr2=0x7fa79c0dda50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:00.779 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.699+0000 7fa7a9484700 1 --2- 172.21.15.90:0/1063553196 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa79c0e1230 0x7fa79c0dda50 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fa79400c7f0 tx=0x7fa79400cb00 comp rx=0 tx=0).stop 2023-06-09T04:42:00.779 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.699+0000 7fa7a37fe700 1 -- 172.21.15.90:0/1063553196 reap_dead start 2023-06-09T04:42:00.779 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.699+0000 7ff52651f700 1 -- 172.21.15.90:0/1393043232 --> [v2:172.21.15.90:6800/3064028136,v1:172.21.15.90:6801/3064028136] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff52006a750 con 0x7ff50406eb20 2023-06-09T04:42:00.780 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.699+0000 7fa7a9484700 1 -- 172.21.15.90:0/1063553196 shutdown_connections 2023-06-09T04:42:00.780 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.699+0000 7f75f759e700 1 -- 172.21.15.90:0/1781607525 --> [v2:172.21.15.90:6824/3713146326,v1:172.21.15.90:6825/3713146326] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f75dc005c60 con 0x7f75dc0015e0 2023-06-09T04:42:00.781 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.699+0000 7fa7a9484700 1 -- 172.21.15.90:0/1063553196 >> 172.21.15.90:0/1063553196 conn(0x7fa79c051700 msgr2=0x7fa79c04ffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:00.781 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.699+0000 7ff515ffb700 1 -- 172.21.15.90:0/1393043232 <== osd.1 v2:172.21.15.90:6800/3064028136 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7ff510006de0 con 0x7ff50406eb20 2023-06-09T04:42:00.782 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.699+0000 7f75e6ffd700 1 -- 172.21.15.90:0/1781607525 <== osd.2 v2:172.21.15.90:6824/3713146326 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f75dc005c60 con 0x7f75dc0015e0 2023-06-09T04:42:00.782 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.699+0000 7fa7a9484700 1 -- 172.21.15.90:0/1063553196 shutdown_connections 2023-06-09T04:42:00.782 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.699+0000 7fa7a9484700 1 -- 172.21.15.90:0/1063553196 wait complete. 2023-06-09T04:42:00.783 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.699+0000 7ff52651f700 1 -- 172.21.15.90:0/1393043232 >> [v2:172.21.15.90:6800/3064028136,v1:172.21.15.90:6801/3064028136] conn(0x7ff50406eb20 msgr2=0x7ff504070f30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:00.783 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.699+0000 7ff52651f700 1 --2- 172.21.15.90:0/1393043232 >> [v2:172.21.15.90:6800/3064028136,v1:172.21.15.90:6801/3064028136] conn(0x7ff50406eb20 0x7ff504070f30 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:00.783 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.703+0000 7ff52651f700 1 -- 172.21.15.90:0/1393043232 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7ff5040662f0 msgr2=0x7ff5040687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:00.783 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.703+0000 7ff52651f700 1 --2- 172.21.15.90:0/1393043232 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7ff5040662f0 0x7ff5040687a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff51c00afd0 tx=0x7ff51c012000 comp rx=0 tx=0).stop 2023-06-09T04:42:00.784 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.703+0000 7f75f759e700 1 -- 172.21.15.90:0/1781607525 >> [v2:172.21.15.90:6824/3713146326,v1:172.21.15.90:6825/3713146326] conn(0x7f75dc0015e0 msgr2=0x7f75dc003a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:00.784 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.703+0000 7f75f759e700 1 --2- 172.21.15.90:0/1781607525 >> [v2:172.21.15.90:6824/3713146326,v1:172.21.15.90:6825/3713146326] conn(0x7f75dc0015e0 0x7f75dc003a90 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:00.784 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.703+0000 7f75f759e700 1 -- 172.21.15.90:0/1781607525 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f75d80663c0 msgr2=0x7f75d8068870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:00.785 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.703+0000 7f75f759e700 1 --2- 172.21.15.90:0/1781607525 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f75d80663c0 0x7f75d8068870 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f75f0009fa0 tx=0x7f75f000b040 comp rx=0 tx=0).stop 2023-06-09T04:42:00.785 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.703+0000 7f75f759e700 1 -- 172.21.15.90:0/1781607525 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f75f80cb050 msgr2=0x7f75f815bfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:00.785 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.703+0000 7f75f759e700 1 --2- 172.21.15.90:0/1781607525 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f75f80cb050 0x7f75f815bfd0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f75e800c500 tx=0x7f75e800c810 comp rx=0 tx=0).stop 2023-06-09T04:42:00.785 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.703+0000 7f75f6d9d700 1 -- 172.21.15.90:0/1781607525 reap_dead start 2023-06-09T04:42:00.785 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.703+0000 7f75f759e700 1 -- 172.21.15.90:0/1781607525 shutdown_connections 2023-06-09T04:42:00.785 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.703+0000 7f75f759e700 1 -- 172.21.15.90:0/1781607525 >> 172.21.15.90:0/1781607525 conn(0x7f75f806c690 msgr2=0x7f75f80cce70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:00.785 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.703+0000 7f75f759e700 1 -- 172.21.15.90:0/1781607525 shutdown_connections 2023-06-09T04:42:00.785 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.703+0000 7f75f759e700 1 -- 172.21.15.90:0/1781607525 wait complete. 2023-06-09T04:42:00.786 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.703+0000 7ff52651f700 1 -- 172.21.15.90:0/1393043232 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff5200cc5c0 msgr2=0x7ff5201fdf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:00.786 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.703+0000 7ff52651f700 1 --2- 172.21.15.90:0/1393043232 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff5200cc5c0 0x7ff5201fdf90 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff51800cae0 tx=0x7ff51800cdf0 comp rx=0 tx=0).stop 2023-06-09T04:42:00.786 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.703+0000 7ff525d1e700 1 -- 172.21.15.90:0/1393043232 reap_dead start 2023-06-09T04:42:00.787 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.703+0000 7ff52651f700 1 -- 172.21.15.90:0/1393043232 shutdown_connections 2023-06-09T04:42:00.787 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.703+0000 7ff52651f700 1 -- 172.21.15.90:0/1393043232 >> 172.21.15.90:0/1393043232 conn(0x7ff52006c690 msgr2=0x7ff520155360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:00.787 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.703+0000 7f97231c1700 1 -- 172.21.15.90:0/666598704 --> [v2:172.21.15.174:6816/1707702879,v1:172.21.15.174:6818/1707702879] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f971c0ca7d0 con 0x7f970806eca0 2023-06-09T04:42:00.787 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.703+0000 7ff52651f700 1 -- 172.21.15.90:0/1393043232 shutdown_connections 2023-06-09T04:42:00.788 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.703+0000 7ff52651f700 1 -- 172.21.15.90:0/1393043232 wait complete. 2023-06-09T04:42:00.788 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.703+0000 7f97197fa700 1 -- 172.21.15.90:0/666598704 <== osd.5 v2:172.21.15.174:6816/1707702879 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f9714009280 con 0x7f970806eca0 2023-06-09T04:42:00.788 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.711+0000 7fdf51411700 1 -- 172.21.15.90:0/3364301073 --> [v2:172.21.15.174:6800/864450534,v1:172.21.15.174:6801/864450534] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fdf2c002d90 con 0x7fdf3806ec20 2023-06-09T04:42:00.789 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.711+0000 7f9702ffd700 1 -- 172.21.15.90:0/666598704 >> [v2:172.21.15.174:6816/1707702879,v1:172.21.15.174:6818/1707702879] conn(0x7f970806eca0 msgr2=0x7f97080710b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:00.789 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.711+0000 7f9702ffd700 1 --2- 172.21.15.90:0/666598704 >> [v2:172.21.15.174:6816/1707702879,v1:172.21.15.174:6818/1707702879] conn(0x7f970806eca0 0x7f97080710b0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:00.793 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.711+0000 7f9702ffd700 1 -- 172.21.15.90:0/666598704 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f97080663f0 msgr2=0x7f97080688a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:00.793 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.711+0000 7f9702ffd700 1 --2- 172.21.15.90:0/666598704 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f97080663f0 0x7f97080688a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f970c006fd0 tx=0x7f970c008040 comp rx=0 tx=0).stop 2023-06-09T04:42:00.794 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.711+0000 7f9702ffd700 1 -- 172.21.15.90:0/666598704 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f971c069820 msgr2=0x7f971c162c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:00.794 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.711+0000 7f9702ffd700 1 --2- 172.21.15.90:0/666598704 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f971c069820 0x7f971c162c60 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f971000b370 tx=0x7f9710004af0 comp rx=0 tx=0).stop 2023-06-09T04:42:00.794 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.711+0000 7f972175e700 1 -- 172.21.15.90:0/666598704 reap_dead start 2023-06-09T04:42:00.794 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.711+0000 7fdf337fe700 1 -- 172.21.15.90:0/3364301073 <== osd.6 v2:172.21.15.174:6800/864450534 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fdf2c002d90 con 0x7fdf3806ec20 2023-06-09T04:42:00.795 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.711+0000 7f9702ffd700 1 -- 172.21.15.90:0/666598704 shutdown_connections 2023-06-09T04:42:00.795 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.711+0000 7f9702ffd700 1 -- 172.21.15.90:0/666598704 >> 172.21.15.90:0/666598704 conn(0x7f971c06c690 msgr2=0x7f971c0ae7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:00.795 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.711+0000 7f9702ffd700 1 -- 172.21.15.90:0/666598704 shutdown_connections 2023-06-09T04:42:00.795 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.715+0000 7f9702ffd700 1 -- 172.21.15.90:0/666598704 wait complete. 2023-06-09T04:42:00.796 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.715+0000 7fc3cde4d700 1 -- 172.21.15.90:0/2545790252 --> [v2:172.21.15.174:6817/1138565854,v1:172.21.15.174:6819/1138565854] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc3a4005cc0 con 0x7fc3a40015e0 2023-06-09T04:42:00.796 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.715+0000 7fdf51411700 1 -- 172.21.15.90:0/3364301073 >> [v2:172.21.15.174:6800/864450534,v1:172.21.15.174:6801/864450534] conn(0x7fdf3806ec20 msgr2=0x7fdf38071030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:00.797 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.715+0000 7fdf51411700 1 --2- 172.21.15.90:0/3364301073 >> [v2:172.21.15.174:6800/864450534,v1:172.21.15.174:6801/864450534] conn(0x7fdf3806ec20 0x7fdf38071030 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:00.797 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.715+0000 7fdf51411700 1 -- 172.21.15.90:0/3364301073 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fdf38066370 msgr2=0x7fdf38068820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:00.797 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.715+0000 7fdf51411700 1 --2- 172.21.15.90:0/3364301073 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fdf38066370 0x7fdf38068820 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fdf3c000f60 tx=0x7fdf3c009040 comp rx=0 tx=0).stop 2023-06-09T04:42:00.797 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.715+0000 7fdf51411700 1 -- 172.21.15.90:0/3364301073 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdf4c0cf0b0 msgr2=0x7fdf4c0d0130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:00.797 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.715+0000 7fdf51411700 1 --2- 172.21.15.90:0/3364301073 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdf4c0cf0b0 0x7fdf4c0d0130 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fdf40000c00 tx=0x7fdf40004770 comp rx=0 tx=0).stop 2023-06-09T04:42:00.797 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.715+0000 7fdf4bfff700 1 -- 172.21.15.90:0/3364301073 reap_dead start 2023-06-09T04:42:00.798 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.715+0000 7fc3b3fff700 1 -- 172.21.15.90:0/2545790252 <== osd.4 v2:172.21.15.174:6817/1138565854 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fc3a4005cc0 con 0x7fc3a40015e0 2023-06-09T04:42:00.798 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.715+0000 7fdf51411700 1 -- 172.21.15.90:0/3364301073 shutdown_connections 2023-06-09T04:42:00.798 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.715+0000 7fdf51411700 1 -- 172.21.15.90:0/3364301073 >> 172.21.15.90:0/3364301073 conn(0x7fdf4c06dfe0 msgr2=0x7fdf4c0b4140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:00.799 INFO:teuthology.orchestra.run.smithi090.stdout:55834574853 2023-06-09T04:42:00.799 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-06-09T04:42:00.800 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.715+0000 7fc3cde4d700 1 -- 172.21.15.90:0/2545790252 >> [v2:172.21.15.174:6817/1138565854,v1:172.21.15.174:6819/1138565854] conn(0x7fc3a40015e0 msgr2=0x7fc3a4003a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:00.801 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.715+0000 7fc3cde4d700 1 --2- 172.21.15.90:0/2545790252 >> [v2:172.21.15.174:6817/1138565854,v1:172.21.15.174:6819/1138565854] conn(0x7fc3a40015e0 0x7fc3a4003a90 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:00.801 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.715+0000 7fc3cde4d700 1 -- 172.21.15.90:0/2545790252 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fc3ac0663c0 msgr2=0x7fc3ac068870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:00.801 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.715+0000 7fc3cde4d700 1 --2- 172.21.15.90:0/2545790252 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fc3ac0663c0 0x7fc3ac068870 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc3b4019040 tx=0x7fc3b4008030 comp rx=0 tx=0).stop 2023-06-09T04:42:00.801 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.715+0000 7fc3cde4d700 1 -- 172.21.15.90:0/2545790252 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc3c8069d60 msgr2=0x7fc3c8156c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:00.801 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.715+0000 7fc3cde4d700 1 --2- 172.21.15.90:0/2545790252 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc3c8069d60 0x7fc3c8156c10 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fc3bc00c820 tx=0x7fc3bc00cb30 comp rx=0 tx=0).stop 2023-06-09T04:42:00.801 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.715+0000 7fc3ccbeb700 1 -- 172.21.15.90:0/2545790252 reap_dead start 2023-06-09T04:42:00.801 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.715+0000 7fc3cde4d700 1 -- 172.21.15.90:0/2545790252 shutdown_connections 2023-06-09T04:42:00.802 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.715+0000 7fc3cde4d700 1 -- 172.21.15.90:0/2545790252 >> 172.21.15.90:0/2545790252 conn(0x7fc3c80b1250 msgr2=0x7fc3c80ae190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:00.802 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.715+0000 7fc3cde4d700 1 -- 172.21.15.90:0/2545790252 shutdown_connections 2023-06-09T04:42:00.802 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.715+0000 7fc3cde4d700 1 -- 172.21.15.90:0/2545790252 wait complete. 2023-06-09T04:42:00.802 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.719+0000 7f2131770700 1 -- 172.21.15.90:0/3422166608 --> [v2:172.21.15.174:6808/2527640659,v1:172.21.15.174:6809/2527640659] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f210c005c60 con 0x7f210c0015e0 2023-06-09T04:42:00.802 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.719+0000 7fdf51411700 1 -- 172.21.15.90:0/3364301073 shutdown_connections 2023-06-09T04:42:00.803 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.719+0000 7fdf51411700 1 -- 172.21.15.90:0/3364301073 wait complete. 2023-06-09T04:42:00.803 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.723+0000 7f21137fe700 1 -- 172.21.15.90:0/3422166608 <== osd.7 v2:172.21.15.174:6808/2527640659 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f210c005c60 con 0x7f210c0015e0 2023-06-09T04:42:00.804 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.723+0000 7f2131770700 1 -- 172.21.15.90:0/3422166608 >> [v2:172.21.15.174:6808/2527640659,v1:172.21.15.174:6809/2527640659] conn(0x7f210c0015e0 msgr2=0x7f210c003a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:00.804 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.723+0000 7f2131770700 1 --2- 172.21.15.90:0/3422166608 >> [v2:172.21.15.174:6808/2527640659,v1:172.21.15.174:6809/2527640659] conn(0x7f210c0015e0 0x7f210c003a90 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:00.804 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.723+0000 7f2131770700 1 -- 172.21.15.90:0/3422166608 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f21180662f0 msgr2=0x7f21180687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:00.804 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.723+0000 7f2131770700 1 --2- 172.21.15.90:0/3422166608 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f21180662f0 0x7f21180687a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f21200017e0 tx=0x7f2120009040 comp rx=0 tx=0).stop 2023-06-09T04:42:00.804 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.723+0000 7f2131770700 1 -- 172.21.15.90:0/3422166608 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2114003a20 msgr2=0x7f21240d4180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:00.804 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.723+0000 7f2131770700 1 --2- 172.21.15.90:0/3422166608 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2114003a20 0x7f21240d4180 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f212c04e950 tx=0x7f212c069790 comp rx=0 tx=0).stop 2023-06-09T04:42:00.805 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.723+0000 7f212b7fe700 1 -- 172.21.15.90:0/3422166608 reap_dead start 2023-06-09T04:42:00.805 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.723+0000 7f2131770700 1 -- 172.21.15.90:0/3422166608 shutdown_connections 2023-06-09T04:42:00.805 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.723+0000 7f2131770700 1 -- 172.21.15.90:0/3422166608 >> 172.21.15.90:0/3422166608 conn(0x7f2124059060 msgr2=0x7f21240db6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:00.805 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.723+0000 7f2131770700 1 -- 172.21.15.90:0/3422166608 shutdown_connections 2023-06-09T04:42:00.805 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:00.723+0000 7f2131770700 1 -- 172.21.15.90:0/3422166608 wait complete. 2023-06-09T04:42:00.806 INFO:teuthology.orchestra.run.smithi090.stdout:55834574855 2023-06-09T04:42:00.806 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-06-09T04:42:00.807 INFO:teuthology.orchestra.run.smithi090.stdout:55834574855 2023-06-09T04:42:00.807 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-06-09T04:42:00.808 INFO:teuthology.orchestra.run.smithi090.stdout:55834574854 2023-06-09T04:42:00.809 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-06-09T04:42:00.810 INFO:teuthology.orchestra.run.smithi090.stdout:55834574854 2023-06-09T04:42:00.810 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-06-09T04:42:00.811 INFO:teuthology.orchestra.run.smithi090.stdout:55834574855 2023-06-09T04:42:00.811 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-06-09T04:42:00.812 INFO:teuthology.orchestra.run.smithi090.stdout:55834574854 2023-06-09T04:42:00.812 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-06-09T04:42:00.813 INFO:teuthology.orchestra.run.smithi090.stdout:55834574855 2023-06-09T04:42:00.813 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-06-09T04:42:01.072 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.067+0000 7fae08a78700 1 Processor -- start 2023-06-09T04:42:01.073 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.067+0000 7fae08a78700 1 -- start start 2023-06-09T04:42:01.075 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.071+0000 7fae08a78700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fadfc0550a0 0x7fadfc051410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:01.075 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.071+0000 7fae08a78700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadfc0e6280 con 0x7fadfc0e3770 2023-06-09T04:42:01.075 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.071+0000 7fae08a78700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadfc0e6560 con 0x7fadfc0e28d0 2023-06-09T04:42:01.075 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.071+0000 7fae08a78700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadfc0e7100 con 0x7fadfc0550a0 2023-06-09T04:42:01.076 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.071+0000 7fae01d9b700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7fadfc0e3770 0x7fadfc054990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:46504/0 (socket says 172.21.15.90:46504) 2023-06-09T04:42:01.076 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.071+0000 7fae01d9b700 1 -- 172.21.15.90:0/5388553 learned_addr learned my addr 172.21.15.90:0/5388553 (peer_addr_for_me v1:172.21.15.90:0/0) 2023-06-09T04:42:01.076 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.071+0000 7fae02d9d700 1 --2- 172.21.15.90:0/5388553 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fadfc0550a0 0x7fadfc051410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:01.076 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.071+0000 7fae0159a700 1 -- 172.21.15.90:0/5388553 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4048451768 0 0) 0x7fadfc0e6280 con 0x7fadfc0e3770 2023-06-09T04:42:01.077 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.071+0000 7fae0159a700 1 -- 172.21.15.90:0/5388553 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fadec0035d0 con 0x7fadfc0e3770 2023-06-09T04:42:01.077 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.071+0000 7fae0159a700 1 -- 172.21.15.90:0/5388553 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1571625950 0 0) 0x7fadfc0e6560 con 0x7fadfc0e28d0 2023-06-09T04:42:01.077 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.071+0000 7fae0159a700 1 -- 172.21.15.90:0/5388553 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fadfc0e6280 con 0x7fadfc0e28d0 2023-06-09T04:42:01.077 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.071+0000 7fae02d9d700 1 -- 172.21.15.90:0/5388553 >> v1:172.21.15.174:6789/0 conn(0x7fadfc0e28d0 legacy=0x7fadfc0e69f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:01.077 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.071+0000 7fae02d9d700 1 -- 172.21.15.90:0/5388553 >> v1:172.21.15.90:6789/0 conn(0x7fadfc0e3770 legacy=0x7fadfc054990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:01.078 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.071+0000 7fae02d9d700 1 -- 172.21.15.90:0/5388553 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadfc038b90 con 0x7fadfc0550a0 2023-06-09T04:42:01.078 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.071+0000 7ff2b232d700 1 Processor -- start 2023-06-09T04:42:01.078 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.071+0000 7fae02d9d700 1 --2- 172.21.15.90:0/5388553 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fadfc0550a0 0x7fadfc051410 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fae04000b60 tx=0x7fae04069790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6200c492b8d1769e server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:01.079 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.071+0000 7fae0159a700 1 -- 172.21.15.90:0/5388553 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae04065900 con 0x7fadfc0550a0 2023-06-09T04:42:01.079 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.071+0000 7fae0159a700 1 -- 172.21.15.90:0/5388553 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae04065a60 con 0x7fadfc0550a0 2023-06-09T04:42:01.079 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.071+0000 7fae0159a700 1 -- 172.21.15.90:0/5388553 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae040669c0 con 0x7fadfc0550a0 2023-06-09T04:42:01.079 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.071+0000 7fae08a78700 1 -- 172.21.15.90:0/5388553 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fadfc0550a0 msgr2=0x7fadfc051410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:01.079 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.071+0000 7fae08a78700 1 --2- 172.21.15.90:0/5388553 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fadfc0550a0 0x7fadfc051410 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fae04000b60 tx=0x7fae04069790 comp rx=0 tx=0).stop 2023-06-09T04:42:01.079 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.071+0000 7ff2b232d700 1 -- start start 2023-06-09T04:42:01.080 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.075+0000 7fae08a78700 1 -- 172.21.15.90:0/5388553 shutdown_connections 2023-06-09T04:42:01.080 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.075+0000 7fae08a78700 1 --2- 172.21.15.90:0/5388553 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fadfc0550a0 0x7fadfc051410 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:01.080 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.075+0000 7fae08a78700 1 -- 172.21.15.90:0/5388553 >> 172.21.15.90:0/5388553 conn(0x7fadfc00cf60 msgr2=0x7fadfc053840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:01.080 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.075+0000 7fae08a78700 1 -- 172.21.15.90:0/5388553 shutdown_connections 2023-06-09T04:42:01.081 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.075+0000 7ff2b232d700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff2ac0cb310 0x7ff2ac0cdb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:01.081 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.075+0000 7ff2b232d700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ff2ac1608d0 0x7ff2ac160d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:01.081 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.075+0000 7ff2b232d700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2ac1647b0 con 0x7ff2ac1574c0 2023-06-09T04:42:01.081 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.075+0000 7ff2b232d700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2ac157890 con 0x7ff2ac1608d0 2023-06-09T04:42:01.081 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.075+0000 7ff2b232d700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2ac0ce040 con 0x7ff2ac0cb310 2023-06-09T04:42:01.082 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.075+0000 7fae08a78700 1 -- 172.21.15.90:0/5388553 wait complete. 2023-06-09T04:42:01.082 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.075+0000 7ff2b08ca700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ff2ac1608d0 0x7ff2ac160d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:01.082 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.075+0000 7ff2abfff700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7ff2ac1574c0 0x7ff2ac0cac00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:46508/0 (socket says 172.21.15.90:46508) 2023-06-09T04:42:01.082 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.075+0000 7ff2abfff700 1 -- 172.21.15.90:0/2269868794 learned_addr learned my addr 172.21.15.90:0/2269868794 (peer_addr_for_me v1:172.21.15.90:0/0) 2023-06-09T04:42:01.082 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.075+0000 7fc67764d700 1 Processor -- start 2023-06-09T04:42:01.083 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.075+0000 7fa6018c3700 1 Processor -- start 2023-06-09T04:42:01.083 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.075+0000 7ff2b08ca700 1 -- 172.21.15.90:0/2269868794 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff2ac0cb310 msgr2=0x7ff2ac0cdb00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-06-09T04:42:01.083 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.075+0000 7ff2b08ca700 1 --2- 172.21.15.90:0/2269868794 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff2ac0cb310 0x7ff2ac0cdb00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:01.084 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.075+0000 7ff2b08ca700 1 -- 172.21.15.90:0/2269868794 >> v1:172.21.15.90:6789/0 conn(0x7ff2ac1574c0 legacy=0x7ff2ac0cac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:01.084 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.075+0000 7ff2b08ca700 1 -- 172.21.15.90:0/2269868794 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2ac163ec0 con 0x7ff2ac1608d0 2023-06-09T04:42:01.084 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.075+0000 7ff2b08ca700 1 --2- 172.21.15.90:0/2269868794 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff2ac1608d0 0x7ff2ac160d50 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff294009880 tx=0x7ff294009b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aad59b66b0471b8d server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:01.084 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.075+0000 7fae08a78700 1 Processor -- start 2023-06-09T04:42:01.085 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.075+0000 7ff2ab7fe700 1 -- 172.21.15.90:0/2269868794 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff294011830 con 0x7ff2ac1608d0 2023-06-09T04:42:01.085 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.075+0000 7ff2ab7fe700 1 -- 172.21.15.90:0/2269868794 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff294011990 con 0x7ff2ac1608d0 2023-06-09T04:42:01.085 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.075+0000 7ff2ab7fe700 1 -- 172.21.15.90:0/2269868794 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff294011d20 con 0x7ff2ac1608d0 2023-06-09T04:42:01.085 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.075+0000 7fa6018c3700 1 -- start start 2023-06-09T04:42:01.085 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.079+0000 7fa6018c3700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa5f4036e80 0x7fa5f40f18a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:01.085 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.079+0000 7fa6018c3700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5f4053df0 con 0x7fa5f40e6e60 2023-06-09T04:42:01.086 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.079+0000 7fa6018c3700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5f404fa50 con 0x7fa5f40512b0 2023-06-09T04:42:01.086 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.079+0000 7fa6018c3700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f40486b0 con 0x7fa5f4036e80 2023-06-09T04:42:01.086 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.075+0000 7fae08a78700 1 -- start start 2023-06-09T04:42:01.086 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.075+0000 7fc67764d700 1 -- start start 2023-06-09T04:42:01.087 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.075+0000 7fc67764d700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc670069820 0x7fc670071760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:01.087 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.075+0000 7fc67764d700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc6700ba0d0 0x7fc670069bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:01.087 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.075+0000 7fc67764d700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc67006a130 con 0x7fc6700bba30 2023-06-09T04:42:01.087 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.075+0000 7fc67764d700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6700ba5d0 con 0x7fc6700ba0d0 2023-06-09T04:42:01.087 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.075+0000 7fc67764d700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6700b8590 con 0x7fc670069820 2023-06-09T04:42:01.087 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.075+0000 7ff2b232d700 1 -- 172.21.15.90:0/2269868794 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff2ac1608d0 msgr2=0x7ff2ac160d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:01.088 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.075+0000 7ff2b232d700 1 --2- 172.21.15.90:0/2269868794 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff2ac1608d0 0x7ff2ac160d50 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff294009880 tx=0x7ff294009b90 comp rx=0 tx=0).stop 2023-06-09T04:42:01.088 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.079+0000 7fa5faffd700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7fa5f40e6e60 0x7fa5f404f340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:46514/0 (socket says 172.21.15.90:46514) 2023-06-09T04:42:01.088 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.079+0000 7fa5faffd700 1 -- 172.21.15.90:0/163320641 learned_addr learned my addr 172.21.15.90:0/163320641 (peer_addr_for_me v1:172.21.15.90:0/0) 2023-06-09T04:42:01.088 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.079+0000 7ff2b232d700 1 -- 172.21.15.90:0/2269868794 shutdown_connections 2023-06-09T04:42:01.089 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.079+0000 7fc6753e9700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc670069820 0x7fc670071760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:01.089 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.079+0000 7fc6753e9700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc670069820 0x7fc670071760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.90:37424/0 (socket says 172.21.15.90:37424) 2023-06-09T04:42:01.089 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.079+0000 7fc6753e9700 1 -- 172.21.15.90:0/550209052 learned_addr learned my addr 172.21.15.90:0/550209052 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:01.089 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.079+0000 7fae08a78700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fadfc0550a0 0x7fadfc04be80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:01.090 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.079+0000 7ff2b232d700 1 --2- 172.21.15.90:0/2269868794 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff2ac1608d0 0x7ff2ac160d50 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:01.090 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.079+0000 7fa5fb7fe700 1 --2- 172.21.15.90:0/163320641 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa5f4036e80 0x7fa5f40f18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:01.090 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.079+0000 7ff2b232d700 1 --2- 172.21.15.90:0/2269868794 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff2ac0cb310 0x7ff2ac0cdb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:01.091 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.079+0000 7ff2b232d700 1 -- 172.21.15.90:0/2269868794 >> 172.21.15.90:0/2269868794 conn(0x7ff2ac06c690 msgr2=0x7ff2ac0aff00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:01.091 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.079+0000 7fae08a78700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fadfc0e28d0 0x7fadfc0da320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:01.091 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.079+0000 7fae08a78700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fadfc0e3770 0x7fadfc03b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:01.091 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.079+0000 7fae08a78700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadfc04d190 con 0x7fadfc0e3770 2023-06-09T04:42:01.091 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.079+0000 7fae08a78700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadfc0da860 con 0x7fadfc0e28d0 2023-06-09T04:42:01.091 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.079+0000 7fae08a78700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadfc04c510 con 0x7fadfc0550a0 2023-06-09T04:42:01.092 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.079+0000 7ff2b232d700 1 -- 172.21.15.90:0/2269868794 shutdown_connections 2023-06-09T04:42:01.092 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.079+0000 7fc6753e9700 1 -- 172.21.15.90:0/550209052 >> v2:172.21.15.174:3300/0 conn(0x7fc6700ba0d0 msgr2=0x7fc670069bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:01.092 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.079+0000 7fc6753e9700 1 --2- 172.21.15.90:0/550209052 >> v2:172.21.15.174:3300/0 conn(0x7fc6700ba0d0 0x7fc670069bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:01.092 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.079+0000 7fc6753e9700 1 -- 172.21.15.90:0/550209052 >> v1:172.21.15.90:6789/0 conn(0x7fc6700bba30 legacy=0x7fc6700bbeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:01.093 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.079+0000 7fc6753e9700 1 -- 172.21.15.90:0/550209052 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6700b8870 con 0x7fc670069820 2023-06-09T04:42:01.093 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.079+0000 7fae0259c700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fadfc0550a0 0x7fadfc04be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:01.093 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.079+0000 7fae01d9b700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fadfc0e28d0 0x7fadfc0da320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:01.093 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.079+0000 7fae0259c700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fadfc0550a0 0x7fadfc04be80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.90:37434/0 (socket says 172.21.15.90:37434) 2023-06-09T04:42:01.093 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.079+0000 7fae0259c700 1 -- 172.21.15.90:0/3800351984 learned_addr learned my addr 172.21.15.90:0/3800351984 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:01.094 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.079+0000 7fae02d9d700 1 --2- 172.21.15.90:0/3800351984 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fadfc0e3770 0x7fadfc03b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:01.094 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.079+0000 7fa5fb7fe700 1 -- 172.21.15.90:0/163320641 >> v1:172.21.15.174:6789/0 conn(0x7fa5f40512b0 legacy=0x7fa5f4036770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:01.094 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.079+0000 7fc6753e9700 1 --2- 172.21.15.90:0/550209052 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc670069820 0x7fc670071760 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fc66c009e80 tx=0x7fc66c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=52245612568db3b4 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:01.094 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.079+0000 7fa6e27ac700 1 Processor -- start 2023-06-09T04:42:01.095 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.079+0000 7fae02d9d700 1 -- 172.21.15.90:0/3800351984 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fadfc0550a0 msgr2=0x7fadfc04be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:01.095 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.079+0000 7fae02d9d700 1 --2- 172.21.15.90:0/3800351984 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fadfc0550a0 0x7fadfc04be80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:01.095 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.079+0000 7fae02d9d700 1 -- 172.21.15.90:0/3800351984 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fadfc0e28d0 msgr2=0x7fadfc0da320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:01.096 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.079+0000 7fae02d9d700 1 --2- 172.21.15.90:0/3800351984 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fadfc0e28d0 0x7fadfc0da320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:01.096 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.079+0000 7fae02d9d700 1 -- 172.21.15.90:0/3800351984 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadfc04c7f0 con 0x7fadfc0e3770 2023-06-09T04:42:01.096 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.079+0000 7fc667fff700 1 -- 172.21.15.90:0/550209052 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc66c00e070 con 0x7fc670069820 2023-06-09T04:42:01.096 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.079+0000 7fc667fff700 1 -- 172.21.15.90:0/550209052 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc66c003a40 con 0x7fc670069820 2023-06-09T04:42:01.096 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.079+0000 7fc667fff700 1 -- 172.21.15.90:0/550209052 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc66c003dd0 con 0x7fc670069820 2023-06-09T04:42:01.097 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.079+0000 7fa5fb7fe700 1 -- 172.21.15.90:0/163320641 >> v1:172.21.15.90:6789/0 conn(0x7fa5f40e6e60 legacy=0x7fa5f404f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:01.097 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.079+0000 7fa5fb7fe700 1 -- 172.21.15.90:0/163320641 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5f4033a80 con 0x7fa5f4036e80 2023-06-09T04:42:01.097 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.079+0000 7fa5fb7fe700 1 --2- 172.21.15.90:0/163320641 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa5f4036e80 0x7fa5f40f18a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fa5ec009880 tx=0x7fa5ec009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7c506f4e18371ff4 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:01.097 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.079+0000 7fa6e27ac700 1 -- start start 2023-06-09T04:42:01.098 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.079+0000 7ff2b232d700 1 -- 172.21.15.90:0/2269868794 wait complete. 2023-06-09T04:42:01.098 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.079+0000 7fae02d9d700 1 --2- 172.21.15.90:0/3800351984 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fadfc0e3770 0x7fadfc03b0b0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fae0404f4a0 tx=0x7fae040615d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:01.098 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.079+0000 7fadf2ffd700 1 -- 172.21.15.90:0/3800351984 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae04065e10 con 0x7fadfc0e3770 2023-06-09T04:42:01.098 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.079+0000 7fadf2ffd700 1 -- 172.21.15.90:0/3800351984 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae04065f70 con 0x7fadfc0e3770 2023-06-09T04:42:01.099 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.079+0000 7fadf2ffd700 1 -- 172.21.15.90:0/3800351984 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae04066120 con 0x7fadfc0e3770 2023-06-09T04:42:01.099 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.079+0000 7fc67764d700 1 -- 172.21.15.90:0/550209052 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc670069820 msgr2=0x7fc670071760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:01.099 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.079+0000 7fc67764d700 1 --2- 172.21.15.90:0/550209052 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc670069820 0x7fc670071760 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fc66c009e80 tx=0x7fc66c00b330 comp rx=0 tx=0).stop 2023-06-09T04:42:01.100 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.079+0000 7fa5f9ffb700 1 -- 172.21.15.90:0/163320641 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5ec004230 con 0x7fa5f4036e80 2023-06-09T04:42:01.100 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.079+0000 7fa5f9ffb700 1 -- 172.21.15.90:0/163320641 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5ec004390 con 0x7fa5f4036e80 2023-06-09T04:42:01.100 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.083+0000 7fa5f9ffb700 1 -- 172.21.15.90:0/163320641 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5ec0036c0 con 0x7fa5f4036e80 2023-06-09T04:42:01.100 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.083+0000 7fc67764d700 1 -- 172.21.15.90:0/550209052 shutdown_connections 2023-06-09T04:42:01.100 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.083+0000 7fc67764d700 1 --2- 172.21.15.90:0/550209052 >> v2:172.21.15.174:3300/0 conn(0x7fc6700ba0d0 0x7fc670069bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:01.101 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.083+0000 7fc67764d700 1 --2- 172.21.15.90:0/550209052 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc670069820 0x7fc670071760 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:01.101 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.083+0000 7fc67764d700 1 -- 172.21.15.90:0/550209052 >> 172.21.15.90:0/550209052 conn(0x7fc6700d76d0 msgr2=0x7fc6700b99c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:01.101 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.083+0000 7ff2b232d700 1 Processor -- start 2023-06-09T04:42:01.101 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.079+0000 7fae08a78700 1 -- 172.21.15.90:0/3800351984 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadfc04cad0 con 0x7fadfc0e3770 2023-06-09T04:42:01.102 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.079+0000 7fae08a78700 1 -- 172.21.15.90:0/3800351984 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadfc03b5f0 con 0x7fadfc0e3770 2023-06-09T04:42:01.102 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.083+0000 7ff2b232d700 1 -- start start 2023-06-09T04:42:01.102 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.083+0000 7fa6018c3700 1 -- 172.21.15.90:0/163320641 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa5f4036e80 msgr2=0x7fa5f40f18a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:01.102 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.083+0000 7fa6018c3700 1 --2- 172.21.15.90:0/163320641 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa5f4036e80 0x7fa5f40f18a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fa5ec009880 tx=0x7fa5ec009b90 comp rx=0 tx=0).stop 2023-06-09T04:42:01.103 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.083+0000 7fa6e27ac700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fa6d40e6e60 0x7fa6d404f340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:01.103 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.083+0000 7fa6e27ac700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fa6d40512b0 0x7fa6d4036770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:01.103 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.083+0000 7fa6e27ac700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6d40528c0 con 0x7fa6d4036cb0 2023-06-09T04:42:01.103 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.083+0000 7fae08a78700 1 -- 172.21.15.90:0/3800351984 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadfc04d2d0 con 0x7fadfc0e3770 2023-06-09T04:42:01.104 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.083+0000 7fa6e27ac700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6d40486b0 con 0x7fa6d40e6e60 2023-06-09T04:42:01.104 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.083+0000 7fa6e27ac700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6d4037130 con 0x7fa6d40512b0 2023-06-09T04:42:01.104 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.083+0000 7fa6018c3700 1 -- 172.21.15.90:0/163320641 shutdown_connections 2023-06-09T04:42:01.105 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.083+0000 7fa6018c3700 1 --2- 172.21.15.90:0/163320641 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa5f4036e80 0x7fa5f40f18a0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:01.105 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.083+0000 7fa6018c3700 1 -- 172.21.15.90:0/163320641 >> 172.21.15.90:0/163320641 conn(0x7fa5f4051770 msgr2=0x7fa5f4051b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:01.105 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.083+0000 7fa6018c3700 1 -- 172.21.15.90:0/163320641 shutdown_connections 2023-06-09T04:42:01.105 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.083+0000 7fa6018c3700 1 -- 172.21.15.90:0/163320641 wait complete. 2023-06-09T04:42:01.105 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.083+0000 7fc67764d700 1 -- 172.21.15.90:0/550209052 shutdown_connections 2023-06-09T04:42:01.106 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.083+0000 7ff2b232d700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff2ac0cb310 0x7ff2ac15dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:01.106 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.083+0000 7ff2b232d700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff2ac1574c0 0x7ff2ac1560d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:01.106 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.083+0000 7ff2b232d700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff2ac1608d0 0x7ff2ac15cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:01.106 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.083+0000 7ff2b232d700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2ac158300 con 0x7ff2ac0cb310 2023-06-09T04:42:01.107 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.083+0000 7ff2b232d700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2ac0b4050 con 0x7ff2ac1608d0 2023-06-09T04:42:01.107 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.083+0000 7ff2b232d700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2ac1579d0 con 0x7ff2ac1574c0 2023-06-09T04:42:01.107 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.083+0000 7ff2a37fe700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff2ac1574c0 0x7ff2ac1560d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:01.107 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.083+0000 7ff2a37fe700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff2ac1574c0 0x7ff2ac1560d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.90:37442/0 (socket says 172.21.15.90:37442) 2023-06-09T04:42:01.107 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.083+0000 7ff2a37fe700 1 -- 172.21.15.90:0/4122332938 learned_addr learned my addr 172.21.15.90:0/4122332938 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:01.107 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.083+0000 7ff2b08ca700 1 --2- 172.21.15.90:0/4122332938 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff2ac1608d0 0x7ff2ac15cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:01.107 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.083+0000 7ff2abfff700 1 --2- 172.21.15.90:0/4122332938 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff2ac0cb310 0x7ff2ac15dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:01.108 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.087+0000 7fa6018c3700 1 Processor -- start 2023-06-09T04:42:01.108 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.083+0000 7ff2a37fe700 1 -- 172.21.15.90:0/4122332938 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff2ac1608d0 msgr2=0x7ff2ac15cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:01.108 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.083+0000 7ff2a37fe700 1 --2- 172.21.15.90:0/4122332938 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff2ac1608d0 0x7ff2ac15cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:01.108 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.083+0000 7ff2a37fe700 1 -- 172.21.15.90:0/4122332938 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff2ac0cb310 msgr2=0x7ff2ac15dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:01.108 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.083+0000 7ff2a37fe700 1 --2- 172.21.15.90:0/4122332938 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff2ac0cb310 0x7ff2ac15dbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:01.109 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.083+0000 7ff2a37fe700 1 -- 172.21.15.90:0/4122332938 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2940094b0 con 0x7ff2ac1574c0 2023-06-09T04:42:01.109 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.087+0000 7ff2abfff700 1 --2- 172.21.15.90:0/4122332938 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff2ac0cb310 0x7ff2ac15dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:42:01.109 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.087+0000 7fa6018c3700 1 -- start start 2023-06-09T04:42:01.109 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.083+0000 7fc67764d700 1 -- 172.21.15.90:0/550209052 wait complete. 2023-06-09T04:42:01.110 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.087+0000 7fc67764d700 1 Processor -- start 2023-06-09T04:42:01.110 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.087+0000 7ff2a37fe700 1 --2- 172.21.15.90:0/4122332938 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff2ac1574c0 0x7ff2ac1560d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ff29c00b550 tx=0x7ff29c00b860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:01.110 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.083+0000 7fadf2ffd700 1 -- 172.21.15.90:0/3800351984 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fae0408f020 con 0x7fadfc0e3770 2023-06-09T04:42:01.110 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.087+0000 7fadf2ffd700 1 --2- 172.21.15.90:0/3800351984 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fade40663f0 0x7fade40688a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:01.111 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.087+0000 7fadf2ffd700 1 -- 172.21.15.90:0/3800351984 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fae040fddd0 con 0x7fadfc0e3770 2023-06-09T04:42:01.111 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.087+0000 7fa6dbfff700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fa6d40e6e60 0x7fa6d404f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:01.111 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.087+0000 7fa6dbfff700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fa6d40e6e60 0x7fa6d404f340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:33550/0 (socket says 172.21.15.90:33550) 2023-06-09T04:42:01.111 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.087+0000 7fa6dbfff700 1 -- 172.21.15.90:0/3708226160 learned_addr learned my addr 172.21.15.90:0/3708226160 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:01.111 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.087+0000 7fa6db7fe700 1 --2- 172.21.15.90:0/3708226160 >> v2:172.21.15.174:3300/0 conn(0x7fa6d40512b0 0x7fa6d4036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:01.112 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.087+0000 7fae0259c700 1 --2- 172.21.15.90:0/3800351984 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fade40663f0 0x7fade40688a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:01.112 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.087+0000 7fc67764d700 1 -- start start 2023-06-09T04:42:01.112 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.087+0000 7fc67764d700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc670069820 0x7fc6700937c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:01.113 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.087+0000 7ff2a97fa700 1 -- 172.21.15.90:0/4122332938 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff29c011830 con 0x7ff2ac1574c0 2023-06-09T04:42:01.113 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.087+0000 7ff2a97fa700 1 -- 172.21.15.90:0/4122332938 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff29c0119b0 con 0x7ff2ac1574c0 2023-06-09T04:42:01.113 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.087+0000 7ff2a97fa700 1 -- 172.21.15.90:0/4122332938 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff29c011d60 con 0x7ff2ac1574c0 2023-06-09T04:42:01.113 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.087+0000 7ff2b232d700 1 -- 172.21.15.90:0/4122332938 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2ac157cb0 con 0x7ff2ac1574c0 2023-06-09T04:42:01.113 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.087+0000 7ff2b232d700 1 -- 172.21.15.90:0/4122332938 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2ac15d2d0 con 0x7ff2ac1574c0 2023-06-09T04:42:01.114 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.087+0000 7fc67764d700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc6700ba0d0 0x7fc6700a09a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:01.114 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.087+0000 7fc67764d700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc6700bba30 0x7fc670201dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:01.114 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.087+0000 7fc67764d700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6700cd4c0 con 0x7fc670069820 2023-06-09T04:42:01.114 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.087+0000 7fc67764d700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6700b6d50 con 0x7fc6700ba0d0 2023-06-09T04:42:01.114 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.087+0000 7fc67764d700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6700b7030 con 0x7fc6700bba30 2023-06-09T04:42:01.114 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.087+0000 7fa6018c3700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa5f4036e80 0x7fa5f40e7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:01.115 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.087+0000 7fa6018c3700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa5f40512b0 0x7fa5f40e9a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:01.115 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.087+0000 7fc674be8700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc6700ba0d0 0x7fc6700a09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:01.115 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.087+0000 7fa5faffd700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa5f4036e80 0x7fa5f40e7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:01.116 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.087+0000 7fc675bea700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc6700bba30 0x7fc670201dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:01.116 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.087+0000 7fc6753e9700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc670069820 0x7fc6700937c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:01.116 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.087+0000 7fc674be8700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc6700ba0d0 0x7fc6700a09a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.90:38492/0 (socket says 172.21.15.90:38492) 2023-06-09T04:42:01.116 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.087+0000 7fc674be8700 1 -- 172.21.15.90:0/1025320058 learned_addr learned my addr 172.21.15.90:0/1025320058 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:01.116 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.087+0000 7fa6db7fe700 1 -- 172.21.15.90:0/3708226160 >> v2:172.21.15.90:3300/0 conn(0x7fa6d40e6e60 msgr2=0x7fa6d404f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:01.117 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.087+0000 7fa6db7fe700 1 --2- 172.21.15.90:0/3708226160 >> v2:172.21.15.90:3300/0 conn(0x7fa6d40e6e60 0x7fa6d404f340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:01.117 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.087+0000 7fa5fa7fc700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa5f40512b0 0x7fa5f40e9a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:01.117 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.087+0000 7fa5faffd700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa5f4036e80 0x7fa5f40e7230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.90:37454/0 (socket says 172.21.15.90:37454) 2023-06-09T04:42:01.117 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.087+0000 7fa5fa7fc700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa5f40512b0 0x7fa5f40e9a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:33572/0 (socket says 172.21.15.90:33572) 2023-06-09T04:42:01.118 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.087+0000 7fa5faffd700 1 -- 172.21.15.90:0/1687659611 learned_addr learned my addr 172.21.15.90:0/1687659611 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:01.118 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.087+0000 7fa6db7fe700 1 -- 172.21.15.90:0/3708226160 >> v1:172.21.15.90:6789/0 conn(0x7fa6d4036cb0 legacy=0x7fa6d40060c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:01.118 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.087+0000 7fa6018c3700 1 --2- 172.21.15.90:0/1687659611 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa5f40e6e60 0x7fa5f4037d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:01.118 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.087+0000 7fa6db7fe700 1 -- 172.21.15.90:0/3708226160 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6d4037b40 con 0x7fa6d40512b0 2023-06-09T04:42:01.119 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.087+0000 7fa6018c3700 1 -- 172.21.15.90:0/1687659611 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f4180ae0 con 0x7fa5f40512b0 2023-06-09T04:42:01.119 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.087+0000 7fa6018c3700 1 -- 172.21.15.90:0/1687659611 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f404d8f0 con 0x7fa5f40e6e60 2023-06-09T04:42:01.119 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.087+0000 7fa6018c3700 1 -- 172.21.15.90:0/1687659611 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f404dbd0 con 0x7fa5f4036e80 2023-06-09T04:42:01.119 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.091+0000 7fae0259c700 1 --2- 172.21.15.90:0/3800351984 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fade40663f0 0x7fade40688a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fadf4001950 tx=0x7fadf4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:01.120 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.091+0000 7fc6753e9700 1 -- 172.21.15.90:0/1025320058 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc6700bba30 msgr2=0x7fc670201dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:01.120 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.091+0000 7fc6753e9700 1 --2- 172.21.15.90:0/1025320058 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc6700bba30 0x7fc670201dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:01.120 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.091+0000 7fc6753e9700 1 -- 172.21.15.90:0/1025320058 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc6700ba0d0 msgr2=0x7fc6700a09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:01.120 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.091+0000 7fc6753e9700 1 --2- 172.21.15.90:0/1025320058 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc6700ba0d0 0x7fc6700a09a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:01.120 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.091+0000 7fc6753e9700 1 -- 172.21.15.90:0/1025320058 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc66c009b30 con 0x7fc670069820 2023-06-09T04:42:01.121 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.091+0000 7fa5fb7fe700 1 --2- 172.21.15.90:0/1687659611 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa5f40e6e60 0x7fa5f4037d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:01.121 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.091+0000 7fa6db7fe700 1 --2- 172.21.15.90:0/3708226160 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa6d40512b0 0x7fa6d4036770 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa6d40071f0 tx=0x7fa6c8009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=78ced1d6412b2fab server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:01.121 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.091+0000 7fc6753e9700 1 --2- 172.21.15.90:0/1025320058 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc670069820 0x7fc6700937c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc66c014000 tx=0x7fc66c004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:01.122 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.091+0000 7fa5faffd700 1 -- 172.21.15.90:0/1687659611 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa5f40e6e60 msgr2=0x7fa5f4037d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:01.122 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.091+0000 7fa5faffd700 1 --2- 172.21.15.90:0/1687659611 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa5f40e6e60 0x7fa5f4037d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:01.122 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.091+0000 7fa5faffd700 1 -- 172.21.15.90:0/1687659611 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa5f40512b0 msgr2=0x7fa5f40e9a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:01.122 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.091+0000 7fa5faffd700 1 --2- 172.21.15.90:0/1687659611 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa5f40512b0 0x7fa5f40e9a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:01.122 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.091+0000 7fa5faffd700 1 -- 172.21.15.90:0/1687659611 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5ec0094b0 con 0x7fa5f4036e80 2023-06-09T04:42:01.123 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.091+0000 7ff2b232d700 1 -- 172.21.15.90:0/4122332938 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff290005310 con 0x7ff2ac1574c0 2023-06-09T04:42:01.123 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.091+0000 7fa5faffd700 1 --2- 172.21.15.90:0/1687659611 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa5f4036e80 0x7fa5f40e7230 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fa5fc0613c0 tx=0x7fa5fc065be0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:01.123 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.091+0000 7fa6daffd700 1 -- 172.21.15.90:0/3708226160 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6c8011830 con 0x7fa6d40512b0 2023-06-09T04:42:01.123 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.091+0000 7fa6daffd700 1 -- 172.21.15.90:0/3708226160 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6c8011990 con 0x7fa6d40512b0 2023-06-09T04:42:01.124 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.091+0000 7fa6daffd700 1 -- 172.21.15.90:0/3708226160 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6c8011d20 con 0x7fa6d40512b0 2023-06-09T04:42:01.124 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.091+0000 7fe72992b700 1 Processor -- start 2023-06-09T04:42:01.124 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.091+0000 7fe72992b700 1 -- start start 2023-06-09T04:42:01.124 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.091+0000 7fa6e27ac700 1 -- 172.21.15.90:0/3708226160 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa6d40512b0 msgr2=0x7fa6d4036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:01.125 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.091+0000 7fa6e27ac700 1 --2- 172.21.15.90:0/3708226160 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa6d40512b0 0x7fa6d4036770 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa6d40071f0 tx=0x7fa6c8009b30 comp rx=0 tx=0).stop 2023-06-09T04:42:01.125 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.091+0000 7fa5e3fff700 1 -- 172.21.15.90:0/1687659611 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5fc0662e0 con 0x7fa5f4036e80 2023-06-09T04:42:01.125 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.091+0000 7fa6018c3700 1 -- 172.21.15.90:0/1687659611 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5f404deb0 con 0x7fa5f4036e80 2023-06-09T04:42:01.125 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.091+0000 7fa6018c3700 1 -- 172.21.15.90:0/1687659611 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5f40e7770 con 0x7fa5f4036e80 2023-06-09T04:42:01.126 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.091+0000 7fa6e27ac700 1 -- 172.21.15.90:0/3708226160 shutdown_connections 2023-06-09T04:42:01.126 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.091+0000 7fa6e27ac700 1 --2- 172.21.15.90:0/3708226160 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa6d40512b0 0x7fa6d4036770 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:01.126 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.091+0000 7fa6e27ac700 1 --2- 172.21.15.90:0/3708226160 >> v2:172.21.15.90:3300/0 conn(0x7fa6d40e6e60 0x7fa6d404f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:01.126 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.091+0000 7fa6e27ac700 1 -- 172.21.15.90:0/3708226160 >> 172.21.15.90:0/3708226160 conn(0x7fa6d4051770 msgr2=0x7fa6d4051b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:01.126 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.091+0000 7fa6e27ac700 1 -- 172.21.15.90:0/3708226160 shutdown_connections 2023-06-09T04:42:01.126 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.091+0000 7fa6e27ac700 1 -- 172.21.15.90:0/3708226160 wait complete. 2023-06-09T04:42:01.127 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.091+0000 7fa6018c3700 1 -- 172.21.15.90:0/1687659611 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5f4005530 con 0x7fa5f4036e80 2023-06-09T04:42:01.127 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.091+0000 7ff2a97fa700 1 -- 172.21.15.90:0/4122332938 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff29c01a400 con 0x7ff2ac1574c0 2023-06-09T04:42:01.127 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.091+0000 7fe72992b700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe724069820 0x7fe724069c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:01.128 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.091+0000 7fa0f827b700 1 Processor -- start 2023-06-09T04:42:01.128 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.091+0000 7fe72992b700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fe72415a3a0 0x7fe72415a800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:01.128 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.091+0000 7fe72992b700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe72406aa30 con 0x7fe72406fb70 2023-06-09T04:42:01.128 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.091+0000 7fe72992b700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe72406a1b0 con 0x7fe72415a3a0 2023-06-09T04:42:01.128 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.091+0000 7fe72992b700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe72406a470 con 0x7fe724069820 2023-06-09T04:42:01.129 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.091+0000 7fa0f827b700 1 -- start start 2023-06-09T04:42:01.129 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.091+0000 7fe728929700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7fe72406fb70 0x7fe72406ff40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.90:34962/0 (socket says 172.21.15.90:34962) 2023-06-09T04:42:01.129 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.095+0000 7fe728929700 1 -- 172.21.15.90:0/1588745337 learned_addr learned my addr 172.21.15.90:0/1588745337 (peer_addr_for_me v1:172.21.15.90:0/0) 2023-06-09T04:42:01.130 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.095+0000 7fe72912a700 1 --2- 172.21.15.90:0/1588745337 >> v2:172.21.15.174:3300/0 conn(0x7fe72415a3a0 0x7fe72415a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:01.130 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.095+0000 7fe723fff700 1 --2- 172.21.15.90:0/1588745337 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe724069820 0x7fe724069c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:01.130 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.095+0000 7ff2a97fa700 1 --2- 172.21.15.90:0/4122332938 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7ff28c066340 0x7ff28c0687f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:01.130 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.095+0000 7ff2a97fa700 1 -- 172.21.15.90:0/4122332938 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff29c084280 con 0x7ff2ac1574c0 2023-06-09T04:42:01.131 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.095+0000 7fa6e27ac700 1 Processor -- start 2023-06-09T04:42:01.131 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.095+0000 7fadf2ffd700 1 -- 172.21.15.90:0/3800351984 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fae040cb3e0 con 0x7fadfc0e3770 2023-06-09T04:42:01.131 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.095+0000 7fa6e27ac700 1 -- start start 2023-06-09T04:42:01.131 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.095+0000 7ff2abfff700 1 --2- 172.21.15.90:0/4122332938 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7ff28c066340 0x7ff28c0687f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:01.132 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.095+0000 7fe7237fe700 1 -- 172.21.15.90:0/1588745337 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2124342825 0 0) 0x7fe72406aa30 con 0x7fe72406fb70 2023-06-09T04:42:01.132 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.095+0000 7fe7237fe700 1 -- 172.21.15.90:0/1588745337 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe7140035d0 con 0x7fe72406fb70 2023-06-09T04:42:01.132 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.095+0000 7fe72912a700 1 -- 172.21.15.90:0/1588745337 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe724069820 msgr2=0x7fe724069c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:01.132 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.095+0000 7fe72912a700 1 --2- 172.21.15.90:0/1588745337 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe724069820 0x7fe724069c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:01.133 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.095+0000 7fe72912a700 1 -- 172.21.15.90:0/1588745337 >> v1:172.21.15.174:6789/0 conn(0x7fe72406fb70 legacy=0x7fe72406ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:01.133 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.095+0000 7fe72912a700 1 -- 172.21.15.90:0/1588745337 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe72406a750 con 0x7fe72415a3a0 2023-06-09T04:42:01.133 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.095+0000 7fe72912a700 1 --2- 172.21.15.90:0/1588745337 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe72415a3a0 0x7fe72415a800 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe71c00aea0 tx=0x7fe71c00c330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3570bdbfa3b091f8 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:01.133 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.095+0000 7fe7237fe700 1 -- 172.21.15.90:0/1588745337 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe71c00f070 con 0x7fe72415a3a0 2023-06-09T04:42:01.133 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.095+0000 7fc665ffb700 1 -- 172.21.15.90:0/1025320058 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc66c004440 con 0x7fc670069820 2023-06-09T04:42:01.134 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.095+0000 7fc67764d700 1 -- 172.21.15.90:0/1025320058 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6700b7310 con 0x7fc670069820 2023-06-09T04:42:01.134 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.095+0000 7fe7237fe700 1 -- 172.21.15.90:0/1588745337 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe71c003a40 con 0x7fe72415a3a0 2023-06-09T04:42:01.134 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.095+0000 7fe7237fe700 1 -- 172.21.15.90:0/1588745337 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe71c003dd0 con 0x7fe72415a3a0 2023-06-09T04:42:01.135 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.095+0000 7fa6e27ac700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa6d4036cb0 0x7fa6d40da600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:01.135 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.095+0000 7fa6e27ac700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa6d40512b0 0x7fa6d40e88c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:01.135 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.095+0000 7fa6e27ac700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa6d40e6e60 0x7fa6d4053770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:01.135 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.095+0000 7fa6e27ac700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6d404a8f0 con 0x7fa6d4036cb0 2023-06-09T04:42:01.135 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.095+0000 7fa6e27ac700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6d40dab40 con 0x7fa6d40e6e60 2023-06-09T04:42:01.135 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.095+0000 7fa6e27ac700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6d404a610 con 0x7fa6d40512b0 2023-06-09T04:42:01.135 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.095+0000 7fa6db7fe700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa6d40512b0 0x7fa6d40e88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:01.136 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.095+0000 7fa6db7fe700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa6d40512b0 0x7fa6d40e88c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.90:37488/0 (socket says 172.21.15.90:37488) 2023-06-09T04:42:01.136 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.095+0000 7fa6dbfff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa6d4036cb0 0x7fa6d40da600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:01.136 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.095+0000 7fa6db7fe700 1 -- 172.21.15.90:0/2955859950 learned_addr learned my addr 172.21.15.90:0/2955859950 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:01.136 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.095+0000 7fa6e0d49700 1 --2- 172.21.15.90:0/2955859950 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa6d40e6e60 0x7fa6d4053770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:01.136 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.095+0000 7ff2abfff700 1 --2- 172.21.15.90:0/4122332938 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7ff28c066340 0x7ff28c0687f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff2a4005cb0 tx=0x7ff2a4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:01.137 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.095+0000 7fe72992b700 1 -- 172.21.15.90:0/1588745337 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe72415a3a0 msgr2=0x7fe72415a800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:01.137 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.095+0000 7fe72992b700 1 --2- 172.21.15.90:0/1588745337 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe72415a3a0 0x7fe72415a800 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe71c00aea0 tx=0x7fe71c00c330 comp rx=0 tx=0).stop 2023-06-09T04:42:01.137 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.095+0000 7fe72992b700 1 -- 172.21.15.90:0/1588745337 shutdown_connections 2023-06-09T04:42:01.137 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.095+0000 7fe72992b700 1 --2- 172.21.15.90:0/1588745337 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe72415a3a0 0x7fe72415a800 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:01.137 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.095+0000 7fe72992b700 1 --2- 172.21.15.90:0/1588745337 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe724069820 0x7fe724069c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:01.137 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.095+0000 7fe72992b700 1 -- 172.21.15.90:0/1588745337 >> 172.21.15.90:0/1588745337 conn(0x7fe72406c690 msgr2=0x7fe7240aff00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:01.138 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.095+0000 7fa6db7fe700 1 -- 172.21.15.90:0/2955859950 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa6d40e6e60 msgr2=0x7fa6d4053770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:01.138 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.095+0000 7fa6db7fe700 1 --2- 172.21.15.90:0/2955859950 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa6d40e6e60 0x7fa6d4053770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:01.138 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.095+0000 7fa6db7fe700 1 -- 172.21.15.90:0/2955859950 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa6d4036cb0 msgr2=0x7fa6d40da600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:01.138 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.095+0000 7fa6db7fe700 1 --2- 172.21.15.90:0/2955859950 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa6d4036cb0 0x7fa6d40da600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:01.138 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.095+0000 7fa6db7fe700 1 -- 172.21.15.90:0/2955859950 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6c80094b0 con 0x7fa6d40512b0 2023-06-09T04:42:01.138 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.095+0000 7fe72992b700 1 -- 172.21.15.90:0/1588745337 shutdown_connections 2023-06-09T04:42:01.139 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.099+0000 7fa6db7fe700 1 --2- 172.21.15.90:0/2955859950 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa6d40512b0 0x7fa6d40e88c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa6c8014040 tx=0x7fa6c8004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:01.139 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.095+0000 7fc67764d700 1 -- 172.21.15.90:0/1025320058 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc670093d00 con 0x7fc670069820 2023-06-09T04:42:01.139 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.095+0000 7fc665ffb700 1 -- 172.21.15.90:0/1025320058 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc66c0092e0 con 0x7fc670069820 2023-06-09T04:42:01.139 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.095+0000 7fc665ffb700 1 -- 172.21.15.90:0/1025320058 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc66c0047e0 con 0x7fc670069820 2023-06-09T04:42:01.140 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.099+0000 7fa0f827b700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fa0e80de730 0x7fa0e8036630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:01.140 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.099+0000 7fa0f827b700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa0e80deb00 0x7fa0e8036b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:01.140 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.099+0000 7fa0f827b700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0e8034460 con 0x7fa0e804f200 2023-06-09T04:42:01.140 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.099+0000 7fa0f827b700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0e80e3300 con 0x7fa0e80de730 2023-06-09T04:42:01.140 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.099+0000 7fa0f827b700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0e80df090 con 0x7fa0e80deb00 2023-06-09T04:42:01.141 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.099+0000 7fc67764d700 1 -- 172.21.15.90:0/1025320058 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6700b7830 con 0x7fc670069820 2023-06-09T04:42:01.141 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.099+0000 7fa0f5816700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa0e80deb00 0x7fa0e8036b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:01.141 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.099+0000 7fa0f5816700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa0e80deb00 0x7fa0e8036b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.90:37494/0 (socket says 172.21.15.90:37494) 2023-06-09T04:42:01.141 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.099+0000 7fa0f5816700 1 -- 172.21.15.90:0/2623617072 learned_addr learned my addr 172.21.15.90:0/2623617072 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:01.142 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.099+0000 7fc665ffb700 1 -- 172.21.15.90:0/1025320058 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc66c012430 con 0x7fc670069820 2023-06-09T04:42:01.142 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.099+0000 7f08dd06d700 1 Processor -- start 2023-06-09T04:42:01.142 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.099+0000 7f08dd06d700 1 -- start start 2023-06-09T04:42:01.143 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.095+0000 7fe72992b700 1 -- 172.21.15.90:0/1588745337 wait complete. 2023-06-09T04:42:01.143 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.099+0000 7fe72992b700 1 Processor -- start 2023-06-09T04:42:01.143 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.099+0000 7fa5e3fff700 1 -- 172.21.15.90:0/1687659611 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5fc08d070 con 0x7fa5f4036e80 2023-06-09T04:42:01.143 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.099+0000 7fa5e3fff700 1 -- 172.21.15.90:0/1687659611 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5fc069a20 con 0x7fa5f4036e80 2023-06-09T04:42:01.144 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.099+0000 7fa0f5816700 1 -- 172.21.15.90:0/2623617072 >> v2:172.21.15.90:3300/0 conn(0x7fa0e80de730 msgr2=0x7fa0e8036630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:01.144 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.099+0000 7fa0f5816700 1 --2- 172.21.15.90:0/2623617072 >> v2:172.21.15.90:3300/0 conn(0x7fa0e80de730 0x7fa0e8036630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:01.144 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.099+0000 7fa0f5816700 1 -- 172.21.15.90:0/2623617072 >> v1:172.21.15.174:6789/0 conn(0x7fa0e804f200 legacy=0x7fa0e804f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:01.144 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.099+0000 7fa0f5816700 1 -- 172.21.15.90:0/2623617072 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0e80df370 con 0x7fa0e80deb00 2023-06-09T04:42:01.144 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.099+0000 7fc665ffb700 1 --2- 172.21.15.90:0/1025320058 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fc6540662f0 0x7fc6540687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:01.144 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.099+0000 7fc665ffb700 1 -- 172.21.15.90:0/1025320058 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc66c085260 con 0x7fc670069820 2023-06-09T04:42:01.145 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.099+0000 7ff2a97fa700 1 -- 172.21.15.90:0/4122332938 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff29c051770 con 0x7ff2ac1574c0 2023-06-09T04:42:01.145 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.099+0000 7f08dd06d700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f08d8160d90 0x7f08d8163170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:01.145 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.099+0000 7f08dd06d700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08d813e480 con 0x7f08d813d710 2023-06-09T04:42:01.146 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.099+0000 7f08dd06d700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08d8158770 con 0x7f08d80cac00 2023-06-09T04:42:01.146 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.099+0000 7f08dd06d700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08d815ca20 con 0x7f08d8160d90 2023-06-09T04:42:01.146 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.099+0000 7fe72992b700 1 -- start start 2023-06-09T04:42:01.146 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.103+0000 7fa6d8ff9700 1 -- 172.21.15.90:0/2955859950 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6c8004610 con 0x7fa6d40512b0 2023-06-09T04:42:01.147 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.103+0000 7fa6d8ff9700 1 -- 172.21.15.90:0/2955859950 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6c801e070 con 0x7fa6d40512b0 2023-06-09T04:42:01.147 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.103+0000 7fa6d8ff9700 1 -- 172.21.15.90:0/2955859950 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6c8003900 con 0x7fa6d40512b0 2023-06-09T04:42:01.147 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.103+0000 7fa6e27ac700 1 -- 172.21.15.90:0/2955859950 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6d40e7de0 con 0x7fa6d40512b0 2023-06-09T04:42:01.147 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.103+0000 7fc674be8700 1 --2- 172.21.15.90:0/1025320058 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fc6540662f0 0x7fc6540687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:01.147 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.103+0000 7f08d77fe700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f08d813d710 0x7f08d813db60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:46530/0 (socket says 172.21.15.90:46530) 2023-06-09T04:42:01.148 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.103+0000 7f08d77fe700 1 -- 172.21.15.90:0/2448037721 learned_addr learned my addr 172.21.15.90:0/2448037721 (peer_addr_for_me v1:172.21.15.90:0/0) 2023-06-09T04:42:01.148 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.103+0000 7fa6e27ac700 1 -- 172.21.15.90:0/2955859950 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6d40e83a0 con 0x7fa6d40512b0 2023-06-09T04:42:01.148 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.103+0000 7fa6e27ac700 1 -- 172.21.15.90:0/2955859950 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6d40e7c40 con 0x7fa6d40512b0 2023-06-09T04:42:01.148 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.103+0000 7fc674be8700 1 --2- 172.21.15.90:0/1025320058 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fc6540662f0 0x7fc6540687a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc67006c7f0 tx=0x7fc6600091c0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:01.149 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.103+0000 7fa0f5816700 1 --2- 172.21.15.90:0/2623617072 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa0e80deb00 0x7fa0e8036b70 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa0e0009390 tx=0x7fa0e0009f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=79f8c4740e71eae3 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:01.149 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.103+0000 7f08dc86c700 1 --2- 172.21.15.90:0/2448037721 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f08d8160d90 0x7f08d8163170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:01.149 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.103+0000 7f08d6ffd700 1 -- 172.21.15.90:0/2448037721 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 744045472 0 0) 0x7f08d8158770 con 0x7f08d80cac00 2023-06-09T04:42:01.149 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.103+0000 7f08d6ffd700 1 -- 172.21.15.90:0/2448037721 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f08c40046e0 con 0x7f08d80cac00 2023-06-09T04:42:01.150 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.103+0000 7f08d6ffd700 1 -- 172.21.15.90:0/2448037721 <== mon.1 v1:172.21.15.174:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3457100943 0 0) 0x7f08c40046e0 con 0x7f08d80cac00 2023-06-09T04:42:01.150 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.103+0000 7f08d6ffd700 1 -- 172.21.15.90:0/2448037721 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f08d8160d90 msgr2=0x7f08d8163170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:01.150 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.103+0000 7f08d6ffd700 1 --2- 172.21.15.90:0/2448037721 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f08d8160d90 0x7f08d8163170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:01.150 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.103+0000 7f08d6ffd700 1 -- 172.21.15.90:0/2448037721 >> v1:172.21.15.90:6789/0 conn(0x7f08d813d710 legacy=0x7f08d813db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:01.150 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.103+0000 7f08d6ffd700 1 -- 172.21.15.90:0/2448037721 --> v1:172.21.15.174:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08d8158a50 con 0x7f08d80cac00 2023-06-09T04:42:01.150 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.103+0000 7f08d6ffd700 1 -- 172.21.15.90:0/2448037721 <== mon.1 v1:172.21.15.174:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3604404106 0 0) 0x7f08d00019f0 con 0x7f08d80cac00 2023-06-09T04:42:01.150 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.103+0000 7f08d6ffd700 1 -- 172.21.15.90:0/2448037721 >> v1:172.21.15.174:6789/0 conn(0x7f08d80cac00 legacy=0x7f08d80cafd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:01.150 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.103+0000 7f08d6ffd700 1 --2- 172.21.15.90:0/2448037721 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f08d8160d90 0x7f08c4004b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:01.151 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.103+0000 7f08d6ffd700 1 --2- 172.21.15.90:0/2448037721 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f08c40050b0 0x7f08c4005980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:01.151 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.103+0000 7f08d6ffd700 1 --2- 172.21.15.90:0/2448037721 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f08c4005ec0 0x7f08c400cb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:01.151 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.103+0000 7f08d6ffd700 1 -- 172.21.15.90:0/2448037721 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08d815ca20 con 0x7f08c40050b0 2023-06-09T04:42:01.151 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.103+0000 7f08d6ffd700 1 -- 172.21.15.90:0/2448037721 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08c4006440 con 0x7f08c4005ec0 2023-06-09T04:42:01.151 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.103+0000 7f08d6ffd700 1 -- 172.21.15.90:0/2448037721 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08c4006600 con 0x7f08d8160d90 2023-06-09T04:42:01.151 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.103+0000 7f08dc86c700 1 --2- 172.21.15.90:0/2448037721 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f08c4005ec0 0x7f08c400cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:01.151 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.103+0000 7f08d77fe700 1 --2- 172.21.15.90:0/2448037721 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f08c40050b0 0x7f08c4005980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:01.152 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.103+0000 7fe72992b700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe724069820 0x7fe7240b1200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:01.152 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.103+0000 7f08d7fff700 1 --2- 172.21.15.90:0/2448037721 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f08d8160d90 0x7f08c4004b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:01.152 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.103+0000 7f08dc86c700 1 -- 172.21.15.90:0/2448037721 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f08d8160d90 msgr2=0x7f08c4004b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:01.152 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.103+0000 7f08dc86c700 1 --2- 172.21.15.90:0/2448037721 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f08d8160d90 0x7f08c4004b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:01.153 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.103+0000 7f08dc86c700 1 -- 172.21.15.90:0/2448037721 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f08c40050b0 msgr2=0x7f08c4005980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:01.153 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.103+0000 7f08dc86c700 1 --2- 172.21.15.90:0/2448037721 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f08c40050b0 0x7f08c4005980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:01.153 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.103+0000 7f08dc86c700 1 -- 172.21.15.90:0/2448037721 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08d8158a50 con 0x7f08c4005ec0 2023-06-09T04:42:01.153 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.103+0000 7f08d77fe700 1 --2- 172.21.15.90:0/2448037721 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f08c40050b0 0x7f08c4005980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:42:01.153 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.103+0000 7fe72992b700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe72406fb70 0x7fe724139230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:01.154 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.103+0000 7fe72992b700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe72415a3a0 0x7fe7241f8f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:01.154 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.103+0000 7fe72992b700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7240b1970 con 0x7fe724069820 2023-06-09T04:42:01.154 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.103+0000 7fe72992b700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7241638a0 con 0x7fe72415a3a0 2023-06-09T04:42:01.154 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.103+0000 7fe72992b700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7240b1740 con 0x7fe72406fb70 2023-06-09T04:42:01.154 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.103+0000 7fe723fff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe72406fb70 0x7fe724139230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:01.154 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.103+0000 7fe723fff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe72406fb70 0x7fe724139230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.90:37524/0 (socket says 172.21.15.90:37524) 2023-06-09T04:42:01.154 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.103+0000 7fe723fff700 1 -- 172.21.15.90:0/2110816822 learned_addr learned my addr 172.21.15.90:0/2110816822 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:01.155 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.103+0000 7fe728929700 1 --2- 172.21.15.90:0/2110816822 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe724069820 0x7fe7240b1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:01.155 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.103+0000 7fa5e3fff700 1 -- 172.21.15.90:0/1687659611 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa5fc069c40 con 0x7fa5f4036e80 2023-06-09T04:42:01.155 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.107+0000 7fe728929700 1 -- 172.21.15.90:0/2110816822 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe72406fb70 msgr2=0x7fe724139230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:01.155 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.107+0000 7fe728929700 1 --2- 172.21.15.90:0/2110816822 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe72406fb70 0x7fe724139230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:01.156 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.107+0000 7fe728929700 1 -- 172.21.15.90:0/2110816822 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe72415a3a0 msgr2=0x7fe7241f8f70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-06-09T04:42:01.156 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.107+0000 7fe728929700 1 --2- 172.21.15.90:0/2110816822 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe72415a3a0 0x7fe7241f8f70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:01.156 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.107+0000 7fe728929700 1 -- 172.21.15.90:0/2110816822 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe71c00ab80 con 0x7fe724069820 2023-06-09T04:42:01.156 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.107+0000 7fa5e3fff700 1 --2- 172.21.15.90:0/1687659611 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fa5e80662f0 0x7fa5e80687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:01.157 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.107+0000 7fe723fff700 1 --2- 172.21.15.90:0/2110816822 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe72406fb70 0x7fe724139230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:42:01.157 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.107+0000 7fa5e3fff700 1 -- 172.21.15.90:0/1687659611 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa5fc0fd5a0 con 0x7fa5f4036e80 2023-06-09T04:42:01.157 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.107+0000 7fc665ffb700 1 -- 172.21.15.90:0/1025320058 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc66c052890 con 0x7fc670069820 2023-06-09T04:42:01.157 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.107+0000 7fa5fa7fc700 1 --2- 172.21.15.90:0/1687659611 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fa5e80662f0 0x7fa5e80687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:01.158 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.107+0000 7fe728929700 1 --2- 172.21.15.90:0/2110816822 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe724069820 0x7fe7240b1200 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe71800c410 tx=0x7fe71800c720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:01.158 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.107+0000 7fa5fa7fc700 1 --2- 172.21.15.90:0/1687659611 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fa5e80662f0 0x7fa5e80687a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa5f40ea360 tx=0x7fa5f0007ee0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:01.159 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.107+0000 7fa0f5015700 1 -- 172.21.15.90:0/2623617072 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0e000cb30 con 0x7fa0e80deb00 2023-06-09T04:42:01.159 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.107+0000 7fa0f5015700 1 -- 172.21.15.90:0/2623617072 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0e000cc90 con 0x7fa0e80deb00 2023-06-09T04:42:01.159 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.107+0000 7fa0f5015700 1 -- 172.21.15.90:0/2623617072 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0e0009870 con 0x7fa0e80deb00 2023-06-09T04:42:01.159 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.107+0000 7fa0f827b700 1 -- 172.21.15.90:0/2623617072 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa0e80deb00 msgr2=0x7fa0e8036b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:01.159 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.107+0000 7fa0f827b700 1 --2- 172.21.15.90:0/2623617072 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa0e80deb00 0x7fa0e8036b70 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa0e0009390 tx=0x7fa0e0009f90 comp rx=0 tx=0).stop 2023-06-09T04:42:01.160 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.107+0000 7fe7217fa700 1 -- 172.21.15.90:0/2110816822 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe718004ca0 con 0x7fe724069820 2023-06-09T04:42:01.160 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.107+0000 7fe72992b700 1 -- 172.21.15.90:0/2110816822 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe724164830 con 0x7fe724069820 2023-06-09T04:42:01.160 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.107+0000 7fe72992b700 1 -- 172.21.15.90:0/2110816822 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe724164050 con 0x7fe724069820 2023-06-09T04:42:01.160 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.107+0000 7fe7217fa700 1 -- 172.21.15.90:0/2110816822 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe71800ce90 con 0x7fe724069820 2023-06-09T04:42:01.160 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.107+0000 7fe7217fa700 1 -- 172.21.15.90:0/2110816822 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7180070d0 con 0x7fe724069820 2023-06-09T04:42:01.161 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.111+0000 7f08dc86c700 1 --2- 172.21.15.90:0/2448037721 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f08c4005ec0 0x7f08c400cb40 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f08c8009b40 tx=0x7f08c40069b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5dc3250cf65fc388 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:01.161 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.111+0000 7fa6d8ff9700 1 -- 172.21.15.90:0/2955859950 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa6c8003a60 con 0x7fa6d40512b0 2023-06-09T04:42:01.161 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.111+0000 7fa0f827b700 1 -- 172.21.15.90:0/2623617072 shutdown_connections 2023-06-09T04:42:01.161 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.111+0000 7fa0f827b700 1 --2- 172.21.15.90:0/2623617072 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa0e80deb00 0x7fa0e8036b70 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:01.162 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.111+0000 7fa0f827b700 1 --2- 172.21.15.90:0/2623617072 >> v2:172.21.15.90:3300/0 conn(0x7fa0e80de730 0x7fa0e8036630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:01.162 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.111+0000 7fa0f827b700 1 -- 172.21.15.90:0/2623617072 >> 172.21.15.90:0/2623617072 conn(0x7fa0e8051630 msgr2=0x7fa0e8051a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:01.162 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.111+0000 7fa0f827b700 1 -- 172.21.15.90:0/2623617072 shutdown_connections 2023-06-09T04:42:01.162 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.111+0000 7fa5e3fff700 1 -- 172.21.15.90:0/1687659611 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa5fc0ca8f0 con 0x7fa5f4036e80 2023-06-09T04:42:01.162 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.111+0000 7fa6d8ff9700 1 --2- 172.21.15.90:0/2955859950 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fa6c00663c0 0x7fa6c0068870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:01.163 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.111+0000 7fa6d8ff9700 1 -- 172.21.15.90:0/2955859950 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa6c8085060 con 0x7fa6d40512b0 2023-06-09T04:42:01.163 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.111+0000 7fa6dbfff700 1 --2- 172.21.15.90:0/2955859950 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fa6c00663c0 0x7fa6c0068870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:01.163 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.111+0000 7fa0f827b700 1 -- 172.21.15.90:0/2623617072 wait complete. 2023-06-09T04:42:01.163 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.111+0000 7fa0f827b700 1 Processor -- start 2023-06-09T04:42:01.164 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.111+0000 7f08d6ffd700 1 -- 172.21.15.90:0/2448037721 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08c800e6c0 con 0x7f08c4005ec0 2023-06-09T04:42:01.164 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.111+0000 7f08d6ffd700 1 -- 172.21.15.90:0/2448037721 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08c800e820 con 0x7f08c4005ec0 2023-06-09T04:42:01.164 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.111+0000 7f08d6ffd700 1 -- 172.21.15.90:0/2448037721 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08c800eb90 con 0x7f08c4005ec0 2023-06-09T04:42:01.164 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.111+0000 7f08dd06d700 1 -- 172.21.15.90:0/2448037721 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f08c4005ec0 msgr2=0x7f08c400cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:01.164 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.111+0000 7f08dd06d700 1 --2- 172.21.15.90:0/2448037721 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f08c4005ec0 0x7f08c400cb40 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f08c8009b40 tx=0x7f08c40069b0 comp rx=0 tx=0).stop 2023-06-09T04:42:01.164 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.111+0000 7f08dc86c700 1 -- 172.21.15.90:0/2448037721 reap_dead start 2023-06-09T04:42:01.164 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.111+0000 7f08dd06d700 1 -- 172.21.15.90:0/2448037721 shutdown_connections 2023-06-09T04:42:01.165 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.111+0000 7f08dd06d700 1 -- 172.21.15.90:0/2448037721 >> 172.21.15.90:0/2448037721 conn(0x7f08d806c690 msgr2=0x7f08d80aff00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:01.165 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.111+0000 7fe72992b700 1 -- 172.21.15.90:0/2110816822 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe704005310 con 0x7fe724069820 2023-06-09T04:42:01.165 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.111+0000 7fa6d8ff9700 1 -- 172.21.15.90:0/2955859950 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa6c8052550 con 0x7fa6d40512b0 2023-06-09T04:42:01.165 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.115+0000 7fa6dbfff700 1 --2- 172.21.15.90:0/2955859950 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fa6c00663c0 0x7fa6c0068870 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa6d0011340 tx=0x7fa6d000b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:01.166 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.111+0000 7fa0f827b700 1 -- start start 2023-06-09T04:42:01.166 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.115+0000 7fa0f827b700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa0e804f200 0x7fa0e80e12c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:01.166 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.115+0000 7fa0f827b700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa0e80de730 0x7fa0e80d38e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:01.166 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.115+0000 7fa0f6017700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa0e804f200 0x7fa0e80e12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:01.167 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.115+0000 7fa0f6017700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa0e804f200 0x7fa0e80e12c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.90:38542/0 (socket says 172.21.15.90:38542) 2023-06-09T04:42:01.167 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.115+0000 7fa0f6017700 1 -- 172.21.15.90:0/3063332131 learned_addr learned my addr 172.21.15.90:0/3063332131 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:01.167 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.115+0000 7fa0f827b700 1 --2- 172.21.15.90:0/3063332131 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa0e80deb00 0x7fa0e804a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:01.167 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.115+0000 7fa0f827b700 1 -- 172.21.15.90:0/3063332131 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0e80e9630 con 0x7fa0e80de730 2023-06-09T04:42:01.167 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.115+0000 7fa0f827b700 1 -- 172.21.15.90:0/3063332131 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0e8180670 con 0x7fa0e804f200 2023-06-09T04:42:01.167 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.115+0000 7fa0f827b700 1 -- 172.21.15.90:0/3063332131 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0e817f8b0 con 0x7fa0e80deb00 2023-06-09T04:42:01.168 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.115+0000 7f08dd06d700 1 -- 172.21.15.90:0/2448037721 shutdown_connections 2023-06-09T04:42:01.168 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.115+0000 7fa0f6818700 1 --2- 172.21.15.90:0/3063332131 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa0e80deb00 0x7fa0e804a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:01.168 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.115+0000 7fa0f6017700 1 -- 172.21.15.90:0/3063332131 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa0e80deb00 msgr2=0x7fa0e804a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:01.168 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.115+0000 7fa0f6017700 1 --2- 172.21.15.90:0/3063332131 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa0e80deb00 0x7fa0e804a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:01.168 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.115+0000 7fa0f6017700 1 -- 172.21.15.90:0/3063332131 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa0e80de730 msgr2=0x7fa0e80d38e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:01.169 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.115+0000 7fa0f6017700 1 --2- 172.21.15.90:0/3063332131 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa0e80de730 0x7fa0e80d38e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:01.169 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.115+0000 7fa0f6017700 1 -- 172.21.15.90:0/3063332131 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0e0009e00 con 0x7fa0e804f200 2023-06-09T04:42:01.169 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.115+0000 7fe7217fa700 1 -- 172.21.15.90:0/2110816822 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe718007230 con 0x7fe724069820 2023-06-09T04:42:01.169 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.115+0000 7fe7217fa700 1 --2- 172.21.15.90:0/2110816822 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fe7080662f0 0x7fe7080687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:01.169 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.119+0000 7fe7217fa700 1 -- 172.21.15.90:0/2110816822 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe718083640 con 0x7fe724069820 2023-06-09T04:42:01.170 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.119+0000 7fe723fff700 1 --2- 172.21.15.90:0/2110816822 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fe7080662f0 0x7fe7080687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:01.170 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.119+0000 7fe723fff700 1 --2- 172.21.15.90:0/2110816822 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fe7080662f0 0x7fe7080687a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe710007f00 tx=0x7fe710008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:01.171 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.119+0000 7f08dd06d700 1 -- 172.21.15.90:0/2448037721 wait complete. 2023-06-09T04:42:01.171 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.119+0000 7f08dd06d700 1 Processor -- start 2023-06-09T04:42:01.171 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.119+0000 7f08dd06d700 1 -- start start 2023-06-09T04:42:01.171 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.123+0000 7f08dd06d700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f08c4005ec0 0x7f08d8151fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:01.171 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.123+0000 7f08dd06d700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f08d8139c70 0x7f08d813a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:01.171 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.123+0000 7f08d7fff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f08c4005ec0 0x7f08d8151fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:01.172 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.123+0000 7f08d7fff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f08c4005ec0 0x7f08d8151fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:33628/0 (socket says 172.21.15.90:33628) 2023-06-09T04:42:01.172 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.123+0000 7f08d7fff700 1 -- 172.21.15.90:0/1406567213 learned_addr learned my addr 172.21.15.90:0/1406567213 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:01.172 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.123+0000 7f08dd06d700 1 --2- 172.21.15.90:0/1406567213 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f08d8156900 0x7f08d8156d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:01.172 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.123+0000 7f08dd06d700 1 -- 172.21.15.90:0/1406567213 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08d81572b0 con 0x7f08c4005ec0 2023-06-09T04:42:01.172 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.123+0000 7f08d77fe700 1 --2- 172.21.15.90:0/1406567213 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f08d8139c70 0x7f08d813a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:01.172 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.123+0000 7f08dd06d700 1 -- 172.21.15.90:0/1406567213 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08d8156320 con 0x7f08d8139c70 2023-06-09T04:42:01.172 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.123+0000 7f08dd06d700 1 -- 172.21.15.90:0/1406567213 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08d813a7e0 con 0x7f08d8156900 2023-06-09T04:42:01.173 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.123+0000 7f08dc86c700 1 --2- 172.21.15.90:0/1406567213 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f08d8156900 0x7f08d8156d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:01.173 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.123+0000 7fa0f6017700 1 --2- 172.21.15.90:0/3063332131 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa0e804f200 0x7fa0e80e12c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fa0ec00b550 tx=0x7fa0ec00b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:01.173 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.123+0000 7f08d7fff700 1 -- 172.21.15.90:0/1406567213 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f08d8156900 msgr2=0x7f08d8156d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:01.173 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.123+0000 7f08d7fff700 1 --2- 172.21.15.90:0/1406567213 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f08d8156900 0x7f08d8156d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:01.174 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.123+0000 7f08d7fff700 1 -- 172.21.15.90:0/1406567213 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f08d8139c70 msgr2=0x7f08d813a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:01.174 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.123+0000 7f08d7fff700 1 --2- 172.21.15.90:0/1406567213 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f08d8139c70 0x7f08d813a0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:01.174 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.127+0000 7f08d7fff700 1 -- 172.21.15.90:0/1406567213 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08d813aac0 con 0x7f08c4005ec0 2023-06-09T04:42:01.174 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.127+0000 7f08d77fe700 1 --2- 172.21.15.90:0/1406567213 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f08d8139c70 0x7f08d813a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:42:01.174 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.123+0000 7fe7217fa700 1 -- 172.21.15.90:0/2110816822 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe718050a20 con 0x7fe724069820 2023-06-09T04:42:01.175 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.127+0000 7f08d7fff700 1 --2- 172.21.15.90:0/1406567213 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f08c4005ec0 0x7f08d8151fe0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f08d000c1d0 tx=0x7f08d000c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:01.175 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.127+0000 7fa0e6ffd700 1 -- 172.21.15.90:0/3063332131 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0ec011830 con 0x7fa0e804f200 2023-06-09T04:42:01.175 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.127+0000 7fa0e6ffd700 1 -- 172.21.15.90:0/3063332131 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0ec011990 con 0x7fa0e804f200 2023-06-09T04:42:01.175 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.127+0000 7fa0e6ffd700 1 -- 172.21.15.90:0/3063332131 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0ec011d40 con 0x7fa0e804f200 2023-06-09T04:42:01.175 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.127+0000 7fa0f827b700 1 -- 172.21.15.90:0/3063332131 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0e817fb90 con 0x7fa0e804f200 2023-06-09T04:42:01.176 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.127+0000 7fa0f827b700 1 -- 172.21.15.90:0/3063332131 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0e8180150 con 0x7fa0e804f200 2023-06-09T04:42:01.176 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.127+0000 7f08d4ff9700 1 -- 172.21.15.90:0/1406567213 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08d000cd60 con 0x7f08c4005ec0 2023-06-09T04:42:01.176 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.127+0000 7f08d4ff9700 1 -- 172.21.15.90:0/1406567213 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08d0003a20 con 0x7f08c4005ec0 2023-06-09T04:42:01.176 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.127+0000 7f08d4ff9700 1 -- 172.21.15.90:0/1406567213 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08d0003dd0 con 0x7f08c4005ec0 2023-06-09T04:42:01.176 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.127+0000 7f08dd06d700 1 -- 172.21.15.90:0/1406567213 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08d813ada0 con 0x7f08c4005ec0 2023-06-09T04:42:01.177 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.127+0000 7f08dd06d700 1 -- 172.21.15.90:0/1406567213 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08d8152520 con 0x7f08c4005ec0 2023-06-09T04:42:01.177 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.131+0000 7fa0e6ffd700 1 -- 172.21.15.90:0/3063332131 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa0ec01a400 con 0x7fa0e804f200 2023-06-09T04:42:01.177 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.131+0000 7fa0e6ffd700 1 --2- 172.21.15.90:0/3063332131 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fa0d40663c0 0x7fa0d4068870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:01.177 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.131+0000 7fa0e6ffd700 1 -- 172.21.15.90:0/3063332131 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa0ec083e20 con 0x7fa0e804f200 2023-06-09T04:42:01.178 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.131+0000 7f08d4ff9700 1 -- 172.21.15.90:0/1406567213 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f08d00050d0 con 0x7f08c4005ec0 2023-06-09T04:42:01.178 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.131+0000 7f08d4ff9700 1 --2- 172.21.15.90:0/1406567213 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f08b8066320 0x7f08b80687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:01.178 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.131+0000 7f08d4ff9700 1 -- 172.21.15.90:0/1406567213 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f08d0084390 con 0x7f08c4005ec0 2023-06-09T04:42:01.178 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.135+0000 7fa0f827b700 1 -- 172.21.15.90:0/3063332131 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0d8005310 con 0x7fa0e804f200 2023-06-09T04:42:01.178 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.135+0000 7f08d77fe700 1 --2- 172.21.15.90:0/1406567213 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f08b8066320 0x7f08b80687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:01.179 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.135+0000 7fa0f5816700 1 --2- 172.21.15.90:0/3063332131 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fa0d40663c0 0x7fa0d4068870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:01.179 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.135+0000 7f08dd06d700 1 -- 172.21.15.90:0/1406567213 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08d813b4f0 con 0x7f08c4005ec0 2023-06-09T04:42:01.179 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.135+0000 7fa0f5816700 1 --2- 172.21.15.90:0/3063332131 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fa0d40663c0 0x7fa0d4068870 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa0e80d5c50 tx=0x7fa0e0011000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:01.180 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.135+0000 7f08d77fe700 1 --2- 172.21.15.90:0/1406567213 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f08b8066320 0x7f08b80687d0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f08c00048f0 tx=0x7f08c0012040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:01.180 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.143+0000 7f08d4ff9700 1 -- 172.21.15.90:0/1406567213 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f08d813b4f0 con 0x7f08c4005ec0 2023-06-09T04:42:01.180 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.143+0000 7fa0e6ffd700 1 -- 172.21.15.90:0/3063332131 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa0ec015080 con 0x7fa0e804f200 2023-06-09T04:42:01.420 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.415+0000 7fae08a78700 1 -- 172.21.15.90:0/3800351984 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fadfc04d2d0 con 0x7fadfc0e3770 2023-06-09T04:42:01.421 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.415+0000 7fadf2ffd700 1 -- 172.21.15.90:0/3800351984 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fadfc04d2d0 con 0x7fadfc0e3770 2023-06-09T04:42:01.423 INFO:teuthology.orchestra.run.smithi090.stdout:55834574852 2023-06-09T04:42:01.424 INFO:teuthology.orchestra.run.smithi090.stdout:55834574853 2023-06-09T04:42:01.424 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.415+0000 7fc67764d700 1 -- 172.21.15.90:0/1025320058 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc6700b7170 con 0x7fc670069820 2023-06-09T04:42:01.424 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.419+0000 7fc665ffb700 1 -- 172.21.15.90:0/1025320058 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc6700b7170 con 0x7fc670069820 2023-06-09T04:42:01.426 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.419+0000 7fadf0ff9700 1 -- 172.21.15.90:0/3800351984 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fade40663f0 msgr2=0x7fade40688a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:01.426 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.419+0000 7fc65b7fe700 1 -- 172.21.15.90:0/1025320058 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fc6540662f0 msgr2=0x7fc6540687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:01.427 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.419+0000 7fc65b7fe700 1 --2- 172.21.15.90:0/1025320058 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fc6540662f0 0x7fc6540687a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc67006c7f0 tx=0x7fc6600091c0 comp rx=0 tx=0).stop 2023-06-09T04:42:01.427 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.419+0000 7fadf0ff9700 1 --2- 172.21.15.90:0/3800351984 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fade40663f0 0x7fade40688a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fadf4001950 tx=0x7fadf4009040 comp rx=0 tx=0).stop 2023-06-09T04:42:01.428 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.419+0000 7fc65b7fe700 1 -- 172.21.15.90:0/1025320058 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc670069820 msgr2=0x7fc6700937c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:01.428 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.419+0000 7fc65b7fe700 1 --2- 172.21.15.90:0/1025320058 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc670069820 0x7fc6700937c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc66c014000 tx=0x7fc66c004af0 comp rx=0 tx=0).stop 2023-06-09T04:42:01.428 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.423+0000 7fc65b7fe700 1 -- 172.21.15.90:0/1025320058 shutdown_connections 2023-06-09T04:42:01.429 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.423+0000 7fc65b7fe700 1 --2- 172.21.15.90:0/1025320058 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fc6540662f0 0x7fc6540687a0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:01.429 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.423+0000 7fadf0ff9700 1 -- 172.21.15.90:0/3800351984 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fadfc0e3770 msgr2=0x7fadfc03b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:01.430 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.423+0000 7fc65b7fe700 1 --2- 172.21.15.90:0/1025320058 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc6700bba30 0x7fc670201dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:01.430 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.423+0000 7fadf0ff9700 1 --2- 172.21.15.90:0/3800351984 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fadfc0e3770 0x7fadfc03b0b0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fae0404f4a0 tx=0x7fae040615d0 comp rx=0 tx=0).stop 2023-06-09T04:42:01.430 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.423+0000 7fc65b7fe700 1 --2- 172.21.15.90:0/1025320058 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc6700ba0d0 0x7fc6700a09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:01.431 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.423+0000 7fc65b7fe700 1 --2- 172.21.15.90:0/1025320058 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc670069820 0x7fc6700937c0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:01.431 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.423+0000 7fc65b7fe700 1 -- 172.21.15.90:0/1025320058 >> 172.21.15.90:0/1025320058 conn(0x7fc6700d76d0 msgr2=0x7fc6700d3d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:01.432 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.423+0000 7fadf0ff9700 1 -- 172.21.15.90:0/3800351984 shutdown_connections 2023-06-09T04:42:01.432 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.423+0000 7fadf0ff9700 1 --2- 172.21.15.90:0/3800351984 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fade40663f0 0x7fade40688a0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:01.432 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.423+0000 7fadf0ff9700 1 --2- 172.21.15.90:0/3800351984 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fadfc0e3770 0x7fadfc03b0b0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:01.432 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.423+0000 7fadf0ff9700 1 --2- 172.21.15.90:0/3800351984 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fadfc0e28d0 0x7fadfc0da320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:01.432 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.423+0000 7fadf0ff9700 1 --2- 172.21.15.90:0/3800351984 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fadfc0550a0 0x7fadfc04be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:01.432 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.423+0000 7fadf0ff9700 1 -- 172.21.15.90:0/3800351984 >> 172.21.15.90:0/3800351984 conn(0x7fadfc00cf60 msgr2=0x7fadfc0e5700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:01.433 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.423+0000 7fadf0ff9700 1 -- 172.21.15.90:0/3800351984 shutdown_connections 2023-06-09T04:42:01.433 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.423+0000 7fadf0ff9700 1 -- 172.21.15.90:0/3800351984 wait complete. 2023-06-09T04:42:01.433 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.423+0000 7fc65b7fe700 1 -- 172.21.15.90:0/1025320058 shutdown_connections 2023-06-09T04:42:01.433 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.423+0000 7fc65b7fe700 1 -- 172.21.15.90:0/1025320058 wait complete. 2023-06-09T04:42:01.435 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.431+0000 7fa6018c3700 1 -- 172.21.15.90:0/1687659611 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa5f40376f0 con 0x7fa5f4036e80 2023-06-09T04:42:01.436 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.431+0000 7fa5e3fff700 1 -- 172.21.15.90:0/1687659611 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa5fc066440 con 0x7fa5f4036e80 2023-06-09T04:42:01.438 INFO:teuthology.orchestra.run.smithi090.stdout:55834574854 2023-06-09T04:42:01.439 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.435+0000 7ff2b232d700 1 -- 172.21.15.90:0/4122332938 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7ff290005890 con 0x7ff2ac1574c0 2023-06-09T04:42:01.439 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.435+0000 7ff2a97fa700 1 -- 172.21.15.90:0/4122332938 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff29c015020 con 0x7ff2ac1574c0 2023-06-09T04:42:01.440 INFO:teuthology.orchestra.run.smithi090.stdout:55834574853 2023-06-09T04:42:01.441 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.435+0000 7fa6018c3700 1 -- 172.21.15.90:0/1687659611 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fa5e80662f0 msgr2=0x7fa5e80687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:01.441 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.435+0000 7fa6018c3700 1 --2- 172.21.15.90:0/1687659611 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fa5e80662f0 0x7fa5e80687a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa5f40ea360 tx=0x7fa5f0007ee0 comp rx=0 tx=0).stop 2023-06-09T04:42:01.441 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.435+0000 7fa6018c3700 1 -- 172.21.15.90:0/1687659611 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa5f4036e80 msgr2=0x7fa5f40e7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:01.442 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.435+0000 7fa6018c3700 1 --2- 172.21.15.90:0/1687659611 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa5f4036e80 0x7fa5f40e7230 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fa5fc0613c0 tx=0x7fa5fc065be0 comp rx=0 tx=0).stop 2023-06-09T04:42:01.442 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.435+0000 7fa6018c3700 1 -- 172.21.15.90:0/1687659611 shutdown_connections 2023-06-09T04:42:01.442 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.435+0000 7fa6018c3700 1 --2- 172.21.15.90:0/1687659611 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fa5e80662f0 0x7fa5e80687a0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:01.442 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.435+0000 7fa6018c3700 1 --2- 172.21.15.90:0/1687659611 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa5f40e6e60 0x7fa5f4037d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:01.442 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.435+0000 7fa6018c3700 1 --2- 172.21.15.90:0/1687659611 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa5f40512b0 0x7fa5f40e9a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:01.442 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.435+0000 7fa6018c3700 1 --2- 172.21.15.90:0/1687659611 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa5f4036e80 0x7fa5f40e7230 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:01.443 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.435+0000 7fa6018c3700 1 -- 172.21.15.90:0/1687659611 >> 172.21.15.90:0/1687659611 conn(0x7fa5f4051770 msgr2=0x7fa5f4036630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:01.443 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.435+0000 7fa6018c3700 1 -- 172.21.15.90:0/1687659611 shutdown_connections 2023-06-09T04:42:01.443 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.435+0000 7fa6018c3700 1 -- 172.21.15.90:0/1687659611 wait complete. 2023-06-09T04:42:01.444 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.439+0000 7ff2b232d700 1 -- 172.21.15.90:0/4122332938 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7ff28c066340 msgr2=0x7ff28c0687f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:01.445 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.439+0000 7ff2b232d700 1 --2- 172.21.15.90:0/4122332938 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7ff28c066340 0x7ff28c0687f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff2a4005cb0 tx=0x7ff2a4009040 comp rx=0 tx=0).stop 2023-06-09T04:42:01.445 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.439+0000 7ff2b232d700 1 -- 172.21.15.90:0/4122332938 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff2ac1574c0 msgr2=0x7ff2ac1560d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:01.445 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.439+0000 7ff2b232d700 1 --2- 172.21.15.90:0/4122332938 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff2ac1574c0 0x7ff2ac1560d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ff29c00b550 tx=0x7ff29c00b860 comp rx=0 tx=0).stop 2023-06-09T04:42:01.445 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.439+0000 7ff2b232d700 1 -- 172.21.15.90:0/4122332938 shutdown_connections 2023-06-09T04:42:01.445 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.439+0000 7ff2b232d700 1 --2- 172.21.15.90:0/4122332938 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7ff28c066340 0x7ff28c0687f0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:01.445 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.439+0000 7ff2b232d700 1 --2- 172.21.15.90:0/4122332938 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff2ac1608d0 0x7ff2ac15cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:01.446 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.439+0000 7ff2b232d700 1 --2- 172.21.15.90:0/4122332938 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff2ac1574c0 0x7ff2ac1560d0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:01.446 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.439+0000 7ff2b232d700 1 --2- 172.21.15.90:0/4122332938 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff2ac0cb310 0x7ff2ac15dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:01.446 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.439+0000 7ff2b232d700 1 -- 172.21.15.90:0/4122332938 >> 172.21.15.90:0/4122332938 conn(0x7ff2ac06c690 msgr2=0x7ff2ac0cc0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:01.446 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.439+0000 7ff2b232d700 1 -- 172.21.15.90:0/4122332938 shutdown_connections 2023-06-09T04:42:01.446 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.439+0000 7ff2b232d700 1 -- 172.21.15.90:0/4122332938 wait complete. 2023-06-09T04:42:01.447 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.443+0000 7fa6e27ac700 1 -- 172.21.15.90:0/2955859950 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa6d40e7c40 con 0x7fa6d40512b0 2023-06-09T04:42:01.448 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.443+0000 7fa6d8ff9700 1 -- 172.21.15.90:0/2955859950 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa6d40e7c40 con 0x7fa6d40512b0 2023-06-09T04:42:01.448 INFO:teuthology.orchestra.run.smithi090.stdout:55834574854 2023-06-09T04:42:01.450 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.443+0000 7fe72992b700 1 -- 172.21.15.90:0/2110816822 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fe7040055c0 con 0x7fe724069820 2023-06-09T04:42:01.451 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.447+0000 7fe7217fa700 1 -- 172.21.15.90:0/2110816822 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe7180102c0 con 0x7fe724069820 2023-06-09T04:42:01.454 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.447+0000 7fa6e27ac700 1 -- 172.21.15.90:0/2955859950 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fa6c00663c0 msgr2=0x7fa6c0068870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:01.455 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.447+0000 7fa6e27ac700 1 --2- 172.21.15.90:0/2955859950 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fa6c00663c0 0x7fa6c0068870 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa6d0011340 tx=0x7fa6d000b040 comp rx=0 tx=0).stop 2023-06-09T04:42:01.455 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.447+0000 7fa6e27ac700 1 -- 172.21.15.90:0/2955859950 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa6d40512b0 msgr2=0x7fa6d40e88c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:01.455 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.447+0000 7fa6e27ac700 1 --2- 172.21.15.90:0/2955859950 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa6d40512b0 0x7fa6d40e88c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa6c8014040 tx=0x7fa6c8004770 comp rx=0 tx=0).stop 2023-06-09T04:42:01.455 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.447+0000 7fa6e27ac700 1 -- 172.21.15.90:0/2955859950 shutdown_connections 2023-06-09T04:42:01.455 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.447+0000 7fa6e27ac700 1 --2- 172.21.15.90:0/2955859950 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fa6c00663c0 0x7fa6c0068870 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:01.455 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.447+0000 7fa6e27ac700 1 --2- 172.21.15.90:0/2955859950 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa6d40e6e60 0x7fa6d4053770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:01.455 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.447+0000 7fa6e27ac700 1 --2- 172.21.15.90:0/2955859950 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa6d40512b0 0x7fa6d40e88c0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:01.456 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.447+0000 7fa6e27ac700 1 --2- 172.21.15.90:0/2955859950 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa6d4036cb0 0x7fa6d40da600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:01.456 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.447+0000 7fa6e27ac700 1 -- 172.21.15.90:0/2955859950 >> 172.21.15.90:0/2955859950 conn(0x7fa6d4051770 msgr2=0x7fa6d4007220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:01.456 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.447+0000 7fa6e27ac700 1 -- 172.21.15.90:0/2955859950 shutdown_connections 2023-06-09T04:42:01.456 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.447+0000 7fa6e27ac700 1 -- 172.21.15.90:0/2955859950 wait complete. 2023-06-09T04:42:01.456 INFO:teuthology.orchestra.run.smithi090.stdout:55834574854 2023-06-09T04:42:01.457 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.3 2023-06-09T04:42:01.457 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.451+0000 7fe70effd700 1 -- 172.21.15.90:0/2110816822 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fe7080662f0 msgr2=0x7fe7080687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:01.458 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.451+0000 7fe70effd700 1 --2- 172.21.15.90:0/2110816822 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fe7080662f0 0x7fe7080687a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe710007f00 tx=0x7fe710008040 comp rx=0 tx=0).stop 2023-06-09T04:42:01.458 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.451+0000 7fe70effd700 1 -- 172.21.15.90:0/2110816822 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe724069820 msgr2=0x7fe7240b1200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:01.458 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.451+0000 7fe70effd700 1 --2- 172.21.15.90:0/2110816822 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe724069820 0x7fe7240b1200 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe71800c410 tx=0x7fe71800c720 comp rx=0 tx=0).stop 2023-06-09T04:42:01.459 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.1 2023-06-09T04:42:01.459 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.451+0000 7fe70effd700 1 -- 172.21.15.90:0/2110816822 shutdown_connections 2023-06-09T04:42:01.459 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.451+0000 7fe70effd700 1 --2- 172.21.15.90:0/2110816822 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fe7080662f0 0x7fe7080687a0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:01.459 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.451+0000 7fe70effd700 1 --2- 172.21.15.90:0/2110816822 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe72415a3a0 0x7fe7241f8f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:01.460 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.451+0000 7fe70effd700 1 --2- 172.21.15.90:0/2110816822 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe72406fb70 0x7fe724139230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:01.460 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.451+0000 7fe70effd700 1 --2- 172.21.15.90:0/2110816822 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe724069820 0x7fe7240b1200 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:01.460 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.451+0000 7fe70effd700 1 -- 172.21.15.90:0/2110816822 >> 172.21.15.90:0/2110816822 conn(0x7fe72406c690 msgr2=0x7fe7240cc870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:01.460 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.451+0000 7fe70effd700 1 -- 172.21.15.90:0/2110816822 shutdown_connections 2023-06-09T04:42:01.460 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.451+0000 7fe70effd700 1 -- 172.21.15.90:0/2110816822 wait complete. 2023-06-09T04:42:01.461 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.455+0000 7fa0f827b700 1 -- 172.21.15.90:0/3063332131 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fa0d80055c0 con 0x7fa0e804f200 2023-06-09T04:42:01.462 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.455+0000 7fa0e6ffd700 1 -- 172.21.15.90:0/3063332131 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa0ec051310 con 0x7fa0e804f200 2023-06-09T04:42:01.462 INFO:teuthology.orchestra.run.smithi090.stdout:55834574854 2023-06-09T04:42:01.463 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.459+0000 7f08dd06d700 1 -- 172.21.15.90:0/1406567213 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f08d813b8d0 con 0x7f08c4005ec0 2023-06-09T04:42:01.463 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.459+0000 7f08d4ff9700 1 -- 172.21.15.90:0/1406567213 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f08d813b8d0 con 0x7f08c4005ec0 2023-06-09T04:42:01.464 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.0 2023-06-09T04:42:01.465 INFO:teuthology.orchestra.run.smithi090.stdout:55834574853 2023-06-09T04:42:01.466 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.459+0000 7fa0f827b700 1 -- 172.21.15.90:0/3063332131 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fa0d40663c0 msgr2=0x7fa0d4068870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:01.466 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.459+0000 7fa0f827b700 1 --2- 172.21.15.90:0/3063332131 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fa0d40663c0 0x7fa0d4068870 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa0e80d5c50 tx=0x7fa0e0011000 comp rx=0 tx=0).stop 2023-06-09T04:42:01.466 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.459+0000 7fa0f827b700 1 -- 172.21.15.90:0/3063332131 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa0e804f200 msgr2=0x7fa0e80e12c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:01.466 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.459+0000 7fa0f827b700 1 --2- 172.21.15.90:0/3063332131 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa0e804f200 0x7fa0e80e12c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fa0ec00b550 tx=0x7fa0ec00b910 comp rx=0 tx=0).stop 2023-06-09T04:42:01.467 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.459+0000 7fa0f827b700 1 -- 172.21.15.90:0/3063332131 shutdown_connections 2023-06-09T04:42:01.467 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.459+0000 7fa0f827b700 1 --2- 172.21.15.90:0/3063332131 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fa0d40663c0 0x7fa0d4068870 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:01.467 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.459+0000 7fa0f827b700 1 --2- 172.21.15.90:0/3063332131 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa0e80deb00 0x7fa0e804a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:01.467 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.459+0000 7fa0f827b700 1 --2- 172.21.15.90:0/3063332131 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa0e80de730 0x7fa0e80d38e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:01.467 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.459+0000 7fa0f827b700 1 --2- 172.21.15.90:0/3063332131 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa0e804f200 0x7fa0e80e12c0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:01.467 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.459+0000 7fa0f827b700 1 -- 172.21.15.90:0/3063332131 >> 172.21.15.90:0/3063332131 conn(0x7fa0e8051630 msgr2=0x7fa0e80d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:01.468 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.459+0000 7fa0f827b700 1 -- 172.21.15.90:0/3063332131 shutdown_connections 2023-06-09T04:42:01.468 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.463+0000 7fa0f827b700 1 -- 172.21.15.90:0/3063332131 wait complete. 2023-06-09T04:42:01.469 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.463+0000 7f08dd06d700 1 -- 172.21.15.90:0/1406567213 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f08b8066320 msgr2=0x7f08b80687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:01.469 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.463+0000 7f08dd06d700 1 --2- 172.21.15.90:0/1406567213 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f08b8066320 0x7f08b80687d0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f08c00048f0 tx=0x7f08c0012040 comp rx=0 tx=0).stop 2023-06-09T04:42:01.469 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.463+0000 7f08dd06d700 1 -- 172.21.15.90:0/1406567213 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f08c4005ec0 msgr2=0x7f08d8151fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:01.469 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.463+0000 7f08dd06d700 1 --2- 172.21.15.90:0/1406567213 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f08c4005ec0 0x7f08d8151fe0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f08d000c1d0 tx=0x7f08d000c4e0 comp rx=0 tx=0).stop 2023-06-09T04:42:01.469 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.463+0000 7f08dd06d700 1 -- 172.21.15.90:0/1406567213 shutdown_connections 2023-06-09T04:42:01.470 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.463+0000 7f08dd06d700 1 --2- 172.21.15.90:0/1406567213 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f08b8066320 0x7f08b80687d0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:01.470 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.463+0000 7f08dd06d700 1 --2- 172.21.15.90:0/1406567213 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f08d8156900 0x7f08d8156d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:01.470 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.463+0000 7f08dd06d700 1 --2- 172.21.15.90:0/1406567213 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f08d8139c70 0x7f08d813a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:01.470 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.463+0000 7f08dd06d700 1 --2- 172.21.15.90:0/1406567213 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f08c4005ec0 0x7f08d8151fe0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:01.470 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.463+0000 7f08dd06d700 1 -- 172.21.15.90:0/1406567213 >> 172.21.15.90:0/1406567213 conn(0x7f08d806c690 msgr2=0x7f08d81535e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:01.470 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.463+0000 7f08dd06d700 1 -- 172.21.15.90:0/1406567213 shutdown_connections 2023-06-09T04:42:01.470 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:01.463+0000 7f08dd06d700 1 -- 172.21.15.90:0/1406567213 wait complete. 2023-06-09T04:42:01.471 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.5 2023-06-09T04:42:01.476 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.2 2023-06-09T04:42:01.484 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.7 2023-06-09T04:42:01.485 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.6 2023-06-09T04:42:01.488 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.4 2023-06-09T04:42:02.458 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-06-09T04:42:02.459 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-06-09T04:42:02.465 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-06-09T04:42:02.472 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-06-09T04:42:02.477 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-06-09T04:42:02.486 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-06-09T04:42:02.486 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-06-09T04:42:02.489 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-06-09T04:42:02.667 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.663+0000 7fa60d6f5700 1 Processor -- start 2023-06-09T04:42:02.667 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.663+0000 7fa60d6f5700 1 -- start start 2023-06-09T04:42:02.669 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.663+0000 7fec86a78700 1 Processor -- start 2023-06-09T04:42:02.669 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.663+0000 7fec86a78700 1 -- start start 2023-06-09T04:42:02.670 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.663+0000 7fa60d6f5700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fa60815bed0 0x7fa6080cd7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:02.670 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.663+0000 7fa60d6f5700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fa60806d670 0x7fa608069a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:02.670 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.663+0000 7fa60d6f5700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa60815fbc0 con 0x7fa6080cdd30 2023-06-09T04:42:02.670 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.663+0000 7fa60d6f5700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa60815fea0 con 0x7fa60815bed0 2023-06-09T04:42:02.670 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.663+0000 7fa60d6f5700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa608160180 con 0x7fa60806d670 2023-06-09T04:42:02.671 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.663+0000 7fa606ffd700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fa60815bed0 0x7fa6080cd7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:02.671 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.663+0000 7fa6077fe700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fa60806d670 0x7fa608069a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:02.671 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.663+0000 7fa606ffd700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fa60815bed0 0x7fa6080cd7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:33644/0 (socket says 172.21.15.90:33644) 2023-06-09T04:42:02.671 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.663+0000 7fa606ffd700 1 -- 172.21.15.90:0/2642523575 learned_addr learned my addr 172.21.15.90:0/2642523575 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:02.672 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.663+0000 7fec86a78700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fec80089a90 0x7fec800cd430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:02.672 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.663+0000 7fec86a78700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec800cd970 con 0x7fec8006d670 2023-06-09T04:42:02.672 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.663+0000 7fec86a78700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec8016cb50 con 0x7fec800cc0f0 2023-06-09T04:42:02.672 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.663+0000 7fec86a78700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec8016d6d0 con 0x7fec80089a90 2023-06-09T04:42:02.672 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.667+0000 7fec85015700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7fec8006d670 0x7fec80069c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:46540/0 (socket says 172.21.15.90:46540) 2023-06-09T04:42:02.673 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.667+0000 7fec85015700 1 -- 172.21.15.90:0/3619771547 learned_addr learned my addr 172.21.15.90:0/3619771547 (peer_addr_for_me v1:172.21.15.90:0/0) 2023-06-09T04:42:02.673 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.667+0000 7fec84814700 1 --2- 172.21.15.90:0/3619771547 >> v2:172.21.15.174:3300/0 conn(0x7fec80089a90 0x7fec800cd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:02.673 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.667+0000 7fa605ffb700 1 -- 172.21.15.90:0/2642523575 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1491884691 0 0) 0x7fa60815fbc0 con 0x7fa6080cdd30 2023-06-09T04:42:02.673 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.667+0000 7fa605ffb700 1 -- 172.21.15.90:0/2642523575 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa5f00035d0 con 0x7fa6080cdd30 2023-06-09T04:42:02.674 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.667+0000 7fa6077fe700 1 -- 172.21.15.90:0/2642523575 >> v2:172.21.15.90:3300/0 conn(0x7fa60815bed0 msgr2=0x7fa6080cd7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:02.674 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.667+0000 7fa6077fe700 1 --2- 172.21.15.90:0/2642523575 >> v2:172.21.15.90:3300/0 conn(0x7fa60815bed0 0x7fa6080cd7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:02.674 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.667+0000 7fa6077fe700 1 -- 172.21.15.90:0/2642523575 >> v1:172.21.15.174:6789/0 conn(0x7fa6080cdd30 legacy=0x7fa60806cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:02.674 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.667+0000 7fa6077fe700 1 -- 172.21.15.90:0/2642523575 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa608160460 con 0x7fa60806d670 2023-06-09T04:42:02.674 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.667+0000 7fec7f7fe700 1 -- 172.21.15.90:0/3619771547 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2774129531 0 0) 0x7fec70001110 con 0x7fec8006d670 2023-06-09T04:42:02.674 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.667+0000 7fec7f7fe700 1 -- 172.21.15.90:0/3619771547 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec680035d0 con 0x7fec8006d670 2023-06-09T04:42:02.675 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.667+0000 7fa606ffd700 1 --2- 172.21.15.90:0/2642523575 >> v2:172.21.15.90:3300/0 conn(0x7fa60815bed0 0x7fa6080cd7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:42:02.675 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.667+0000 7fec7f7fe700 1 -- 172.21.15.90:0/3619771547 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 95010510 0 0) 0x7fec8016cb50 con 0x7fec800cc0f0 2023-06-09T04:42:02.675 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.667+0000 7fec7f7fe700 1 -- 172.21.15.90:0/3619771547 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec68004950 con 0x7fec800cc0f0 2023-06-09T04:42:02.675 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.667+0000 7fec84814700 1 -- 172.21.15.90:0/3619771547 >> v1:172.21.15.174:6789/0 conn(0x7fec800cc0f0 legacy=0x7fec8006cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:02.676 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.667+0000 7fec84814700 1 -- 172.21.15.90:0/3619771547 >> v1:172.21.15.90:6789/0 conn(0x7fec8006d670 legacy=0x7fec80069c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:02.676 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.667+0000 7fec84814700 1 -- 172.21.15.90:0/3619771547 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec8016ce30 con 0x7fec80089a90 2023-06-09T04:42:02.676 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.667+0000 7fa6077fe700 1 --2- 172.21.15.90:0/2642523575 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa60806d670 0x7fa608069a60 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa60806f2b0 tx=0x7fa60000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8790af12396b27cd server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:02.676 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.667+0000 7fec84814700 1 --2- 172.21.15.90:0/3619771547 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fec80089a90 0x7fec800cd430 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fec74009850 tx=0x7fec74009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=de619897b94f5889 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:02.677 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.667+0000 7fa605ffb700 1 -- 172.21.15.90:0/2642523575 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa60000e070 con 0x7fa60806d670 2023-06-09T04:42:02.677 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.667+0000 7fa605ffb700 1 -- 172.21.15.90:0/2642523575 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa60000bb20 con 0x7fa60806d670 2023-06-09T04:42:02.677 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.667+0000 7fa605ffb700 1 -- 172.21.15.90:0/2642523575 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa600012430 con 0x7fa60806d670 2023-06-09T04:42:02.677 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.667+0000 7fec7f7fe700 1 -- 172.21.15.90:0/3619771547 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec74011830 con 0x7fec80089a90 2023-06-09T04:42:02.678 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.667+0000 7fec7f7fe700 1 -- 172.21.15.90:0/3619771547 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec74011990 con 0x7fec80089a90 2023-06-09T04:42:02.678 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.667+0000 7fec7f7fe700 1 -- 172.21.15.90:0/3619771547 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec74011d00 con 0x7fec80089a90 2023-06-09T04:42:02.678 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.667+0000 7fa60d6f5700 1 -- 172.21.15.90:0/2642523575 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa60806d670 msgr2=0x7fa608069a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:02.678 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.667+0000 7fa60d6f5700 1 --2- 172.21.15.90:0/2642523575 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa60806d670 0x7fa608069a60 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa60806f2b0 tx=0x7fa60000b330 comp rx=0 tx=0).stop 2023-06-09T04:42:02.679 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.667+0000 7fec86a78700 1 -- 172.21.15.90:0/3619771547 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fec80089a90 msgr2=0x7fec800cd430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:02.679 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.667+0000 7fec86a78700 1 --2- 172.21.15.90:0/3619771547 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fec80089a90 0x7fec800cd430 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fec74009850 tx=0x7fec74009b60 comp rx=0 tx=0).stop 2023-06-09T04:42:02.679 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.667+0000 7f76ea98d700 1 Processor -- start 2023-06-09T04:42:02.679 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.671+0000 7f76ea98d700 1 -- start start 2023-06-09T04:42:02.680 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.667+0000 7fa60d6f5700 1 -- 172.21.15.90:0/2642523575 shutdown_connections 2023-06-09T04:42:02.680 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.667+0000 7fa60d6f5700 1 --2- 172.21.15.90:0/2642523575 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa60806d670 0x7fa608069a60 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:02.680 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.667+0000 7fa60d6f5700 1 --2- 172.21.15.90:0/2642523575 >> v2:172.21.15.90:3300/0 conn(0x7fa60815bed0 0x7fa6080cd7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:02.680 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.667+0000 7fa60d6f5700 1 -- 172.21.15.90:0/2642523575 >> 172.21.15.90:0/2642523575 conn(0x7fa6080ce1f0 msgr2=0x7fa6080ce5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:02.681 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.671+0000 7fec86a78700 1 -- 172.21.15.90:0/3619771547 shutdown_connections 2023-06-09T04:42:02.681 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.671+0000 7fec86a78700 1 --2- 172.21.15.90:0/3619771547 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fec80089a90 0x7fec800cd430 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:02.681 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.671+0000 7fec86a78700 1 -- 172.21.15.90:0/3619771547 >> 172.21.15.90:0/3619771547 conn(0x7fec800ce1f0 msgr2=0x7fec800ce5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:02.681 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.671+0000 7fec86a78700 1 -- 172.21.15.90:0/3619771547 shutdown_connections 2023-06-09T04:42:02.681 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.671+0000 7fec86a78700 1 -- 172.21.15.90:0/3619771547 wait complete. 2023-06-09T04:42:02.682 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.671+0000 7f76ea98d700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f76e415bed0 0x7f76e40cd7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:02.682 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.671+0000 7f76ea98d700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76e415fbc0 con 0x7f76e40cdd30 2023-06-09T04:42:02.682 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.671+0000 7f76ea98d700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76e415fea0 con 0x7f76e406d670 2023-06-09T04:42:02.682 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.671+0000 7f76ea98d700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76e4160180 con 0x7f76e415bed0 2023-06-09T04:42:02.682 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.671+0000 7f76e37fe700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f76e40cdd30 0x7f76e406cf60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:46554/0 (socket says 172.21.15.90:46554) 2023-06-09T04:42:02.682 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.671+0000 7f76e37fe700 1 -- 172.21.15.90:0/65927191 learned_addr learned my addr 172.21.15.90:0/65927191 (peer_addr_for_me v1:172.21.15.90:0/0) 2023-06-09T04:42:02.683 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.671+0000 7fa60d6f5700 1 -- 172.21.15.90:0/2642523575 shutdown_connections 2023-06-09T04:42:02.683 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.671+0000 7fa60d6f5700 1 -- 172.21.15.90:0/2642523575 wait complete. 2023-06-09T04:42:02.683 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.671+0000 7f76e3fff700 1 --2- 172.21.15.90:0/65927191 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f76e415bed0 0x7f76e40cd7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:02.684 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.671+0000 7f76e2ffd700 1 -- 172.21.15.90:0/65927191 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3856033756 0 0) 0x7f76e415fbc0 con 0x7f76e40cdd30 2023-06-09T04:42:02.684 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.671+0000 7f76e2ffd700 1 -- 172.21.15.90:0/65927191 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f76cc0035d0 con 0x7f76e40cdd30 2023-06-09T04:42:02.684 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.671+0000 7f76e3fff700 1 -- 172.21.15.90:0/65927191 >> v1:172.21.15.174:6789/0 conn(0x7f76e406d670 legacy=0x7f76e4069a60 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-06-09T04:42:02.684 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.671+0000 7f76e3fff700 1 -- 172.21.15.90:0/65927191 >> v1:172.21.15.90:6789/0 conn(0x7f76e40cdd30 legacy=0x7f76e406cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:02.684 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.671+0000 7f76e3fff700 1 -- 172.21.15.90:0/65927191 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76e4160460 con 0x7f76e415bed0 2023-06-09T04:42:02.684 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.675+0000 7f76e3fff700 1 --2- 172.21.15.90:0/65927191 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f76e415bed0 0x7f76e40cd7f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f76d4009880 tx=0x7f76d4009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d0d777292045d38f server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:02.685 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.675+0000 7fec86a78700 1 Processor -- start 2023-06-09T04:42:02.685 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.675+0000 7f76e2ffd700 1 -- 172.21.15.90:0/65927191 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76d4004230 con 0x7f76e415bed0 2023-06-09T04:42:02.685 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.675+0000 7f76e2ffd700 1 -- 172.21.15.90:0/65927191 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76d4004390 con 0x7f76e415bed0 2023-06-09T04:42:02.685 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.675+0000 7f76e2ffd700 1 -- 172.21.15.90:0/65927191 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76d40036c0 con 0x7f76e415bed0 2023-06-09T04:42:02.686 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.675+0000 7fec86a78700 1 -- start start 2023-06-09T04:42:02.686 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.675+0000 7f76ea98d700 1 -- 172.21.15.90:0/65927191 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f76e415bed0 msgr2=0x7f76e40cd7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:02.686 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.675+0000 7f76ea98d700 1 --2- 172.21.15.90:0/65927191 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f76e415bed0 0x7f76e40cd7f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f76d4009880 tx=0x7f76d4009b90 comp rx=0 tx=0).stop 2023-06-09T04:42:02.686 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.675+0000 7f76ea98d700 1 -- 172.21.15.90:0/65927191 shutdown_connections 2023-06-09T04:42:02.686 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.675+0000 7f76ea98d700 1 --2- 172.21.15.90:0/65927191 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f76e415bed0 0x7f76e40cd7f0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:02.687 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.675+0000 7f76ea98d700 1 -- 172.21.15.90:0/65927191 >> 172.21.15.90:0/65927191 conn(0x7f76e40ce1f0 msgr2=0x7f76e40ce5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:02.687 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.679+0000 7fec86a78700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fec8006d670 0x7fec800af080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:02.687 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.679+0000 7fec86a78700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fec80089a90 0x7fec80160690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:02.687 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.679+0000 7fec86a78700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fec800cc0f0 0x7fec8015baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:02.687 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.679+0000 7fec84814700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fec8006d670 0x7fec800af080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:02.687 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.679+0000 7fec84814700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fec8006d670 0x7fec800af080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.90:37562/0 (socket says 172.21.15.90:37562) 2023-06-09T04:42:02.688 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.679+0000 7fec7ffff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fec80089a90 0x7fec80160690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:02.688 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.679+0000 7fec7ffff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fec80089a90 0x7fec80160690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.90:38558/0 (socket says 172.21.15.90:38558) 2023-06-09T04:42:02.688 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.675+0000 7fa60d6f5700 1 Processor -- start 2023-06-09T04:42:02.688 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.675+0000 7f76ea98d700 1 -- 172.21.15.90:0/65927191 shutdown_connections 2023-06-09T04:42:02.689 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.675+0000 7f76ea98d700 1 -- 172.21.15.90:0/65927191 wait complete. 2023-06-09T04:42:02.689 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.679+0000 7f76ea98d700 1 Processor -- start 2023-06-09T04:42:02.689 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.675+0000 7f384d318700 1 Processor -- start 2023-06-09T04:42:02.690 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.675+0000 7f384d318700 1 -- start start 2023-06-09T04:42:02.690 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.679+0000 7f384d318700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f3848155950 0x7f384806d400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:02.690 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.679+0000 7f384d318700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f384806fdb0 0x7f384815c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:02.690 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.679+0000 7f384d318700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f384813d660 con 0x7f384806f960 2023-06-09T04:42:02.690 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.679+0000 7f384d318700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f384813d8b0 con 0x7f3848155950 2023-06-09T04:42:02.690 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.679+0000 7f384d318700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f384813db90 con 0x7f384806fdb0 2023-06-09T04:42:02.690 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.679+0000 7f38477fe700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f384806f960 0x7f384815b9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:46570/0 (socket says 172.21.15.90:46570) 2023-06-09T04:42:02.691 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.679+0000 7f38477fe700 1 -- 172.21.15.90:0/1047675172 learned_addr learned my addr 172.21.15.90:0/1047675172 (peer_addr_for_me v1:172.21.15.90:0/0) 2023-06-09T04:42:02.691 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.679+0000 7f384cb17700 1 --2- 172.21.15.90:0/1047675172 >> v2:172.21.15.174:3300/0 conn(0x7f384806fdb0 0x7f384815c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:02.691 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.679+0000 7f3846ffd700 1 -- 172.21.15.90:0/1047675172 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1337750127 0 0) 0x7f384813d660 con 0x7f384806f960 2023-06-09T04:42:02.691 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.679+0000 7f3846ffd700 1 -- 172.21.15.90:0/1047675172 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f38300035b0 con 0x7f384806f960 2023-06-09T04:42:02.691 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.679+0000 7f384cb17700 1 -- 172.21.15.90:0/1047675172 >> v2:172.21.15.90:3300/0 conn(0x7f3848155950 msgr2=0x7f384806d400 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-06-09T04:42:02.691 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.679+0000 7f3847fff700 1 --2- 172.21.15.90:0/1047675172 >> v2:172.21.15.90:3300/0 conn(0x7f3848155950 0x7f384806d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:02.691 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.679+0000 7fec85015700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fec800cc0f0 0x7fec8015baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:02.692 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.679+0000 7fec85015700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fec800cc0f0 0x7fec8015baa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:33648/0 (socket says 172.21.15.90:33648) 2023-06-09T04:42:02.692 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.679+0000 7fa60d6f5700 1 -- start start 2023-06-09T04:42:02.692 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.679+0000 7f76ea98d700 1 -- start start 2023-06-09T04:42:02.693 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.679+0000 7f3846ffd700 1 -- 172.21.15.90:0/1047675172 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 432806207 0 0) 0x7f38300035b0 con 0x7f384806f960 2023-06-09T04:42:02.693 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.679+0000 7f384cb17700 1 --2- 172.21.15.90:0/1047675172 >> v2:172.21.15.90:3300/0 conn(0x7f3848155950 0x7f384806d400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:02.693 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.679+0000 7f384cb17700 1 -- 172.21.15.90:0/1047675172 >> v1:172.21.15.90:6789/0 conn(0x7f384806f960 legacy=0x7f384815b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:02.693 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.679+0000 7f384cb17700 1 -- 172.21.15.90:0/1047675172 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f384813de70 con 0x7f384806fdb0 2023-06-09T04:42:02.693 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.683+0000 7f3847fff700 1 --2- 172.21.15.90:0/1047675172 >> v2:172.21.15.90:3300/0 conn(0x7f3848155950 0x7f384806d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:42:02.694 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.683+0000 7f76ea98d700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f76e406d670 0x7f76e415a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:02.694 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.683+0000 7fec84814700 1 -- 172.21.15.90:0/1571292999 learned_addr learned my addr 172.21.15.90:0/1571292999 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:02.694 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.683+0000 7f384cb17700 1 --2- 172.21.15.90:0/1047675172 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f384806fdb0 0x7f384815c100 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f384806e2c0 tx=0x7f384000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e0d035dc87c31ffa server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:02.695 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.683+0000 7f76ea98d700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f76e40cdd30 0x7f76e4201540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:02.695 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.683+0000 7fa60d6f5700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa60806d670 0x7fa608153fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:02.695 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.683+0000 7fec86a78700 1 -- 172.21.15.90:0/1571292999 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec80088720 con 0x7fec800cc0f0 2023-06-09T04:42:02.696 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.683+0000 7fec86a78700 1 -- 172.21.15.90:0/1571292999 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec80088bb0 con 0x7fec80089a90 2023-06-09T04:42:02.696 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.683+0000 7fa60d6f5700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa6080cdd30 0x7fa60814fe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:02.696 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.683+0000 7fa60d6f5700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa60815bed0 0x7fa608153590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:02.696 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.683+0000 7fa60d6f5700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa608150380 con 0x7fa60806d670 2023-06-09T04:42:02.697 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.683+0000 7fa60d6f5700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6081545a0 con 0x7fa6080cdd30 2023-06-09T04:42:02.697 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.683+0000 7fa60d6f5700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa608154880 con 0x7fa60815bed0 2023-06-09T04:42:02.697 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.683+0000 7fa606ffd700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa60806d670 0x7fa608153fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:02.697 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.683+0000 7fa606ffd700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa60806d670 0x7fa608153fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:33668/0 (socket says 172.21.15.90:33668) 2023-06-09T04:42:02.697 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.683+0000 7fa606ffd700 1 -- 172.21.15.90:0/2113526587 learned_addr learned my addr 172.21.15.90:0/2113526587 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:02.698 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.683+0000 7f76e3fff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f76e406d670 0x7f76e415a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:02.698 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.683+0000 7f76e3fff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f76e406d670 0x7f76e415a8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.90:38566/0 (socket says 172.21.15.90:38566) 2023-06-09T04:42:02.698 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.683+0000 7f76e37fe700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f76e40cdd30 0x7f76e4201540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:02.698 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.683+0000 7f76e37fe700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f76e40cdd30 0x7f76e4201540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:33654/0 (socket says 172.21.15.90:33654) 2023-06-09T04:42:02.698 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.683+0000 7fec86a78700 1 -- 172.21.15.90:0/1571292999 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec80087b10 con 0x7fec8006d670 2023-06-09T04:42:02.699 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.683+0000 7f3846ffd700 1 -- 172.21.15.90:0/1047675172 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f384000e070 con 0x7f384806fdb0 2023-06-09T04:42:02.699 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.683+0000 7f3846ffd700 1 -- 172.21.15.90:0/1047675172 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3840003a40 con 0x7f384806fdb0 2023-06-09T04:42:02.699 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.683+0000 7f3846ffd700 1 -- 172.21.15.90:0/1047675172 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3838004d80 con 0x7f384806fdb0 2023-06-09T04:42:02.699 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.683+0000 7f76e3fff700 1 -- 172.21.15.90:0/3905186101 learned_addr learned my addr 172.21.15.90:0/3905186101 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:02.700 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.683+0000 7f76ea98d700 1 --2- 172.21.15.90:0/3905186101 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f76e415bed0 0x7f76e4201a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:02.700 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.683+0000 7fa6067fc700 1 --2- 172.21.15.90:0/2113526587 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa6080cdd30 0x7fa60814fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:02.700 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.683+0000 7fa6077fe700 1 --2- 172.21.15.90:0/2113526587 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa60815bed0 0x7fa608153590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:02.701 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.683+0000 7fa606ffd700 1 -- 172.21.15.90:0/2113526587 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa60815bed0 msgr2=0x7fa608153590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:02.701 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.683+0000 7fa606ffd700 1 --2- 172.21.15.90:0/2113526587 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa60815bed0 0x7fa608153590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:02.701 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.683+0000 7fa606ffd700 1 -- 172.21.15.90:0/2113526587 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa6080cdd30 msgr2=0x7fa60814fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:02.701 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.683+0000 7fa606ffd700 1 --2- 172.21.15.90:0/2113526587 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa6080cdd30 0x7fa60814fe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:02.701 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.683+0000 7fa606ffd700 1 -- 172.21.15.90:0/2113526587 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5fc009570 con 0x7fa60806d670 2023-06-09T04:42:02.701 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.683+0000 7fa6077fe700 1 --2- 172.21.15.90:0/2113526587 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa60815bed0 0x7fa608153590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:42:02.701 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.683+0000 7f384d318700 1 -- 172.21.15.90:0/1047675172 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f384806fdb0 msgr2=0x7f384815c100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:02.702 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.683+0000 7f384d318700 1 --2- 172.21.15.90:0/1047675172 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f384806fdb0 0x7f384815c100 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f384806e2c0 tx=0x7f384000b330 comp rx=0 tx=0).stop 2023-06-09T04:42:02.702 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.683+0000 7f76ea98d700 1 -- 172.21.15.90:0/3905186101 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76e40b2c60 con 0x7f76e40cdd30 2023-06-09T04:42:02.702 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.683+0000 7f76ea98d700 1 -- 172.21.15.90:0/3905186101 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76e415ae10 con 0x7f76e406d670 2023-06-09T04:42:02.702 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.683+0000 7f76ea98d700 1 -- 172.21.15.90:0/3905186101 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76e40b2e40 con 0x7f76e415bed0 2023-06-09T04:42:02.703 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.683+0000 7f384d318700 1 -- 172.21.15.90:0/1047675172 shutdown_connections 2023-06-09T04:42:02.703 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.683+0000 7f384d318700 1 --2- 172.21.15.90:0/1047675172 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f384806fdb0 0x7f384815c100 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:02.703 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.683+0000 7f384d318700 1 --2- 172.21.15.90:0/1047675172 >> v2:172.21.15.90:3300/0 conn(0x7f3848155950 0x7f384806d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:02.703 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.683+0000 7f384d318700 1 -- 172.21.15.90:0/1047675172 >> 172.21.15.90:0/1047675172 conn(0x7f38480ce1f0 msgr2=0x7f38480ce5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:02.704 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.683+0000 7fa606ffd700 1 --2- 172.21.15.90:0/2113526587 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa60806d670 0x7fa608153fc0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa5fc00e9d0 tx=0x7fa5fc00ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:02.704 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.683+0000 7f76e8f2a700 1 --2- 172.21.15.90:0/3905186101 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f76e415bed0 0x7f76e4201a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:02.704 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.683+0000 7f384d318700 1 -- 172.21.15.90:0/1047675172 shutdown_connections 2023-06-09T04:42:02.705 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.683+0000 7fec7ffff700 1 -- 172.21.15.90:0/1571292999 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fec8006d670 msgr2=0x7fec800af080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:02.705 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.683+0000 7fec7ffff700 1 --2- 172.21.15.90:0/1571292999 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fec8006d670 0x7fec800af080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:02.705 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.683+0000 7fec7ffff700 1 -- 172.21.15.90:0/1571292999 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fec800cc0f0 msgr2=0x7fec8015baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:02.705 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.683+0000 7fec7ffff700 1 --2- 172.21.15.90:0/1571292999 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fec800cc0f0 0x7fec8015baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:02.705 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.683+0000 7fec7ffff700 1 -- 172.21.15.90:0/1571292999 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec740094b0 con 0x7fec80089a90 2023-06-09T04:42:02.705 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.683+0000 7fa5ef7fe700 1 -- 172.21.15.90:0/2113526587 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5fc00c850 con 0x7fa60806d670 2023-06-09T04:42:02.706 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.683+0000 7fa5ef7fe700 1 -- 172.21.15.90:0/2113526587 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5fc00c9b0 con 0x7fa60806d670 2023-06-09T04:42:02.706 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.683+0000 7fa5ef7fe700 1 -- 172.21.15.90:0/2113526587 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5fc00cd20 con 0x7fa60806d670 2023-06-09T04:42:02.706 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.683+0000 7fa60d6f5700 1 -- 172.21.15.90:0/2113526587 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa600009a70 con 0x7fa60806d670 2023-06-09T04:42:02.706 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.683+0000 7f76e3fff700 1 -- 172.21.15.90:0/3905186101 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f76e415bed0 msgr2=0x7f76e4201a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:02.706 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.683+0000 7f76e3fff700 1 --2- 172.21.15.90:0/3905186101 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f76e415bed0 0x7f76e4201a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:02.707 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.683+0000 7f76e3fff700 1 -- 172.21.15.90:0/3905186101 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f76e40cdd30 msgr2=0x7f76e4201540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:02.707 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.683+0000 7f76e3fff700 1 --2- 172.21.15.90:0/3905186101 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f76e40cdd30 0x7f76e4201540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:02.707 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.683+0000 7f76e3fff700 1 -- 172.21.15.90:0/3905186101 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76d40094b0 con 0x7f76e406d670 2023-06-09T04:42:02.707 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.683+0000 7fec7ffff700 1 --2- 172.21.15.90:0/1571292999 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fec80089a90 0x7fec80160690 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fec7800cb40 tx=0x7fec7800ce50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:02.708 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.683+0000 7fa60d6f5700 1 -- 172.21.15.90:0/2113526587 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa608159940 con 0x7fa60806d670 2023-06-09T04:42:02.708 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.683+0000 7f76e3fff700 1 --2- 172.21.15.90:0/3905186101 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f76e406d670 0x7f76e415a8d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f76d4000c00 tx=0x7f76d4004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:02.708 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.687+0000 7fec7d7fa700 1 -- 172.21.15.90:0/1571292999 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec78003c20 con 0x7fec80089a90 2023-06-09T04:42:02.709 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.687+0000 7fec7d7fa700 1 -- 172.21.15.90:0/1571292999 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec78003d80 con 0x7fec80089a90 2023-06-09T04:42:02.709 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.687+0000 7fec86a78700 1 -- 172.21.15.90:0/1571292999 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec80087df0 con 0x7fec80089a90 2023-06-09T04:42:02.709 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.687+0000 7fec86a78700 1 -- 172.21.15.90:0/1571292999 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec800883b0 con 0x7fec80089a90 2023-06-09T04:42:02.709 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.687+0000 7fec7d7fa700 1 -- 172.21.15.90:0/1571292999 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec7800a9e0 con 0x7fec80089a90 2023-06-09T04:42:02.709 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.687+0000 7f76e0ff9700 1 -- 172.21.15.90:0/3905186101 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76d4006ea0 con 0x7f76e406d670 2023-06-09T04:42:02.710 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.687+0000 7f76e0ff9700 1 -- 172.21.15.90:0/3905186101 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76d4011630 con 0x7f76e406d670 2023-06-09T04:42:02.710 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.687+0000 7f76e0ff9700 1 -- 172.21.15.90:0/3905186101 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76d40119e0 con 0x7f76e406d670 2023-06-09T04:42:02.710 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.683+0000 7f384d318700 1 -- 172.21.15.90:0/1047675172 wait complete. 2023-06-09T04:42:02.710 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.687+0000 7f384d318700 1 Processor -- start 2023-06-09T04:42:02.710 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.687+0000 7f76ea98d700 1 -- 172.21.15.90:0/3905186101 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76e40b3120 con 0x7f76e406d670 2023-06-09T04:42:02.711 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.687+0000 7f384d318700 1 -- start start 2023-06-09T04:42:02.711 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.687+0000 7f76ea98d700 1 -- 172.21.15.90:0/3905186101 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76e40b36e0 con 0x7f76e406d670 2023-06-09T04:42:02.712 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.687+0000 7fa5ef7fe700 1 -- 172.21.15.90:0/2113526587 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa5fc013470 con 0x7fa60806d670 2023-06-09T04:42:02.712 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.687+0000 7fa5ef7fe700 1 --2- 172.21.15.90:0/2113526587 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fa5f4066370 0x7fa5f4068820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:02.712 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.687+0000 7f76ea98d700 1 -- 172.21.15.90:0/3905186101 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76e40b38d0 con 0x7f76e406d670 2023-06-09T04:42:02.712 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.687+0000 7fa5ef7fe700 1 -- 172.21.15.90:0/2113526587 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa5fc083a30 con 0x7fa60806d670 2023-06-09T04:42:02.713 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.691+0000 7fa6067fc700 1 --2- 172.21.15.90:0/2113526587 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fa5f4066370 0x7fa5f4068820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:02.713 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.691+0000 7fec7d7fa700 1 -- 172.21.15.90:0/1571292999 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fec7800ab40 con 0x7fec80089a90 2023-06-09T04:42:02.713 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.687+0000 7fec66ffd700 1 -- 172.21.15.90:0/1571292999 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec58005310 con 0x7fec80089a90 2023-06-09T04:42:02.714 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.691+0000 7f384d318700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f384806f960 0x7f3848152aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:02.714 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.691+0000 7f384d318700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f384806fdb0 0x7f384814f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:02.714 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.691+0000 7f384d318700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3848155950 0x7f384814fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:02.714 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.691+0000 7f384d318700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3848151a00 con 0x7f384806f960 2023-06-09T04:42:02.714 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.691+0000 7f384d318700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3848151ce0 con 0x7f384806fdb0 2023-06-09T04:42:02.714 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.691+0000 7f384d318700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3848151fc0 con 0x7f3848155950 2023-06-09T04:42:02.715 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.691+0000 7fa6067fc700 1 --2- 172.21.15.90:0/2113526587 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fa5f4066370 0x7fa5f4068820 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa5f8007fd0 tx=0x7fa5f8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:02.715 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.691+0000 7fa60d6f5700 1 -- 172.21.15.90:0/2113526587 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6081594c0 con 0x7fa60806d670 2023-06-09T04:42:02.715 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.691+0000 7f3847fff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f384806f960 0x7f3848152aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:02.715 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.691+0000 7f3847fff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f384806f960 0x7f3848152aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:33676/0 (socket says 172.21.15.90:33676) 2023-06-09T04:42:02.716 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.691+0000 7f3847fff700 1 -- 172.21.15.90:0/2923079423 learned_addr learned my addr 172.21.15.90:0/2923079423 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:02.716 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.691+0000 7fec7d7fa700 1 --2- 172.21.15.90:0/1571292999 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fec6c066370 0x7fec6c068820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:02.716 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.691+0000 7fec7d7fa700 1 -- 172.21.15.90:0/1571292999 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fec78083c10 con 0x7fec80089a90 2023-06-09T04:42:02.716 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.691+0000 7fec84814700 1 --2- 172.21.15.90:0/1571292999 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fec6c066370 0x7fec6c068820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:02.716 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.691+0000 7f3847fff700 1 -- 172.21.15.90:0/2923079423 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3848155950 msgr2=0x7f384814fb30 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-06-09T04:42:02.717 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.691+0000 7f3847fff700 1 --2- 172.21.15.90:0/2923079423 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3848155950 0x7f384814fb30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:02.717 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.691+0000 7f3847fff700 1 -- 172.21.15.90:0/2923079423 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f384806fdb0 msgr2=0x7f384814f380 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-06-09T04:42:02.717 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.691+0000 7f3847fff700 1 --2- 172.21.15.90:0/2923079423 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f384806fdb0 0x7f384814f380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:02.717 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.691+0000 7f3847fff700 1 -- 172.21.15.90:0/2923079423 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3840009a70 con 0x7f384806f960 2023-06-09T04:42:02.717 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.691+0000 7fec84814700 1 --2- 172.21.15.90:0/1571292999 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fec6c066370 0x7fec6c068820 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fec74006ee0 tx=0x7fec74008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:02.718 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.691+0000 7f3847fff700 1 --2- 172.21.15.90:0/2923079423 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f384806f960 0x7f3848152aa0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f383c00c7c0 tx=0x7f383c00cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:02.718 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.691+0000 7f76e0ff9700 1 -- 172.21.15.90:0/3905186101 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f76d4011b40 con 0x7f76e406d670 2023-06-09T04:42:02.718 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.691+0000 7f76e0ff9700 1 --2- 172.21.15.90:0/3905186101 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f76d00663c0 0x7f76d0068870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:02.718 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.691+0000 7f76e0ff9700 1 -- 172.21.15.90:0/3905186101 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f76d4085320 con 0x7f76e406d670 2023-06-09T04:42:02.719 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.695+0000 7f76e37fe700 1 --2- 172.21.15.90:0/3905186101 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f76d00663c0 0x7f76d0068870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:02.719 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.695+0000 7f76e37fe700 1 --2- 172.21.15.90:0/3905186101 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f76d00663c0 0x7f76d0068870 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f76e40a7530 tx=0x7f76d8007de0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:02.719 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.699+0000 7fec7d7fa700 1 -- 172.21.15.90:0/1571292999 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fec78051080 con 0x7fec80089a90 2023-06-09T04:42:02.719 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.699+0000 7fa5ef7fe700 1 -- 172.21.15.90:0/2113526587 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa6081594c0 con 0x7fa60806d670 2023-06-09T04:42:02.720 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.699+0000 7f3844ff9700 1 -- 172.21.15.90:0/2923079423 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f383c011800 con 0x7f384806f960 2023-06-09T04:42:02.720 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.699+0000 7f384d318700 1 -- 172.21.15.90:0/2923079423 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38481522a0 con 0x7f384806f960 2023-06-09T04:42:02.720 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.699+0000 7f384d318700 1 -- 172.21.15.90:0/2923079423 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f384814f8c0 con 0x7f384806f960 2023-06-09T04:42:02.720 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.703+0000 7f3844ff9700 1 -- 172.21.15.90:0/2923079423 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f383c011960 con 0x7f384806f960 2023-06-09T04:42:02.720 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.703+0000 7f3844ff9700 1 -- 172.21.15.90:0/2923079423 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f383c011cd0 con 0x7f384806f960 2023-06-09T04:42:02.721 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.703+0000 7f384d318700 1 -- 172.21.15.90:0/2923079423 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3828005310 con 0x7f384806f960 2023-06-09T04:42:02.721 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.703+0000 7f76e0ff9700 1 -- 172.21.15.90:0/3905186101 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f76d4052930 con 0x7f76e406d670 2023-06-09T04:42:02.721 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.703+0000 7f3844ff9700 1 -- 172.21.15.90:0/2923079423 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f383c021350 con 0x7f384806f960 2023-06-09T04:42:02.722 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.707+0000 7f3844ff9700 1 --2- 172.21.15.90:0/2923079423 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f38340662f0 0x7f38340687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:02.722 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.707+0000 7f3844ff9700 1 -- 172.21.15.90:0/2923079423 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f383c083ca0 con 0x7f384806f960 2023-06-09T04:42:02.722 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.707+0000 7f38477fe700 1 --2- 172.21.15.90:0/2923079423 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f38340662f0 0x7f38340687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:02.722 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.715+0000 7f3844ff9700 1 -- 172.21.15.90:0/2923079423 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f383c054b20 con 0x7f384806f960 2023-06-09T04:42:02.722 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.715+0000 7f38477fe700 1 --2- 172.21.15.90:0/2923079423 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f38340662f0 0x7f38340687a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f384815aa80 tx=0x7f3838006c50 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:02.732 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.727+0000 7f72c6103700 1 Processor -- start 2023-06-09T04:42:02.732 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.727+0000 7f72c6103700 1 -- start start 2023-06-09T04:42:02.734 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.727+0000 7f72c6103700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f72c00d2570 0x7f72c00cfa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:02.735 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.731+0000 7f72c5101700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f72c00d2570 0x7f72c00cfa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:02.735 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.731+0000 7f72c6103700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f72c00b1a90 0x7f72c00cd1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:02.735 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.731+0000 7f72c5101700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f72c00d2570 0x7f72c00cfa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:33684/0 (socket says 172.21.15.90:33684) 2023-06-09T04:42:02.736 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.731+0000 7f72c5101700 1 -- 172.21.15.90:0/3240763271 learned_addr learned my addr 172.21.15.90:0/3240763271 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:02.736 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.731+0000 7f72c6103700 1 -- 172.21.15.90:0/3240763271 --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72c00d03c0 con 0x7f72c00cedd0 2023-06-09T04:42:02.736 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.731+0000 7f72c6103700 1 -- 172.21.15.90:0/3240763271 --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72c015c450 con 0x7f72c00d2570 2023-06-09T04:42:02.736 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.731+0000 7f72c6103700 1 -- 172.21.15.90:0/3240763271 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72c00d0610 con 0x7f72c00b1a90 2023-06-09T04:42:02.737 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.731+0000 7f72c5902700 1 --2- 172.21.15.90:0/3240763271 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f72c00b1a90 0x7f72c00cd1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:02.737 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.731+0000 7f72c5101700 1 -- 172.21.15.90:0/3240763271 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f72c00b1a90 msgr2=0x7f72c00cd1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:02.737 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.731+0000 7f72c5101700 1 --2- 172.21.15.90:0/3240763271 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f72c00b1a90 0x7f72c00cd1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:02.737 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.731+0000 7f72c5101700 1 -- 172.21.15.90:0/3240763271 >> v1:172.21.15.174:6789/0 conn(0x7f72c00cedd0 legacy=0x7f72c00d2940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:02.737 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.731+0000 7f72c5101700 1 -- 172.21.15.90:0/3240763271 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72c00d08f0 con 0x7f72c00d2570 2023-06-09T04:42:02.737 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.731+0000 7f72c5101700 1 --2- 172.21.15.90:0/3240763271 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f72c00d2570 0x7f72c00cfa80 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f72b0009910 tx=0x7f72b0009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=203f8f17d89907ab server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:02.738 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.731+0000 7f72b7fff700 1 -- 172.21.15.90:0/3240763271 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72b000ba60 con 0x7f72c00d2570 2023-06-09T04:42:02.738 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.731+0000 7f72b7fff700 1 -- 172.21.15.90:0/3240763271 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72b000bbc0 con 0x7f72c00d2570 2023-06-09T04:42:02.738 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.731+0000 7f72b7fff700 1 -- 172.21.15.90:0/3240763271 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72b0009e60 con 0x7f72c00d2570 2023-06-09T04:42:02.738 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.731+0000 7f72c6103700 1 -- 172.21.15.90:0/3240763271 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f72c00d2570 msgr2=0x7f72c00cfa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:02.739 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.731+0000 7f72c6103700 1 --2- 172.21.15.90:0/3240763271 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f72c00d2570 0x7f72c00cfa80 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f72b0009910 tx=0x7f72b0009c20 comp rx=0 tx=0).stop 2023-06-09T04:42:02.739 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.731+0000 7f72c6103700 1 -- 172.21.15.90:0/3240763271 shutdown_connections 2023-06-09T04:42:02.739 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.731+0000 7f72c6103700 1 --2- 172.21.15.90:0/3240763271 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f72c00b1a90 0x7f72c00cd1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:02.739 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.731+0000 7f72c6103700 1 --2- 172.21.15.90:0/3240763271 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f72c00d2570 0x7f72c00cfa80 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:02.739 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.731+0000 7f72c6103700 1 -- 172.21.15.90:0/3240763271 >> 172.21.15.90:0/3240763271 conn(0x7f72c00b5530 msgr2=0x7f72c00b5930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:02.739 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.731+0000 7f72c6103700 1 -- 172.21.15.90:0/3240763271 shutdown_connections 2023-06-09T04:42:02.739 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.731+0000 7f72c6103700 1 -- 172.21.15.90:0/3240763271 wait complete. 2023-06-09T04:42:02.740 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.735+0000 7f17fe34c700 1 Processor -- start 2023-06-09T04:42:02.740 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.735+0000 7f72c6103700 1 Processor -- start 2023-06-09T04:42:02.741 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.735+0000 7f72c6103700 1 -- start start 2023-06-09T04:42:02.741 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.735+0000 7f17fe34c700 1 -- start start 2023-06-09T04:42:02.742 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.735+0000 7f72c6103700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f72c00b1a90 0x7f72c00cd440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:02.743 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.739+0000 7f17fe34c700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f17f80b1ca0 0x7f17f8160920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:02.743 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.739+0000 7f17fe34c700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f17f80d2400 0x7f17f80d28a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:02.744 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.739+0000 7f72c6103700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f72c00cedd0 0x7f72c01f3de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:02.744 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.739+0000 7f72c6103700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f72c00d2570 0x7f72c01f4320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:02.744 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.739+0000 7f72c5101700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f72c00b1a90 0x7f72c00cd440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:02.744 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.739+0000 7f72c5101700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f72c00b1a90 0x7f72c00cd440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.90:38590/0 (socket says 172.21.15.90:38590) 2023-06-09T04:42:02.744 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.739+0000 7f17fcb49700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f17f80b1ca0 0x7f17f8160920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:02.745 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.739+0000 7f17fdb4b700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f17f80d2400 0x7f17f80d28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:02.745 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.739+0000 7f17fd34a700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f17f80b18d0 0x7f17f80cee90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.90:35046/0 (socket says 172.21.15.90:35046) 2023-06-09T04:42:02.745 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.739+0000 7f17fdb4b700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f17f80d2400 0x7f17f80d28a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:33692/0 (socket says 172.21.15.90:33692) 2023-06-09T04:42:02.745 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.739+0000 7f17fcb49700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f17f80b1ca0 0x7f17f8160920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.90:37598/0 (socket says 172.21.15.90:37598) 2023-06-09T04:42:02.745 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.739+0000 7f17fe34c700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17f815c6b0 con 0x7f17f80b18d0 2023-06-09T04:42:02.745 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.739+0000 7f17fe34c700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17f80d2de0 con 0x7f17f80d2400 2023-06-09T04:42:02.745 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.739+0000 7f17fe34c700 1 -- 172.21.15.90:0/2902210703 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17f80cf6a0 con 0x7f17f80b1ca0 2023-06-09T04:42:02.745 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.739+0000 7f17fd34a700 1 -- 172.21.15.90:0/2902210703 learned_addr learned my addr 172.21.15.90:0/2902210703 (peer_addr_for_me v1:172.21.15.90:0/0) 2023-06-09T04:42:02.746 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.739+0000 7f72c5902700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f72c00d2570 0x7f72c01f4320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:02.746 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.739+0000 7f72c5902700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f72c00d2570 0x7f72c01f4320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:33706/0 (socket says 172.21.15.90:33706) 2023-06-09T04:42:02.747 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.739+0000 7f72c5101700 1 -- 172.21.15.90:0/2593526638 learned_addr learned my addr 172.21.15.90:0/2593526638 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:02.747 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.739+0000 7f72c6103700 1 -- 172.21.15.90:0/2593526638 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72c01f4860 con 0x7f72c00d2570 2023-06-09T04:42:02.747 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.739+0000 7f72c6103700 1 -- 172.21.15.90:0/2593526638 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72c014f8e0 con 0x7f72c00b1a90 2023-06-09T04:42:02.747 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.739+0000 7f72c6103700 1 -- 172.21.15.90:0/2593526638 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72c014fbc0 con 0x7f72c00cedd0 2023-06-09T04:42:02.747 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.739+0000 7f72c4900700 1 --2- 172.21.15.90:0/2593526638 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f72c00cedd0 0x7f72c01f3de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:02.747 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.739+0000 7f72c5902700 1 -- 172.21.15.90:0/2593526638 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f72c00cedd0 msgr2=0x7f72c01f3de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:02.747 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.739+0000 7f72c5902700 1 --2- 172.21.15.90:0/2593526638 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f72c00cedd0 0x7f72c01f3de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:02.748 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.739+0000 7f72c5902700 1 -- 172.21.15.90:0/2593526638 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f72c00b1a90 msgr2=0x7f72c00cd440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:02.748 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.739+0000 7f72c5902700 1 --2- 172.21.15.90:0/2593526638 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f72c00b1a90 0x7f72c00cd440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:02.748 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.739+0000 7f72c5902700 1 -- 172.21.15.90:0/2593526638 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72b0009570 con 0x7f72c00d2570 2023-06-09T04:42:02.748 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.739+0000 7f72c5902700 1 --2- 172.21.15.90:0/2593526638 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f72c00d2570 0x7f72c01f4320 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f72c00d24f0 tx=0x7f72b800e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:02.748 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.739+0000 7f17fdb4b700 1 -- 172.21.15.90:0/2902210703 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f17f80b1ca0 msgr2=0x7f17f8160920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:02.749 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.739+0000 7f17fdb4b700 1 --2- 172.21.15.90:0/2902210703 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f17f80b1ca0 0x7f17f8160920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:02.749 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.739+0000 7f17fdb4b700 1 -- 172.21.15.90:0/2902210703 >> v1:172.21.15.174:6789/0 conn(0x7f17f80b18d0 legacy=0x7f17f80cee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:02.749 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.739+0000 7f17fdb4b700 1 -- 172.21.15.90:0/2902210703 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17f80cf980 con 0x7f17f80d2400 2023-06-09T04:42:02.749 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.739+0000 7f17fdb4b700 1 --2- 172.21.15.90:0/2902210703 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f17f80d2400 0x7f17f80d28a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f17f0009d90 tx=0x7f17f000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=922dee26c2272dc3 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:02.749 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.743+0000 7f72b5ffb700 1 -- 172.21.15.90:0/2593526638 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72b8018070 con 0x7f72c00d2570 2023-06-09T04:42:02.750 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.743+0000 7f72c6103700 1 -- 172.21.15.90:0/2593526638 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72c014fea0 con 0x7f72c00d2570 2023-06-09T04:42:02.750 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.743+0000 7f72c6103700 1 -- 172.21.15.90:0/2593526638 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72c0150460 con 0x7f72c00d2570 2023-06-09T04:42:02.750 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.743+0000 7f72b5ffb700 1 -- 172.21.15.90:0/2593526638 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72b8007e80 con 0x7f72c00d2570 2023-06-09T04:42:02.750 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.743+0000 7f72b5ffb700 1 -- 172.21.15.90:0/2593526638 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72b800ed50 con 0x7f72c00d2570 2023-06-09T04:42:02.750 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.743+0000 7f72c6103700 1 -- 172.21.15.90:0/2593526638 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72a0005310 con 0x7f72c00d2570 2023-06-09T04:42:02.751 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.743+0000 7f17effff700 1 -- 172.21.15.90:0/2902210703 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17f0014ce0 con 0x7f17f80d2400 2023-06-09T04:42:02.751 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.743+0000 7f17effff700 1 -- 172.21.15.90:0/2902210703 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17f0014e40 con 0x7f17f80d2400 2023-06-09T04:42:02.751 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.743+0000 7f17effff700 1 -- 172.21.15.90:0/2902210703 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17f0003c80 con 0x7f17f80d2400 2023-06-09T04:42:02.751 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.747+0000 7f17fe34c700 1 -- 172.21.15.90:0/2902210703 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f17f80d2400 msgr2=0x7f17f80d28a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:02.751 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.747+0000 7f17fe34c700 1 --2- 172.21.15.90:0/2902210703 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f17f80d2400 0x7f17f80d28a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f17f0009d90 tx=0x7f17f000b330 comp rx=0 tx=0).stop 2023-06-09T04:42:02.754 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.747+0000 7f72b5ffb700 1 -- 172.21.15.90:0/2593526638 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f72b8014420 con 0x7f72c00d2570 2023-06-09T04:42:02.754 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.747+0000 7f72b5ffb700 1 --2- 172.21.15.90:0/2593526638 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f72a40663c0 0x7f72a4068870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:02.754 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.747+0000 7f72b5ffb700 1 -- 172.21.15.90:0/2593526638 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f72b80838f0 con 0x7f72c00d2570 2023-06-09T04:42:02.754 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.747+0000 7f72c5101700 1 --2- 172.21.15.90:0/2593526638 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f72a40663c0 0x7f72a4068870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:02.755 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.751+0000 7f72c5101700 1 --2- 172.21.15.90:0/2593526638 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f72a40663c0 0x7f72a4068870 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f72b0009150 tx=0x7f72b0008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:02.759 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.751+0000 7f91eba91700 1 Processor -- start 2023-06-09T04:42:02.759 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.751+0000 7f91eba91700 1 -- start start 2023-06-09T04:42:02.759 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.751+0000 7f91eba91700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f91dc036d40 0x7f91dc037a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:02.759 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.751+0000 7f91eba91700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91dc053f20 con 0x7f91dc1004f0 2023-06-09T04:42:02.759 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.751+0000 7f91eba91700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91dc006e40 con 0x7f91dc1008c0 2023-06-09T04:42:02.759 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.751+0000 7f91eba91700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91dc052a50 con 0x7f91dc036d40 2023-06-09T04:42:02.760 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.751+0000 7f91e982d700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f91dc1004f0 0x7f91dc053810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:46586/0 (socket says 172.21.15.90:46586) 2023-06-09T04:42:02.760 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.751+0000 7f91e982d700 1 -- 172.21.15.90:0/91208022 learned_addr learned my addr 172.21.15.90:0/91208022 (peer_addr_for_me v1:172.21.15.90:0/0) 2023-06-09T04:42:02.760 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.751+0000 7f91ea02e700 1 --2- 172.21.15.90:0/91208022 >> v2:172.21.15.174:3300/0 conn(0x7f91dc036d40 0x7f91dc037a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:02.760 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.751+0000 7f17fe34c700 1 -- 172.21.15.90:0/2902210703 shutdown_connections 2023-06-09T04:42:02.760 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.751+0000 7f17fe34c700 1 --2- 172.21.15.90:0/2902210703 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f17f80d2400 0x7f17f80d28a0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:02.761 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.751+0000 7f17fe34c700 1 --2- 172.21.15.90:0/2902210703 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f17f80b1ca0 0x7f17f8160920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:02.761 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.751+0000 7f17fe34c700 1 -- 172.21.15.90:0/2902210703 >> 172.21.15.90:0/2902210703 conn(0x7f17f809b9b0 msgr2=0x7f17f80b55d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:02.761 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.755+0000 7f17fe34c700 1 -- 172.21.15.90:0/2902210703 shutdown_connections 2023-06-09T04:42:02.761 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.755+0000 7f17fe34c700 1 -- 172.21.15.90:0/2902210703 wait complete. 2023-06-09T04:42:02.761 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.755+0000 7f91ea02e700 1 -- 172.21.15.90:0/91208022 >> v1:172.21.15.174:6789/0 conn(0x7f91dc1008c0 legacy=0x7f91dc036630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:02.762 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.755+0000 7f91ea02e700 1 -- 172.21.15.90:0/91208022 >> v1:172.21.15.90:6789/0 conn(0x7f91dc1004f0 legacy=0x7f91dc053810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:02.762 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.755+0000 7f91ea02e700 1 -- 172.21.15.90:0/91208022 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91dc052d30 con 0x7f91dc036d40 2023-06-09T04:42:02.762 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.755+0000 7f91ea02e700 1 --2- 172.21.15.90:0/91208022 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f91dc036d40 0x7f91dc037a00 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f91e4000b60 tx=0x7f91e4069790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b50f7640bffe38b4 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:02.762 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.755+0000 7f91e882b700 1 -- 172.21.15.90:0/91208022 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91e404e440 con 0x7f91dc036d40 2023-06-09T04:42:02.762 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.755+0000 7f72b5ffb700 1 -- 172.21.15.90:0/2593526638 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f72b8050de0 con 0x7f72c00d2570 2023-06-09T04:42:02.763 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.755+0000 7f91e882b700 1 -- 172.21.15.90:0/91208022 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91e4065900 con 0x7f91dc036d40 2023-06-09T04:42:02.763 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.755+0000 7f17fe34c700 1 Processor -- start 2023-06-09T04:42:02.763 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.759+0000 7f91eba91700 1 -- 172.21.15.90:0/91208022 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f91dc036d40 msgr2=0x7f91dc037a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:02.764 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.759+0000 7f91eba91700 1 --2- 172.21.15.90:0/91208022 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f91dc036d40 0x7f91dc037a00 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f91e4000b60 tx=0x7f91e4069790 comp rx=0 tx=0).stop 2023-06-09T04:42:02.764 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.755+0000 7f17fe34c700 1 -- start start 2023-06-09T04:42:02.764 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.759+0000 7f91eba91700 1 -- 172.21.15.90:0/91208022 shutdown_connections 2023-06-09T04:42:02.764 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.759+0000 7f91eba91700 1 --2- 172.21.15.90:0/91208022 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f91dc036d40 0x7f91dc037a00 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:02.765 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.759+0000 7f91eba91700 1 -- 172.21.15.90:0/91208022 >> 172.21.15.90:0/91208022 conn(0x7f91dc051630 msgr2=0x7f91dc051a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:02.765 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.759+0000 7f17fe34c700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f17f80b18d0 0x7f17f81567f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:02.765 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.759+0000 7f17fe34c700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f17f80b1ca0 0x7f17f80b3390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:02.766 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.759+0000 7f17fe34c700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f17f80d2400 0x7f17f8155be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:02.766 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.759+0000 7f17fe34c700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17f80ca720 con 0x7f17f80b1ca0 2023-06-09T04:42:02.766 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.759+0000 7f17fe34c700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17f8156120 con 0x7f17f80d2400 2023-06-09T04:42:02.766 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.759+0000 7f17fe34c700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17f80b2f00 con 0x7f17f80b18d0 2023-06-09T04:42:02.766 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.759+0000 7f17fcb49700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f17f80b1ca0 0x7f17f80b3390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:02.766 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.759+0000 7f17fcb49700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f17f80b1ca0 0x7f17f80b3390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:33708/0 (socket says 172.21.15.90:33708) 2023-06-09T04:42:02.766 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.759+0000 7f17fdb4b700 1 --2- 172.21.15.90:0/2257806152 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f17f80d2400 0x7f17f8155be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:02.767 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.759+0000 7f17fcb49700 1 -- 172.21.15.90:0/2257806152 learned_addr learned my addr 172.21.15.90:0/2257806152 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:02.767 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.759+0000 7f91eba91700 1 -- 172.21.15.90:0/91208022 shutdown_connections 2023-06-09T04:42:02.767 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.759+0000 7f17fd34a700 1 --2- 172.21.15.90:0/2257806152 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f17f80b18d0 0x7f17f81567f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:02.767 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.759+0000 7f17fdb4b700 1 -- 172.21.15.90:0/2257806152 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f17f80b18d0 msgr2=0x7f17f81567f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:02.768 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.759+0000 7f17fdb4b700 1 --2- 172.21.15.90:0/2257806152 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f17f80b18d0 0x7f17f81567f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:02.768 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.759+0000 7f17fdb4b700 1 -- 172.21.15.90:0/2257806152 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f17f80b1ca0 msgr2=0x7f17f80b3390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:02.768 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.759+0000 7f17fdb4b700 1 --2- 172.21.15.90:0/2257806152 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f17f80b1ca0 0x7f17f80b3390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:02.768 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.759+0000 7f17fdb4b700 1 -- 172.21.15.90:0/2257806152 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17f0009a70 con 0x7f17f80d2400 2023-06-09T04:42:02.768 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.759+0000 7f17fdb4b700 1 --2- 172.21.15.90:0/2257806152 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f17f80d2400 0x7f17f8155be0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f17f001d000 tx=0x7f17f0004af0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:02.769 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.759+0000 7f91eba91700 1 -- 172.21.15.90:0/91208022 wait complete. 2023-06-09T04:42:02.769 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.759+0000 7f5ed9356700 1 Processor -- start 2023-06-09T04:42:02.769 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.763+0000 7f91eba91700 1 Processor -- start 2023-06-09T04:42:02.769 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.759+0000 7f17edffb700 1 -- 172.21.15.90:0/2257806152 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17f0004230 con 0x7f17f80d2400 2023-06-09T04:42:02.770 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.759+0000 7f17edffb700 1 -- 172.21.15.90:0/2257806152 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17f0004390 con 0x7f17f80d2400 2023-06-09T04:42:02.770 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.759+0000 7f17edffb700 1 -- 172.21.15.90:0/2257806152 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17f0004720 con 0x7f17f80d2400 2023-06-09T04:42:02.770 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.759+0000 7f17fe34c700 1 -- 172.21.15.90:0/2257806152 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17f80cc2c0 con 0x7f17f80d2400 2023-06-09T04:42:02.770 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.763+0000 7f17fe34c700 1 -- 172.21.15.90:0/2257806152 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17f80b2b90 con 0x7f17f80d2400 2023-06-09T04:42:02.770 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.759+0000 7f5ed9356700 1 -- start start 2023-06-09T04:42:02.771 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.763+0000 7f5ed9356700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f5ed40c1540 0x7f5ed40b31c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:02.771 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.763+0000 7f91eba91700 1 -- start start 2023-06-09T04:42:02.771 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.763+0000 7f91eba91700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f91dc036d40 0x7f91dc054360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:02.771 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.763+0000 7f5ed9356700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5ed40c1910 0x7f5ed406a230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:02.772 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.763+0000 7f5ed9356700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ed40b3dc0 con 0x7f5ed40ad580 2023-06-09T04:42:02.772 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.763+0000 7f5ed9356700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ed40cc910 con 0x7f5ed40c1540 2023-06-09T04:42:02.772 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.763+0000 7f5ed9356700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed406ac20 con 0x7f5ed40c1910 2023-06-09T04:42:02.772 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.763+0000 7f91eba91700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f91dc1004f0 0x7f91dc102620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:02.772 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.763+0000 7f5ed2ffd700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f5ed40c1540 0x7f5ed40b31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:02.773 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.763+0000 7f5ed2ffd700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f5ed40c1540 0x7f5ed40b31c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.90:38608/0 (socket says 172.21.15.90:38608) 2023-06-09T04:42:02.773 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.763+0000 7f5ed2ffd700 1 -- 172.21.15.90:0/3732618809 learned_addr learned my addr 172.21.15.90:0/3732618809 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:02.773 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.763+0000 7f91e982d700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f91dc036d40 0x7f91dc054360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:02.773 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.763+0000 7f91e982d700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f91dc036d40 0x7f91dc054360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.90:37614/0 (socket says 172.21.15.90:37614) 2023-06-09T04:42:02.774 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.763+0000 7f91e902c700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f91dc1004f0 0x7f91dc102620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:02.774 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.763+0000 7f91e902c700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f91dc1004f0 0x7f91dc102620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.90:38622/0 (socket says 172.21.15.90:38622) 2023-06-09T04:42:02.774 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.763+0000 7f5ed3fff700 1 --2- 172.21.15.90:0/3732618809 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5ed40c1910 0x7f5ed406a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:02.774 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.767+0000 7f91e982d700 1 -- 172.21.15.90:0/583271962 learned_addr learned my addr 172.21.15.90:0/583271962 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:02.775 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.767+0000 7f91eba91700 1 --2- 172.21.15.90:0/583271962 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f91dc1008c0 0x7f91dc102b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:02.775 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.767+0000 7f5ed2ffd700 1 -- 172.21.15.90:0/3732618809 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5ed40c1910 msgr2=0x7f5ed406a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:02.775 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.767+0000 7f5ed2ffd700 1 --2- 172.21.15.90:0/3732618809 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5ed40c1910 0x7f5ed406a230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:02.775 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.767+0000 7f5ed2ffd700 1 -- 172.21.15.90:0/3732618809 >> v1:172.21.15.90:6789/0 conn(0x7f5ed40ad580 legacy=0x7f5ed40cc200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:02.775 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.767+0000 7f5ed2ffd700 1 -- 172.21.15.90:0/3732618809 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ed40b40a0 con 0x7f5ed40c1540 2023-06-09T04:42:02.776 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.767+0000 7f91eba91700 1 -- 172.21.15.90:0/583271962 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91dc04a0d0 con 0x7f91dc1008c0 2023-06-09T04:42:02.776 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.767+0000 7f91eba91700 1 -- 172.21.15.90:0/583271962 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91dc1030a0 con 0x7f91dc1004f0 2023-06-09T04:42:02.776 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.767+0000 7f91eba91700 1 -- 172.21.15.90:0/583271962 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91dc103310 con 0x7f91dc036d40 2023-06-09T04:42:02.777 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.767+0000 7f5ed2ffd700 1 --2- 172.21.15.90:0/3732618809 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5ed40c1540 0x7f5ed40b31c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f5ec4009910 tx=0x7f5ec4009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=819702d03c199098 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:02.777 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.767+0000 7f5ed1ffb700 1 -- 172.21.15.90:0/3732618809 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ec4004230 con 0x7f5ed40c1540 2023-06-09T04:42:02.777 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.767+0000 7f5ed1ffb700 1 -- 172.21.15.90:0/3732618809 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ec4004390 con 0x7f5ed40c1540 2023-06-09T04:42:02.777 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.767+0000 7f5ed1ffb700 1 -- 172.21.15.90:0/3732618809 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ec4009e60 con 0x7f5ed40c1540 2023-06-09T04:42:02.777 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.767+0000 7f17edffb700 1 -- 172.21.15.90:0/2257806152 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f17f0028470 con 0x7f17f80d2400 2023-06-09T04:42:02.778 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.767+0000 7f91e982d700 1 -- 172.21.15.90:0/583271962 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f91dc1004f0 msgr2=0x7f91dc102620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:02.778 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.767+0000 7f91e982d700 1 --2- 172.21.15.90:0/583271962 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f91dc1004f0 0x7f91dc102620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:02.778 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.767+0000 7f91e982d700 1 -- 172.21.15.90:0/583271962 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f91dc1008c0 msgr2=0x7f91dc102b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:02.778 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.767+0000 7f91e982d700 1 --2- 172.21.15.90:0/583271962 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f91dc1008c0 0x7f91dc102b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:02.778 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.767+0000 7f91e982d700 1 -- 172.21.15.90:0/583271962 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91e4067840 con 0x7f91dc036d40 2023-06-09T04:42:02.778 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.767+0000 7f5ed9356700 1 -- 172.21.15.90:0/3732618809 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5ed40c1540 msgr2=0x7f5ed40b31c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:02.779 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.767+0000 7f5ed9356700 1 --2- 172.21.15.90:0/3732618809 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5ed40c1540 0x7f5ed40b31c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f5ec4009910 tx=0x7f5ec4009c20 comp rx=0 tx=0).stop 2023-06-09T04:42:02.779 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.767+0000 7f91e982d700 1 --2- 172.21.15.90:0/583271962 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f91dc036d40 0x7f91dc054360 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f91e000c730 tx=0x7f91e000ca40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:02.779 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.767+0000 7f5ed9356700 1 -- 172.21.15.90:0/3732618809 shutdown_connections 2023-06-09T04:42:02.780 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.767+0000 7f5ed9356700 1 --2- 172.21.15.90:0/3732618809 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5ed40c1910 0x7f5ed406a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:02.780 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.767+0000 7f5ed9356700 1 --2- 172.21.15.90:0/3732618809 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5ed40c1540 0x7f5ed40b31c0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:02.780 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.767+0000 7f5ed9356700 1 -- 172.21.15.90:0/3732618809 >> 172.21.15.90:0/3732618809 conn(0x7f5ed40ce300 msgr2=0x7f5ed40ce700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:02.780 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.767+0000 7f5ed9356700 1 -- 172.21.15.90:0/3732618809 shutdown_connections 2023-06-09T04:42:02.780 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.767+0000 7f91da7fc700 1 -- 172.21.15.90:0/583271962 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91e0005d90 con 0x7f91dc036d40 2023-06-09T04:42:02.781 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.767+0000 7f17fe34c700 1 -- 172.21.15.90:0/2257806152 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17d8005310 con 0x7f17f80d2400 2023-06-09T04:42:02.781 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.767+0000 7f17edffb700 1 --2- 172.21.15.90:0/2257806152 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f17dc0663f0 0x7f17dc0688a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:02.781 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.767+0000 7f17edffb700 1 -- 172.21.15.90:0/2257806152 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f17f008e590 con 0x7f17f80d2400 2023-06-09T04:42:02.782 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.767+0000 7f5ed9356700 1 -- 172.21.15.90:0/3732618809 wait complete. 2023-06-09T04:42:02.782 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.771+0000 7f91eba91700 1 -- 172.21.15.90:0/583271962 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91dc049730 con 0x7f91dc036d40 2023-06-09T04:42:02.782 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.771+0000 7f91eba91700 1 -- 172.21.15.90:0/583271962 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91dc049cf0 con 0x7f91dc036d40 2023-06-09T04:42:02.782 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.771+0000 7f91da7fc700 1 -- 172.21.15.90:0/583271962 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91e00070d0 con 0x7f91dc036d40 2023-06-09T04:42:02.782 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.771+0000 7f91da7fc700 1 -- 172.21.15.90:0/583271962 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91e0007440 con 0x7f91dc036d40 2023-06-09T04:42:02.783 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.771+0000 7f17fd34a700 1 --2- 172.21.15.90:0/2257806152 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f17dc0663f0 0x7f17dc0688a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:02.783 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.771+0000 7f91eba91700 1 -- 172.21.15.90:0/583271962 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91cc005310 con 0x7f91dc036d40 2023-06-09T04:42:02.783 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.771+0000 7f17fd34a700 1 --2- 172.21.15.90:0/2257806152 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f17dc0663f0 0x7f17dc0688a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f17f80b4060 tx=0x7f17e8009380 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:02.784 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.771+0000 7f5ed9356700 1 Processor -- start 2023-06-09T04:42:02.784 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.775+0000 7f5ed9356700 1 -- start start 2023-06-09T04:42:02.784 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.775+0000 7f5ed9356700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5ed40ad580 0x7f5ed40ac420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:02.784 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.775+0000 7f5ed9356700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5ed40c1540 0x7f5ed409bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:02.784 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.775+0000 7f5ed9356700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5ed40c1910 0x7f5ed40cca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:02.784 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.775+0000 7f5ed9356700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed415d8a0 con 0x7f5ed40c1540 2023-06-09T04:42:02.784 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.775+0000 7f5ed9356700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed40ac960 con 0x7f5ed40ad580 2023-06-09T04:42:02.785 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.775+0000 7f5ed9356700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed409c110 con 0x7f5ed40c1910 2023-06-09T04:42:02.785 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.775+0000 7f5ed2ffd700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5ed40ad580 0x7f5ed40ac420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:02.785 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.775+0000 7f5ed2ffd700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5ed40ad580 0x7f5ed40ac420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.90:38630/0 (socket says 172.21.15.90:38630) 2023-06-09T04:42:02.785 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.775+0000 7f5ed2ffd700 1 -- 172.21.15.90:0/2260360484 learned_addr learned my addr 172.21.15.90:0/2260360484 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:02.785 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.775+0000 7f91da7fc700 1 -- 172.21.15.90:0/583271962 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f91e00075a0 con 0x7f91dc036d40 2023-06-09T04:42:02.785 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.775+0000 7f91da7fc700 1 --2- 172.21.15.90:0/583271962 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f91c80663c0 0x7f91c8068870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:02.786 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.775+0000 7f91da7fc700 1 -- 172.21.15.90:0/583271962 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f91e0082fc0 con 0x7f91dc036d40 2023-06-09T04:42:02.786 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.775+0000 7f5ed27fc700 1 --2- 172.21.15.90:0/2260360484 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5ed40c1540 0x7f5ed409bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:02.786 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.775+0000 7f5ed3fff700 1 --2- 172.21.15.90:0/2260360484 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5ed40c1910 0x7f5ed40cca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:02.786 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.775+0000 7f5ed2ffd700 1 -- 172.21.15.90:0/2260360484 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5ed40c1910 msgr2=0x7f5ed40cca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:02.786 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.775+0000 7f5ed2ffd700 1 --2- 172.21.15.90:0/2260360484 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5ed40c1910 0x7f5ed40cca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:02.787 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.775+0000 7f5ed2ffd700 1 -- 172.21.15.90:0/2260360484 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5ed40c1540 msgr2=0x7f5ed409bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:02.787 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.775+0000 7f91e902c700 1 --2- 172.21.15.90:0/583271962 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f91c80663c0 0x7f91c8068870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:02.787 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.775+0000 7f5ed2ffd700 1 --2- 172.21.15.90:0/2260360484 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5ed40c1540 0x7f5ed409bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:02.788 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.775+0000 7f5ed2ffd700 1 -- 172.21.15.90:0/2260360484 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ec4009570 con 0x7f5ed40ad580 2023-06-09T04:42:02.788 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.775+0000 7f5ed27fc700 1 --2- 172.21.15.90:0/2260360484 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5ed40c1540 0x7f5ed409bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:42:02.788 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.779+0000 7f5ed2ffd700 1 --2- 172.21.15.90:0/2260360484 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5ed40ad580 0x7f5ed40ac420 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f5ec4004000 tx=0x7f5ec4004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:02.788 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.779+0000 7f5ec37fe700 1 -- 172.21.15.90:0/2260360484 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ec400bdb0 con 0x7f5ed40ad580 2023-06-09T04:42:02.788 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.779+0000 7f5ec37fe700 1 -- 172.21.15.90:0/2260360484 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ec401f070 con 0x7f5ed40ad580 2023-06-09T04:42:02.788 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.779+0000 7f5ec37fe700 1 -- 172.21.15.90:0/2260360484 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ec4003900 con 0x7f5ed40ad580 2023-06-09T04:42:02.788 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.779+0000 7f5ed9356700 1 -- 172.21.15.90:0/2260360484 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ed415ccb0 con 0x7f5ed40ad580 2023-06-09T04:42:02.789 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.779+0000 7f5ed9356700 1 -- 172.21.15.90:0/2260360484 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ed415d250 con 0x7f5ed40ad580 2023-06-09T04:42:02.789 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.779+0000 7f91e902c700 1 --2- 172.21.15.90:0/583271962 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f91c80663c0 0x7f91c8068870 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f91dc050050 tx=0x7f91d4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:02.789 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.779+0000 7f17edffb700 1 -- 172.21.15.90:0/2257806152 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f17f005bba0 con 0x7f17f80d2400 2023-06-09T04:42:02.790 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.779+0000 7f5ed9356700 1 -- 172.21.15.90:0/2260360484 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ed404e380 con 0x7f5ed40ad580 2023-06-09T04:42:02.790 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.783+0000 7f5ec37fe700 1 -- 172.21.15.90:0/2260360484 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5ec4021030 con 0x7f5ed40ad580 2023-06-09T04:42:02.790 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.783+0000 7f5ec37fe700 1 --2- 172.21.15.90:0/2260360484 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f5eb80662f0 0x7f5eb80687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:02.790 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.783+0000 7f5ec37fe700 1 -- 172.21.15.90:0/2260360484 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5ec4085350 con 0x7f5ed40ad580 2023-06-09T04:42:02.790 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.783+0000 7f91da7fc700 1 -- 172.21.15.90:0/583271962 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f91e0050560 con 0x7f91dc036d40 2023-06-09T04:42:02.791 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.783+0000 7f5ed27fc700 1 --2- 172.21.15.90:0/2260360484 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f5eb80662f0 0x7f5eb80687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:02.791 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.787+0000 7f5ed27fc700 1 --2- 172.21.15.90:0/2260360484 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f5eb80662f0 0x7f5eb80687a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f5ed40c4950 tx=0x7f5ec8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:02.795 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:02.791+0000 7f5ec37fe700 1 -- 172.21.15.90:0/2260360484 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5ec40527c0 con 0x7f5ed40ad580 2023-06-09T04:42:03.012 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:03.007+0000 7fec66ffd700 1 -- 172.21.15.90:0/1571292999 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fec580055c0 con 0x7fec80089a90 2023-06-09T04:42:03.015 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:03.007+0000 7fec7d7fa700 1 -- 172.21.15.90:0/1571292999 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fec780546a0 con 0x7fec80089a90 2023-06-09T04:42:03.015 INFO:teuthology.orchestra.run.smithi090.stdout:55834574852 2023-06-09T04:42:03.018 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:03.011+0000 7fec86a78700 1 -- 172.21.15.90:0/1571292999 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fec6c066370 msgr2=0x7fec6c068820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:03.018 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:03.011+0000 7fec86a78700 1 --2- 172.21.15.90:0/1571292999 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fec6c066370 0x7fec6c068820 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fec74006ee0 tx=0x7fec74008030 comp rx=0 tx=0).stop 2023-06-09T04:42:03.018 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:03.011+0000 7fec86a78700 1 -- 172.21.15.90:0/1571292999 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fec80089a90 msgr2=0x7fec80160690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:03.018 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:03.011+0000 7fec86a78700 1 --2- 172.21.15.90:0/1571292999 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fec80089a90 0x7fec80160690 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fec7800cb40 tx=0x7fec7800ce50 comp rx=0 tx=0).stop 2023-06-09T04:42:03.019 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:03.011+0000 7fec86a78700 1 -- 172.21.15.90:0/1571292999 shutdown_connections 2023-06-09T04:42:03.019 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:03.011+0000 7fec86a78700 1 --2- 172.21.15.90:0/1571292999 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fec6c066370 0x7fec6c068820 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:03.019 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:03.011+0000 7fec86a78700 1 --2- 172.21.15.90:0/1571292999 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fec800cc0f0 0x7fec8015baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:03.019 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:03.011+0000 7fec86a78700 1 --2- 172.21.15.90:0/1571292999 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fec80089a90 0x7fec80160690 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:03.019 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:03.011+0000 7fec86a78700 1 --2- 172.21.15.90:0/1571292999 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fec8006d670 0x7fec800af080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:03.019 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:03.011+0000 7fec86a78700 1 -- 172.21.15.90:0/1571292999 >> 172.21.15.90:0/1571292999 conn(0x7fec800ce1f0 msgr2=0x7fec800ca480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:03.020 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:03.011+0000 7fec86a78700 1 -- 172.21.15.90:0/1571292999 shutdown_connections 2023-06-09T04:42:03.020 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:03.011+0000 7fec86a78700 1 -- 172.21.15.90:0/1571292999 wait complete. 2023-06-09T04:42:03.021 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:03.015+0000 7fa60d6f5700 1 -- 172.21.15.90:0/2113526587 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa6081594c0 con 0x7fa60806d670 2023-06-09T04:42:03.022 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:03.015+0000 7fa5ef7fe700 1 -- 172.21.15.90:0/2113526587 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa6081594c0 con 0x7fa60806d670 2023-06-09T04:42:03.022 INFO:teuthology.orchestra.run.smithi090.stdout:55834574855 2023-06-09T04:42:03.026 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:03.019+0000 7fa5edffb700 1 -- 172.21.15.90:0/2113526587 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fa5f4066370 msgr2=0x7fa5f4068820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:03.026 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:03.019+0000 7fa5edffb700 1 --2- 172.21.15.90:0/2113526587 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fa5f4066370 0x7fa5f4068820 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa5f8007fd0 tx=0x7fa5f8009040 comp rx=0 tx=0).stop 2023-06-09T04:42:03.026 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:03.019+0000 7fa5edffb700 1 -- 172.21.15.90:0/2113526587 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa60806d670 msgr2=0x7fa608153fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:03.027 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:03.019+0000 7fa5edffb700 1 --2- 172.21.15.90:0/2113526587 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa60806d670 0x7fa608153fc0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa5fc00e9d0 tx=0x7fa5fc00ed90 comp rx=0 tx=0).stop 2023-06-09T04:42:03.027 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:03.019+0000 7fa5edffb700 1 -- 172.21.15.90:0/2113526587 shutdown_connections 2023-06-09T04:42:03.027 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:03.019+0000 7fa5edffb700 1 --2- 172.21.15.90:0/2113526587 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fa5f4066370 0x7fa5f4068820 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:03.027 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:03.019+0000 7fa5edffb700 1 --2- 172.21.15.90:0/2113526587 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa60815bed0 0x7fa608153590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:03.027 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:03.019+0000 7fa5edffb700 1 --2- 172.21.15.90:0/2113526587 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa6080cdd30 0x7fa60814fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:03.027 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:03.019+0000 7fa5edffb700 1 --2- 172.21.15.90:0/2113526587 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa60806d670 0x7fa608153fc0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:03.027 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:03.019+0000 7fa5edffb700 1 -- 172.21.15.90:0/2113526587 >> 172.21.15.90:0/2113526587 conn(0x7fa6080ce1f0 msgr2=0x7fa6080712f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:03.028 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:03.023+0000 7fa5edffb700 1 -- 172.21.15.90:0/2113526587 shutdown_connections 2023-06-09T04:42:03.028 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:03.023+0000 7fa5edffb700 1 -- 172.21.15.90:0/2113526587 wait complete. 2023-06-09T04:42:03.030 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:03.023+0000 7f76ea98d700 1 -- 172.21.15.90:0/3905186101 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f76e404e380 con 0x7f76e406d670 2023-06-09T04:42:03.030 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:03.023+0000 7f76e0ff9700 1 -- 172.21.15.90:0/3905186101 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f76d4055f50 con 0x7f76e406d670 2023-06-09T04:42:03.033 INFO:teuthology.orchestra.run.smithi090.stdout:55834574856 2023-06-09T04:42:03.034 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:03.027+0000 7f384d318700 1 -- 172.21.15.90:0/2923079423 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f38280055c0 con 0x7f384806f960 2023-06-09T04:42:03.034 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:03.027+0000 7f3844ff9700 1 -- 172.21.15.90:0/2923079423 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f383c0546b0 con 0x7f384806f960 2023-06-09T04:42:03.034 INFO:teuthology.orchestra.run.smithi090.stdout:55834574855 2023-06-09T04:42:03.037 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:03.031+0000 7f76ea98d700 1 -- 172.21.15.90:0/3905186101 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f76d00663c0 msgr2=0x7f76d0068870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:03.037 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:03.031+0000 7f76ea98d700 1 --2- 172.21.15.90:0/3905186101 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f76d00663c0 0x7f76d0068870 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f76e40a7530 tx=0x7f76d8007de0 comp rx=0 tx=0).stop 2023-06-09T04:42:03.037 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:03.031+0000 7f384d318700 1 -- 172.21.15.90:0/2923079423 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f38340662f0 msgr2=0x7f38340687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:03.038 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:03.031+0000 7f76ea98d700 1 -- 172.21.15.90:0/3905186101 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f76e406d670 msgr2=0x7f76e415a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:03.038 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:03.031+0000 7f76ea98d700 1 --2- 172.21.15.90:0/3905186101 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f76e406d670 0x7f76e415a8d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f76d4000c00 tx=0x7f76d4004770 comp rx=0 tx=0).stop 2023-06-09T04:42:03.038 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:03.031+0000 7f384d318700 1 --2- 172.21.15.90:0/2923079423 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f38340662f0 0x7f38340687a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f384815aa80 tx=0x7f3838006c50 comp rx=0 tx=0).stop 2023-06-09T04:42:03.039 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:03.031+0000 7f76ea98d700 1 -- 172.21.15.90:0/3905186101 shutdown_connections 2023-06-09T04:42:03.039 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:03.031+0000 7f76ea98d700 1 --2- 172.21.15.90:0/3905186101 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f76d00663c0 0x7f76d0068870 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:03.039 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:03.031+0000 7f76ea98d700 1 --2- 172.21.15.90:0/3905186101 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f76e415bed0 0x7f76e4201a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:03.039 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:03.031+0000 7f76ea98d700 1 --2- 172.21.15.90:0/3905186101 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f76e40cdd30 0x7f76e4201540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:03.040 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:03.031+0000 7f76ea98d700 1 --2- 172.21.15.90:0/3905186101 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f76e406d670 0x7f76e415a8d0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:03.040 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:03.031+0000 7f76ea98d700 1 -- 172.21.15.90:0/3905186101 >> 172.21.15.90:0/3905186101 conn(0x7f76e40ce1f0 msgr2=0x7f76e4152040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:03.040 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:03.031+0000 7f384d318700 1 -- 172.21.15.90:0/2923079423 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f384806f960 msgr2=0x7f3848152aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:03.040 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:03.031+0000 7f384d318700 1 --2- 172.21.15.90:0/2923079423 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f384806f960 0x7f3848152aa0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f383c00c7c0 tx=0x7f383c00cb80 comp rx=0 tx=0).stop 2023-06-09T04:42:03.041 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:03.031+0000 7f76ea98d700 1 -- 172.21.15.90:0/3905186101 shutdown_connections 2023-06-09T04:42:03.041 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:03.031+0000 7f76ea98d700 1 -- 172.21.15.90:0/3905186101 wait complete. 2023-06-09T04:42:03.042 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:03.031+0000 7f384d318700 1 -- 172.21.15.90:0/2923079423 shutdown_connections 2023-06-09T04:42:03.042 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:03.031+0000 7f384d318700 1 --2- 172.21.15.90:0/2923079423 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f38340662f0 0x7f38340687a0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:03.042 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:03.031+0000 7f384d318700 1 --2- 172.21.15.90:0/2923079423 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3848155950 0x7f384814fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:03.042 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:03.031+0000 7f384d318700 1 --2- 172.21.15.90:0/2923079423 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f384806fdb0 0x7f384814f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:03.042 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:03.031+0000 7f384d318700 1 --2- 172.21.15.90:0/2923079423 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f384806f960 0x7f3848152aa0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:03.042 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:03.031+0000 7f384d318700 1 -- 172.21.15.90:0/2923079423 >> 172.21.15.90:0/2923079423 conn(0x7f38480ce1f0 msgr2=0x7f384813b610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:03.043 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:03.035+0000 7f384d318700 1 -- 172.21.15.90:0/2923079423 shutdown_connections 2023-06-09T04:42:03.043 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:03.035+0000 7f384d318700 1 -- 172.21.15.90:0/2923079423 wait complete. 2023-06-09T04:42:03.046 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.3 2023-06-09T04:42:03.049 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574855 for osd.1 2023-06-09T04:42:03.050 DEBUG:teuthology.parallel:result is None 2023-06-09T04:42:03.066 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574856 for osd.0 2023-06-09T04:42:03.067 DEBUG:teuthology.parallel:result is None 2023-06-09T04:42:03.067 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574855 for osd.5 2023-06-09T04:42:03.067 DEBUG:teuthology.parallel:result is None 2023-06-09T04:42:03.078 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:03.071+0000 7f72c6103700 1 -- 172.21.15.90:0/2593526638 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f72a00055c0 con 0x7f72c00d2570 2023-06-09T04:42:03.079 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:03.075+0000 7f72b5ffb700 1 -- 172.21.15.90:0/2593526638 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f72b8054400 con 0x7f72c00d2570 2023-06-09T04:42:03.079 INFO:teuthology.orchestra.run.smithi090.stdout:55834574855 2023-06-09T04:42:03.083 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:03.079+0000 7f72c6103700 1 -- 172.21.15.90:0/2593526638 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f72a40663c0 msgr2=0x7f72a4068870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:03.083 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:03.079+0000 7f72c6103700 1 --2- 172.21.15.90:0/2593526638 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f72a40663c0 0x7f72a4068870 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f72b0009150 tx=0x7f72b0008030 comp rx=0 tx=0).stop 2023-06-09T04:42:03.083 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:03.079+0000 7f72c6103700 1 -- 172.21.15.90:0/2593526638 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f72c00d2570 msgr2=0x7f72c01f4320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:03.083 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:03.079+0000 7f72c6103700 1 --2- 172.21.15.90:0/2593526638 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f72c00d2570 0x7f72c01f4320 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f72c00d24f0 tx=0x7f72b800e3c0 comp rx=0 tx=0).stop 2023-06-09T04:42:03.084 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:03.079+0000 7f72c6103700 1 -- 172.21.15.90:0/2593526638 shutdown_connections 2023-06-09T04:42:03.084 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:03.079+0000 7f72c6103700 1 --2- 172.21.15.90:0/2593526638 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f72a40663c0 0x7f72a4068870 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:03.084 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:03.079+0000 7f72c6103700 1 --2- 172.21.15.90:0/2593526638 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f72c00d2570 0x7f72c01f4320 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:03.084 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:03.079+0000 7f72c6103700 1 --2- 172.21.15.90:0/2593526638 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f72c00cedd0 0x7f72c01f3de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:03.084 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:03.079+0000 7f72c6103700 1 --2- 172.21.15.90:0/2593526638 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f72c00b1a90 0x7f72c00cd440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:03.084 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:03.079+0000 7f72c6103700 1 -- 172.21.15.90:0/2593526638 >> 172.21.15.90:0/2593526638 conn(0x7f72c00b5530 msgr2=0x7f72c00d2940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:03.085 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:03.079+0000 7f72c6103700 1 -- 172.21.15.90:0/2593526638 shutdown_connections 2023-06-09T04:42:03.085 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:03.079+0000 7f72c6103700 1 -- 172.21.15.90:0/2593526638 wait complete. 2023-06-09T04:42:03.105 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:03.099+0000 7f91eba91700 1 -- 172.21.15.90:0/583271962 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f91cc0055c0 con 0x7f91dc036d40 2023-06-09T04:42:03.106 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574855 for osd.7 2023-06-09T04:42:03.107 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:03.099+0000 7f91da7fc700 1 -- 172.21.15.90:0/583271962 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f91e0053b80 con 0x7f91dc036d40 2023-06-09T04:42:03.107 INFO:teuthology.orchestra.run.smithi090.stdout:55834574856 2023-06-09T04:42:03.107 DEBUG:teuthology.parallel:result is None 2023-06-09T04:42:03.108 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:03.103+0000 7f17fe34c700 1 -- 172.21.15.90:0/2257806152 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f17d80055c0 con 0x7f17f80d2400 2023-06-09T04:42:03.108 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:03.103+0000 7f17edffb700 1 -- 172.21.15.90:0/2257806152 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f17f002c090 con 0x7f17f80d2400 2023-06-09T04:42:03.108 INFO:teuthology.orchestra.run.smithi090.stdout:55834574856 2023-06-09T04:42:03.109 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:03.103+0000 7f91eba91700 1 -- 172.21.15.90:0/583271962 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f91c80663c0 msgr2=0x7f91c8068870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:03.110 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:03.103+0000 7f91eba91700 1 --2- 172.21.15.90:0/583271962 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f91c80663c0 0x7f91c8068870 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f91dc050050 tx=0x7f91d4009040 comp rx=0 tx=0).stop 2023-06-09T04:42:03.110 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:03.103+0000 7f91eba91700 1 -- 172.21.15.90:0/583271962 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f91dc036d40 msgr2=0x7f91dc054360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:03.110 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:03.103+0000 7f91eba91700 1 --2- 172.21.15.90:0/583271962 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f91dc036d40 0x7f91dc054360 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f91e000c730 tx=0x7f91e000ca40 comp rx=0 tx=0).stop 2023-06-09T04:42:03.110 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:03.103+0000 7f91eba91700 1 -- 172.21.15.90:0/583271962 shutdown_connections 2023-06-09T04:42:03.110 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:03.103+0000 7f91eba91700 1 --2- 172.21.15.90:0/583271962 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f91c80663c0 0x7f91c8068870 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:03.110 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:03.103+0000 7f91eba91700 1 --2- 172.21.15.90:0/583271962 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f91dc1008c0 0x7f91dc102b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:03.110 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:03.103+0000 7f91eba91700 1 --2- 172.21.15.90:0/583271962 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f91dc1004f0 0x7f91dc102620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:03.111 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:03.103+0000 7f91eba91700 1 --2- 172.21.15.90:0/583271962 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f91dc036d40 0x7f91dc054360 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:03.111 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:03.103+0000 7f91eba91700 1 -- 172.21.15.90:0/583271962 >> 172.21.15.90:0/583271962 conn(0x7f91dc051630 msgr2=0x7f91dc038b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:03.111 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:03.103+0000 7f91eba91700 1 -- 172.21.15.90:0/583271962 shutdown_connections 2023-06-09T04:42:03.111 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:03.103+0000 7f91eba91700 1 -- 172.21.15.90:0/583271962 wait complete. 2023-06-09T04:42:03.113 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:03.107+0000 7f17fe34c700 1 -- 172.21.15.90:0/2257806152 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f17dc0663f0 msgr2=0x7f17dc0688a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:03.113 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:03.107+0000 7f17fe34c700 1 --2- 172.21.15.90:0/2257806152 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f17dc0663f0 0x7f17dc0688a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f17f80b4060 tx=0x7f17e8009380 comp rx=0 tx=0).stop 2023-06-09T04:42:03.113 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:03.107+0000 7f17fe34c700 1 -- 172.21.15.90:0/2257806152 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f17f80d2400 msgr2=0x7f17f8155be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:03.113 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:03.107+0000 7f17fe34c700 1 --2- 172.21.15.90:0/2257806152 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f17f80d2400 0x7f17f8155be0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f17f001d000 tx=0x7f17f0004af0 comp rx=0 tx=0).stop 2023-06-09T04:42:03.114 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:03.107+0000 7f17fe34c700 1 -- 172.21.15.90:0/2257806152 shutdown_connections 2023-06-09T04:42:03.114 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:03.107+0000 7f17fe34c700 1 --2- 172.21.15.90:0/2257806152 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f17dc0663f0 0x7f17dc0688a0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:03.114 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:03.107+0000 7f17fe34c700 1 --2- 172.21.15.90:0/2257806152 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f17f80d2400 0x7f17f8155be0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:03.114 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:03.107+0000 7f17fe34c700 1 --2- 172.21.15.90:0/2257806152 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f17f80b1ca0 0x7f17f80b3390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:03.114 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:03.107+0000 7f17fe34c700 1 --2- 172.21.15.90:0/2257806152 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f17f80b18d0 0x7f17f81567f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:03.114 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:03.107+0000 7f17fe34c700 1 -- 172.21.15.90:0/2257806152 >> 172.21.15.90:0/2257806152 conn(0x7f17f809b9b0 msgr2=0x7f17f80b7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:03.114 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:03.107+0000 7f17fe34c700 1 -- 172.21.15.90:0/2257806152 shutdown_connections 2023-06-09T04:42:03.114 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:03.107+0000 7f17fe34c700 1 -- 172.21.15.90:0/2257806152 wait complete. 2023-06-09T04:42:03.115 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:03.107+0000 7f5ed9356700 1 -- 172.21.15.90:0/2260360484 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f5ed404e380 con 0x7f5ed40ad580 2023-06-09T04:42:03.115 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:03.107+0000 7f5ec37fe700 1 -- 172.21.15.90:0/2260360484 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5ec4055de0 con 0x7f5ed40ad580 2023-06-09T04:42:03.115 INFO:teuthology.orchestra.run.smithi090.stdout:55834574856 2023-06-09T04:42:03.117 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:03.111+0000 7f5ed9356700 1 -- 172.21.15.90:0/2260360484 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f5eb80662f0 msgr2=0x7f5eb80687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:03.117 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:03.111+0000 7f5ed9356700 1 --2- 172.21.15.90:0/2260360484 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f5eb80662f0 0x7f5eb80687a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f5ed40c4950 tx=0x7f5ec8008040 comp rx=0 tx=0).stop 2023-06-09T04:42:03.117 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:03.111+0000 7f5ed9356700 1 -- 172.21.15.90:0/2260360484 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5ed40ad580 msgr2=0x7f5ed40ac420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:03.117 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:03.111+0000 7f5ed9356700 1 --2- 172.21.15.90:0/2260360484 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5ed40ad580 0x7f5ed40ac420 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f5ec4004000 tx=0x7f5ec4004770 comp rx=0 tx=0).stop 2023-06-09T04:42:03.118 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:03.111+0000 7f5ed9356700 1 -- 172.21.15.90:0/2260360484 shutdown_connections 2023-06-09T04:42:03.118 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:03.111+0000 7f5ed9356700 1 --2- 172.21.15.90:0/2260360484 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f5eb80662f0 0x7f5eb80687a0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:03.118 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:03.111+0000 7f5ed9356700 1 --2- 172.21.15.90:0/2260360484 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5ed40c1910 0x7f5ed40cca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:03.118 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:03.111+0000 7f5ed9356700 1 --2- 172.21.15.90:0/2260360484 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5ed40c1540 0x7f5ed409bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:03.118 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:03.111+0000 7f5ed9356700 1 --2- 172.21.15.90:0/2260360484 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5ed40ad580 0x7f5ed40ac420 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:03.118 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:03.111+0000 7f5ed9356700 1 -- 172.21.15.90:0/2260360484 >> 172.21.15.90:0/2260360484 conn(0x7f5ed40ce300 msgr2=0x7f5ed40ab600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:03.118 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:03.111+0000 7f5ed9356700 1 -- 172.21.15.90:0/2260360484 shutdown_connections 2023-06-09T04:42:03.118 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:03.111+0000 7f5ed9356700 1 -- 172.21.15.90:0/2260360484 wait complete. 2023-06-09T04:42:03.128 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574856 for osd.6 2023-06-09T04:42:03.129 DEBUG:teuthology.parallel:result is None 2023-06-09T04:42:03.131 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574856 for osd.4 2023-06-09T04:42:03.132 DEBUG:teuthology.parallel:result is None 2023-06-09T04:42:03.135 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574856 for osd.2 2023-06-09T04:42:03.135 DEBUG:teuthology.parallel:result is None 2023-06-09T04:42:04.047 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-06-09T04:42:04.224 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:04.219+0000 7fc53a4a6700 1 Processor -- start 2023-06-09T04:42:04.225 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:04.219+0000 7fc53a4a6700 1 -- start start 2023-06-09T04:42:04.226 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:04.219+0000 7fc53a4a6700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc53415c670 0x7fc53415cad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:04.227 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:04.219+0000 7fc53a4a6700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fc53415d010 0x7fc5340d06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:04.227 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:04.223+0000 7fc53a4a6700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5340ce270 con 0x7fc53415c2a0 2023-06-09T04:42:04.227 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:04.223+0000 7fc53a4a6700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc53406a9f0 con 0x7fc53415d010 2023-06-09T04:42:04.227 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:04.223+0000 7fc53a4a6700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5340ce060 con 0x7fc53415c670 2023-06-09T04:42:04.228 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:04.223+0000 7fc539ca5700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fc53415d010 0x7fc5340d06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:04.228 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:04.223+0000 7fc538ca3700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc53415c670 0x7fc53415cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:04.228 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:04.223+0000 7fc539ca5700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fc53415d010 0x7fc5340d06d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:33746/0 (socket says 172.21.15.90:33746) 2023-06-09T04:42:04.228 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:04.223+0000 7fc539ca5700 1 -- 172.21.15.90:0/772800649 learned_addr learned my addr 172.21.15.90:0/772800649 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:04.229 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:04.223+0000 7fc538ca3700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc53415c670 0x7fc53415cad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.90:38644/0 (socket says 172.21.15.90:38644) 2023-06-09T04:42:04.229 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:04.223+0000 7fc539ca5700 1 -- 172.21.15.90:0/772800649 >> v2:172.21.15.174:3300/0 conn(0x7fc53415c670 msgr2=0x7fc53415cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:04.229 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:04.223+0000 7fc539ca5700 1 --2- 172.21.15.90:0/772800649 >> v2:172.21.15.174:3300/0 conn(0x7fc53415c670 0x7fc53415cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:04.229 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:04.223+0000 7fc539ca5700 1 -- 172.21.15.90:0/772800649 >> v1:172.21.15.174:6789/0 conn(0x7fc53415c2a0 legacy=0x7fc53406a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:04.229 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:04.223+0000 7fc539ca5700 1 -- 172.21.15.90:0/772800649 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5340ce550 con 0x7fc53415d010 2023-06-09T04:42:04.230 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:04.223+0000 7fc539ca5700 1 --2- 172.21.15.90:0/772800649 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc53415d010 0x7fc5340d06d0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fc5340cd370 tx=0x7fc52c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18f25b0e3aa718ef server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:04.230 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:04.223+0000 7fc52bfff700 1 -- 172.21.15.90:0/772800649 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc52c00e070 con 0x7fc53415d010 2023-06-09T04:42:04.230 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:04.223+0000 7fc52bfff700 1 -- 172.21.15.90:0/772800649 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc52c00b910 con 0x7fc53415d010 2023-06-09T04:42:04.230 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:04.223+0000 7fc52bfff700 1 -- 172.21.15.90:0/772800649 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc52c00bcc0 con 0x7fc53415d010 2023-06-09T04:42:04.231 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:04.223+0000 7fc53a4a6700 1 -- 172.21.15.90:0/772800649 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc53415d010 msgr2=0x7fc5340d06d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:04.231 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:04.223+0000 7fc53a4a6700 1 --2- 172.21.15.90:0/772800649 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc53415d010 0x7fc5340d06d0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fc5340cd370 tx=0x7fc52c00b330 comp rx=0 tx=0).stop 2023-06-09T04:42:04.231 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:04.227+0000 7fc53a4a6700 1 -- 172.21.15.90:0/772800649 shutdown_connections 2023-06-09T04:42:04.231 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:04.227+0000 7fc53a4a6700 1 --2- 172.21.15.90:0/772800649 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc53415d010 0x7fc5340d06d0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:04.231 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:04.227+0000 7fc53a4a6700 1 --2- 172.21.15.90:0/772800649 >> v2:172.21.15.174:3300/0 conn(0x7fc53415c670 0x7fc53415cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:04.231 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:04.227+0000 7fc53a4a6700 1 -- 172.21.15.90:0/772800649 >> 172.21.15.90:0/772800649 conn(0x7fc5340b4ee0 msgr2=0x7fc5340d2720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:04.232 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:04.227+0000 7fc53a4a6700 1 -- 172.21.15.90:0/772800649 shutdown_connections 2023-06-09T04:42:04.232 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:04.227+0000 7fc53a4a6700 1 -- 172.21.15.90:0/772800649 wait complete. 2023-06-09T04:42:04.234 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:04.227+0000 7fc53a4a6700 1 Processor -- start 2023-06-09T04:42:04.235 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:04.231+0000 7fc53a4a6700 1 -- start start 2023-06-09T04:42:04.237 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:04.231+0000 7fc53a4a6700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc53415c2a0 0x7fc534152f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:04.237 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:04.231+0000 7fc53a4a6700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc53415c670 0x7fc5340cba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:04.237 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:04.231+0000 7fc53a4a6700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc53415d010 0x7fc5340b65a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:04.237 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:04.231+0000 7fc53a4a6700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5340cb600 con 0x7fc53415c2a0 2023-06-09T04:42:04.238 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:04.231+0000 7fc53a4a6700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5340b6f10 con 0x7fc53415d010 2023-06-09T04:42:04.238 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:04.231+0000 7fc53a4a6700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5340b71f0 con 0x7fc53415c670 2023-06-09T04:42:04.238 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:04.231+0000 7fc5394a4700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc53415c2a0 0x7fc534152f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:04.238 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:04.231+0000 7fc5394a4700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc53415c2a0 0x7fc534152f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:33748/0 (socket says 172.21.15.90:33748) 2023-06-09T04:42:04.238 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:04.231+0000 7fc5394a4700 1 -- 172.21.15.90:0/98990311 learned_addr learned my addr 172.21.15.90:0/98990311 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:04.239 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:04.231+0000 7fc539ca5700 1 --2- 172.21.15.90:0/98990311 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc53415d010 0x7fc5340b65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:04.239 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:04.231+0000 7fc538ca3700 1 --2- 172.21.15.90:0/98990311 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc53415c670 0x7fc5340cba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:04.240 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:04.231+0000 7fc5394a4700 1 -- 172.21.15.90:0/98990311 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc53415c670 msgr2=0x7fc5340cba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:04.240 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:04.231+0000 7fc5394a4700 1 --2- 172.21.15.90:0/98990311 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc53415c670 0x7fc5340cba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:04.240 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:04.231+0000 7fc5394a4700 1 -- 172.21.15.90:0/98990311 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc53415d010 msgr2=0x7fc5340b65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:04.240 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:04.231+0000 7fc5394a4700 1 --2- 172.21.15.90:0/98990311 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc53415d010 0x7fc5340b65a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:04.240 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:04.231+0000 7fc5394a4700 1 -- 172.21.15.90:0/98990311 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc52c009b30 con 0x7fc53415c2a0 2023-06-09T04:42:04.240 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:04.231+0000 7fc539ca5700 1 --2- 172.21.15.90:0/98990311 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc53415d010 0x7fc5340b65a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:42:04.240 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:04.231+0000 7fc5394a4700 1 --2- 172.21.15.90:0/98990311 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc53415c2a0 0x7fc534152f70 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc53000c500 tx=0x7fc53000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:04.241 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:04.235+0000 7fc529ffb700 1 -- 172.21.15.90:0/98990311 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5300052d0 con 0x7fc53415c2a0 2023-06-09T04:42:04.241 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:04.235+0000 7fc529ffb700 1 -- 172.21.15.90:0/98990311 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc530005430 con 0x7fc53415c2a0 2023-06-09T04:42:04.241 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:04.235+0000 7fc53a4a6700 1 -- 172.21.15.90:0/98990311 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5340cb290 con 0x7fc53415c2a0 2023-06-09T04:42:04.241 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:04.235+0000 7fc529ffb700 1 -- 172.21.15.90:0/98990311 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5300055a0 con 0x7fc53415c2a0 2023-06-09T04:42:04.241 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:04.235+0000 7fc53a4a6700 1 -- 172.21.15.90:0/98990311 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5340b6ae0 con 0x7fc53415c2a0 2023-06-09T04:42:04.241 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:04.235+0000 7fc53a4a6700 1 -- 172.21.15.90:0/98990311 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5340cb0f0 con 0x7fc53415c2a0 2023-06-09T04:42:04.243 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:04.239+0000 7fc529ffb700 1 -- 172.21.15.90:0/98990311 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc5300038e0 con 0x7fc53415c2a0 2023-06-09T04:42:04.244 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:04.239+0000 7fc529ffb700 1 --2- 172.21.15.90:0/98990311 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fc5180662f0 0x7fc5180687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:04.244 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:04.239+0000 7fc529ffb700 1 -- 172.21.15.90:0/98990311 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc5300832b0 con 0x7fc53415c2a0 2023-06-09T04:42:04.245 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:04.239+0000 7fc538ca3700 1 --2- 172.21.15.90:0/98990311 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fc5180662f0 0x7fc5180687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:04.246 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:04.243+0000 7fc538ca3700 1 --2- 172.21.15.90:0/98990311 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fc5180662f0 0x7fc5180687a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc53406a5d0 tx=0x7fc524008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:04.253 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:04.247+0000 7fc529ffb700 1 -- 172.21.15.90:0/98990311 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc5340cb0f0 con 0x7fc53415c2a0 2023-06-09T04:42:04.413 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:04.407+0000 7fc53a4a6700 1 -- 172.21.15.90:0/98990311 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fc5340cb0f0 con 0x7fc53415c2a0 2023-06-09T04:42:04.414 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:04.407+0000 7fc529ffb700 1 -- 172.21.15.90:0/98990311 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc5340cb0f0 con 0x7fc53415c2a0 2023-06-09T04:42:04.414 INFO:teuthology.orchestra.run.smithi090.stdout:55834574854 2023-06-09T04:42:04.418 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:04.411+0000 7fc53a4a6700 1 -- 172.21.15.90:0/98990311 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fc5180662f0 msgr2=0x7fc5180687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:04.418 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:04.411+0000 7fc53a4a6700 1 --2- 172.21.15.90:0/98990311 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fc5180662f0 0x7fc5180687a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc53406a5d0 tx=0x7fc524008040 comp rx=0 tx=0).stop 2023-06-09T04:42:04.418 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:04.411+0000 7fc53a4a6700 1 -- 172.21.15.90:0/98990311 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc53415c2a0 msgr2=0x7fc534152f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:04.419 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:04.411+0000 7fc53a4a6700 1 --2- 172.21.15.90:0/98990311 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc53415c2a0 0x7fc534152f70 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc53000c500 tx=0x7fc53000c8c0 comp rx=0 tx=0).stop 2023-06-09T04:42:04.419 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:04.411+0000 7fc53a4a6700 1 -- 172.21.15.90:0/98990311 shutdown_connections 2023-06-09T04:42:04.419 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:04.411+0000 7fc53a4a6700 1 --2- 172.21.15.90:0/98990311 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fc5180662f0 0x7fc5180687a0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:04.420 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:04.411+0000 7fc53a4a6700 1 --2- 172.21.15.90:0/98990311 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc53415d010 0x7fc5340b65a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:04.420 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:04.411+0000 7fc53a4a6700 1 --2- 172.21.15.90:0/98990311 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc53415c670 0x7fc5340cba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:04.420 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:04.411+0000 7fc53a4a6700 1 --2- 172.21.15.90:0/98990311 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc53415c2a0 0x7fc534152f70 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:04.420 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:04.411+0000 7fc53a4a6700 1 -- 172.21.15.90:0/98990311 >> 172.21.15.90:0/98990311 conn(0x7fc5340b4ee0 msgr2=0x7fc5340ceeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:04.420 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:04.415+0000 7fc53a4a6700 1 -- 172.21.15.90:0/98990311 shutdown_connections 2023-06-09T04:42:04.420 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:04.415+0000 7fc53a4a6700 1 -- 172.21.15.90:0/98990311 wait complete. 2023-06-09T04:42:04.438 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574854 for osd.3 2023-06-09T04:42:04.439 DEBUG:teuthology.parallel:result is None 2023-06-09T04:42:04.439 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-06-09T04:42:04.439 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-09T04:42:04.597 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:04.591+0000 7fa9ef1af700 1 Processor -- start 2023-06-09T04:42:04.597 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:04.591+0000 7fa9ef1af700 1 -- start start 2023-06-09T04:42:04.599 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:04.595+0000 7fa9ef1af700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fa9e815bf60 0x7fa9e806f960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:04.599 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:04.595+0000 7fa9ef1af700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fa9e80cc0f0 0x7fa9e80cd750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:04.599 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:04.595+0000 7fa9ef1af700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9e806fea0 con 0x7fa9e80cdc90 2023-06-09T04:42:04.599 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:04.595+0000 7fa9ef1af700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9e80cc6b0 con 0x7fa9e80cc0f0 2023-06-09T04:42:04.599 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:04.595+0000 7fa9ef1af700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9e80cc990 con 0x7fa9e815bf60 2023-06-09T04:42:04.600 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:04.595+0000 7fa9ed9ac700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fa9e80cc0f0 0x7fa9e80cd750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:04.600 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:04.595+0000 7fa9ed9ac700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fa9e80cc0f0 0x7fa9e80cd750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:33762/0 (socket says 172.21.15.90:33762) 2023-06-09T04:42:04.600 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:04.595+0000 7fa9ed9ac700 1 -- 172.21.15.90:0/3051545491 learned_addr learned my addr 172.21.15.90:0/3051545491 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:04.601 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:04.595+0000 7fa9ed9ac700 1 -- 172.21.15.90:0/3051545491 >> v2:172.21.15.174:3300/0 conn(0x7fa9e815bf60 msgr2=0x7fa9e806f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:04.601 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:04.595+0000 7fa9ed9ac700 1 --2- 172.21.15.90:0/3051545491 >> v2:172.21.15.174:3300/0 conn(0x7fa9e815bf60 0x7fa9e806f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:04.601 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:04.595+0000 7fa9ed9ac700 1 -- 172.21.15.90:0/3051545491 >> v1:172.21.15.90:6789/0 conn(0x7fa9e80cdc90 legacy=0x7fa9e80ab890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:04.601 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:04.595+0000 7fa9ed9ac700 1 -- 172.21.15.90:0/3051545491 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9e80ccc70 con 0x7fa9e80cc0f0 2023-06-09T04:42:04.601 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:04.595+0000 7fa9ed9ac700 1 --2- 172.21.15.90:0/3051545491 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa9e80cc0f0 0x7fa9e80cd750 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa9e80cbd70 tx=0x7fa9d8009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aecd7624aadb948b server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:04.602 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:04.595+0000 7fa9ed1ab700 1 -- 172.21.15.90:0/3051545491 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9d800b8a0 con 0x7fa9e80cc0f0 2023-06-09T04:42:04.602 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:04.595+0000 7fa9ed1ab700 1 -- 172.21.15.90:0/3051545491 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9d800ba00 con 0x7fa9e80cc0f0 2023-06-09T04:42:04.602 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:04.595+0000 7fa9ed1ab700 1 -- 172.21.15.90:0/3051545491 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9d800bd90 con 0x7fa9e80cc0f0 2023-06-09T04:42:04.602 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:04.595+0000 7fa9ef1af700 1 -- 172.21.15.90:0/3051545491 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa9e80cc0f0 msgr2=0x7fa9e80cd750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:04.602 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:04.595+0000 7fa9ef1af700 1 --2- 172.21.15.90:0/3051545491 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa9e80cc0f0 0x7fa9e80cd750 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa9e80cbd70 tx=0x7fa9d8009bf0 comp rx=0 tx=0).stop 2023-06-09T04:42:04.603 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:04.595+0000 7fa9ef1af700 1 -- 172.21.15.90:0/3051545491 shutdown_connections 2023-06-09T04:42:04.603 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:04.595+0000 7fa9ef1af700 1 --2- 172.21.15.90:0/3051545491 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa9e80cc0f0 0x7fa9e80cd750 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:04.603 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:04.595+0000 7fa9ef1af700 1 --2- 172.21.15.90:0/3051545491 >> v2:172.21.15.174:3300/0 conn(0x7fa9e815bf60 0x7fa9e806f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:04.603 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:04.595+0000 7fa9ef1af700 1 -- 172.21.15.90:0/3051545491 >> 172.21.15.90:0/3051545491 conn(0x7fa9e806c690 msgr2=0x7fa9e80aff00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:04.604 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:04.595+0000 7fa9ef1af700 1 -- 172.21.15.90:0/3051545491 shutdown_connections 2023-06-09T04:42:04.604 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:04.595+0000 7fa9ef1af700 1 -- 172.21.15.90:0/3051545491 wait complete. 2023-06-09T04:42:04.606 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:04.599+0000 7fa9ef1af700 1 Processor -- start 2023-06-09T04:42:04.607 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:04.603+0000 7fa9ef1af700 1 -- start start 2023-06-09T04:42:04.609 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:04.603+0000 7fa9ef1af700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa9e80cc0f0 0x7fa9e81504e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:04.609 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:04.603+0000 7fa9ef1af700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa9e80cdc90 0x7fa9e81563d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:04.609 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:04.603+0000 7fa9ef1af700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa9e815bf60 0x7fa9e81528d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:04.609 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:04.603+0000 7fa9ef1af700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9e8156910 con 0x7fa9e80cc0f0 2023-06-09T04:42:04.610 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:04.603+0000 7fa9ef1af700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9e8150b50 con 0x7fa9e80cdc90 2023-06-09T04:42:04.610 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:04.603+0000 7fa9ef1af700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9e8150e30 con 0x7fa9e815bf60 2023-06-09T04:42:04.611 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:04.603+0000 7fa9ee1ad700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa9e80cc0f0 0x7fa9e81504e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:04.611 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:04.603+0000 7fa9ee1ad700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa9e80cc0f0 0x7fa9e81504e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:33774/0 (socket says 172.21.15.90:33774) 2023-06-09T04:42:04.611 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:04.603+0000 7fa9ee1ad700 1 -- 172.21.15.90:0/1402392513 learned_addr learned my addr 172.21.15.90:0/1402392513 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:04.611 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:04.603+0000 7fa9ee9ae700 1 --2- 172.21.15.90:0/1402392513 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa9e815bf60 0x7fa9e81528d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:04.611 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:04.603+0000 7fa9ed9ac700 1 --2- 172.21.15.90:0/1402392513 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa9e80cdc90 0x7fa9e81563d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:04.611 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:04.603+0000 7fa9ee1ad700 1 -- 172.21.15.90:0/1402392513 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa9e815bf60 msgr2=0x7fa9e81528d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:04.612 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:04.603+0000 7fa9ee1ad700 1 --2- 172.21.15.90:0/1402392513 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa9e815bf60 0x7fa9e81528d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:04.612 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:04.603+0000 7fa9ee1ad700 1 -- 172.21.15.90:0/1402392513 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa9e80cdc90 msgr2=0x7fa9e81563d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:04.612 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:04.603+0000 7fa9ee1ad700 1 --2- 172.21.15.90:0/1402392513 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa9e80cdc90 0x7fa9e81563d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:04.612 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:04.603+0000 7fa9ee1ad700 1 -- 172.21.15.90:0/1402392513 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9d8009570 con 0x7fa9e80cc0f0 2023-06-09T04:42:04.612 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:04.607+0000 7fa9ee1ad700 1 --2- 172.21.15.90:0/1402392513 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa9e80cc0f0 0x7fa9e81504e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fa9e400b550 tx=0x7fa9e400b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:04.613 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:04.607+0000 7fa9deffd700 1 -- 172.21.15.90:0/1402392513 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9e4011830 con 0x7fa9e80cc0f0 2023-06-09T04:42:04.613 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:04.607+0000 7fa9deffd700 1 -- 172.21.15.90:0/1402392513 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9e4011990 con 0x7fa9e80cc0f0 2023-06-09T04:42:04.613 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:04.607+0000 7fa9ef1af700 1 -- 172.21.15.90:0/1402392513 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9e8151110 con 0x7fa9e80cc0f0 2023-06-09T04:42:04.613 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:04.607+0000 7fa9deffd700 1 -- 172.21.15.90:0/1402392513 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9e4011d40 con 0x7fa9e80cc0f0 2023-06-09T04:42:04.613 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:04.607+0000 7fa9ef1af700 1 -- 172.21.15.90:0/1402392513 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9e81516d0 con 0x7fa9e80cc0f0 2023-06-09T04:42:04.614 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:04.607+0000 7fa9ef1af700 1 -- 172.21.15.90:0/1402392513 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9e81518c0 con 0x7fa9e80cc0f0 2023-06-09T04:42:04.615 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:04.611+0000 7fa9deffd700 1 -- 172.21.15.90:0/1402392513 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa9e401a400 con 0x7fa9e80cc0f0 2023-06-09T04:42:04.617 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:04.611+0000 7fa9deffd700 1 --2- 172.21.15.90:0/1402392513 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fa9cc0662f0 0x7fa9cc0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:04.617 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:04.611+0000 7fa9deffd700 1 -- 172.21.15.90:0/1402392513 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa9e4083d60 con 0x7fa9e80cc0f0 2023-06-09T04:42:04.617 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:04.611+0000 7fa9ed9ac700 1 --2- 172.21.15.90:0/1402392513 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fa9cc0662f0 0x7fa9cc0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:04.619 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:04.615+0000 7fa9ed9ac700 1 --2- 172.21.15.90:0/1402392513 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fa9cc0662f0 0x7fa9cc0687a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa9d8000c00 tx=0x7fa9d8008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:04.621 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:04.615+0000 7fa9deffd700 1 -- 172.21.15.90:0/1402392513 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa9e40511d0 con 0x7fa9e80cc0f0 2023-06-09T04:42:04.781 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:04.775+0000 7fa9ef1af700 1 -- 172.21.15.90:0/1402392513 --> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa9e80cd230 con 0x7fa9cc0662f0 2023-06-09T04:42:04.796 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:04.791+0000 7fa9deffd700 1 -- 172.21.15.90:0/1402392513 <== mgr.4104 v2:172.21.15.174:6832/1389974754 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286496 (secure 0 0 0) 0x7fa9d8004040 con 0x7fa9cc0662f0 2023-06-09T04:42:04.799 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:42:04.806 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:04.799+0000 7fa9ef1af700 1 -- 172.21.15.90:0/1402392513 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fa9cc0662f0 msgr2=0x7fa9cc0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:04.807 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:04.799+0000 7fa9ef1af700 1 --2- 172.21.15.90:0/1402392513 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fa9cc0662f0 0x7fa9cc0687a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa9d8000c00 tx=0x7fa9d8008030 comp rx=0 tx=0).stop 2023-06-09T04:42:04.807 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:04.799+0000 7fa9ef1af700 1 -- 172.21.15.90:0/1402392513 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa9e80cc0f0 msgr2=0x7fa9e81504e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:04.807 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:04.799+0000 7fa9ef1af700 1 --2- 172.21.15.90:0/1402392513 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa9e80cc0f0 0x7fa9e81504e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fa9e400b550 tx=0x7fa9e400b910 comp rx=0 tx=0).stop 2023-06-09T04:42:04.807 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:04.799+0000 7fa9ef1af700 1 -- 172.21.15.90:0/1402392513 shutdown_connections 2023-06-09T04:42:04.807 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:04.799+0000 7fa9ef1af700 1 --2- 172.21.15.90:0/1402392513 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fa9cc0662f0 0x7fa9cc0687a0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:04.807 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:04.799+0000 7fa9ef1af700 1 --2- 172.21.15.90:0/1402392513 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa9e815bf60 0x7fa9e81528d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:04.807 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:04.799+0000 7fa9ef1af700 1 --2- 172.21.15.90:0/1402392513 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa9e80cdc90 0x7fa9e81563d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:04.808 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:04.799+0000 7fa9ef1af700 1 --2- 172.21.15.90:0/1402392513 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa9e80cc0f0 0x7fa9e81504e0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:04.808 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:04.799+0000 7fa9ef1af700 1 -- 172.21.15.90:0/1402392513 >> 172.21.15.90:0/1402392513 conn(0x7fa9e806c690 msgr2=0x7fa9e8069820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:04.808 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:04.803+0000 7fa9ef1af700 1 -- 172.21.15.90:0/1402392513 shutdown_connections 2023-06-09T04:42:04.808 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:04.803+0000 7fa9ef1af700 1 -- 172.21.15.90:0/1402392513 wait complete. 2023-06-09T04:42:04.809 INFO:teuthology.orchestra.run.smithi090.stderr:dumped all 2023-06-09T04:42:04.827 INFO:teuthology.orchestra.run.smithi090.stdout:{"pg_ready":true,"pg_map":{"version":29,"stamp":"2023-06-09T04:42:04.314762+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218824,"kb_used_data":3208,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754755896,"statfs":{"total":773094113280,"available":772870037504,"internally_reserved":0,"allocated":3284992,"data_stored":1939620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.921761"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.406944+0000","last_change":"2023-06-09T04:41:54.403483+0000","last_active":"2023-06-09T04:41:55.406944+0000","last_peered":"2023-06-09T04:41:55.406944+0000","last_clean":"2023-06-09T04:41:55.406944+0000","last_became_active":"2023-06-09T04:41:54.403189+0000","last_became_peered":"2023-06-09T04:41:54.403189+0000","last_unstale":"2023-06-09T04:41:55.406944+0000","last_undegraded":"2023-06-09T04:41:55.406944+0000","last_fullsized":"2023-06-09T04:41:55.406944+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:45:23.237006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.874307+0000","last_change":"2023-06-09T04:41:54.417816+0000","last_active":"2023-06-09T04:41:55.874307+0000","last_peered":"2023-06-09T04:41:55.874307+0000","last_clean":"2023-06-09T04:41:55.874307+0000","last_became_active":"2023-06-09T04:41:54.417523+0000","last_became_peered":"2023-06-09T04:41:54.417523+0000","last_unstale":"2023-06-09T04:41:55.874307+0000","last_undegraded":"2023-06-09T04:41:55.874307+0000","last_fullsized":"2023-06-09T04:41:55.874307+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:02:15.067018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.408132+0000","last_change":"2023-06-09T04:41:54.434121+0000","last_active":"2023-06-09T04:41:55.408132+0000","last_peered":"2023-06-09T04:41:55.408132+0000","last_clean":"2023-06-09T04:41:55.408132+0000","last_became_active":"2023-06-09T04:41:54.433774+0000","last_became_peered":"2023-06-09T04:41:54.433774+0000","last_unstale":"2023-06-09T04:41:55.408132+0000","last_undegraded":"2023-06-09T04:41:55.408132+0000","last_fullsized":"2023-06-09T04:41:55.408132+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:50:09.575767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.406854+0000","last_change":"2023-06-09T04:41:54.424411+0000","last_active":"2023-06-09T04:41:55.406854+0000","last_peered":"2023-06-09T04:41:55.406854+0000","last_clean":"2023-06-09T04:41:55.406854+0000","last_became_active":"2023-06-09T04:41:54.423966+0000","last_became_peered":"2023-06-09T04:41:54.423966+0000","last_unstale":"2023-06-09T04:41:55.406854+0000","last_undegraded":"2023-06-09T04:41:55.406854+0000","last_fullsized":"2023-06-09T04:41:55.406854+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:45:08.259045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.873607+0000","last_change":"2023-06-09T04:41:54.414192+0000","last_active":"2023-06-09T04:41:55.873607+0000","last_peered":"2023-06-09T04:41:55.873607+0000","last_clean":"2023-06-09T04:41:55.873607+0000","last_became_active":"2023-06-09T04:41:54.413938+0000","last_became_peered":"2023-06-09T04:41:54.413938+0000","last_unstale":"2023-06-09T04:41:55.873607+0000","last_undegraded":"2023-06-09T04:41:55.873607+0000","last_fullsized":"2023-06-09T04:41:55.873607+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:34:10.329381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.407620+0000","last_change":"2023-06-09T04:41:54.434214+0000","last_active":"2023-06-09T04:41:55.407620+0000","last_peered":"2023-06-09T04:41:55.407620+0000","last_clean":"2023-06-09T04:41:55.407620+0000","last_became_active":"2023-06-09T04:41:54.433495+0000","last_became_peered":"2023-06-09T04:41:54.433495+0000","last_unstale":"2023-06-09T04:41:55.407620+0000","last_undegraded":"2023-06-09T04:41:55.407620+0000","last_fullsized":"2023-06-09T04:41:55.407620+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:55:02.127077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.872502+0000","last_change":"2023-06-09T04:41:54.419655+0000","last_active":"2023-06-09T04:41:55.872502+0000","last_peered":"2023-06-09T04:41:55.872502+0000","last_clean":"2023-06-09T04:41:55.872502+0000","last_became_active":"2023-06-09T04:41:54.419050+0000","last_became_peered":"2023-06-09T04:41:54.419050+0000","last_unstale":"2023-06-09T04:41:55.872502+0000","last_undegraded":"2023-06-09T04:41:55.872502+0000","last_fullsized":"2023-06-09T04:41:55.872502+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:50:09.575767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.873689+0000","last_change":"2023-06-09T04:41:54.437218+0000","last_active":"2023-06-09T04:41:55.873689+0000","last_peered":"2023-06-09T04:41:55.873689+0000","last_clean":"2023-06-09T04:41:55.873689+0000","last_became_active":"2023-06-09T04:41:54.436898+0000","last_became_peered":"2023-06-09T04:41:54.436898+0000","last_unstale":"2023-06-09T04:41:55.873689+0000","last_undegraded":"2023-06-09T04:41:55.873689+0000","last_fullsized":"2023-06-09T04:41:55.873689+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:34:10.329381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.873735+0000","last_change":"2023-06-09T04:41:54.417378+0000","last_active":"2023-06-09T04:41:55.873735+0000","last_peered":"2023-06-09T04:41:55.873735+0000","last_clean":"2023-06-09T04:41:55.873735+0000","last_became_active":"2023-06-09T04:41:54.416459+0000","last_became_peered":"2023-06-09T04:41:54.416459+0000","last_unstale":"2023-06-09T04:41:55.873735+0000","last_undegraded":"2023-06-09T04:41:55.873735+0000","last_fullsized":"2023-06-09T04:41:55.873735+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:55:02.127077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.874681+0000","last_change":"2023-06-09T04:41:54.417848+0000","last_active":"2023-06-09T04:41:55.874681+0000","last_peered":"2023-06-09T04:41:55.874681+0000","last_clean":"2023-06-09T04:41:55.874681+0000","last_became_active":"2023-06-09T04:41:54.417560+0000","last_became_peered":"2023-06-09T04:41:54.417560+0000","last_unstale":"2023-06-09T04:41:55.874681+0000","last_undegraded":"2023-06-09T04:41:55.874681+0000","last_fullsized":"2023-06-09T04:41:55.874681+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:46:21.659594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.408404+0000","last_change":"2023-06-09T04:41:54.434090+0000","last_active":"2023-06-09T04:41:55.408404+0000","last_peered":"2023-06-09T04:41:55.408404+0000","last_clean":"2023-06-09T04:41:55.408404+0000","last_became_active":"2023-06-09T04:41:54.433687+0000","last_became_peered":"2023-06-09T04:41:54.433687+0000","last_unstale":"2023-06-09T04:41:55.408404+0000","last_undegraded":"2023-06-09T04:41:55.408404+0000","last_fullsized":"2023-06-09T04:41:55.408404+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:44:36.362428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.406772+0000","last_change":"2023-06-09T04:41:54.437425+0000","last_active":"2023-06-09T04:41:55.406772+0000","last_peered":"2023-06-09T04:41:55.406772+0000","last_clean":"2023-06-09T04:41:55.406772+0000","last_became_active":"2023-06-09T04:41:54.437149+0000","last_became_peered":"2023-06-09T04:41:54.437149+0000","last_unstale":"2023-06-09T04:41:55.406772+0000","last_undegraded":"2023-06-09T04:41:55.406772+0000","last_fullsized":"2023-06-09T04:41:55.406772+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:44:39.043853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.406611+0000","last_change":"2023-06-09T04:41:54.406715+0000","last_active":"2023-06-09T04:41:55.406611+0000","last_peered":"2023-06-09T04:41:55.406611+0000","last_clean":"2023-06-09T04:41:55.406611+0000","last_became_active":"2023-06-09T04:41:54.406316+0000","last_became_peered":"2023-06-09T04:41:54.406316+0000","last_unstale":"2023-06-09T04:41:55.406611+0000","last_undegraded":"2023-06-09T04:41:55.406611+0000","last_fullsized":"2023-06-09T04:41:55.406611+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:40:08.604981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.873902+0000","last_change":"2023-06-09T04:41:54.405717+0000","last_active":"2023-06-09T04:41:55.873902+0000","last_peered":"2023-06-09T04:41:55.873902+0000","last_clean":"2023-06-09T04:41:55.873902+0000","last_became_active":"2023-06-09T04:41:54.405412+0000","last_became_peered":"2023-06-09T04:41:54.405412+0000","last_unstale":"2023-06-09T04:41:55.873902+0000","last_undegraded":"2023-06-09T04:41:55.873902+0000","last_fullsized":"2023-06-09T04:41:55.873902+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:55:02.127077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.872713+0000","last_change":"2023-06-09T04:41:54.419861+0000","last_active":"2023-06-09T04:41:55.872713+0000","last_peered":"2023-06-09T04:41:55.872713+0000","last_clean":"2023-06-09T04:41:55.872713+0000","last_became_active":"2023-06-09T04:41:54.419404+0000","last_became_peered":"2023-06-09T04:41:54.419404+0000","last_unstale":"2023-06-09T04:41:55.872713+0000","last_undegraded":"2023-06-09T04:41:55.872713+0000","last_fullsized":"2023-06-09T04:41:55.872713+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:46:21.659594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.407159+0000","last_change":"2023-06-09T04:41:54.433128+0000","last_active":"2023-06-09T04:41:55.407159+0000","last_peered":"2023-06-09T04:41:55.407159+0000","last_clean":"2023-06-09T04:41:55.407159+0000","last_became_active":"2023-06-09T04:41:54.432642+0000","last_became_peered":"2023-06-09T04:41:54.432642+0000","last_unstale":"2023-06-09T04:41:55.407159+0000","last_undegraded":"2023-06-09T04:41:55.407159+0000","last_fullsized":"2023-06-09T04:41:55.407159+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:01:41.876981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.873916+0000","last_change":"2023-06-09T04:41:54.416438+0000","last_active":"2023-06-09T04:41:55.873916+0000","last_peered":"2023-06-09T04:41:55.873916+0000","last_clean":"2023-06-09T04:41:55.873916+0000","last_became_active":"2023-06-09T04:41:54.416180+0000","last_became_peered":"2023-06-09T04:41:54.416180+0000","last_unstale":"2023-06-09T04:41:55.873916+0000","last_undegraded":"2023-06-09T04:41:55.873916+0000","last_fullsized":"2023-06-09T04:41:55.873916+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:35:38.355296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.408577+0000","last_change":"2023-06-09T04:41:54.433381+0000","last_active":"2023-06-09T04:41:55.408577+0000","last_peered":"2023-06-09T04:41:55.408577+0000","last_clean":"2023-06-09T04:41:55.408577+0000","last_became_active":"2023-06-09T04:41:54.433196+0000","last_became_peered":"2023-06-09T04:41:54.433196+0000","last_unstale":"2023-06-09T04:41:55.408577+0000","last_undegraded":"2023-06-09T04:41:55.408577+0000","last_fullsized":"2023-06-09T04:41:55.408577+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:20:06.903346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.406837+0000","last_change":"2023-06-09T04:41:54.427593+0000","last_active":"2023-06-09T04:41:55.406837+0000","last_peered":"2023-06-09T04:41:55.406837+0000","last_clean":"2023-06-09T04:41:55.406837+0000","last_became_active":"2023-06-09T04:41:54.427307+0000","last_became_peered":"2023-06-09T04:41:54.427307+0000","last_unstale":"2023-06-09T04:41:55.406837+0000","last_undegraded":"2023-06-09T04:41:55.406837+0000","last_fullsized":"2023-06-09T04:41:55.406837+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:07:19.100918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.408060+0000","last_change":"2023-06-09T04:41:54.436029+0000","last_active":"2023-06-09T04:41:55.408060+0000","last_peered":"2023-06-09T04:41:55.408060+0000","last_clean":"2023-06-09T04:41:55.408060+0000","last_became_active":"2023-06-09T04:41:54.435786+0000","last_became_peered":"2023-06-09T04:41:54.435786+0000","last_unstale":"2023-06-09T04:41:55.408060+0000","last_undegraded":"2023-06-09T04:41:55.408060+0000","last_fullsized":"2023-06-09T04:41:55.408060+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:02:15.067018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.872831+0000","last_change":"2023-06-09T04:41:54.415714+0000","last_active":"2023-06-09T04:41:55.872831+0000","last_peered":"2023-06-09T04:41:55.872831+0000","last_clean":"2023-06-09T04:41:55.872831+0000","last_became_active":"2023-06-09T04:41:54.415422+0000","last_became_peered":"2023-06-09T04:41:54.415422+0000","last_unstale":"2023-06-09T04:41:55.872831+0000","last_undegraded":"2023-06-09T04:41:55.872831+0000","last_fullsized":"2023-06-09T04:41:55.872831+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:44:36.362428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.874142+0000","last_change":"2023-06-09T04:41:54.421187+0000","last_active":"2023-06-09T04:41:55.874142+0000","last_peered":"2023-06-09T04:41:55.874142+0000","last_clean":"2023-06-09T04:41:55.874142+0000","last_became_active":"2023-06-09T04:41:54.420916+0000","last_became_peered":"2023-06-09T04:41:54.420916+0000","last_unstale":"2023-06-09T04:41:55.874142+0000","last_undegraded":"2023-06-09T04:41:55.874142+0000","last_fullsized":"2023-06-09T04:41:55.874142+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:50:09.575767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.654195+0000","last_change":"2023-06-09T04:41:54.413591+0000","last_active":"2023-06-09T04:41:55.654195+0000","last_peered":"2023-06-09T04:41:55.654195+0000","last_clean":"2023-06-09T04:41:55.654195+0000","last_became_active":"2023-06-09T04:41:54.413258+0000","last_became_peered":"2023-06-09T04:41:54.413258+0000","last_unstale":"2023-06-09T04:41:55.654195+0000","last_undegraded":"2023-06-09T04:41:55.654195+0000","last_fullsized":"2023-06-09T04:41:55.654195+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:06:03.696521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.872978+0000","last_change":"2023-06-09T04:41:54.426948+0000","last_active":"2023-06-09T04:41:55.872978+0000","last_peered":"2023-06-09T04:41:55.872978+0000","last_clean":"2023-06-09T04:41:55.872978+0000","last_became_active":"2023-06-09T04:41:54.424537+0000","last_became_peered":"2023-06-09T04:41:54.424537+0000","last_unstale":"2023-06-09T04:41:55.872978+0000","last_undegraded":"2023-06-09T04:41:55.872978+0000","last_fullsized":"2023-06-09T04:41:55.872978+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:02:42.425459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.874331+0000","last_change":"2023-06-09T04:41:54.423154+0000","last_active":"2023-06-09T04:41:55.874331+0000","last_peered":"2023-06-09T04:41:55.874331+0000","last_clean":"2023-06-09T04:41:55.874331+0000","last_became_active":"2023-06-09T04:41:54.422890+0000","last_became_peered":"2023-06-09T04:41:54.422890+0000","last_unstale":"2023-06-09T04:41:55.874331+0000","last_undegraded":"2023-06-09T04:41:55.874331+0000","last_fullsized":"2023-06-09T04:41:55.874331+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:02:15.067018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.874778+0000","last_change":"2023-06-09T04:41:54.411853+0000","last_active":"2023-06-09T04:41:55.874778+0000","last_peered":"2023-06-09T04:41:55.874778+0000","last_clean":"2023-06-09T04:41:55.874778+0000","last_became_active":"2023-06-09T04:41:54.411513+0000","last_became_peered":"2023-06-09T04:41:54.411513+0000","last_unstale":"2023-06-09T04:41:55.874778+0000","last_undegraded":"2023-06-09T04:41:55.874778+0000","last_fullsized":"2023-06-09T04:41:55.874778+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:32:14.262842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.874581+0000","last_change":"2023-06-09T04:41:54.423403+0000","last_active":"2023-06-09T04:41:55.874581+0000","last_peered":"2023-06-09T04:41:55.874581+0000","last_clean":"2023-06-09T04:41:55.874581+0000","last_became_active":"2023-06-09T04:41:54.422935+0000","last_became_peered":"2023-06-09T04:41:54.422935+0000","last_unstale":"2023-06-09T04:41:55.874581+0000","last_undegraded":"2023-06-09T04:41:55.874581+0000","last_fullsized":"2023-06-09T04:41:55.874581+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:50:09.575767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.874025+0000","last_change":"2023-06-09T04:41:54.416963+0000","last_active":"2023-06-09T04:41:55.874025+0000","last_peered":"2023-06-09T04:41:55.874025+0000","last_clean":"2023-06-09T04:41:55.874025+0000","last_became_active":"2023-06-09T04:41:54.416720+0000","last_became_peered":"2023-06-09T04:41:54.416720+0000","last_unstale":"2023-06-09T04:41:55.874025+0000","last_undegraded":"2023-06-09T04:41:55.874025+0000","last_fullsized":"2023-06-09T04:41:55.874025+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:29:47.126124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.654421+0000","last_change":"2023-06-09T04:41:54.425010+0000","last_active":"2023-06-09T04:41:55.654421+0000","last_peered":"2023-06-09T04:41:55.654421+0000","last_clean":"2023-06-09T04:41:55.654421+0000","last_became_active":"2023-06-09T04:41:54.423548+0000","last_became_peered":"2023-06-09T04:41:54.423548+0000","last_unstale":"2023-06-09T04:41:55.654421+0000","last_undegraded":"2023-06-09T04:41:55.654421+0000","last_fullsized":"2023-06-09T04:41:55.654421+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:02:15.067018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.408322+0000","last_change":"2023-06-09T04:41:54.433955+0000","last_active":"2023-06-09T04:41:55.408322+0000","last_peered":"2023-06-09T04:41:55.408322+0000","last_clean":"2023-06-09T04:41:55.408322+0000","last_became_active":"2023-06-09T04:41:54.433402+0000","last_became_peered":"2023-06-09T04:41:54.433402+0000","last_unstale":"2023-06-09T04:41:55.408322+0000","last_undegraded":"2023-06-09T04:41:55.408322+0000","last_fullsized":"2023-06-09T04:41:55.408322+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:46:21.659594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.653882+0000","last_change":"2023-06-09T04:41:54.412120+0000","last_active":"2023-06-09T04:41:55.653882+0000","last_peered":"2023-06-09T04:41:55.653882+0000","last_clean":"2023-06-09T04:41:55.653882+0000","last_became_active":"2023-06-09T04:41:54.411844+0000","last_became_peered":"2023-06-09T04:41:54.411844+0000","last_unstale":"2023-06-09T04:41:55.653882+0000","last_undegraded":"2023-06-09T04:41:55.653882+0000","last_fullsized":"2023-06-09T04:41:55.653882+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:02:24.420270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.406356+0000","last_change":"2023-06-09T04:41:54.429251+0000","last_active":"2023-06-09T04:41:55.406356+0000","last_peered":"2023-06-09T04:41:55.406356+0000","last_clean":"2023-06-09T04:41:55.406356+0000","last_became_active":"2023-06-09T04:41:54.428359+0000","last_became_peered":"2023-06-09T04:41:54.428359+0000","last_unstale":"2023-06-09T04:41:55.406356+0000","last_undegraded":"2023-06-09T04:41:55.406356+0000","last_fullsized":"2023-06-09T04:41:55.406356+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:11:53.056966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.654119+0000","last_change":"2023-06-09T04:41:54.429333+0000","last_active":"2023-06-09T04:41:55.654119+0000","last_peered":"2023-06-09T04:41:55.654119+0000","last_clean":"2023-06-09T04:41:55.654119+0000","last_became_active":"2023-06-09T04:41:54.428962+0000","last_became_peered":"2023-06-09T04:41:54.428962+0000","last_unstale":"2023-06-09T04:41:55.654119+0000","last_undegraded":"2023-06-09T04:41:55.654119+0000","last_fullsized":"2023-06-09T04:41:55.654119+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:03:22.727998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"23'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.873117+0000","last_change":"2023-06-09T04:41:53.950213+0000","last_active":"2023-06-09T04:41:55.873117+0000","last_peered":"2023-06-09T04:41:55.873117+0000","last_clean":"2023-06-09T04:41:55.873117+0000","last_became_active":"2023-06-09T04:41:53.949956+0000","last_became_peered":"2023-06-09T04:41:53.949956+0000","last_unstale":"2023-06-09T04:41:55.873117+0000","last_undegraded":"2023-06-09T04:41:55.873117+0000","last_fullsized":"2023-06-09T04:41:55.873117+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_clean_scrub_stamp":"2023-06-09T04:41:52.888143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:20:05.889342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.874763+0000","last_change":"2023-06-09T04:41:54.423233+0000","last_active":"2023-06-09T04:41:55.874763+0000","last_peered":"2023-06-09T04:41:55.874763+0000","last_clean":"2023-06-09T04:41:55.874763+0000","last_became_active":"2023-06-09T04:41:54.422587+0000","last_became_peered":"2023-06-09T04:41:54.422587+0000","last_unstale":"2023-06-09T04:41:55.874763+0000","last_undegraded":"2023-06-09T04:41:55.874763+0000","last_fullsized":"2023-06-09T04:41:55.874763+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:01:04.929884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.874374+0000","last_change":"2023-06-09T04:41:53.944320+0000","last_active":"2023-06-09T04:41:55.874374+0000","last_peered":"2023-06-09T04:41:55.874374+0000","last_clean":"2023-06-09T04:41:55.874374+0000","last_became_active":"2023-06-09T04:41:53.944039+0000","last_became_peered":"2023-06-09T04:41:53.944039+0000","last_unstale":"2023-06-09T04:41:55.874374+0000","last_undegraded":"2023-06-09T04:41:55.874374+0000","last_fullsized":"2023-06-09T04:41:55.874374+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_clean_scrub_stamp":"2023-06-09T04:41:52.888143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:32:13.248839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.873809+0000","last_change":"2023-06-09T04:41:54.417754+0000","last_active":"2023-06-09T04:41:55.873809+0000","last_peered":"2023-06-09T04:41:55.873809+0000","last_clean":"2023-06-09T04:41:55.873809+0000","last_became_active":"2023-06-09T04:41:54.417462+0000","last_became_peered":"2023-06-09T04:41:54.417462+0000","last_unstale":"2023-06-09T04:41:55.873809+0000","last_undegraded":"2023-06-09T04:41:55.873809+0000","last_fullsized":"2023-06-09T04:41:55.873809+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:06:03.696521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.872806+0000","last_change":"2023-06-09T04:41:53.950199+0000","last_active":"2023-06-09T04:41:55.872806+0000","last_peered":"2023-06-09T04:41:55.872806+0000","last_clean":"2023-06-09T04:41:55.872806+0000","last_became_active":"2023-06-09T04:41:53.949846+0000","last_became_peered":"2023-06-09T04:41:53.949846+0000","last_unstale":"2023-06-09T04:41:55.872806+0000","last_undegraded":"2023-06-09T04:41:55.872806+0000","last_fullsized":"2023-06-09T04:41:55.872806+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_clean_scrub_stamp":"2023-06-09T04:41:52.888143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:37:16.212704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.654767+0000","last_change":"2023-06-09T04:41:54.423952+0000","last_active":"2023-06-09T04:41:55.654767+0000","last_peered":"2023-06-09T04:41:55.654767+0000","last_clean":"2023-06-09T04:41:55.654767+0000","last_became_active":"2023-06-09T04:41:54.423601+0000","last_became_peered":"2023-06-09T04:41:54.423601+0000","last_unstale":"2023-06-09T04:41:55.654767+0000","last_undegraded":"2023-06-09T04:41:55.654767+0000","last_fullsized":"2023-06-09T04:41:55.654767+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:46:21.659594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"23'8","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.406561+0000","last_change":"2023-06-09T04:41:53.945735+0000","last_active":"2023-06-09T04:41:55.406561+0000","last_peered":"2023-06-09T04:41:55.406561+0000","last_clean":"2023-06-09T04:41:55.406561+0000","last_became_active":"2023-06-09T04:41:53.945260+0000","last_became_peered":"2023-06-09T04:41:53.945260+0000","last_unstale":"2023-06-09T04:41:55.406561+0000","last_undegraded":"2023-06-09T04:41:55.406561+0000","last_fullsized":"2023-06-09T04:41:55.406561+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_clean_scrub_stamp":"2023-06-09T04:41:52.888143+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:48:52.910038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"23'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.873690+0000","last_change":"2023-06-09T04:41:53.950178+0000","last_active":"2023-06-09T04:41:55.873690+0000","last_peered":"2023-06-09T04:41:55.873690+0000","last_clean":"2023-06-09T04:41:55.873690+0000","last_became_active":"2023-06-09T04:41:53.949874+0000","last_became_peered":"2023-06-09T04:41:53.949874+0000","last_unstale":"2023-06-09T04:41:55.873690+0000","last_undegraded":"2023-06-09T04:41:55.873690+0000","last_fullsized":"2023-06-09T04:41:55.873690+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_clean_scrub_stamp":"2023-06-09T04:41:52.888143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:14:18.414303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.873991+0000","last_change":"2023-06-09T04:41:54.421270+0000","last_active":"2023-06-09T04:41:55.873991+0000","last_peered":"2023-06-09T04:41:55.873991+0000","last_clean":"2023-06-09T04:41:55.873991+0000","last_became_active":"2023-06-09T04:41:54.421019+0000","last_became_peered":"2023-06-09T04:41:54.421019+0000","last_unstale":"2023-06-09T04:41:55.873991+0000","last_undegraded":"2023-06-09T04:41:55.873991+0000","last_fullsized":"2023-06-09T04:41:55.873991+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:29:47.126124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"23'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.873655+0000","last_change":"2023-06-09T04:41:53.951880+0000","last_active":"2023-06-09T04:41:55.873655+0000","last_peered":"2023-06-09T04:41:55.873655+0000","last_clean":"2023-06-09T04:41:55.873655+0000","last_became_active":"2023-06-09T04:41:53.951460+0000","last_became_peered":"2023-06-09T04:41:53.951460+0000","last_unstale":"2023-06-09T04:41:55.873655+0000","last_undegraded":"2023-06-09T04:41:55.873655+0000","last_fullsized":"2023-06-09T04:41:55.873655+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_clean_scrub_stamp":"2023-06-09T04:41:52.888143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:35:48.907156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.407368+0000","last_change":"2023-06-09T04:41:54.432752+0000","last_active":"2023-06-09T04:41:55.407368+0000","last_peered":"2023-06-09T04:41:55.407368+0000","last_clean":"2023-06-09T04:41:55.407368+0000","last_became_active":"2023-06-09T04:41:54.432341+0000","last_became_peered":"2023-06-09T04:41:54.432341+0000","last_unstale":"2023-06-09T04:41:55.407368+0000","last_undegraded":"2023-06-09T04:41:55.407368+0000","last_fullsized":"2023-06-09T04:41:55.407368+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:02:24.420270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"23'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.873267+0000","last_change":"2023-06-09T04:41:53.943033+0000","last_active":"2023-06-09T04:41:55.873267+0000","last_peered":"2023-06-09T04:41:55.873267+0000","last_clean":"2023-06-09T04:41:55.873267+0000","last_became_active":"2023-06-09T04:41:53.942705+0000","last_became_peered":"2023-06-09T04:41:53.942705+0000","last_unstale":"2023-06-09T04:41:55.873267+0000","last_undegraded":"2023-06-09T04:41:55.873267+0000","last_fullsized":"2023-06-09T04:41:55.873267+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_clean_scrub_stamp":"2023-06-09T04:41:52.888143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:07:18.392407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.406357+0000","last_change":"2023-06-09T04:41:54.423994+0000","last_active":"2023-06-09T04:41:55.406357+0000","last_peered":"2023-06-09T04:41:55.406357+0000","last_clean":"2023-06-09T04:41:55.406357+0000","last_became_active":"2023-06-09T04:41:54.423563+0000","last_became_peered":"2023-06-09T04:41:54.423563+0000","last_unstale":"2023-06-09T04:41:55.406357+0000","last_undegraded":"2023-06-09T04:41:55.406357+0000","last_fullsized":"2023-06-09T04:41:55.406357+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:57:36.919960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.874564+0000","last_change":"2023-06-09T04:41:53.943463+0000","last_active":"2023-06-09T04:41:55.874564+0000","last_peered":"2023-06-09T04:41:55.874564+0000","last_clean":"2023-06-09T04:41:55.874564+0000","last_became_active":"2023-06-09T04:41:53.943156+0000","last_became_peered":"2023-06-09T04:41:53.943156+0000","last_unstale":"2023-06-09T04:41:55.874564+0000","last_undegraded":"2023-06-09T04:41:55.874564+0000","last_fullsized":"2023-06-09T04:41:55.874564+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_clean_scrub_stamp":"2023-06-09T04:41:52.888143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:48:33.879868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.872666+0000","last_change":"2023-06-09T04:41:54.421050+0000","last_active":"2023-06-09T04:41:55.872666+0000","last_peered":"2023-06-09T04:41:55.872666+0000","last_clean":"2023-06-09T04:41:55.872666+0000","last_became_active":"2023-06-09T04:41:54.420683+0000","last_became_peered":"2023-06-09T04:41:54.420683+0000","last_unstale":"2023-06-09T04:41:55.872666+0000","last_undegraded":"2023-06-09T04:41:55.872666+0000","last_fullsized":"2023-06-09T04:41:55.872666+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:01:41.876981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"23'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.654774+0000","last_change":"2023-06-09T04:41:53.946942+0000","last_active":"2023-06-09T04:41:55.654774+0000","last_peered":"2023-06-09T04:41:55.654774+0000","last_clean":"2023-06-09T04:41:55.654774+0000","last_became_active":"2023-06-09T04:41:53.946653+0000","last_became_peered":"2023-06-09T04:41:53.946653+0000","last_unstale":"2023-06-09T04:41:55.654774+0000","last_undegraded":"2023-06-09T04:41:55.654774+0000","last_fullsized":"2023-06-09T04:41:55.654774+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_clean_scrub_stamp":"2023-06-09T04:41:52.888143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:01:03.915881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.408152+0000","last_change":"2023-06-09T04:41:54.435489+0000","last_active":"2023-06-09T04:41:55.408152+0000","last_peered":"2023-06-09T04:41:55.408152+0000","last_clean":"2023-06-09T04:41:55.408152+0000","last_became_active":"2023-06-09T04:41:54.435221+0000","last_became_peered":"2023-06-09T04:41:54.435221+0000","last_unstale":"2023-06-09T04:41:55.408152+0000","last_undegraded":"2023-06-09T04:41:55.408152+0000","last_fullsized":"2023-06-09T04:41:55.408152+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:32:14.262842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.406707+0000","last_change":"2023-06-09T04:41:53.949739+0000","last_active":"2023-06-09T04:41:55.406707+0000","last_peered":"2023-06-09T04:41:55.406707+0000","last_clean":"2023-06-09T04:41:55.406707+0000","last_became_active":"2023-06-09T04:41:53.949424+0000","last_became_peered":"2023-06-09T04:41:53.949424+0000","last_unstale":"2023-06-09T04:41:55.406707+0000","last_undegraded":"2023-06-09T04:41:55.406707+0000","last_fullsized":"2023-06-09T04:41:55.406707+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_clean_scrub_stamp":"2023-06-09T04:41:52.888143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T04:56:37.643976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.408495+0000","last_change":"2023-06-09T04:41:54.432641+0000","last_active":"2023-06-09T04:41:55.408495+0000","last_peered":"2023-06-09T04:41:55.408495+0000","last_clean":"2023-06-09T04:41:55.408495+0000","last_became_active":"2023-06-09T04:41:54.432274+0000","last_became_peered":"2023-06-09T04:41:54.432274+0000","last_unstale":"2023-06-09T04:41:55.408495+0000","last_undegraded":"2023-06-09T04:41:55.408495+0000","last_fullsized":"2023-06-09T04:41:55.408495+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:02:42.425459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.408131+0000","last_change":"2023-06-09T04:41:53.941677+0000","last_active":"2023-06-09T04:41:55.408131+0000","last_peered":"2023-06-09T04:41:55.408131+0000","last_clean":"2023-06-09T04:41:55.408131+0000","last_became_active":"2023-06-09T04:41:53.940978+0000","last_became_peered":"2023-06-09T04:41:53.940978+0000","last_unstale":"2023-06-09T04:41:55.408131+0000","last_undegraded":"2023-06-09T04:41:55.408131+0000","last_fullsized":"2023-06-09T04:41:55.408131+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_clean_scrub_stamp":"2023-06-09T04:41:52.888143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:48:33.879868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.408415+0000","last_change":"2023-06-09T04:41:54.432635+0000","last_active":"2023-06-09T04:41:55.408415+0000","last_peered":"2023-06-09T04:41:55.408415+0000","last_clean":"2023-06-09T04:41:55.408415+0000","last_became_active":"2023-06-09T04:41:54.432242+0000","last_became_peered":"2023-06-09T04:41:54.432242+0000","last_unstale":"2023-06-09T04:41:55.408415+0000","last_undegraded":"2023-06-09T04:41:55.408415+0000","last_fullsized":"2023-06-09T04:41:55.408415+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:03:50.071570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.654432+0000","last_change":"2023-06-09T04:41:53.946859+0000","last_active":"2023-06-09T04:41:55.654432+0000","last_peered":"2023-06-09T04:41:55.654432+0000","last_clean":"2023-06-09T04:41:55.654432+0000","last_became_active":"2023-06-09T04:41:53.946579+0000","last_became_peered":"2023-06-09T04:41:53.946579+0000","last_unstale":"2023-06-09T04:41:55.654432+0000","last_undegraded":"2023-06-09T04:41:55.654432+0000","last_fullsized":"2023-06-09T04:41:55.654432+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_clean_scrub_stamp":"2023-06-09T04:41:52.888143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:48:33.879868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.874463+0000","last_change":"2023-06-09T04:41:54.412726+0000","last_active":"2023-06-09T04:41:55.874463+0000","last_peered":"2023-06-09T04:41:55.874463+0000","last_clean":"2023-06-09T04:41:55.874463+0000","last_became_active":"2023-06-09T04:41:54.410016+0000","last_became_peered":"2023-06-09T04:41:54.410016+0000","last_unstale":"2023-06-09T04:41:55.874463+0000","last_undegraded":"2023-06-09T04:41:55.874463+0000","last_fullsized":"2023-06-09T04:41:55.874463+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:48:34.893871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":175,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.872709+0000","last_change":"2023-06-09T04:41:43.997052+0000","last_active":"2023-06-09T04:41:55.872709+0000","last_peered":"2023-06-09T04:41:55.872709+0000","last_clean":"2023-06-09T04:41:55.872709+0000","last_became_active":"2023-06-09T04:41:43.993827+0000","last_became_peered":"2023-06-09T04:41:43.993827+0000","last_unstale":"2023-06-09T04:41:55.872709+0000","last_undegraded":"2023-06-09T04:41:55.872709+0000","last_fullsized":"2023-06-09T04:41:55.872709+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:42.777858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:42.777858+0000","last_clean_scrub_stamp":"2023-06-09T04:41:42.777858+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:03:38.947282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.874488+0000","last_change":"2023-06-09T04:41:48.873288+0000","last_active":"2023-06-09T04:41:55.874488+0000","last_peered":"2023-06-09T04:41:55.874488+0000","last_clean":"2023-06-09T04:41:55.874488+0000","last_became_active":"2023-06-09T04:41:48.872659+0000","last_became_peered":"2023-06-09T04:41:48.872659+0000","last_unstale":"2023-06-09T04:41:55.874488+0000","last_undegraded":"2023-06-09T04:41:55.874488+0000","last_fullsized":"2023-06-09T04:41:55.874488+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:47.838489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:47.838489+0000","last_clean_scrub_stamp":"2023-06-09T04:41:47.838489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:32:08.199185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.653752+0000","last_change":"2023-06-09T04:41:53.936424+0000","last_active":"2023-06-09T04:41:55.653752+0000","last_peered":"2023-06-09T04:41:55.653752+0000","last_clean":"2023-06-09T04:41:55.653752+0000","last_became_active":"2023-06-09T04:41:53.935818+0000","last_became_peered":"2023-06-09T04:41:53.935818+0000","last_unstale":"2023-06-09T04:41:55.653752+0000","last_undegraded":"2023-06-09T04:41:55.653752+0000","last_fullsized":"2023-06-09T04:41:55.653752+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_clean_scrub_stamp":"2023-06-09T04:41:52.888143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:01:40.862978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.406643+0000","last_change":"2023-06-09T04:41:54.435480+0000","last_active":"2023-06-09T04:41:55.406643+0000","last_peered":"2023-06-09T04:41:55.406643+0000","last_clean":"2023-06-09T04:41:55.406643+0000","last_became_active":"2023-06-09T04:41:54.435108+0000","last_became_peered":"2023-06-09T04:41:54.435108+0000","last_unstale":"2023-06-09T04:41:55.406643+0000","last_undegraded":"2023-06-09T04:41:55.406643+0000","last_fullsized":"2023-06-09T04:41:55.406643+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:23:54.068246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.872386+0000","last_change":"2023-06-09T04:41:48.880106+0000","last_active":"2023-06-09T04:41:55.872386+0000","last_peered":"2023-06-09T04:41:55.872386+0000","last_clean":"2023-06-09T04:41:55.872386+0000","last_became_active":"2023-06-09T04:41:48.879669+0000","last_became_peered":"2023-06-09T04:41:48.879669+0000","last_unstale":"2023-06-09T04:41:55.872386+0000","last_undegraded":"2023-06-09T04:41:55.872386+0000","last_fullsized":"2023-06-09T04:41:55.872386+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:47.838489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:47.838489+0000","last_clean_scrub_stamp":"2023-06-09T04:41:47.838489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:32:08.199185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.872214+0000","last_change":"2023-06-09T04:41:53.950810+0000","last_active":"2023-06-09T04:41:55.872214+0000","last_peered":"2023-06-09T04:41:55.872214+0000","last_clean":"2023-06-09T04:41:55.872214+0000","last_became_active":"2023-06-09T04:41:53.950443+0000","last_became_peered":"2023-06-09T04:41:53.950443+0000","last_unstale":"2023-06-09T04:41:55.872214+0000","last_undegraded":"2023-06-09T04:41:55.872214+0000","last_fullsized":"2023-06-09T04:41:55.872214+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_clean_scrub_stamp":"2023-06-09T04:41:52.888143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:02:21.285375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.873507+0000","last_change":"2023-06-09T04:41:54.424529+0000","last_active":"2023-06-09T04:41:55.873507+0000","last_peered":"2023-06-09T04:41:55.873507+0000","last_clean":"2023-06-09T04:41:55.873507+0000","last_became_active":"2023-06-09T04:41:54.424272+0000","last_became_peered":"2023-06-09T04:41:54.424272+0000","last_unstale":"2023-06-09T04:41:55.873507+0000","last_undegraded":"2023-06-09T04:41:55.873507+0000","last_fullsized":"2023-06-09T04:41:55.873507+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:03:22.727998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.406445+0000","last_change":"2023-06-09T04:41:48.966313+0000","last_active":"2023-06-09T04:41:55.406445+0000","last_peered":"2023-06-09T04:41:55.406445+0000","last_clean":"2023-06-09T04:41:55.406445+0000","last_became_active":"2023-06-09T04:41:48.965659+0000","last_became_peered":"2023-06-09T04:41:48.965659+0000","last_unstale":"2023-06-09T04:41:55.406445+0000","last_undegraded":"2023-06-09T04:41:55.406445+0000","last_fullsized":"2023-06-09T04:41:55.406445+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:47.838489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:47.838489+0000","last_clean_scrub_stamp":"2023-06-09T04:41:47.838489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:46:50.802354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.872660+0000","last_change":"2023-06-09T04:41:53.938212+0000","last_active":"2023-06-09T04:41:55.872660+0000","last_peered":"2023-06-09T04:41:55.872660+0000","last_clean":"2023-06-09T04:41:55.872660+0000","last_became_active":"2023-06-09T04:41:53.937944+0000","last_became_peered":"2023-06-09T04:41:53.937944+0000","last_unstale":"2023-06-09T04:41:55.872660+0000","last_undegraded":"2023-06-09T04:41:55.872660+0000","last_fullsized":"2023-06-09T04:41:55.872660+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_clean_scrub_stamp":"2023-06-09T04:41:52.888143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:37:52.478621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.874512+0000","last_change":"2023-06-09T04:41:54.419815+0000","last_active":"2023-06-09T04:41:55.874512+0000","last_peered":"2023-06-09T04:41:55.874512+0000","last_clean":"2023-06-09T04:41:55.874512+0000","last_became_active":"2023-06-09T04:41:54.419519+0000","last_became_peered":"2023-06-09T04:41:54.419519+0000","last_unstale":"2023-06-09T04:41:55.874512+0000","last_undegraded":"2023-06-09T04:41:55.874512+0000","last_fullsized":"2023-06-09T04:41:55.874512+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:50:09.575767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.873799+0000","last_change":"2023-06-09T04:41:48.873002+0000","last_active":"2023-06-09T04:41:55.873799+0000","last_peered":"2023-06-09T04:41:55.873799+0000","last_clean":"2023-06-09T04:41:55.873799+0000","last_became_active":"2023-06-09T04:41:48.872455+0000","last_became_peered":"2023-06-09T04:41:48.872455+0000","last_unstale":"2023-06-09T04:41:55.873799+0000","last_undegraded":"2023-06-09T04:41:55.873799+0000","last_fullsized":"2023-06-09T04:41:55.873799+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:47.838489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:47.838489+0000","last_clean_scrub_stamp":"2023-06-09T04:41:47.838489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:05:57.632864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.408311+0000","last_change":"2023-06-09T04:41:53.947015+0000","last_active":"2023-06-09T04:41:55.408311+0000","last_peered":"2023-06-09T04:41:55.408311+0000","last_clean":"2023-06-09T04:41:55.408311+0000","last_became_active":"2023-06-09T04:41:53.946714+0000","last_became_peered":"2023-06-09T04:41:53.946714+0000","last_unstale":"2023-06-09T04:41:55.408311+0000","last_undegraded":"2023-06-09T04:41:55.408311+0000","last_fullsized":"2023-06-09T04:41:55.408311+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_clean_scrub_stamp":"2023-06-09T04:41:52.888143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:01:03.915881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.873441+0000","last_change":"2023-06-09T04:41:54.411876+0000","last_active":"2023-06-09T04:41:55.873441+0000","last_peered":"2023-06-09T04:41:55.873441+0000","last_clean":"2023-06-09T04:41:55.873441+0000","last_became_active":"2023-06-09T04:41:54.411566+0000","last_became_peered":"2023-06-09T04:41:54.411566+0000","last_unstale":"2023-06-09T04:41:55.873441+0000","last_undegraded":"2023-06-09T04:41:55.873441+0000","last_fullsized":"2023-06-09T04:41:55.873441+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:02:24.420270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.874856+0000","last_change":"2023-06-09T04:41:53.936340+0000","last_active":"2023-06-09T04:41:55.874856+0000","last_peered":"2023-06-09T04:41:55.874856+0000","last_clean":"2023-06-09T04:41:55.874856+0000","last_became_active":"2023-06-09T04:41:53.936055+0000","last_became_peered":"2023-06-09T04:41:53.936055+0000","last_unstale":"2023-06-09T04:41:55.874856+0000","last_undegraded":"2023-06-09T04:41:55.874856+0000","last_fullsized":"2023-06-09T04:41:55.874856+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_clean_scrub_stamp":"2023-06-09T04:41:52.888143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:37:16.212704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.874174+0000","last_change":"2023-06-09T04:41:48.978389+0000","last_active":"2023-06-09T04:41:55.874174+0000","last_peered":"2023-06-09T04:41:55.874174+0000","last_clean":"2023-06-09T04:41:55.874174+0000","last_became_active":"2023-06-09T04:41:48.978021+0000","last_became_peered":"2023-06-09T04:41:48.978021+0000","last_unstale":"2023-06-09T04:41:55.874174+0000","last_undegraded":"2023-06-09T04:41:55.874174+0000","last_fullsized":"2023-06-09T04:41:55.874174+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:47.838489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:47.838489+0000","last_clean_scrub_stamp":"2023-06-09T04:41:47.838489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:35:32.291639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.873862+0000","last_change":"2023-06-09T04:41:54.419307+0000","last_active":"2023-06-09T04:41:55.873862+0000","last_peered":"2023-06-09T04:41:55.873862+0000","last_clean":"2023-06-09T04:41:55.873862+0000","last_became_active":"2023-06-09T04:41:54.419053+0000","last_became_peered":"2023-06-09T04:41:54.419053+0000","last_unstale":"2023-06-09T04:41:55.873862+0000","last_undegraded":"2023-06-09T04:41:55.873862+0000","last_fullsized":"2023-06-09T04:41:55.873862+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:06:03.696521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.873723+0000","last_change":"2023-06-09T04:41:53.939038+0000","last_active":"2023-06-09T04:41:55.873723+0000","last_peered":"2023-06-09T04:41:55.873723+0000","last_clean":"2023-06-09T04:41:55.873723+0000","last_became_active":"2023-06-09T04:41:53.938781+0000","last_became_peered":"2023-06-09T04:41:53.938781+0000","last_unstale":"2023-06-09T04:41:55.873723+0000","last_undegraded":"2023-06-09T04:41:55.873723+0000","last_fullsized":"2023-06-09T04:41:55.873723+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_clean_scrub_stamp":"2023-06-09T04:41:52.888143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:55:01.113074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.873352+0000","last_change":"2023-06-09T04:41:48.978235+0000","last_active":"2023-06-09T04:41:55.873352+0000","last_peered":"2023-06-09T04:41:55.873352+0000","last_clean":"2023-06-09T04:41:55.873352+0000","last_became_active":"2023-06-09T04:41:48.977568+0000","last_became_peered":"2023-06-09T04:41:48.977568+0000","last_unstale":"2023-06-09T04:41:55.873352+0000","last_undegraded":"2023-06-09T04:41:55.873352+0000","last_fullsized":"2023-06-09T04:41:55.873352+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:47.838489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:47.838489+0000","last_clean_scrub_stamp":"2023-06-09T04:41:47.838489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:32:35.516622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.872976+0000","last_change":"2023-06-09T04:41:54.422440+0000","last_active":"2023-06-09T04:41:55.872976+0000","last_peered":"2023-06-09T04:41:55.872976+0000","last_clean":"2023-06-09T04:41:55.872976+0000","last_became_active":"2023-06-09T04:41:54.421701+0000","last_became_peered":"2023-06-09T04:41:54.421701+0000","last_unstale":"2023-06-09T04:41:55.872976+0000","last_undegraded":"2023-06-09T04:41:55.872976+0000","last_fullsized":"2023-06-09T04:41:55.872976+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:37:53.492624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"23'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.654758+0000","last_change":"2023-06-09T04:41:53.943578+0000","last_active":"2023-06-09T04:41:55.654758+0000","last_peered":"2023-06-09T04:41:55.654758+0000","last_clean":"2023-06-09T04:41:55.654758+0000","last_became_active":"2023-06-09T04:41:53.943305+0000","last_became_peered":"2023-06-09T04:41:53.943305+0000","last_unstale":"2023-06-09T04:41:55.654758+0000","last_undegraded":"2023-06-09T04:41:55.654758+0000","last_fullsized":"2023-06-09T04:41:55.654758+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_clean_scrub_stamp":"2023-06-09T04:41:52.888143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:32:13.248839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.874764+0000","last_change":"2023-06-09T04:41:48.877786+0000","last_active":"2023-06-09T04:41:55.874764+0000","last_peered":"2023-06-09T04:41:55.874764+0000","last_clean":"2023-06-09T04:41:55.874764+0000","last_became_active":"2023-06-09T04:41:48.877370+0000","last_became_peered":"2023-06-09T04:41:48.877370+0000","last_unstale":"2023-06-09T04:41:55.874764+0000","last_undegraded":"2023-06-09T04:41:55.874764+0000","last_fullsized":"2023-06-09T04:41:55.874764+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:47.838489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:47.838489+0000","last_clean_scrub_stamp":"2023-06-09T04:41:47.838489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:46:15.595937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.653828+0000","last_change":"2023-06-09T04:41:54.424286+0000","last_active":"2023-06-09T04:41:55.653828+0000","last_peered":"2023-06-09T04:41:55.653828+0000","last_clean":"2023-06-09T04:41:55.653828+0000","last_became_active":"2023-06-09T04:41:54.424012+0000","last_became_peered":"2023-06-09T04:41:54.424012+0000","last_unstale":"2023-06-09T04:41:55.653828+0000","last_undegraded":"2023-06-09T04:41:55.653828+0000","last_fullsized":"2023-06-09T04:41:55.653828+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:37:53.492624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"24'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:56.396542+0000","last_change":"2023-06-09T04:41:53.947520+0000","last_active":"2023-06-09T04:41:56.396542+0000","last_peered":"2023-06-09T04:41:56.396542+0000","last_clean":"2023-06-09T04:41:56.396542+0000","last_became_active":"2023-06-09T04:41:53.947160+0000","last_became_peered":"2023-06-09T04:41:53.947160+0000","last_unstale":"2023-06-09T04:41:56.396542+0000","last_undegraded":"2023-06-09T04:41:56.396542+0000","last_fullsized":"2023-06-09T04:41:56.396542+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_clean_scrub_stamp":"2023-06-09T04:41:52.888143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:02:14.053015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.407151+0000","last_change":"2023-06-09T04:41:48.880094+0000","last_active":"2023-06-09T04:41:55.407151+0000","last_peered":"2023-06-09T04:41:55.407151+0000","last_clean":"2023-06-09T04:41:55.407151+0000","last_became_active":"2023-06-09T04:41:48.879506+0000","last_became_peered":"2023-06-09T04:41:48.879506+0000","last_unstale":"2023-06-09T04:41:55.407151+0000","last_undegraded":"2023-06-09T04:41:55.407151+0000","last_fullsized":"2023-06-09T04:41:55.407151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:47.838489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:47.838489+0000","last_clean_scrub_stamp":"2023-06-09T04:41:47.838489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:59:58.200203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.407606+0000","last_change":"2023-06-09T04:41:54.426906+0000","last_active":"2023-06-09T04:41:55.407606+0000","last_peered":"2023-06-09T04:41:55.407606+0000","last_clean":"2023-06-09T04:41:55.407606+0000","last_became_active":"2023-06-09T04:41:54.426543+0000","last_became_peered":"2023-06-09T04:41:54.426543+0000","last_unstale":"2023-06-09T04:41:55.407606+0000","last_undegraded":"2023-06-09T04:41:55.407606+0000","last_fullsized":"2023-06-09T04:41:55.407606+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:34:10.329381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.408027+0000","last_change":"2023-06-09T04:41:54.425437+0000","last_active":"2023-06-09T04:41:55.408027+0000","last_peered":"2023-06-09T04:41:55.408027+0000","last_clean":"2023-06-09T04:41:55.408027+0000","last_became_active":"2023-06-09T04:41:54.425093+0000","last_became_peered":"2023-06-09T04:41:54.425093+0000","last_unstale":"2023-06-09T04:41:55.408027+0000","last_undegraded":"2023-06-09T04:41:55.408027+0000","last_fullsized":"2023-06-09T04:41:55.408027+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:35:38.355296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"23'6","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.408353+0000","last_change":"2023-06-09T04:41:53.946445+0000","last_active":"2023-06-09T04:41:55.408353+0000","last_peered":"2023-06-09T04:41:55.408353+0000","last_clean":"2023-06-09T04:41:55.408353+0000","last_became_active":"2023-06-09T04:41:53.942330+0000","last_became_peered":"2023-06-09T04:41:53.942330+0000","last_unstale":"2023-06-09T04:41:55.408353+0000","last_undegraded":"2023-06-09T04:41:55.408353+0000","last_fullsized":"2023-06-09T04:41:55.408353+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_clean_scrub_stamp":"2023-06-09T04:41:52.888143+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:37:16.212704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.873568+0000","last_change":"2023-06-09T04:41:54.423048+0000","last_active":"2023-06-09T04:41:55.873568+0000","last_peered":"2023-06-09T04:41:55.873568+0000","last_clean":"2023-06-09T04:41:55.873568+0000","last_became_active":"2023-06-09T04:41:54.422813+0000","last_became_peered":"2023-06-09T04:41:54.422813+0000","last_unstale":"2023-06-09T04:41:55.873568+0000","last_undegraded":"2023-06-09T04:41:55.873568+0000","last_fullsized":"2023-06-09T04:41:55.873568+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:34:10.329381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"23'3","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.872749+0000","last_change":"2023-06-09T04:41:53.947478+0000","last_active":"2023-06-09T04:41:55.872749+0000","last_peered":"2023-06-09T04:41:55.872749+0000","last_clean":"2023-06-09T04:41:55.872749+0000","last_became_active":"2023-06-09T04:41:53.947126+0000","last_became_peered":"2023-06-09T04:41:53.947126+0000","last_unstale":"2023-06-09T04:41:55.872749+0000","last_undegraded":"2023-06-09T04:41:55.872749+0000","last_fullsized":"2023-06-09T04:41:55.872749+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_clean_scrub_stamp":"2023-06-09T04:41:52.888143+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:01:03.915881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.874913+0000","last_change":"2023-06-09T04:41:53.943073+0000","last_active":"2023-06-09T04:41:55.874913+0000","last_peered":"2023-06-09T04:41:55.874913+0000","last_clean":"2023-06-09T04:41:55.874913+0000","last_became_active":"2023-06-09T04:41:53.942802+0000","last_became_peered":"2023-06-09T04:41:53.942802+0000","last_unstale":"2023-06-09T04:41:55.874913+0000","last_undegraded":"2023-06-09T04:41:55.874913+0000","last_fullsized":"2023-06-09T04:41:55.874913+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_clean_scrub_stamp":"2023-06-09T04:41:52.888143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:44:35.348425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.654252+0000","last_change":"2023-06-09T04:41:54.424894+0000","last_active":"2023-06-09T04:41:55.654252+0000","last_peered":"2023-06-09T04:41:55.654252+0000","last_clean":"2023-06-09T04:41:55.654252+0000","last_became_active":"2023-06-09T04:41:54.423546+0000","last_became_peered":"2023-06-09T04:41:54.423546+0000","last_unstale":"2023-06-09T04:41:55.654252+0000","last_undegraded":"2023-06-09T04:41:55.654252+0000","last_fullsized":"2023-06-09T04:41:55.654252+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:29:47.126124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.874732+0000","last_change":"2023-06-09T04:41:53.945046+0000","last_active":"2023-06-09T04:41:55.874732+0000","last_peered":"2023-06-09T04:41:55.874732+0000","last_clean":"2023-06-09T04:41:55.874732+0000","last_became_active":"2023-06-09T04:41:53.944775+0000","last_became_peered":"2023-06-09T04:41:53.944775+0000","last_unstale":"2023-06-09T04:41:55.874732+0000","last_undegraded":"2023-06-09T04:41:55.874732+0000","last_fullsized":"2023-06-09T04:41:55.874732+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_clean_scrub_stamp":"2023-06-09T04:41:52.888143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:46:20.645591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.653741+0000","last_change":"2023-06-09T04:41:54.412545+0000","last_active":"2023-06-09T04:41:55.653741+0000","last_peered":"2023-06-09T04:41:55.653741+0000","last_clean":"2023-06-09T04:41:55.653741+0000","last_became_active":"2023-06-09T04:41:54.412243+0000","last_became_peered":"2023-06-09T04:41:54.412243+0000","last_unstale":"2023-06-09T04:41:55.653741+0000","last_undegraded":"2023-06-09T04:41:55.653741+0000","last_fullsized":"2023-06-09T04:41:55.653741+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:02:22.299378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.406954+0000","last_change":"2023-06-09T04:41:54.424839+0000","last_active":"2023-06-09T04:41:55.406954+0000","last_peered":"2023-06-09T04:41:55.406954+0000","last_clean":"2023-06-09T04:41:55.406954+0000","last_became_active":"2023-06-09T04:41:54.424393+0000","last_became_peered":"2023-06-09T04:41:54.424393+0000","last_unstale":"2023-06-09T04:41:55.406954+0000","last_undegraded":"2023-06-09T04:41:55.406954+0000","last_fullsized":"2023-06-09T04:41:55.406954+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:49:19.500921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.654122+0000","last_change":"2023-06-09T04:41:53.946167+0000","last_active":"2023-06-09T04:41:55.654122+0000","last_peered":"2023-06-09T04:41:55.654122+0000","last_clean":"2023-06-09T04:41:55.654122+0000","last_became_active":"2023-06-09T04:41:53.945851+0000","last_became_peered":"2023-06-09T04:41:53.945851+0000","last_unstale":"2023-06-09T04:41:55.654122+0000","last_undegraded":"2023-06-09T04:41:55.654122+0000","last_fullsized":"2023-06-09T04:41:55.654122+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_clean_scrub_stamp":"2023-06-09T04:41:52.888143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:34:09.315377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.873175+0000","last_change":"2023-06-09T04:41:54.422093+0000","last_active":"2023-06-09T04:41:55.873175+0000","last_peered":"2023-06-09T04:41:55.873175+0000","last_clean":"2023-06-09T04:41:55.873175+0000","last_became_active":"2023-06-09T04:41:54.421470+0000","last_became_peered":"2023-06-09T04:41:54.421470+0000","last_unstale":"2023-06-09T04:41:55.873175+0000","last_undegraded":"2023-06-09T04:41:55.873175+0000","last_fullsized":"2023-06-09T04:41:55.873175+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:02:24.420270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.873487+0000","last_change":"2023-06-09T04:41:53.948249+0000","last_active":"2023-06-09T04:41:55.873487+0000","last_peered":"2023-06-09T04:41:55.873487+0000","last_clean":"2023-06-09T04:41:55.873487+0000","last_became_active":"2023-06-09T04:41:53.947922+0000","last_became_peered":"2023-06-09T04:41:53.947922+0000","last_unstale":"2023-06-09T04:41:55.873487+0000","last_undegraded":"2023-06-09T04:41:55.873487+0000","last_fullsized":"2023-06-09T04:41:55.873487+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_clean_scrub_stamp":"2023-06-09T04:41:52.888143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:03:21.713995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.654127+0000","last_change":"2023-06-09T04:41:54.414099+0000","last_active":"2023-06-09T04:41:55.654127+0000","last_peered":"2023-06-09T04:41:55.654127+0000","last_clean":"2023-06-09T04:41:55.654127+0000","last_became_active":"2023-06-09T04:41:54.413814+0000","last_became_peered":"2023-06-09T04:41:54.413814+0000","last_unstale":"2023-06-09T04:41:55.654127+0000","last_undegraded":"2023-06-09T04:41:55.654127+0000","last_fullsized":"2023-06-09T04:41:55.654127+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:55:02.127077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"23'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.407877+0000","last_change":"2023-06-09T04:41:53.946921+0000","last_active":"2023-06-09T04:41:55.407877+0000","last_peered":"2023-06-09T04:41:55.407877+0000","last_clean":"2023-06-09T04:41:55.407877+0000","last_became_active":"2023-06-09T04:41:53.946528+0000","last_became_peered":"2023-06-09T04:41:53.946528+0000","last_unstale":"2023-06-09T04:41:55.407877+0000","last_undegraded":"2023-06-09T04:41:55.407877+0000","last_fullsized":"2023-06-09T04:41:55.407877+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_clean_scrub_stamp":"2023-06-09T04:41:52.888143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:29:46.112121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.406923+0000","last_change":"2023-06-09T04:41:54.414420+0000","last_active":"2023-06-09T04:41:55.406923+0000","last_peered":"2023-06-09T04:41:55.406923+0000","last_clean":"2023-06-09T04:41:55.406923+0000","last_became_active":"2023-06-09T04:41:54.413915+0000","last_became_peered":"2023-06-09T04:41:54.413915+0000","last_unstale":"2023-06-09T04:41:55.406923+0000","last_undegraded":"2023-06-09T04:41:55.406923+0000","last_fullsized":"2023-06-09T04:41:55.406923+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:17:24.443064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.873918+0000","last_change":"2023-06-09T04:41:53.950753+0000","last_active":"2023-06-09T04:41:55.873918+0000","last_peered":"2023-06-09T04:41:55.873918+0000","last_clean":"2023-06-09T04:41:55.873918+0000","last_became_active":"2023-06-09T04:41:53.950440+0000","last_became_peered":"2023-06-09T04:41:53.950440+0000","last_unstale":"2023-06-09T04:41:55.873918+0000","last_undegraded":"2023-06-09T04:41:55.873918+0000","last_fullsized":"2023-06-09T04:41:55.873918+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_clean_scrub_stamp":"2023-06-09T04:41:52.888143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:29:46.112121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.407721+0000","last_change":"2023-06-09T04:41:54.432857+0000","last_active":"2023-06-09T04:41:55.407721+0000","last_peered":"2023-06-09T04:41:55.407721+0000","last_clean":"2023-06-09T04:41:55.407721+0000","last_became_active":"2023-06-09T04:41:54.432285+0000","last_became_peered":"2023-06-09T04:41:54.432285+0000","last_unstale":"2023-06-09T04:41:55.407721+0000","last_undegraded":"2023-06-09T04:41:55.407721+0000","last_fullsized":"2023-06-09T04:41:55.407721+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:06:03.696521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"23'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.874167+0000","last_change":"2023-06-09T04:41:53.948741+0000","last_active":"2023-06-09T04:41:55.874167+0000","last_peered":"2023-06-09T04:41:55.874167+0000","last_clean":"2023-06-09T04:41:55.874167+0000","last_became_active":"2023-06-09T04:41:53.948401+0000","last_became_peered":"2023-06-09T04:41:53.948401+0000","last_unstale":"2023-06-09T04:41:55.874167+0000","last_undegraded":"2023-06-09T04:41:55.874167+0000","last_fullsized":"2023-06-09T04:41:55.874167+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_clean_scrub_stamp":"2023-06-09T04:41:52.888143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:35:37.341293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.407534+0000","last_change":"2023-06-09T04:41:54.434317+0000","last_active":"2023-06-09T04:41:55.407534+0000","last_peered":"2023-06-09T04:41:55.407534+0000","last_clean":"2023-06-09T04:41:55.407534+0000","last_became_active":"2023-06-09T04:41:54.433815+0000","last_became_peered":"2023-06-09T04:41:54.433815+0000","last_unstale":"2023-06-09T04:41:55.407534+0000","last_undegraded":"2023-06-09T04:41:55.407534+0000","last_fullsized":"2023-06-09T04:41:55.407534+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:03:22.727998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"23'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.874939+0000","last_change":"2023-06-09T04:41:53.949030+0000","last_active":"2023-06-09T04:41:55.874939+0000","last_peered":"2023-06-09T04:41:55.874939+0000","last_clean":"2023-06-09T04:41:55.874939+0000","last_became_active":"2023-06-09T04:41:53.948417+0000","last_became_peered":"2023-06-09T04:41:53.948417+0000","last_unstale":"2023-06-09T04:41:55.874939+0000","last_undegraded":"2023-06-09T04:41:55.874939+0000","last_fullsized":"2023-06-09T04:41:55.874939+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_clean_scrub_stamp":"2023-06-09T04:41:52.888143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:03:49.057567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.654457+0000","last_change":"2023-06-09T04:41:54.402200+0000","last_active":"2023-06-09T04:41:55.654457+0000","last_peered":"2023-06-09T04:41:55.654457+0000","last_clean":"2023-06-09T04:41:55.654457+0000","last_became_active":"2023-06-09T04:41:54.401955+0000","last_became_peered":"2023-06-09T04:41:54.401955+0000","last_unstale":"2023-06-09T04:41:55.654457+0000","last_undegraded":"2023-06-09T04:41:55.654457+0000","last_fullsized":"2023-06-09T04:41:55.654457+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:50:09.575767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"23'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.654265+0000","last_change":"2023-06-09T04:41:53.946110+0000","last_active":"2023-06-09T04:41:55.654265+0000","last_peered":"2023-06-09T04:41:55.654265+0000","last_clean":"2023-06-09T04:41:55.654265+0000","last_became_active":"2023-06-09T04:41:53.945780+0000","last_became_peered":"2023-06-09T04:41:53.945780+0000","last_unstale":"2023-06-09T04:41:55.654265+0000","last_undegraded":"2023-06-09T04:41:55.654265+0000","last_fullsized":"2023-06-09T04:41:55.654265+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_clean_scrub_stamp":"2023-06-09T04:41:52.888143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:35:37.341293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.407217+0000","last_change":"2023-06-09T04:41:54.424850+0000","last_active":"2023-06-09T04:41:55.407217+0000","last_peered":"2023-06-09T04:41:55.407217+0000","last_clean":"2023-06-09T04:41:55.407217+0000","last_became_active":"2023-06-09T04:41:54.424507+0000","last_became_peered":"2023-06-09T04:41:54.424507+0000","last_unstale":"2023-06-09T04:41:55.407217+0000","last_undegraded":"2023-06-09T04:41:55.407217+0000","last_fullsized":"2023-06-09T04:41:55.407217+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:37:53.492624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"23'4","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.874082+0000","last_change":"2023-06-09T04:41:53.940256+0000","last_active":"2023-06-09T04:41:55.874082+0000","last_peered":"2023-06-09T04:41:55.874082+0000","last_clean":"2023-06-09T04:41:55.874082+0000","last_became_active":"2023-06-09T04:41:53.939890+0000","last_became_peered":"2023-06-09T04:41:53.939890+0000","last_unstale":"2023-06-09T04:41:55.874082+0000","last_undegraded":"2023-06-09T04:41:55.874082+0000","last_fullsized":"2023-06-09T04:41:55.874082+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_clean_scrub_stamp":"2023-06-09T04:41:52.888143+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:48:33.879868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":856,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":876544,"data_stored":686418,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.206}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4379999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.591}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.669}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9319999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.2549999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.173}]}]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":253952,"data_stored":94270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.956}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.014}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0750000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.1160000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95899999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1899999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2529999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":262144,"data_stored":94922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2589999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.099}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3959999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4379999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5740000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5049999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3109999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":274432,"data_stored":95890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1519999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.399}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3240000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0049999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4570000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.427}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27204,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344636,"statfs":{"total":96636764160,"available":96608907264,"internally_reserved":0,"allocated":258048,"data_stored":94360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93700000000000006}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80200000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.208}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2709999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1519999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5569999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":253952,"data_stored":94270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.753}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.514}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.028}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3100000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.401}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":253952,"data_stored":94270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1060000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93300000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86699999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0649999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2649999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27784,"kb_used_data":832,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344056,"statfs":{"total":96636764160,"available":96608313344,"internally_reserved":0,"allocated":851968,"data_stored":685220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73099999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1719999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3140000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1990000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4830000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-09T04:42:04.833 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-09T04:42:05.039 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.031+0000 7f9e9b59e700 1 Processor -- start 2023-06-09T04:42:05.039 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.035+0000 7f9e9b59e700 1 -- start start 2023-06-09T04:42:05.041 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.035+0000 7f9e9b59e700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9e9c0b18d0 0x7f9e9c160920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:05.041 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.035+0000 7f9e9b59e700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f9e9c0b1ca0 0x7f9e9c0cee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:05.041 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.035+0000 7f9e9b59e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9e9c0d2400 0x7f9e9c0d28a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:05.041 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.035+0000 7f9e9b59e700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e9c15c6b0 con 0x7f9e9c0b1ca0 2023-06-09T04:42:05.041 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.035+0000 7f9e9b59e700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e9c0d2de0 con 0x7f9e9c0b18d0 2023-06-09T04:42:05.041 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.035+0000 7f9e9b59e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e9c0cf3d0 con 0x7f9e9c0d2400 2023-06-09T04:42:05.042 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.035+0000 7f9e99d9b700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f9e9c0b1ca0 0x7f9e9c0cee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:05.043 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.035+0000 7f9e99d9b700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f9e9c0b1ca0 0x7f9e9c0cee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:33790/0 (socket says 172.21.15.90:33790) 2023-06-09T04:42:05.043 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.035+0000 7f9e99d9b700 1 -- 172.21.15.90:0/1932093019 learned_addr learned my addr 172.21.15.90:0/1932093019 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:05.043 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.035+0000 7f9e9ad9d700 1 --2- 172.21.15.90:0/1932093019 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9e9c0d2400 0x7f9e9c0d28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:05.043 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.035+0000 7f9e9a59c700 1 --2- 172.21.15.90:0/1932093019 >> v2:172.21.15.174:3300/0 conn(0x7f9e9c0b18d0 0x7f9e9c160920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:05.043 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.035+0000 7f9e99d9b700 1 -- 172.21.15.90:0/1932093019 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9e9c0d2400 msgr2=0x7f9e9c0d28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:05.043 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.035+0000 7f9e99d9b700 1 --2- 172.21.15.90:0/1932093019 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9e9c0d2400 0x7f9e9c0d28a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:05.043 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.035+0000 7f9e99d9b700 1 -- 172.21.15.90:0/1932093019 >> v2:172.21.15.174:3300/0 conn(0x7f9e9c0b18d0 msgr2=0x7f9e9c160920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:05.043 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.035+0000 7f9e99d9b700 1 --2- 172.21.15.90:0/1932093019 >> v2:172.21.15.174:3300/0 conn(0x7f9e9c0b18d0 0x7f9e9c160920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:05.044 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.035+0000 7f9e99d9b700 1 -- 172.21.15.90:0/1932093019 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e9c0cf6a0 con 0x7f9e9c0b1ca0 2023-06-09T04:42:05.044 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.035+0000 7f9e99d9b700 1 --2- 172.21.15.90:0/1932093019 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9e9c0b1ca0 0x7f9e9c0cee90 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f9e9c066ca0 tx=0x7f9e90009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7defbc6314b528b0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:05.044 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.039+0000 7f9e9959a700 1 -- 172.21.15.90:0/1932093019 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e90011830 con 0x7f9e9c0b1ca0 2023-06-09T04:42:05.045 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.039+0000 7f9e9959a700 1 -- 172.21.15.90:0/1932093019 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e90011990 con 0x7f9e9c0b1ca0 2023-06-09T04:42:05.045 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.039+0000 7f9e9959a700 1 -- 172.21.15.90:0/1932093019 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e90011d20 con 0x7f9e9c0b1ca0 2023-06-09T04:42:05.045 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.039+0000 7f9e9b59e700 1 -- 172.21.15.90:0/1932093019 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9e9c0b1ca0 msgr2=0x7f9e9c0cee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:05.045 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.039+0000 7f9e9b59e700 1 --2- 172.21.15.90:0/1932093019 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9e9c0b1ca0 0x7f9e9c0cee90 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f9e9c066ca0 tx=0x7f9e90009bf0 comp rx=0 tx=0).stop 2023-06-09T04:42:05.045 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.039+0000 7f9e9b59e700 1 -- 172.21.15.90:0/1932093019 shutdown_connections 2023-06-09T04:42:05.045 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.039+0000 7f9e9b59e700 1 --2- 172.21.15.90:0/1932093019 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9e9c0d2400 0x7f9e9c0d28a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:05.046 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.039+0000 7f9e9b59e700 1 --2- 172.21.15.90:0/1932093019 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9e9c0b1ca0 0x7f9e9c0cee90 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:05.046 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.039+0000 7f9e9b59e700 1 --2- 172.21.15.90:0/1932093019 >> v2:172.21.15.174:3300/0 conn(0x7f9e9c0b18d0 0x7f9e9c160920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:05.046 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.039+0000 7f9e9b59e700 1 -- 172.21.15.90:0/1932093019 >> 172.21.15.90:0/1932093019 conn(0x7f9e9c09b9b0 msgr2=0x7f9e9c0b55d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:05.046 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.039+0000 7f9e9b59e700 1 -- 172.21.15.90:0/1932093019 shutdown_connections 2023-06-09T04:42:05.046 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.039+0000 7f9e9b59e700 1 -- 172.21.15.90:0/1932093019 wait complete. 2023-06-09T04:42:05.047 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.043+0000 7f9e9b59e700 1 Processor -- start 2023-06-09T04:42:05.047 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.043+0000 7f9e9b59e700 1 -- start start 2023-06-09T04:42:05.048 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.043+0000 7f9e9b59e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9e9c0b18d0 0x7f9e9c159510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:05.048 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.043+0000 7f9e9b59e700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9e9c0b1ca0 0x7f9e9c0cb530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:05.049 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.043+0000 7f9e9b59e700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9e9c0d2400 0x7f9e9c0cba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:05.049 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.043+0000 7f9e9b59e700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e9c159a50 con 0x7f9e9c0d2400 2023-06-09T04:42:05.049 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.043+0000 7f9e9b59e700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e9c0b2b90 con 0x7f9e9c0b1ca0 2023-06-09T04:42:05.049 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.043+0000 7f9e9b59e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e9c0b36c0 con 0x7f9e9c0b18d0 2023-06-09T04:42:05.050 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.043+0000 7f9e9ad9d700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9e9c0d2400 0x7f9e9c0cba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:05.050 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.043+0000 7f9e9ad9d700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9e9c0d2400 0x7f9e9c0cba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:33800/0 (socket says 172.21.15.90:33800) 2023-06-09T04:42:05.050 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.043+0000 7f9e9ad9d700 1 -- 172.21.15.90:0/3384898599 learned_addr learned my addr 172.21.15.90:0/3384898599 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:05.051 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.043+0000 7f9e9a59c700 1 --2- 172.21.15.90:0/3384898599 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9e9c0b18d0 0x7f9e9c159510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:05.051 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.043+0000 7f9e99d9b700 1 --2- 172.21.15.90:0/3384898599 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9e9c0b1ca0 0x7f9e9c0cb530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:05.051 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.043+0000 7f9e9ad9d700 1 -- 172.21.15.90:0/3384898599 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9e9c0b18d0 msgr2=0x7f9e9c159510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:05.051 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.043+0000 7f9e9ad9d700 1 --2- 172.21.15.90:0/3384898599 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9e9c0b18d0 0x7f9e9c159510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:05.051 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.043+0000 7f9e9ad9d700 1 -- 172.21.15.90:0/3384898599 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9e9c0b1ca0 msgr2=0x7f9e9c0cb530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:05.051 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.043+0000 7f9e9ad9d700 1 --2- 172.21.15.90:0/3384898599 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9e9c0b1ca0 0x7f9e9c0cb530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:05.051 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.043+0000 7f9e9ad9d700 1 -- 172.21.15.90:0/3384898599 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e90009570 con 0x7f9e9c0d2400 2023-06-09T04:42:05.052 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.043+0000 7f9e9a59c700 1 --2- 172.21.15.90:0/3384898599 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9e9c0b18d0 0x7f9e9c159510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:42:05.052 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.043+0000 7f9e99d9b700 1 --2- 172.21.15.90:0/3384898599 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9e9c0b1ca0 0x7f9e9c0cb530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:42:05.052 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.043+0000 7f9e9ad9d700 1 --2- 172.21.15.90:0/3384898599 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9e9c0d2400 0x7f9e9c0cba70 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f9e94009d30 tx=0x7f9e9400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:05.052 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.043+0000 7f9e8affd700 1 -- 172.21.15.90:0/3384898599 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e94009ba0 con 0x7f9e9c0d2400 2023-06-09T04:42:05.052 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.043+0000 7f9e8affd700 1 -- 172.21.15.90:0/3384898599 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e9400f040 con 0x7f9e9c0d2400 2023-06-09T04:42:05.052 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.043+0000 7f9e8affd700 1 -- 172.21.15.90:0/3384898599 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e94014480 con 0x7f9e9c0d2400 2023-06-09T04:42:05.052 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.043+0000 7f9e9b59e700 1 -- 172.21.15.90:0/3384898599 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e9c0ca130 con 0x7f9e9c0d2400 2023-06-09T04:42:05.053 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.043+0000 7f9e9b59e700 1 -- 172.21.15.90:0/3384898599 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e9c0cac10 con 0x7f9e9c0d2400 2023-06-09T04:42:05.053 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.047+0000 7f9e9b59e700 1 -- 172.21.15.90:0/3384898599 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e9c04e380 con 0x7f9e9c0d2400 2023-06-09T04:42:05.054 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.047+0000 7f9e8affd700 1 -- 172.21.15.90:0/3384898599 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9e940145e0 con 0x7f9e9c0d2400 2023-06-09T04:42:05.056 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.051+0000 7f9e8affd700 1 --2- 172.21.15.90:0/3384898599 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f9e7c0662f0 0x7f9e7c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:05.056 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.051+0000 7f9e8affd700 1 -- 172.21.15.90:0/3384898599 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9e94084530 con 0x7f9e9c0d2400 2023-06-09T04:42:05.056 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.051+0000 7f9e9a59c700 1 --2- 172.21.15.90:0/3384898599 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f9e7c0662f0 0x7f9e7c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:05.057 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.051+0000 7f9e9a59c700 1 --2- 172.21.15.90:0/3384898599 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f9e7c0662f0 0x7f9e7c0687a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f9e8c009bb0 tx=0x7f9e8c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:05.062 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.055+0000 7f9e8affd700 1 -- 172.21.15.90:0/3384898599 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9e94051910 con 0x7f9e9c0d2400 2023-06-09T04:42:05.219 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.211+0000 7f9e9b59e700 1 -- 172.21.15.90:0/3384898599 --> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9e9c0cf980 con 0x7f9e7c0662f0 2023-06-09T04:42:05.235 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.231+0000 7f9e8affd700 1 -- 172.21.15.90:0/3384898599 <== mgr.4104 v2:172.21.15.174:6832/1389974754 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286496 (secure 0 0 0) 0x7f9e8c005a40 con 0x7f9e7c0662f0 2023-06-09T04:42:05.237 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:42:05.243 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.235+0000 7f9e9b59e700 1 -- 172.21.15.90:0/3384898599 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f9e7c0662f0 msgr2=0x7f9e7c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:05.243 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.235+0000 7f9e9b59e700 1 --2- 172.21.15.90:0/3384898599 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f9e7c0662f0 0x7f9e7c0687a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f9e8c009bb0 tx=0x7f9e8c008040 comp rx=0 tx=0).stop 2023-06-09T04:42:05.243 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.235+0000 7f9e9b59e700 1 -- 172.21.15.90:0/3384898599 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9e9c0d2400 msgr2=0x7f9e9c0cba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:05.244 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.235+0000 7f9e9b59e700 1 --2- 172.21.15.90:0/3384898599 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9e9c0d2400 0x7f9e9c0cba70 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f9e94009d30 tx=0x7f9e9400c3a0 comp rx=0 tx=0).stop 2023-06-09T04:42:05.244 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.239+0000 7f9e9b59e700 1 -- 172.21.15.90:0/3384898599 shutdown_connections 2023-06-09T04:42:05.244 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.239+0000 7f9e9b59e700 1 --2- 172.21.15.90:0/3384898599 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f9e7c0662f0 0x7f9e7c0687a0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:05.244 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.239+0000 7f9e9b59e700 1 --2- 172.21.15.90:0/3384898599 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9e9c0d2400 0x7f9e9c0cba70 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:05.244 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.239+0000 7f9e9b59e700 1 --2- 172.21.15.90:0/3384898599 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9e9c0b1ca0 0x7f9e9c0cb530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:05.244 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.239+0000 7f9e9b59e700 1 --2- 172.21.15.90:0/3384898599 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9e9c0b18d0 0x7f9e9c159510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:05.244 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.239+0000 7f9e9b59e700 1 -- 172.21.15.90:0/3384898599 >> 172.21.15.90:0/3384898599 conn(0x7f9e9c09b9b0 msgr2=0x7f9e9c0b7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:05.245 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.239+0000 7f9e9b59e700 1 -- 172.21.15.90:0/3384898599 shutdown_connections 2023-06-09T04:42:05.245 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.239+0000 7f9e9b59e700 1 -- 172.21.15.90:0/3384898599 wait complete. 2023-06-09T04:42:05.245 INFO:teuthology.orchestra.run.smithi090.stderr:dumped all 2023-06-09T04:42:05.265 INFO:teuthology.orchestra.run.smithi090.stdout:{"pg_ready":true,"pg_map":{"version":29,"stamp":"2023-06-09T04:42:04.314762+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218824,"kb_used_data":3208,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754755896,"statfs":{"total":773094113280,"available":772870037504,"internally_reserved":0,"allocated":3284992,"data_stored":1939620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.921761"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.406944+0000","last_change":"2023-06-09T04:41:54.403483+0000","last_active":"2023-06-09T04:41:55.406944+0000","last_peered":"2023-06-09T04:41:55.406944+0000","last_clean":"2023-06-09T04:41:55.406944+0000","last_became_active":"2023-06-09T04:41:54.403189+0000","last_became_peered":"2023-06-09T04:41:54.403189+0000","last_unstale":"2023-06-09T04:41:55.406944+0000","last_undegraded":"2023-06-09T04:41:55.406944+0000","last_fullsized":"2023-06-09T04:41:55.406944+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:45:23.237006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.874307+0000","last_change":"2023-06-09T04:41:54.417816+0000","last_active":"2023-06-09T04:41:55.874307+0000","last_peered":"2023-06-09T04:41:55.874307+0000","last_clean":"2023-06-09T04:41:55.874307+0000","last_became_active":"2023-06-09T04:41:54.417523+0000","last_became_peered":"2023-06-09T04:41:54.417523+0000","last_unstale":"2023-06-09T04:41:55.874307+0000","last_undegraded":"2023-06-09T04:41:55.874307+0000","last_fullsized":"2023-06-09T04:41:55.874307+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:02:15.067018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.408132+0000","last_change":"2023-06-09T04:41:54.434121+0000","last_active":"2023-06-09T04:41:55.408132+0000","last_peered":"2023-06-09T04:41:55.408132+0000","last_clean":"2023-06-09T04:41:55.408132+0000","last_became_active":"2023-06-09T04:41:54.433774+0000","last_became_peered":"2023-06-09T04:41:54.433774+0000","last_unstale":"2023-06-09T04:41:55.408132+0000","last_undegraded":"2023-06-09T04:41:55.408132+0000","last_fullsized":"2023-06-09T04:41:55.408132+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:50:09.575767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.406854+0000","last_change":"2023-06-09T04:41:54.424411+0000","last_active":"2023-06-09T04:41:55.406854+0000","last_peered":"2023-06-09T04:41:55.406854+0000","last_clean":"2023-06-09T04:41:55.406854+0000","last_became_active":"2023-06-09T04:41:54.423966+0000","last_became_peered":"2023-06-09T04:41:54.423966+0000","last_unstale":"2023-06-09T04:41:55.406854+0000","last_undegraded":"2023-06-09T04:41:55.406854+0000","last_fullsized":"2023-06-09T04:41:55.406854+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:45:08.259045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.873607+0000","last_change":"2023-06-09T04:41:54.414192+0000","last_active":"2023-06-09T04:41:55.873607+0000","last_peered":"2023-06-09T04:41:55.873607+0000","last_clean":"2023-06-09T04:41:55.873607+0000","last_became_active":"2023-06-09T04:41:54.413938+0000","last_became_peered":"2023-06-09T04:41:54.413938+0000","last_unstale":"2023-06-09T04:41:55.873607+0000","last_undegraded":"2023-06-09T04:41:55.873607+0000","last_fullsized":"2023-06-09T04:41:55.873607+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:34:10.329381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.407620+0000","last_change":"2023-06-09T04:41:54.434214+0000","last_active":"2023-06-09T04:41:55.407620+0000","last_peered":"2023-06-09T04:41:55.407620+0000","last_clean":"2023-06-09T04:41:55.407620+0000","last_became_active":"2023-06-09T04:41:54.433495+0000","last_became_peered":"2023-06-09T04:41:54.433495+0000","last_unstale":"2023-06-09T04:41:55.407620+0000","last_undegraded":"2023-06-09T04:41:55.407620+0000","last_fullsized":"2023-06-09T04:41:55.407620+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:55:02.127077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.872502+0000","last_change":"2023-06-09T04:41:54.419655+0000","last_active":"2023-06-09T04:41:55.872502+0000","last_peered":"2023-06-09T04:41:55.872502+0000","last_clean":"2023-06-09T04:41:55.872502+0000","last_became_active":"2023-06-09T04:41:54.419050+0000","last_became_peered":"2023-06-09T04:41:54.419050+0000","last_unstale":"2023-06-09T04:41:55.872502+0000","last_undegraded":"2023-06-09T04:41:55.872502+0000","last_fullsized":"2023-06-09T04:41:55.872502+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:50:09.575767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.873689+0000","last_change":"2023-06-09T04:41:54.437218+0000","last_active":"2023-06-09T04:41:55.873689+0000","last_peered":"2023-06-09T04:41:55.873689+0000","last_clean":"2023-06-09T04:41:55.873689+0000","last_became_active":"2023-06-09T04:41:54.436898+0000","last_became_peered":"2023-06-09T04:41:54.436898+0000","last_unstale":"2023-06-09T04:41:55.873689+0000","last_undegraded":"2023-06-09T04:41:55.873689+0000","last_fullsized":"2023-06-09T04:41:55.873689+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:34:10.329381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.873735+0000","last_change":"2023-06-09T04:41:54.417378+0000","last_active":"2023-06-09T04:41:55.873735+0000","last_peered":"2023-06-09T04:41:55.873735+0000","last_clean":"2023-06-09T04:41:55.873735+0000","last_became_active":"2023-06-09T04:41:54.416459+0000","last_became_peered":"2023-06-09T04:41:54.416459+0000","last_unstale":"2023-06-09T04:41:55.873735+0000","last_undegraded":"2023-06-09T04:41:55.873735+0000","last_fullsized":"2023-06-09T04:41:55.873735+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:55:02.127077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.874681+0000","last_change":"2023-06-09T04:41:54.417848+0000","last_active":"2023-06-09T04:41:55.874681+0000","last_peered":"2023-06-09T04:41:55.874681+0000","last_clean":"2023-06-09T04:41:55.874681+0000","last_became_active":"2023-06-09T04:41:54.417560+0000","last_became_peered":"2023-06-09T04:41:54.417560+0000","last_unstale":"2023-06-09T04:41:55.874681+0000","last_undegraded":"2023-06-09T04:41:55.874681+0000","last_fullsized":"2023-06-09T04:41:55.874681+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:46:21.659594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.408404+0000","last_change":"2023-06-09T04:41:54.434090+0000","last_active":"2023-06-09T04:41:55.408404+0000","last_peered":"2023-06-09T04:41:55.408404+0000","last_clean":"2023-06-09T04:41:55.408404+0000","last_became_active":"2023-06-09T04:41:54.433687+0000","last_became_peered":"2023-06-09T04:41:54.433687+0000","last_unstale":"2023-06-09T04:41:55.408404+0000","last_undegraded":"2023-06-09T04:41:55.408404+0000","last_fullsized":"2023-06-09T04:41:55.408404+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:44:36.362428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.406772+0000","last_change":"2023-06-09T04:41:54.437425+0000","last_active":"2023-06-09T04:41:55.406772+0000","last_peered":"2023-06-09T04:41:55.406772+0000","last_clean":"2023-06-09T04:41:55.406772+0000","last_became_active":"2023-06-09T04:41:54.437149+0000","last_became_peered":"2023-06-09T04:41:54.437149+0000","last_unstale":"2023-06-09T04:41:55.406772+0000","last_undegraded":"2023-06-09T04:41:55.406772+0000","last_fullsized":"2023-06-09T04:41:55.406772+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:44:39.043853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.406611+0000","last_change":"2023-06-09T04:41:54.406715+0000","last_active":"2023-06-09T04:41:55.406611+0000","last_peered":"2023-06-09T04:41:55.406611+0000","last_clean":"2023-06-09T04:41:55.406611+0000","last_became_active":"2023-06-09T04:41:54.406316+0000","last_became_peered":"2023-06-09T04:41:54.406316+0000","last_unstale":"2023-06-09T04:41:55.406611+0000","last_undegraded":"2023-06-09T04:41:55.406611+0000","last_fullsized":"2023-06-09T04:41:55.406611+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:40:08.604981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.873902+0000","last_change":"2023-06-09T04:41:54.405717+0000","last_active":"2023-06-09T04:41:55.873902+0000","last_peered":"2023-06-09T04:41:55.873902+0000","last_clean":"2023-06-09T04:41:55.873902+0000","last_became_active":"2023-06-09T04:41:54.405412+0000","last_became_peered":"2023-06-09T04:41:54.405412+0000","last_unstale":"2023-06-09T04:41:55.873902+0000","last_undegraded":"2023-06-09T04:41:55.873902+0000","last_fullsized":"2023-06-09T04:41:55.873902+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:55:02.127077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.872713+0000","last_change":"2023-06-09T04:41:54.419861+0000","last_active":"2023-06-09T04:41:55.872713+0000","last_peered":"2023-06-09T04:41:55.872713+0000","last_clean":"2023-06-09T04:41:55.872713+0000","last_became_active":"2023-06-09T04:41:54.419404+0000","last_became_peered":"2023-06-09T04:41:54.419404+0000","last_unstale":"2023-06-09T04:41:55.872713+0000","last_undegraded":"2023-06-09T04:41:55.872713+0000","last_fullsized":"2023-06-09T04:41:55.872713+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:46:21.659594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.407159+0000","last_change":"2023-06-09T04:41:54.433128+0000","last_active":"2023-06-09T04:41:55.407159+0000","last_peered":"2023-06-09T04:41:55.407159+0000","last_clean":"2023-06-09T04:41:55.407159+0000","last_became_active":"2023-06-09T04:41:54.432642+0000","last_became_peered":"2023-06-09T04:41:54.432642+0000","last_unstale":"2023-06-09T04:41:55.407159+0000","last_undegraded":"2023-06-09T04:41:55.407159+0000","last_fullsized":"2023-06-09T04:41:55.407159+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:01:41.876981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.873916+0000","last_change":"2023-06-09T04:41:54.416438+0000","last_active":"2023-06-09T04:41:55.873916+0000","last_peered":"2023-06-09T04:41:55.873916+0000","last_clean":"2023-06-09T04:41:55.873916+0000","last_became_active":"2023-06-09T04:41:54.416180+0000","last_became_peered":"2023-06-09T04:41:54.416180+0000","last_unstale":"2023-06-09T04:41:55.873916+0000","last_undegraded":"2023-06-09T04:41:55.873916+0000","last_fullsized":"2023-06-09T04:41:55.873916+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:35:38.355296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.408577+0000","last_change":"2023-06-09T04:41:54.433381+0000","last_active":"2023-06-09T04:41:55.408577+0000","last_peered":"2023-06-09T04:41:55.408577+0000","last_clean":"2023-06-09T04:41:55.408577+0000","last_became_active":"2023-06-09T04:41:54.433196+0000","last_became_peered":"2023-06-09T04:41:54.433196+0000","last_unstale":"2023-06-09T04:41:55.408577+0000","last_undegraded":"2023-06-09T04:41:55.408577+0000","last_fullsized":"2023-06-09T04:41:55.408577+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:20:06.903346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.406837+0000","last_change":"2023-06-09T04:41:54.427593+0000","last_active":"2023-06-09T04:41:55.406837+0000","last_peered":"2023-06-09T04:41:55.406837+0000","last_clean":"2023-06-09T04:41:55.406837+0000","last_became_active":"2023-06-09T04:41:54.427307+0000","last_became_peered":"2023-06-09T04:41:54.427307+0000","last_unstale":"2023-06-09T04:41:55.406837+0000","last_undegraded":"2023-06-09T04:41:55.406837+0000","last_fullsized":"2023-06-09T04:41:55.406837+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:07:19.100918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.408060+0000","last_change":"2023-06-09T04:41:54.436029+0000","last_active":"2023-06-09T04:41:55.408060+0000","last_peered":"2023-06-09T04:41:55.408060+0000","last_clean":"2023-06-09T04:41:55.408060+0000","last_became_active":"2023-06-09T04:41:54.435786+0000","last_became_peered":"2023-06-09T04:41:54.435786+0000","last_unstale":"2023-06-09T04:41:55.408060+0000","last_undegraded":"2023-06-09T04:41:55.408060+0000","last_fullsized":"2023-06-09T04:41:55.408060+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:02:15.067018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.872831+0000","last_change":"2023-06-09T04:41:54.415714+0000","last_active":"2023-06-09T04:41:55.872831+0000","last_peered":"2023-06-09T04:41:55.872831+0000","last_clean":"2023-06-09T04:41:55.872831+0000","last_became_active":"2023-06-09T04:41:54.415422+0000","last_became_peered":"2023-06-09T04:41:54.415422+0000","last_unstale":"2023-06-09T04:41:55.872831+0000","last_undegraded":"2023-06-09T04:41:55.872831+0000","last_fullsized":"2023-06-09T04:41:55.872831+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:44:36.362428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.874142+0000","last_change":"2023-06-09T04:41:54.421187+0000","last_active":"2023-06-09T04:41:55.874142+0000","last_peered":"2023-06-09T04:41:55.874142+0000","last_clean":"2023-06-09T04:41:55.874142+0000","last_became_active":"2023-06-09T04:41:54.420916+0000","last_became_peered":"2023-06-09T04:41:54.420916+0000","last_unstale":"2023-06-09T04:41:55.874142+0000","last_undegraded":"2023-06-09T04:41:55.874142+0000","last_fullsized":"2023-06-09T04:41:55.874142+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:50:09.575767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.654195+0000","last_change":"2023-06-09T04:41:54.413591+0000","last_active":"2023-06-09T04:41:55.654195+0000","last_peered":"2023-06-09T04:41:55.654195+0000","last_clean":"2023-06-09T04:41:55.654195+0000","last_became_active":"2023-06-09T04:41:54.413258+0000","last_became_peered":"2023-06-09T04:41:54.413258+0000","last_unstale":"2023-06-09T04:41:55.654195+0000","last_undegraded":"2023-06-09T04:41:55.654195+0000","last_fullsized":"2023-06-09T04:41:55.654195+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:06:03.696521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.872978+0000","last_change":"2023-06-09T04:41:54.426948+0000","last_active":"2023-06-09T04:41:55.872978+0000","last_peered":"2023-06-09T04:41:55.872978+0000","last_clean":"2023-06-09T04:41:55.872978+0000","last_became_active":"2023-06-09T04:41:54.424537+0000","last_became_peered":"2023-06-09T04:41:54.424537+0000","last_unstale":"2023-06-09T04:41:55.872978+0000","last_undegraded":"2023-06-09T04:41:55.872978+0000","last_fullsized":"2023-06-09T04:41:55.872978+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:02:42.425459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.874331+0000","last_change":"2023-06-09T04:41:54.423154+0000","last_active":"2023-06-09T04:41:55.874331+0000","last_peered":"2023-06-09T04:41:55.874331+0000","last_clean":"2023-06-09T04:41:55.874331+0000","last_became_active":"2023-06-09T04:41:54.422890+0000","last_became_peered":"2023-06-09T04:41:54.422890+0000","last_unstale":"2023-06-09T04:41:55.874331+0000","last_undegraded":"2023-06-09T04:41:55.874331+0000","last_fullsized":"2023-06-09T04:41:55.874331+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:02:15.067018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.874778+0000","last_change":"2023-06-09T04:41:54.411853+0000","last_active":"2023-06-09T04:41:55.874778+0000","last_peered":"2023-06-09T04:41:55.874778+0000","last_clean":"2023-06-09T04:41:55.874778+0000","last_became_active":"2023-06-09T04:41:54.411513+0000","last_became_peered":"2023-06-09T04:41:54.411513+0000","last_unstale":"2023-06-09T04:41:55.874778+0000","last_undegraded":"2023-06-09T04:41:55.874778+0000","last_fullsized":"2023-06-09T04:41:55.874778+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:32:14.262842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.874581+0000","last_change":"2023-06-09T04:41:54.423403+0000","last_active":"2023-06-09T04:41:55.874581+0000","last_peered":"2023-06-09T04:41:55.874581+0000","last_clean":"2023-06-09T04:41:55.874581+0000","last_became_active":"2023-06-09T04:41:54.422935+0000","last_became_peered":"2023-06-09T04:41:54.422935+0000","last_unstale":"2023-06-09T04:41:55.874581+0000","last_undegraded":"2023-06-09T04:41:55.874581+0000","last_fullsized":"2023-06-09T04:41:55.874581+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:50:09.575767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.874025+0000","last_change":"2023-06-09T04:41:54.416963+0000","last_active":"2023-06-09T04:41:55.874025+0000","last_peered":"2023-06-09T04:41:55.874025+0000","last_clean":"2023-06-09T04:41:55.874025+0000","last_became_active":"2023-06-09T04:41:54.416720+0000","last_became_peered":"2023-06-09T04:41:54.416720+0000","last_unstale":"2023-06-09T04:41:55.874025+0000","last_undegraded":"2023-06-09T04:41:55.874025+0000","last_fullsized":"2023-06-09T04:41:55.874025+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:29:47.126124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.654421+0000","last_change":"2023-06-09T04:41:54.425010+0000","last_active":"2023-06-09T04:41:55.654421+0000","last_peered":"2023-06-09T04:41:55.654421+0000","last_clean":"2023-06-09T04:41:55.654421+0000","last_became_active":"2023-06-09T04:41:54.423548+0000","last_became_peered":"2023-06-09T04:41:54.423548+0000","last_unstale":"2023-06-09T04:41:55.654421+0000","last_undegraded":"2023-06-09T04:41:55.654421+0000","last_fullsized":"2023-06-09T04:41:55.654421+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:02:15.067018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.408322+0000","last_change":"2023-06-09T04:41:54.433955+0000","last_active":"2023-06-09T04:41:55.408322+0000","last_peered":"2023-06-09T04:41:55.408322+0000","last_clean":"2023-06-09T04:41:55.408322+0000","last_became_active":"2023-06-09T04:41:54.433402+0000","last_became_peered":"2023-06-09T04:41:54.433402+0000","last_unstale":"2023-06-09T04:41:55.408322+0000","last_undegraded":"2023-06-09T04:41:55.408322+0000","last_fullsized":"2023-06-09T04:41:55.408322+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:46:21.659594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.653882+0000","last_change":"2023-06-09T04:41:54.412120+0000","last_active":"2023-06-09T04:41:55.653882+0000","last_peered":"2023-06-09T04:41:55.653882+0000","last_clean":"2023-06-09T04:41:55.653882+0000","last_became_active":"2023-06-09T04:41:54.411844+0000","last_became_peered":"2023-06-09T04:41:54.411844+0000","last_unstale":"2023-06-09T04:41:55.653882+0000","last_undegraded":"2023-06-09T04:41:55.653882+0000","last_fullsized":"2023-06-09T04:41:55.653882+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:02:24.420270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.406356+0000","last_change":"2023-06-09T04:41:54.429251+0000","last_active":"2023-06-09T04:41:55.406356+0000","last_peered":"2023-06-09T04:41:55.406356+0000","last_clean":"2023-06-09T04:41:55.406356+0000","last_became_active":"2023-06-09T04:41:54.428359+0000","last_became_peered":"2023-06-09T04:41:54.428359+0000","last_unstale":"2023-06-09T04:41:55.406356+0000","last_undegraded":"2023-06-09T04:41:55.406356+0000","last_fullsized":"2023-06-09T04:41:55.406356+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:11:53.056966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.654119+0000","last_change":"2023-06-09T04:41:54.429333+0000","last_active":"2023-06-09T04:41:55.654119+0000","last_peered":"2023-06-09T04:41:55.654119+0000","last_clean":"2023-06-09T04:41:55.654119+0000","last_became_active":"2023-06-09T04:41:54.428962+0000","last_became_peered":"2023-06-09T04:41:54.428962+0000","last_unstale":"2023-06-09T04:41:55.654119+0000","last_undegraded":"2023-06-09T04:41:55.654119+0000","last_fullsized":"2023-06-09T04:41:55.654119+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:03:22.727998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"23'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.873117+0000","last_change":"2023-06-09T04:41:53.950213+0000","last_active":"2023-06-09T04:41:55.873117+0000","last_peered":"2023-06-09T04:41:55.873117+0000","last_clean":"2023-06-09T04:41:55.873117+0000","last_became_active":"2023-06-09T04:41:53.949956+0000","last_became_peered":"2023-06-09T04:41:53.949956+0000","last_unstale":"2023-06-09T04:41:55.873117+0000","last_undegraded":"2023-06-09T04:41:55.873117+0000","last_fullsized":"2023-06-09T04:41:55.873117+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_clean_scrub_stamp":"2023-06-09T04:41:52.888143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:20:05.889342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.874763+0000","last_change":"2023-06-09T04:41:54.423233+0000","last_active":"2023-06-09T04:41:55.874763+0000","last_peered":"2023-06-09T04:41:55.874763+0000","last_clean":"2023-06-09T04:41:55.874763+0000","last_became_active":"2023-06-09T04:41:54.422587+0000","last_became_peered":"2023-06-09T04:41:54.422587+0000","last_unstale":"2023-06-09T04:41:55.874763+0000","last_undegraded":"2023-06-09T04:41:55.874763+0000","last_fullsized":"2023-06-09T04:41:55.874763+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:01:04.929884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.874374+0000","last_change":"2023-06-09T04:41:53.944320+0000","last_active":"2023-06-09T04:41:55.874374+0000","last_peered":"2023-06-09T04:41:55.874374+0000","last_clean":"2023-06-09T04:41:55.874374+0000","last_became_active":"2023-06-09T04:41:53.944039+0000","last_became_peered":"2023-06-09T04:41:53.944039+0000","last_unstale":"2023-06-09T04:41:55.874374+0000","last_undegraded":"2023-06-09T04:41:55.874374+0000","last_fullsized":"2023-06-09T04:41:55.874374+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_clean_scrub_stamp":"2023-06-09T04:41:52.888143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:32:13.248839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.873809+0000","last_change":"2023-06-09T04:41:54.417754+0000","last_active":"2023-06-09T04:41:55.873809+0000","last_peered":"2023-06-09T04:41:55.873809+0000","last_clean":"2023-06-09T04:41:55.873809+0000","last_became_active":"2023-06-09T04:41:54.417462+0000","last_became_peered":"2023-06-09T04:41:54.417462+0000","last_unstale":"2023-06-09T04:41:55.873809+0000","last_undegraded":"2023-06-09T04:41:55.873809+0000","last_fullsized":"2023-06-09T04:41:55.873809+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:06:03.696521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.872806+0000","last_change":"2023-06-09T04:41:53.950199+0000","last_active":"2023-06-09T04:41:55.872806+0000","last_peered":"2023-06-09T04:41:55.872806+0000","last_clean":"2023-06-09T04:41:55.872806+0000","last_became_active":"2023-06-09T04:41:53.949846+0000","last_became_peered":"2023-06-09T04:41:53.949846+0000","last_unstale":"2023-06-09T04:41:55.872806+0000","last_undegraded":"2023-06-09T04:41:55.872806+0000","last_fullsized":"2023-06-09T04:41:55.872806+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_clean_scrub_stamp":"2023-06-09T04:41:52.888143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:37:16.212704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.654767+0000","last_change":"2023-06-09T04:41:54.423952+0000","last_active":"2023-06-09T04:41:55.654767+0000","last_peered":"2023-06-09T04:41:55.654767+0000","last_clean":"2023-06-09T04:41:55.654767+0000","last_became_active":"2023-06-09T04:41:54.423601+0000","last_became_peered":"2023-06-09T04:41:54.423601+0000","last_unstale":"2023-06-09T04:41:55.654767+0000","last_undegraded":"2023-06-09T04:41:55.654767+0000","last_fullsized":"2023-06-09T04:41:55.654767+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:46:21.659594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"23'8","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.406561+0000","last_change":"2023-06-09T04:41:53.945735+0000","last_active":"2023-06-09T04:41:55.406561+0000","last_peered":"2023-06-09T04:41:55.406561+0000","last_clean":"2023-06-09T04:41:55.406561+0000","last_became_active":"2023-06-09T04:41:53.945260+0000","last_became_peered":"2023-06-09T04:41:53.945260+0000","last_unstale":"2023-06-09T04:41:55.406561+0000","last_undegraded":"2023-06-09T04:41:55.406561+0000","last_fullsized":"2023-06-09T04:41:55.406561+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_clean_scrub_stamp":"2023-06-09T04:41:52.888143+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:48:52.910038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"23'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.873690+0000","last_change":"2023-06-09T04:41:53.950178+0000","last_active":"2023-06-09T04:41:55.873690+0000","last_peered":"2023-06-09T04:41:55.873690+0000","last_clean":"2023-06-09T04:41:55.873690+0000","last_became_active":"2023-06-09T04:41:53.949874+0000","last_became_peered":"2023-06-09T04:41:53.949874+0000","last_unstale":"2023-06-09T04:41:55.873690+0000","last_undegraded":"2023-06-09T04:41:55.873690+0000","last_fullsized":"2023-06-09T04:41:55.873690+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_clean_scrub_stamp":"2023-06-09T04:41:52.888143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:14:18.414303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.873991+0000","last_change":"2023-06-09T04:41:54.421270+0000","last_active":"2023-06-09T04:41:55.873991+0000","last_peered":"2023-06-09T04:41:55.873991+0000","last_clean":"2023-06-09T04:41:55.873991+0000","last_became_active":"2023-06-09T04:41:54.421019+0000","last_became_peered":"2023-06-09T04:41:54.421019+0000","last_unstale":"2023-06-09T04:41:55.873991+0000","last_undegraded":"2023-06-09T04:41:55.873991+0000","last_fullsized":"2023-06-09T04:41:55.873991+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:29:47.126124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"23'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.873655+0000","last_change":"2023-06-09T04:41:53.951880+0000","last_active":"2023-06-09T04:41:55.873655+0000","last_peered":"2023-06-09T04:41:55.873655+0000","last_clean":"2023-06-09T04:41:55.873655+0000","last_became_active":"2023-06-09T04:41:53.951460+0000","last_became_peered":"2023-06-09T04:41:53.951460+0000","last_unstale":"2023-06-09T04:41:55.873655+0000","last_undegraded":"2023-06-09T04:41:55.873655+0000","last_fullsized":"2023-06-09T04:41:55.873655+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_clean_scrub_stamp":"2023-06-09T04:41:52.888143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:35:48.907156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.407368+0000","last_change":"2023-06-09T04:41:54.432752+0000","last_active":"2023-06-09T04:41:55.407368+0000","last_peered":"2023-06-09T04:41:55.407368+0000","last_clean":"2023-06-09T04:41:55.407368+0000","last_became_active":"2023-06-09T04:41:54.432341+0000","last_became_peered":"2023-06-09T04:41:54.432341+0000","last_unstale":"2023-06-09T04:41:55.407368+0000","last_undegraded":"2023-06-09T04:41:55.407368+0000","last_fullsized":"2023-06-09T04:41:55.407368+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:02:24.420270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"23'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.873267+0000","last_change":"2023-06-09T04:41:53.943033+0000","last_active":"2023-06-09T04:41:55.873267+0000","last_peered":"2023-06-09T04:41:55.873267+0000","last_clean":"2023-06-09T04:41:55.873267+0000","last_became_active":"2023-06-09T04:41:53.942705+0000","last_became_peered":"2023-06-09T04:41:53.942705+0000","last_unstale":"2023-06-09T04:41:55.873267+0000","last_undegraded":"2023-06-09T04:41:55.873267+0000","last_fullsized":"2023-06-09T04:41:55.873267+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_clean_scrub_stamp":"2023-06-09T04:41:52.888143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:07:18.392407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.406357+0000","last_change":"2023-06-09T04:41:54.423994+0000","last_active":"2023-06-09T04:41:55.406357+0000","last_peered":"2023-06-09T04:41:55.406357+0000","last_clean":"2023-06-09T04:41:55.406357+0000","last_became_active":"2023-06-09T04:41:54.423563+0000","last_became_peered":"2023-06-09T04:41:54.423563+0000","last_unstale":"2023-06-09T04:41:55.406357+0000","last_undegraded":"2023-06-09T04:41:55.406357+0000","last_fullsized":"2023-06-09T04:41:55.406357+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:57:36.919960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.874564+0000","last_change":"2023-06-09T04:41:53.943463+0000","last_active":"2023-06-09T04:41:55.874564+0000","last_peered":"2023-06-09T04:41:55.874564+0000","last_clean":"2023-06-09T04:41:55.874564+0000","last_became_active":"2023-06-09T04:41:53.943156+0000","last_became_peered":"2023-06-09T04:41:53.943156+0000","last_unstale":"2023-06-09T04:41:55.874564+0000","last_undegraded":"2023-06-09T04:41:55.874564+0000","last_fullsized":"2023-06-09T04:41:55.874564+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_clean_scrub_stamp":"2023-06-09T04:41:52.888143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:48:33.879868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.872666+0000","last_change":"2023-06-09T04:41:54.421050+0000","last_active":"2023-06-09T04:41:55.872666+0000","last_peered":"2023-06-09T04:41:55.872666+0000","last_clean":"2023-06-09T04:41:55.872666+0000","last_became_active":"2023-06-09T04:41:54.420683+0000","last_became_peered":"2023-06-09T04:41:54.420683+0000","last_unstale":"2023-06-09T04:41:55.872666+0000","last_undegraded":"2023-06-09T04:41:55.872666+0000","last_fullsized":"2023-06-09T04:41:55.872666+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:01:41.876981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"23'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.654774+0000","last_change":"2023-06-09T04:41:53.946942+0000","last_active":"2023-06-09T04:41:55.654774+0000","last_peered":"2023-06-09T04:41:55.654774+0000","last_clean":"2023-06-09T04:41:55.654774+0000","last_became_active":"2023-06-09T04:41:53.946653+0000","last_became_peered":"2023-06-09T04:41:53.946653+0000","last_unstale":"2023-06-09T04:41:55.654774+0000","last_undegraded":"2023-06-09T04:41:55.654774+0000","last_fullsized":"2023-06-09T04:41:55.654774+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_clean_scrub_stamp":"2023-06-09T04:41:52.888143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:01:03.915881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.408152+0000","last_change":"2023-06-09T04:41:54.435489+0000","last_active":"2023-06-09T04:41:55.408152+0000","last_peered":"2023-06-09T04:41:55.408152+0000","last_clean":"2023-06-09T04:41:55.408152+0000","last_became_active":"2023-06-09T04:41:54.435221+0000","last_became_peered":"2023-06-09T04:41:54.435221+0000","last_unstale":"2023-06-09T04:41:55.408152+0000","last_undegraded":"2023-06-09T04:41:55.408152+0000","last_fullsized":"2023-06-09T04:41:55.408152+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:32:14.262842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.406707+0000","last_change":"2023-06-09T04:41:53.949739+0000","last_active":"2023-06-09T04:41:55.406707+0000","last_peered":"2023-06-09T04:41:55.406707+0000","last_clean":"2023-06-09T04:41:55.406707+0000","last_became_active":"2023-06-09T04:41:53.949424+0000","last_became_peered":"2023-06-09T04:41:53.949424+0000","last_unstale":"2023-06-09T04:41:55.406707+0000","last_undegraded":"2023-06-09T04:41:55.406707+0000","last_fullsized":"2023-06-09T04:41:55.406707+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_clean_scrub_stamp":"2023-06-09T04:41:52.888143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T04:56:37.643976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.408495+0000","last_change":"2023-06-09T04:41:54.432641+0000","last_active":"2023-06-09T04:41:55.408495+0000","last_peered":"2023-06-09T04:41:55.408495+0000","last_clean":"2023-06-09T04:41:55.408495+0000","last_became_active":"2023-06-09T04:41:54.432274+0000","last_became_peered":"2023-06-09T04:41:54.432274+0000","last_unstale":"2023-06-09T04:41:55.408495+0000","last_undegraded":"2023-06-09T04:41:55.408495+0000","last_fullsized":"2023-06-09T04:41:55.408495+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:02:42.425459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.408131+0000","last_change":"2023-06-09T04:41:53.941677+0000","last_active":"2023-06-09T04:41:55.408131+0000","last_peered":"2023-06-09T04:41:55.408131+0000","last_clean":"2023-06-09T04:41:55.408131+0000","last_became_active":"2023-06-09T04:41:53.940978+0000","last_became_peered":"2023-06-09T04:41:53.940978+0000","last_unstale":"2023-06-09T04:41:55.408131+0000","last_undegraded":"2023-06-09T04:41:55.408131+0000","last_fullsized":"2023-06-09T04:41:55.408131+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_clean_scrub_stamp":"2023-06-09T04:41:52.888143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:48:33.879868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.408415+0000","last_change":"2023-06-09T04:41:54.432635+0000","last_active":"2023-06-09T04:41:55.408415+0000","last_peered":"2023-06-09T04:41:55.408415+0000","last_clean":"2023-06-09T04:41:55.408415+0000","last_became_active":"2023-06-09T04:41:54.432242+0000","last_became_peered":"2023-06-09T04:41:54.432242+0000","last_unstale":"2023-06-09T04:41:55.408415+0000","last_undegraded":"2023-06-09T04:41:55.408415+0000","last_fullsized":"2023-06-09T04:41:55.408415+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:03:50.071570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.654432+0000","last_change":"2023-06-09T04:41:53.946859+0000","last_active":"2023-06-09T04:41:55.654432+0000","last_peered":"2023-06-09T04:41:55.654432+0000","last_clean":"2023-06-09T04:41:55.654432+0000","last_became_active":"2023-06-09T04:41:53.946579+0000","last_became_peered":"2023-06-09T04:41:53.946579+0000","last_unstale":"2023-06-09T04:41:55.654432+0000","last_undegraded":"2023-06-09T04:41:55.654432+0000","last_fullsized":"2023-06-09T04:41:55.654432+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_clean_scrub_stamp":"2023-06-09T04:41:52.888143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:48:33.879868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.874463+0000","last_change":"2023-06-09T04:41:54.412726+0000","last_active":"2023-06-09T04:41:55.874463+0000","last_peered":"2023-06-09T04:41:55.874463+0000","last_clean":"2023-06-09T04:41:55.874463+0000","last_became_active":"2023-06-09T04:41:54.410016+0000","last_became_peered":"2023-06-09T04:41:54.410016+0000","last_unstale":"2023-06-09T04:41:55.874463+0000","last_undegraded":"2023-06-09T04:41:55.874463+0000","last_fullsized":"2023-06-09T04:41:55.874463+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:48:34.893871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":175,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.872709+0000","last_change":"2023-06-09T04:41:43.997052+0000","last_active":"2023-06-09T04:41:55.872709+0000","last_peered":"2023-06-09T04:41:55.872709+0000","last_clean":"2023-06-09T04:41:55.872709+0000","last_became_active":"2023-06-09T04:41:43.993827+0000","last_became_peered":"2023-06-09T04:41:43.993827+0000","last_unstale":"2023-06-09T04:41:55.872709+0000","last_undegraded":"2023-06-09T04:41:55.872709+0000","last_fullsized":"2023-06-09T04:41:55.872709+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:42.777858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:42.777858+0000","last_clean_scrub_stamp":"2023-06-09T04:41:42.777858+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:03:38.947282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.874488+0000","last_change":"2023-06-09T04:41:48.873288+0000","last_active":"2023-06-09T04:41:55.874488+0000","last_peered":"2023-06-09T04:41:55.874488+0000","last_clean":"2023-06-09T04:41:55.874488+0000","last_became_active":"2023-06-09T04:41:48.872659+0000","last_became_peered":"2023-06-09T04:41:48.872659+0000","last_unstale":"2023-06-09T04:41:55.874488+0000","last_undegraded":"2023-06-09T04:41:55.874488+0000","last_fullsized":"2023-06-09T04:41:55.874488+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:47.838489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:47.838489+0000","last_clean_scrub_stamp":"2023-06-09T04:41:47.838489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:32:08.199185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.653752+0000","last_change":"2023-06-09T04:41:53.936424+0000","last_active":"2023-06-09T04:41:55.653752+0000","last_peered":"2023-06-09T04:41:55.653752+0000","last_clean":"2023-06-09T04:41:55.653752+0000","last_became_active":"2023-06-09T04:41:53.935818+0000","last_became_peered":"2023-06-09T04:41:53.935818+0000","last_unstale":"2023-06-09T04:41:55.653752+0000","last_undegraded":"2023-06-09T04:41:55.653752+0000","last_fullsized":"2023-06-09T04:41:55.653752+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_clean_scrub_stamp":"2023-06-09T04:41:52.888143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:01:40.862978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.406643+0000","last_change":"2023-06-09T04:41:54.435480+0000","last_active":"2023-06-09T04:41:55.406643+0000","last_peered":"2023-06-09T04:41:55.406643+0000","last_clean":"2023-06-09T04:41:55.406643+0000","last_became_active":"2023-06-09T04:41:54.435108+0000","last_became_peered":"2023-06-09T04:41:54.435108+0000","last_unstale":"2023-06-09T04:41:55.406643+0000","last_undegraded":"2023-06-09T04:41:55.406643+0000","last_fullsized":"2023-06-09T04:41:55.406643+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:23:54.068246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.872386+0000","last_change":"2023-06-09T04:41:48.880106+0000","last_active":"2023-06-09T04:41:55.872386+0000","last_peered":"2023-06-09T04:41:55.872386+0000","last_clean":"2023-06-09T04:41:55.872386+0000","last_became_active":"2023-06-09T04:41:48.879669+0000","last_became_peered":"2023-06-09T04:41:48.879669+0000","last_unstale":"2023-06-09T04:41:55.872386+0000","last_undegraded":"2023-06-09T04:41:55.872386+0000","last_fullsized":"2023-06-09T04:41:55.872386+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:47.838489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:47.838489+0000","last_clean_scrub_stamp":"2023-06-09T04:41:47.838489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:32:08.199185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.872214+0000","last_change":"2023-06-09T04:41:53.950810+0000","last_active":"2023-06-09T04:41:55.872214+0000","last_peered":"2023-06-09T04:41:55.872214+0000","last_clean":"2023-06-09T04:41:55.872214+0000","last_became_active":"2023-06-09T04:41:53.950443+0000","last_became_peered":"2023-06-09T04:41:53.950443+0000","last_unstale":"2023-06-09T04:41:55.872214+0000","last_undegraded":"2023-06-09T04:41:55.872214+0000","last_fullsized":"2023-06-09T04:41:55.872214+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_clean_scrub_stamp":"2023-06-09T04:41:52.888143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:02:21.285375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.873507+0000","last_change":"2023-06-09T04:41:54.424529+0000","last_active":"2023-06-09T04:41:55.873507+0000","last_peered":"2023-06-09T04:41:55.873507+0000","last_clean":"2023-06-09T04:41:55.873507+0000","last_became_active":"2023-06-09T04:41:54.424272+0000","last_became_peered":"2023-06-09T04:41:54.424272+0000","last_unstale":"2023-06-09T04:41:55.873507+0000","last_undegraded":"2023-06-09T04:41:55.873507+0000","last_fullsized":"2023-06-09T04:41:55.873507+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:03:22.727998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.406445+0000","last_change":"2023-06-09T04:41:48.966313+0000","last_active":"2023-06-09T04:41:55.406445+0000","last_peered":"2023-06-09T04:41:55.406445+0000","last_clean":"2023-06-09T04:41:55.406445+0000","last_became_active":"2023-06-09T04:41:48.965659+0000","last_became_peered":"2023-06-09T04:41:48.965659+0000","last_unstale":"2023-06-09T04:41:55.406445+0000","last_undegraded":"2023-06-09T04:41:55.406445+0000","last_fullsized":"2023-06-09T04:41:55.406445+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:47.838489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:47.838489+0000","last_clean_scrub_stamp":"2023-06-09T04:41:47.838489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:46:50.802354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.872660+0000","last_change":"2023-06-09T04:41:53.938212+0000","last_active":"2023-06-09T04:41:55.872660+0000","last_peered":"2023-06-09T04:41:55.872660+0000","last_clean":"2023-06-09T04:41:55.872660+0000","last_became_active":"2023-06-09T04:41:53.937944+0000","last_became_peered":"2023-06-09T04:41:53.937944+0000","last_unstale":"2023-06-09T04:41:55.872660+0000","last_undegraded":"2023-06-09T04:41:55.872660+0000","last_fullsized":"2023-06-09T04:41:55.872660+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_clean_scrub_stamp":"2023-06-09T04:41:52.888143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:37:52.478621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.874512+0000","last_change":"2023-06-09T04:41:54.419815+0000","last_active":"2023-06-09T04:41:55.874512+0000","last_peered":"2023-06-09T04:41:55.874512+0000","last_clean":"2023-06-09T04:41:55.874512+0000","last_became_active":"2023-06-09T04:41:54.419519+0000","last_became_peered":"2023-06-09T04:41:54.419519+0000","last_unstale":"2023-06-09T04:41:55.874512+0000","last_undegraded":"2023-06-09T04:41:55.874512+0000","last_fullsized":"2023-06-09T04:41:55.874512+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:50:09.575767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.873799+0000","last_change":"2023-06-09T04:41:48.873002+0000","last_active":"2023-06-09T04:41:55.873799+0000","last_peered":"2023-06-09T04:41:55.873799+0000","last_clean":"2023-06-09T04:41:55.873799+0000","last_became_active":"2023-06-09T04:41:48.872455+0000","last_became_peered":"2023-06-09T04:41:48.872455+0000","last_unstale":"2023-06-09T04:41:55.873799+0000","last_undegraded":"2023-06-09T04:41:55.873799+0000","last_fullsized":"2023-06-09T04:41:55.873799+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:47.838489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:47.838489+0000","last_clean_scrub_stamp":"2023-06-09T04:41:47.838489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:05:57.632864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.408311+0000","last_change":"2023-06-09T04:41:53.947015+0000","last_active":"2023-06-09T04:41:55.408311+0000","last_peered":"2023-06-09T04:41:55.408311+0000","last_clean":"2023-06-09T04:41:55.408311+0000","last_became_active":"2023-06-09T04:41:53.946714+0000","last_became_peered":"2023-06-09T04:41:53.946714+0000","last_unstale":"2023-06-09T04:41:55.408311+0000","last_undegraded":"2023-06-09T04:41:55.408311+0000","last_fullsized":"2023-06-09T04:41:55.408311+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_clean_scrub_stamp":"2023-06-09T04:41:52.888143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:01:03.915881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.873441+0000","last_change":"2023-06-09T04:41:54.411876+0000","last_active":"2023-06-09T04:41:55.873441+0000","last_peered":"2023-06-09T04:41:55.873441+0000","last_clean":"2023-06-09T04:41:55.873441+0000","last_became_active":"2023-06-09T04:41:54.411566+0000","last_became_peered":"2023-06-09T04:41:54.411566+0000","last_unstale":"2023-06-09T04:41:55.873441+0000","last_undegraded":"2023-06-09T04:41:55.873441+0000","last_fullsized":"2023-06-09T04:41:55.873441+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:02:24.420270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.874856+0000","last_change":"2023-06-09T04:41:53.936340+0000","last_active":"2023-06-09T04:41:55.874856+0000","last_peered":"2023-06-09T04:41:55.874856+0000","last_clean":"2023-06-09T04:41:55.874856+0000","last_became_active":"2023-06-09T04:41:53.936055+0000","last_became_peered":"2023-06-09T04:41:53.936055+0000","last_unstale":"2023-06-09T04:41:55.874856+0000","last_undegraded":"2023-06-09T04:41:55.874856+0000","last_fullsized":"2023-06-09T04:41:55.874856+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_clean_scrub_stamp":"2023-06-09T04:41:52.888143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:37:16.212704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.874174+0000","last_change":"2023-06-09T04:41:48.978389+0000","last_active":"2023-06-09T04:41:55.874174+0000","last_peered":"2023-06-09T04:41:55.874174+0000","last_clean":"2023-06-09T04:41:55.874174+0000","last_became_active":"2023-06-09T04:41:48.978021+0000","last_became_peered":"2023-06-09T04:41:48.978021+0000","last_unstale":"2023-06-09T04:41:55.874174+0000","last_undegraded":"2023-06-09T04:41:55.874174+0000","last_fullsized":"2023-06-09T04:41:55.874174+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:47.838489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:47.838489+0000","last_clean_scrub_stamp":"2023-06-09T04:41:47.838489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:35:32.291639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.873862+0000","last_change":"2023-06-09T04:41:54.419307+0000","last_active":"2023-06-09T04:41:55.873862+0000","last_peered":"2023-06-09T04:41:55.873862+0000","last_clean":"2023-06-09T04:41:55.873862+0000","last_became_active":"2023-06-09T04:41:54.419053+0000","last_became_peered":"2023-06-09T04:41:54.419053+0000","last_unstale":"2023-06-09T04:41:55.873862+0000","last_undegraded":"2023-06-09T04:41:55.873862+0000","last_fullsized":"2023-06-09T04:41:55.873862+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:06:03.696521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.873723+0000","last_change":"2023-06-09T04:41:53.939038+0000","last_active":"2023-06-09T04:41:55.873723+0000","last_peered":"2023-06-09T04:41:55.873723+0000","last_clean":"2023-06-09T04:41:55.873723+0000","last_became_active":"2023-06-09T04:41:53.938781+0000","last_became_peered":"2023-06-09T04:41:53.938781+0000","last_unstale":"2023-06-09T04:41:55.873723+0000","last_undegraded":"2023-06-09T04:41:55.873723+0000","last_fullsized":"2023-06-09T04:41:55.873723+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_clean_scrub_stamp":"2023-06-09T04:41:52.888143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:55:01.113074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.873352+0000","last_change":"2023-06-09T04:41:48.978235+0000","last_active":"2023-06-09T04:41:55.873352+0000","last_peered":"2023-06-09T04:41:55.873352+0000","last_clean":"2023-06-09T04:41:55.873352+0000","last_became_active":"2023-06-09T04:41:48.977568+0000","last_became_peered":"2023-06-09T04:41:48.977568+0000","last_unstale":"2023-06-09T04:41:55.873352+0000","last_undegraded":"2023-06-09T04:41:55.873352+0000","last_fullsized":"2023-06-09T04:41:55.873352+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:47.838489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:47.838489+0000","last_clean_scrub_stamp":"2023-06-09T04:41:47.838489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:32:35.516622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.872976+0000","last_change":"2023-06-09T04:41:54.422440+0000","last_active":"2023-06-09T04:41:55.872976+0000","last_peered":"2023-06-09T04:41:55.872976+0000","last_clean":"2023-06-09T04:41:55.872976+0000","last_became_active":"2023-06-09T04:41:54.421701+0000","last_became_peered":"2023-06-09T04:41:54.421701+0000","last_unstale":"2023-06-09T04:41:55.872976+0000","last_undegraded":"2023-06-09T04:41:55.872976+0000","last_fullsized":"2023-06-09T04:41:55.872976+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:37:53.492624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"23'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.654758+0000","last_change":"2023-06-09T04:41:53.943578+0000","last_active":"2023-06-09T04:41:55.654758+0000","last_peered":"2023-06-09T04:41:55.654758+0000","last_clean":"2023-06-09T04:41:55.654758+0000","last_became_active":"2023-06-09T04:41:53.943305+0000","last_became_peered":"2023-06-09T04:41:53.943305+0000","last_unstale":"2023-06-09T04:41:55.654758+0000","last_undegraded":"2023-06-09T04:41:55.654758+0000","last_fullsized":"2023-06-09T04:41:55.654758+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_clean_scrub_stamp":"2023-06-09T04:41:52.888143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:32:13.248839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.874764+0000","last_change":"2023-06-09T04:41:48.877786+0000","last_active":"2023-06-09T04:41:55.874764+0000","last_peered":"2023-06-09T04:41:55.874764+0000","last_clean":"2023-06-09T04:41:55.874764+0000","last_became_active":"2023-06-09T04:41:48.877370+0000","last_became_peered":"2023-06-09T04:41:48.877370+0000","last_unstale":"2023-06-09T04:41:55.874764+0000","last_undegraded":"2023-06-09T04:41:55.874764+0000","last_fullsized":"2023-06-09T04:41:55.874764+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:47.838489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:47.838489+0000","last_clean_scrub_stamp":"2023-06-09T04:41:47.838489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:46:15.595937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.653828+0000","last_change":"2023-06-09T04:41:54.424286+0000","last_active":"2023-06-09T04:41:55.653828+0000","last_peered":"2023-06-09T04:41:55.653828+0000","last_clean":"2023-06-09T04:41:55.653828+0000","last_became_active":"2023-06-09T04:41:54.424012+0000","last_became_peered":"2023-06-09T04:41:54.424012+0000","last_unstale":"2023-06-09T04:41:55.653828+0000","last_undegraded":"2023-06-09T04:41:55.653828+0000","last_fullsized":"2023-06-09T04:41:55.653828+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:37:53.492624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"24'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:56.396542+0000","last_change":"2023-06-09T04:41:53.947520+0000","last_active":"2023-06-09T04:41:56.396542+0000","last_peered":"2023-06-09T04:41:56.396542+0000","last_clean":"2023-06-09T04:41:56.396542+0000","last_became_active":"2023-06-09T04:41:53.947160+0000","last_became_peered":"2023-06-09T04:41:53.947160+0000","last_unstale":"2023-06-09T04:41:56.396542+0000","last_undegraded":"2023-06-09T04:41:56.396542+0000","last_fullsized":"2023-06-09T04:41:56.396542+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_clean_scrub_stamp":"2023-06-09T04:41:52.888143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:02:14.053015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.407151+0000","last_change":"2023-06-09T04:41:48.880094+0000","last_active":"2023-06-09T04:41:55.407151+0000","last_peered":"2023-06-09T04:41:55.407151+0000","last_clean":"2023-06-09T04:41:55.407151+0000","last_became_active":"2023-06-09T04:41:48.879506+0000","last_became_peered":"2023-06-09T04:41:48.879506+0000","last_unstale":"2023-06-09T04:41:55.407151+0000","last_undegraded":"2023-06-09T04:41:55.407151+0000","last_fullsized":"2023-06-09T04:41:55.407151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:47.838489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:47.838489+0000","last_clean_scrub_stamp":"2023-06-09T04:41:47.838489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:59:58.200203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.407606+0000","last_change":"2023-06-09T04:41:54.426906+0000","last_active":"2023-06-09T04:41:55.407606+0000","last_peered":"2023-06-09T04:41:55.407606+0000","last_clean":"2023-06-09T04:41:55.407606+0000","last_became_active":"2023-06-09T04:41:54.426543+0000","last_became_peered":"2023-06-09T04:41:54.426543+0000","last_unstale":"2023-06-09T04:41:55.407606+0000","last_undegraded":"2023-06-09T04:41:55.407606+0000","last_fullsized":"2023-06-09T04:41:55.407606+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:34:10.329381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.408027+0000","last_change":"2023-06-09T04:41:54.425437+0000","last_active":"2023-06-09T04:41:55.408027+0000","last_peered":"2023-06-09T04:41:55.408027+0000","last_clean":"2023-06-09T04:41:55.408027+0000","last_became_active":"2023-06-09T04:41:54.425093+0000","last_became_peered":"2023-06-09T04:41:54.425093+0000","last_unstale":"2023-06-09T04:41:55.408027+0000","last_undegraded":"2023-06-09T04:41:55.408027+0000","last_fullsized":"2023-06-09T04:41:55.408027+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:35:38.355296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"23'6","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.408353+0000","last_change":"2023-06-09T04:41:53.946445+0000","last_active":"2023-06-09T04:41:55.408353+0000","last_peered":"2023-06-09T04:41:55.408353+0000","last_clean":"2023-06-09T04:41:55.408353+0000","last_became_active":"2023-06-09T04:41:53.942330+0000","last_became_peered":"2023-06-09T04:41:53.942330+0000","last_unstale":"2023-06-09T04:41:55.408353+0000","last_undegraded":"2023-06-09T04:41:55.408353+0000","last_fullsized":"2023-06-09T04:41:55.408353+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_clean_scrub_stamp":"2023-06-09T04:41:52.888143+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:37:16.212704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.873568+0000","last_change":"2023-06-09T04:41:54.423048+0000","last_active":"2023-06-09T04:41:55.873568+0000","last_peered":"2023-06-09T04:41:55.873568+0000","last_clean":"2023-06-09T04:41:55.873568+0000","last_became_active":"2023-06-09T04:41:54.422813+0000","last_became_peered":"2023-06-09T04:41:54.422813+0000","last_unstale":"2023-06-09T04:41:55.873568+0000","last_undegraded":"2023-06-09T04:41:55.873568+0000","last_fullsized":"2023-06-09T04:41:55.873568+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:34:10.329381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"23'3","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.872749+0000","last_change":"2023-06-09T04:41:53.947478+0000","last_active":"2023-06-09T04:41:55.872749+0000","last_peered":"2023-06-09T04:41:55.872749+0000","last_clean":"2023-06-09T04:41:55.872749+0000","last_became_active":"2023-06-09T04:41:53.947126+0000","last_became_peered":"2023-06-09T04:41:53.947126+0000","last_unstale":"2023-06-09T04:41:55.872749+0000","last_undegraded":"2023-06-09T04:41:55.872749+0000","last_fullsized":"2023-06-09T04:41:55.872749+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_clean_scrub_stamp":"2023-06-09T04:41:52.888143+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:01:03.915881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.874913+0000","last_change":"2023-06-09T04:41:53.943073+0000","last_active":"2023-06-09T04:41:55.874913+0000","last_peered":"2023-06-09T04:41:55.874913+0000","last_clean":"2023-06-09T04:41:55.874913+0000","last_became_active":"2023-06-09T04:41:53.942802+0000","last_became_peered":"2023-06-09T04:41:53.942802+0000","last_unstale":"2023-06-09T04:41:55.874913+0000","last_undegraded":"2023-06-09T04:41:55.874913+0000","last_fullsized":"2023-06-09T04:41:55.874913+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_clean_scrub_stamp":"2023-06-09T04:41:52.888143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:44:35.348425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.654252+0000","last_change":"2023-06-09T04:41:54.424894+0000","last_active":"2023-06-09T04:41:55.654252+0000","last_peered":"2023-06-09T04:41:55.654252+0000","last_clean":"2023-06-09T04:41:55.654252+0000","last_became_active":"2023-06-09T04:41:54.423546+0000","last_became_peered":"2023-06-09T04:41:54.423546+0000","last_unstale":"2023-06-09T04:41:55.654252+0000","last_undegraded":"2023-06-09T04:41:55.654252+0000","last_fullsized":"2023-06-09T04:41:55.654252+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:29:47.126124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.874732+0000","last_change":"2023-06-09T04:41:53.945046+0000","last_active":"2023-06-09T04:41:55.874732+0000","last_peered":"2023-06-09T04:41:55.874732+0000","last_clean":"2023-06-09T04:41:55.874732+0000","last_became_active":"2023-06-09T04:41:53.944775+0000","last_became_peered":"2023-06-09T04:41:53.944775+0000","last_unstale":"2023-06-09T04:41:55.874732+0000","last_undegraded":"2023-06-09T04:41:55.874732+0000","last_fullsized":"2023-06-09T04:41:55.874732+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_clean_scrub_stamp":"2023-06-09T04:41:52.888143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:46:20.645591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.653741+0000","last_change":"2023-06-09T04:41:54.412545+0000","last_active":"2023-06-09T04:41:55.653741+0000","last_peered":"2023-06-09T04:41:55.653741+0000","last_clean":"2023-06-09T04:41:55.653741+0000","last_became_active":"2023-06-09T04:41:54.412243+0000","last_became_peered":"2023-06-09T04:41:54.412243+0000","last_unstale":"2023-06-09T04:41:55.653741+0000","last_undegraded":"2023-06-09T04:41:55.653741+0000","last_fullsized":"2023-06-09T04:41:55.653741+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:02:22.299378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.406954+0000","last_change":"2023-06-09T04:41:54.424839+0000","last_active":"2023-06-09T04:41:55.406954+0000","last_peered":"2023-06-09T04:41:55.406954+0000","last_clean":"2023-06-09T04:41:55.406954+0000","last_became_active":"2023-06-09T04:41:54.424393+0000","last_became_peered":"2023-06-09T04:41:54.424393+0000","last_unstale":"2023-06-09T04:41:55.406954+0000","last_undegraded":"2023-06-09T04:41:55.406954+0000","last_fullsized":"2023-06-09T04:41:55.406954+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:49:19.500921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.654122+0000","last_change":"2023-06-09T04:41:53.946167+0000","last_active":"2023-06-09T04:41:55.654122+0000","last_peered":"2023-06-09T04:41:55.654122+0000","last_clean":"2023-06-09T04:41:55.654122+0000","last_became_active":"2023-06-09T04:41:53.945851+0000","last_became_peered":"2023-06-09T04:41:53.945851+0000","last_unstale":"2023-06-09T04:41:55.654122+0000","last_undegraded":"2023-06-09T04:41:55.654122+0000","last_fullsized":"2023-06-09T04:41:55.654122+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_clean_scrub_stamp":"2023-06-09T04:41:52.888143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:34:09.315377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.873175+0000","last_change":"2023-06-09T04:41:54.422093+0000","last_active":"2023-06-09T04:41:55.873175+0000","last_peered":"2023-06-09T04:41:55.873175+0000","last_clean":"2023-06-09T04:41:55.873175+0000","last_became_active":"2023-06-09T04:41:54.421470+0000","last_became_peered":"2023-06-09T04:41:54.421470+0000","last_unstale":"2023-06-09T04:41:55.873175+0000","last_undegraded":"2023-06-09T04:41:55.873175+0000","last_fullsized":"2023-06-09T04:41:55.873175+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:02:24.420270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.873487+0000","last_change":"2023-06-09T04:41:53.948249+0000","last_active":"2023-06-09T04:41:55.873487+0000","last_peered":"2023-06-09T04:41:55.873487+0000","last_clean":"2023-06-09T04:41:55.873487+0000","last_became_active":"2023-06-09T04:41:53.947922+0000","last_became_peered":"2023-06-09T04:41:53.947922+0000","last_unstale":"2023-06-09T04:41:55.873487+0000","last_undegraded":"2023-06-09T04:41:55.873487+0000","last_fullsized":"2023-06-09T04:41:55.873487+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_clean_scrub_stamp":"2023-06-09T04:41:52.888143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:03:21.713995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.654127+0000","last_change":"2023-06-09T04:41:54.414099+0000","last_active":"2023-06-09T04:41:55.654127+0000","last_peered":"2023-06-09T04:41:55.654127+0000","last_clean":"2023-06-09T04:41:55.654127+0000","last_became_active":"2023-06-09T04:41:54.413814+0000","last_became_peered":"2023-06-09T04:41:54.413814+0000","last_unstale":"2023-06-09T04:41:55.654127+0000","last_undegraded":"2023-06-09T04:41:55.654127+0000","last_fullsized":"2023-06-09T04:41:55.654127+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:55:02.127077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"23'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.407877+0000","last_change":"2023-06-09T04:41:53.946921+0000","last_active":"2023-06-09T04:41:55.407877+0000","last_peered":"2023-06-09T04:41:55.407877+0000","last_clean":"2023-06-09T04:41:55.407877+0000","last_became_active":"2023-06-09T04:41:53.946528+0000","last_became_peered":"2023-06-09T04:41:53.946528+0000","last_unstale":"2023-06-09T04:41:55.407877+0000","last_undegraded":"2023-06-09T04:41:55.407877+0000","last_fullsized":"2023-06-09T04:41:55.407877+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_clean_scrub_stamp":"2023-06-09T04:41:52.888143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:29:46.112121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.406923+0000","last_change":"2023-06-09T04:41:54.414420+0000","last_active":"2023-06-09T04:41:55.406923+0000","last_peered":"2023-06-09T04:41:55.406923+0000","last_clean":"2023-06-09T04:41:55.406923+0000","last_became_active":"2023-06-09T04:41:54.413915+0000","last_became_peered":"2023-06-09T04:41:54.413915+0000","last_unstale":"2023-06-09T04:41:55.406923+0000","last_undegraded":"2023-06-09T04:41:55.406923+0000","last_fullsized":"2023-06-09T04:41:55.406923+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:17:24.443064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.873918+0000","last_change":"2023-06-09T04:41:53.950753+0000","last_active":"2023-06-09T04:41:55.873918+0000","last_peered":"2023-06-09T04:41:55.873918+0000","last_clean":"2023-06-09T04:41:55.873918+0000","last_became_active":"2023-06-09T04:41:53.950440+0000","last_became_peered":"2023-06-09T04:41:53.950440+0000","last_unstale":"2023-06-09T04:41:55.873918+0000","last_undegraded":"2023-06-09T04:41:55.873918+0000","last_fullsized":"2023-06-09T04:41:55.873918+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_clean_scrub_stamp":"2023-06-09T04:41:52.888143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:29:46.112121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.407721+0000","last_change":"2023-06-09T04:41:54.432857+0000","last_active":"2023-06-09T04:41:55.407721+0000","last_peered":"2023-06-09T04:41:55.407721+0000","last_clean":"2023-06-09T04:41:55.407721+0000","last_became_active":"2023-06-09T04:41:54.432285+0000","last_became_peered":"2023-06-09T04:41:54.432285+0000","last_unstale":"2023-06-09T04:41:55.407721+0000","last_undegraded":"2023-06-09T04:41:55.407721+0000","last_fullsized":"2023-06-09T04:41:55.407721+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:06:03.696521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"23'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.874167+0000","last_change":"2023-06-09T04:41:53.948741+0000","last_active":"2023-06-09T04:41:55.874167+0000","last_peered":"2023-06-09T04:41:55.874167+0000","last_clean":"2023-06-09T04:41:55.874167+0000","last_became_active":"2023-06-09T04:41:53.948401+0000","last_became_peered":"2023-06-09T04:41:53.948401+0000","last_unstale":"2023-06-09T04:41:55.874167+0000","last_undegraded":"2023-06-09T04:41:55.874167+0000","last_fullsized":"2023-06-09T04:41:55.874167+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_clean_scrub_stamp":"2023-06-09T04:41:52.888143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:35:37.341293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.407534+0000","last_change":"2023-06-09T04:41:54.434317+0000","last_active":"2023-06-09T04:41:55.407534+0000","last_peered":"2023-06-09T04:41:55.407534+0000","last_clean":"2023-06-09T04:41:55.407534+0000","last_became_active":"2023-06-09T04:41:54.433815+0000","last_became_peered":"2023-06-09T04:41:54.433815+0000","last_unstale":"2023-06-09T04:41:55.407534+0000","last_undegraded":"2023-06-09T04:41:55.407534+0000","last_fullsized":"2023-06-09T04:41:55.407534+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:03:22.727998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"23'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.874939+0000","last_change":"2023-06-09T04:41:53.949030+0000","last_active":"2023-06-09T04:41:55.874939+0000","last_peered":"2023-06-09T04:41:55.874939+0000","last_clean":"2023-06-09T04:41:55.874939+0000","last_became_active":"2023-06-09T04:41:53.948417+0000","last_became_peered":"2023-06-09T04:41:53.948417+0000","last_unstale":"2023-06-09T04:41:55.874939+0000","last_undegraded":"2023-06-09T04:41:55.874939+0000","last_fullsized":"2023-06-09T04:41:55.874939+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_clean_scrub_stamp":"2023-06-09T04:41:52.888143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:03:49.057567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.654457+0000","last_change":"2023-06-09T04:41:54.402200+0000","last_active":"2023-06-09T04:41:55.654457+0000","last_peered":"2023-06-09T04:41:55.654457+0000","last_clean":"2023-06-09T04:41:55.654457+0000","last_became_active":"2023-06-09T04:41:54.401955+0000","last_became_peered":"2023-06-09T04:41:54.401955+0000","last_unstale":"2023-06-09T04:41:55.654457+0000","last_undegraded":"2023-06-09T04:41:55.654457+0000","last_fullsized":"2023-06-09T04:41:55.654457+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:50:09.575767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"23'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.654265+0000","last_change":"2023-06-09T04:41:53.946110+0000","last_active":"2023-06-09T04:41:55.654265+0000","last_peered":"2023-06-09T04:41:55.654265+0000","last_clean":"2023-06-09T04:41:55.654265+0000","last_became_active":"2023-06-09T04:41:53.945780+0000","last_became_peered":"2023-06-09T04:41:53.945780+0000","last_unstale":"2023-06-09T04:41:55.654265+0000","last_undegraded":"2023-06-09T04:41:55.654265+0000","last_fullsized":"2023-06-09T04:41:55.654265+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_clean_scrub_stamp":"2023-06-09T04:41:52.888143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:35:37.341293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.407217+0000","last_change":"2023-06-09T04:41:54.424850+0000","last_active":"2023-06-09T04:41:55.407217+0000","last_peered":"2023-06-09T04:41:55.407217+0000","last_clean":"2023-06-09T04:41:55.407217+0000","last_became_active":"2023-06-09T04:41:54.424507+0000","last_became_peered":"2023-06-09T04:41:54.424507+0000","last_unstale":"2023-06-09T04:41:55.407217+0000","last_undegraded":"2023-06-09T04:41:55.407217+0000","last_fullsized":"2023-06-09T04:41:55.407217+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:53.902146+0000","last_clean_scrub_stamp":"2023-06-09T04:41:53.902146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:37:53.492624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"23'4","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-09T04:41:55.874082+0000","last_change":"2023-06-09T04:41:53.940256+0000","last_active":"2023-06-09T04:41:55.874082+0000","last_peered":"2023-06-09T04:41:55.874082+0000","last_clean":"2023-06-09T04:41:55.874082+0000","last_became_active":"2023-06-09T04:41:53.939890+0000","last_became_peered":"2023-06-09T04:41:53.939890+0000","last_unstale":"2023-06-09T04:41:55.874082+0000","last_undegraded":"2023-06-09T04:41:55.874082+0000","last_fullsized":"2023-06-09T04:41:55.874082+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:52.888143+0000","last_clean_scrub_stamp":"2023-06-09T04:41:52.888143+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:48:33.879868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":856,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":876544,"data_stored":686418,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.206}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4379999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.591}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.669}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9319999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.2549999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.173}]}]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":253952,"data_stored":94270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.956}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.014}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0750000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.1160000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95899999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1899999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2529999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":262144,"data_stored":94922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2589999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.099}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3959999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4379999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5740000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5049999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3109999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":274432,"data_stored":95890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1519999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.399}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3240000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0049999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4570000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.427}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27204,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344636,"statfs":{"total":96636764160,"available":96608907264,"internally_reserved":0,"allocated":258048,"data_stored":94360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93700000000000006}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80200000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.208}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2709999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1519999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5569999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":253952,"data_stored":94270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.753}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.514}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.028}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3100000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.401}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":253952,"data_stored":94270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1060000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93300000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86699999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0649999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2649999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27784,"kb_used_data":832,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344056,"statfs":{"total":96636764160,"available":96608313344,"internally_reserved":0,"allocated":851968,"data_stored":685220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73099999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1719999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3140000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1990000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4830000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-09T04:42:05.271 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-06-09T04:42:05.271 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-06-09T04:42:05.272 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-06-09T04:42:05.272 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-06-09T04:42:05.473 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.467+0000 7f0869227700 1 Processor -- start 2023-06-09T04:42:05.473 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.467+0000 7f0869227700 1 -- start start 2023-06-09T04:42:05.474 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.467+0000 7f0869227700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f086406a510 0x7f08640cd100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:05.474 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.467+0000 7f0869227700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f086406ac70 con 0x7f08640ace20 2023-06-09T04:42:05.475 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.467+0000 7f0869227700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f086406b1a0 con 0x7f08640cc5f0 2023-06-09T04:42:05.475 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.467+0000 7f0869227700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08640c8a00 con 0x7f086406a510 2023-06-09T04:42:05.476 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.471+0000 7f0863fff700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f08640ace20 0x7f08640cbee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:46604/0 (socket says 172.21.15.90:46604) 2023-06-09T04:42:05.476 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.471+0000 7f0863fff700 1 -- 172.21.15.90:0/610876143 learned_addr learned my addr 172.21.15.90:0/610876143 (peer_addr_for_me v1:172.21.15.90:0/0) 2023-06-09T04:42:05.476 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.471+0000 7f0868a26700 1 --2- 172.21.15.90:0/610876143 >> v2:172.21.15.174:3300/0 conn(0x7f086406a510 0x7f08640cd100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:05.476 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.471+0000 7f08637fe700 1 -- 172.21.15.90:0/610876143 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 356073191 0 0) 0x7f086406ac70 con 0x7f08640ace20 2023-06-09T04:42:05.476 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.471+0000 7f08637fe700 1 -- 172.21.15.90:0/610876143 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f08500035d0 con 0x7f08640ace20 2023-06-09T04:42:05.476 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.471+0000 7f08637fe700 1 -- 172.21.15.90:0/610876143 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1836961586 0 0) 0x7f08500035d0 con 0x7f08640ace20 2023-06-09T04:42:05.477 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.471+0000 7f08637fe700 1 -- 172.21.15.90:0/610876143 >> v2:172.21.15.174:3300/0 conn(0x7f086406a510 msgr2=0x7f08640cd100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:05.477 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.471+0000 7f08637fe700 1 --2- 172.21.15.90:0/610876143 >> v2:172.21.15.174:3300/0 conn(0x7f086406a510 0x7f08640cd100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:05.477 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.471+0000 7f08637fe700 1 -- 172.21.15.90:0/610876143 >> v1:172.21.15.174:6789/0 conn(0x7f08640cc5f0 legacy=0x7f08640ca3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:05.477 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.471+0000 7f08637fe700 1 -- 172.21.15.90:0/610876143 --> v1:172.21.15.90:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08640c8ce0 con 0x7f08640ace20 2023-06-09T04:42:05.477 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.471+0000 7f08637fe700 1 -- 172.21.15.90:0/610876143 <== mon.0 v1:172.21.15.90:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3604404106 0 0) 0x7f08540019f0 con 0x7f08640ace20 2023-06-09T04:42:05.478 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.471+0000 7f08637fe700 1 -- 172.21.15.90:0/610876143 >> v1:172.21.15.90:6789/0 conn(0x7f08640ace20 legacy=0x7f08640cbee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:05.478 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.471+0000 7f08637fe700 1 --2- 172.21.15.90:0/610876143 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0850003a20 0x7f0850003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:05.479 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.471+0000 7f08637fe700 1 --2- 172.21.15.90:0/610876143 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0850004870 0x7f0850004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:05.479 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.471+0000 7f08637fe700 1 --2- 172.21.15.90:0/610876143 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0850005340 0x7f085000ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:05.479 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.471+0000 7f08637fe700 1 -- 172.21.15.90:0/610876143 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08640c8a00 con 0x7f0850003a20 2023-06-09T04:42:05.479 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.471+0000 7f08637fe700 1 -- 172.21.15.90:0/610876143 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f085000c270 con 0x7f0850005340 2023-06-09T04:42:05.479 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.471+0000 7f08637fe700 1 -- 172.21.15.90:0/610876143 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f085000c430 con 0x7f0850004870 2023-06-09T04:42:05.479 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.471+0000 7f0863fff700 1 --2- 172.21.15.90:0/610876143 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0850003a20 0x7f0850003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:05.479 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.471+0000 7f0868a26700 1 --2- 172.21.15.90:0/610876143 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0850005340 0x7f085000ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:05.480 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.471+0000 7f085b7fe700 1 --2- 172.21.15.90:0/610876143 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0850004870 0x7f0850004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:05.480 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.471+0000 7f0863fff700 1 -- 172.21.15.90:0/610876143 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0850004870 msgr2=0x7f0850004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:05.480 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.471+0000 7f0863fff700 1 --2- 172.21.15.90:0/610876143 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0850004870 0x7f0850004ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:05.480 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.471+0000 7f0863fff700 1 -- 172.21.15.90:0/610876143 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0850005340 msgr2=0x7f085000ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:05.480 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.471+0000 7f0863fff700 1 --2- 172.21.15.90:0/610876143 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0850005340 0x7f085000ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:05.480 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.471+0000 7f0868a26700 1 -- 172.21.15.90:0/610876143 reap_dead start 2023-06-09T04:42:05.480 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.471+0000 7f0863fff700 1 -- 172.21.15.90:0/610876143 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08500035d0 con 0x7f0850003a20 2023-06-09T04:42:05.481 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.471+0000 7f0863fff700 1 --2- 172.21.15.90:0/610876143 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0850003a20 0x7f0850003e30 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f085400a830 tx=0x7f08500058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d58ff93e683f2b8 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:05.481 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.471+0000 7f08637fe700 1 -- 172.21.15.90:0/610876143 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f085400a2f0 con 0x7f0850003a20 2023-06-09T04:42:05.481 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.471+0000 7f08637fe700 1 -- 172.21.15.90:0/610876143 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08540072f0 con 0x7f0850003a20 2023-06-09T04:42:05.481 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.471+0000 7f08637fe700 1 -- 172.21.15.90:0/610876143 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08540076a0 con 0x7f0850003a20 2023-06-09T04:42:05.482 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.475+0000 7f0869227700 1 -- 172.21.15.90:0/610876143 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0850003a20 msgr2=0x7f0850003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:05.482 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.475+0000 7f0869227700 1 --2- 172.21.15.90:0/610876143 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0850003a20 0x7f0850003e30 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f085400a830 tx=0x7f08500058a0 comp rx=0 tx=0).stop 2023-06-09T04:42:05.482 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.475+0000 7f0869227700 1 -- 172.21.15.90:0/610876143 shutdown_connections 2023-06-09T04:42:05.482 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.475+0000 7f0869227700 1 --2- 172.21.15.90:0/610876143 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0850003a20 0x7f0850003e30 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:05.482 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.475+0000 7f0869227700 1 -- 172.21.15.90:0/610876143 >> 172.21.15.90:0/610876143 conn(0x7f08640aff00 msgr2=0x7f08640b0300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:05.482 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.475+0000 7f0869227700 1 -- 172.21.15.90:0/610876143 shutdown_connections 2023-06-09T04:42:05.483 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.475+0000 7f0869227700 1 -- 172.21.15.90:0/610876143 wait complete. 2023-06-09T04:42:05.483 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.475+0000 7f0869227700 1 Processor -- start 2023-06-09T04:42:05.483 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.475+0000 7f0869227700 1 -- start start 2023-06-09T04:42:05.484 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.479+0000 7f0869227700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0850003a20 0x7f08641507d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:05.484 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.479+0000 7f0869227700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f08640b1200 0x7f08640b1670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:05.484 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.479+0000 7f0869227700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0864070800 0x7f0864070c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:05.485 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.479+0000 7f0869227700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08640b2df0 con 0x7f08640b1200 2023-06-09T04:42:05.485 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.479+0000 7f0869227700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08640b2240 con 0x7f0850003a20 2023-06-09T04:42:05.485 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.479+0000 7f0869227700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08640711b0 con 0x7f0864070800 2023-06-09T04:42:05.485 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.479+0000 7f085b7fe700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f08640b1200 0x7f08640b1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:05.486 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.479+0000 7f085b7fe700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f08640b1200 0x7f08640b1670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:33816/0 (socket says 172.21.15.90:33816) 2023-06-09T04:42:05.486 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.479+0000 7f085b7fe700 1 -- 172.21.15.90:0/2308002856 learned_addr learned my addr 172.21.15.90:0/2308002856 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:05.486 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.479+0000 7f0863fff700 1 --2- 172.21.15.90:0/2308002856 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0850003a20 0x7f08641507d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:05.487 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.479+0000 7f0868a26700 1 --2- 172.21.15.90:0/2308002856 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0864070800 0x7f0864070c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:05.487 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.479+0000 7f085b7fe700 1 -- 172.21.15.90:0/2308002856 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0864070800 msgr2=0x7f0864070c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:05.487 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.479+0000 7f085b7fe700 1 --2- 172.21.15.90:0/2308002856 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0864070800 0x7f0864070c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:05.487 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.479+0000 7f085b7fe700 1 -- 172.21.15.90:0/2308002856 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0850003a20 msgr2=0x7f08641507d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:05.487 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.479+0000 7f085b7fe700 1 --2- 172.21.15.90:0/2308002856 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0850003a20 0x7f08641507d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:05.487 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.479+0000 7f085b7fe700 1 -- 172.21.15.90:0/2308002856 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08640b1c80 con 0x7f08640b1200 2023-06-09T04:42:05.487 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.479+0000 7f085b7fe700 1 --2- 172.21.15.90:0/2308002856 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f08640b1200 0x7f08640b1670 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f084c000c00 tx=0x7f084c00e740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:05.487 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.479+0000 7f08617fa700 1 -- 172.21.15.90:0/2308002856 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f084c0050d0 con 0x7f08640b1200 2023-06-09T04:42:05.488 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.479+0000 7f08617fa700 1 -- 172.21.15.90:0/2308002856 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f084c005230 con 0x7f08640b1200 2023-06-09T04:42:05.488 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.479+0000 7f0869227700 1 -- 172.21.15.90:0/2308002856 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08640b1f60 con 0x7f08640b1200 2023-06-09T04:42:05.488 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.479+0000 7f08617fa700 1 -- 172.21.15.90:0/2308002856 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f084c0036a0 con 0x7f08640b1200 2023-06-09T04:42:05.488 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.479+0000 7f0869227700 1 -- 172.21.15.90:0/2308002856 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f086415c7f0 con 0x7f08640b1200 2023-06-09T04:42:05.488 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.483+0000 7f0869227700 1 -- 172.21.15.90:0/2308002856 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08640b2f30 con 0x7f08640b1200 2023-06-09T04:42:05.489 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.483+0000 7f08617fa700 1 -- 172.21.15.90:0/2308002856 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f084c003800 con 0x7f08640b1200 2023-06-09T04:42:05.491 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.487+0000 7f08617fa700 1 --2- 172.21.15.90:0/2308002856 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f08440662f0 0x7f08440687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:05.491 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.487+0000 7f08617fa700 1 -- 172.21.15.90:0/2308002856 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f084c083180 con 0x7f08640b1200 2023-06-09T04:42:05.492 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.487+0000 7f0863fff700 1 --2- 172.21.15.90:0/2308002856 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f08440662f0 0x7f08440687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:05.493 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.487+0000 7f0863fff700 1 --2- 172.21.15.90:0/2308002856 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f08440662f0 0x7f08440687a0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f0854000f80 tx=0x7f0854007000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:05.497 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.491+0000 7f08617fa700 1 -- 172.21.15.90:0/2308002856 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f08640b2f30 con 0x7f08640b1200 2023-06-09T04:42:05.698 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.691+0000 7f0869227700 1 -- 172.21.15.90:0/2308002856 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f08640b2f30 con 0x7f08640b1200 2023-06-09T04:42:05.699 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.691+0000 7f08617fa700 1 -- 172.21.15.90:0/2308002856 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f084c019040 con 0x7f08640b1200 2023-06-09T04:42:05.699 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:42:05.699 INFO:teuthology.orchestra.run.smithi090.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-06-09T04:42:05.703 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.699+0000 7f0869227700 1 -- 172.21.15.90:0/2308002856 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f08440662f0 msgr2=0x7f08440687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:05.704 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.699+0000 7f0869227700 1 --2- 172.21.15.90:0/2308002856 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f08440662f0 0x7f08440687a0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f0854000f80 tx=0x7f0854007000 comp rx=0 tx=0).stop 2023-06-09T04:42:05.704 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.699+0000 7f0869227700 1 -- 172.21.15.90:0/2308002856 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f08640b1200 msgr2=0x7f08640b1670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:05.704 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.699+0000 7f0869227700 1 --2- 172.21.15.90:0/2308002856 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f08640b1200 0x7f08640b1670 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f084c000c00 tx=0x7f084c00e740 comp rx=0 tx=0).stop 2023-06-09T04:42:05.704 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.699+0000 7f0869227700 1 -- 172.21.15.90:0/2308002856 shutdown_connections 2023-06-09T04:42:05.705 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.699+0000 7f0869227700 1 --2- 172.21.15.90:0/2308002856 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f08440662f0 0x7f08440687a0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:05.705 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.699+0000 7f0869227700 1 --2- 172.21.15.90:0/2308002856 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0864070800 0x7f0864070c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:05.705 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.699+0000 7f0869227700 1 --2- 172.21.15.90:0/2308002856 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f08640b1200 0x7f08640b1670 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:05.705 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.699+0000 7f0869227700 1 --2- 172.21.15.90:0/2308002856 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0850003a20 0x7f08641507d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:05.705 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.699+0000 7f0869227700 1 -- 172.21.15.90:0/2308002856 >> 172.21.15.90:0/2308002856 conn(0x7f08640aff00 msgr2=0x7f08640ae9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:05.705 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.699+0000 7f0869227700 1 -- 172.21.15.90:0/2308002856 shutdown_connections 2023-06-09T04:42:05.705 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.699+0000 7f0869227700 1 -- 172.21.15.90:0/2308002856 wait complete. 2023-06-09T04:42:05.726 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-06-09T04:42:05.726 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T04:42:05.890 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.883+0000 7fca4493a700 1 Processor -- start 2023-06-09T04:42:05.890 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.883+0000 7fca4493a700 1 -- start start 2023-06-09T04:42:05.891 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.887+0000 7fca4493a700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fca40154370 0x7fca400c8b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:05.892 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.887+0000 7fca4493a700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca400cae10 con 0x7fca400ca7a0 2023-06-09T04:42:05.892 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.887+0000 7fca4493a700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca400cb0f0 con 0x7fca4015e120 2023-06-09T04:42:05.892 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.887+0000 7fca4493a700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca400cac20 con 0x7fca40154370 2023-06-09T04:42:05.892 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.887+0000 7fca35d9b700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7fca400ca7a0 0x7fca4015da10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:46606/0 (socket says 172.21.15.90:46606) 2023-06-09T04:42:05.893 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.887+0000 7fca35d9b700 1 -- 172.21.15.90:0/2005297342 learned_addr learned my addr 172.21.15.90:0/2005297342 (peer_addr_for_me v1:172.21.15.90:0/0) 2023-06-09T04:42:05.893 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.887+0000 7fca3e59c700 1 --2- 172.21.15.90:0/2005297342 >> v2:172.21.15.174:3300/0 conn(0x7fca40154370 0x7fca400c8b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:05.893 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.887+0000 7fca3dd9b700 1 -- 172.21.15.90:0/2005297342 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1287118947 0 0) 0x7fca400cae10 con 0x7fca400ca7a0 2023-06-09T04:42:05.893 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.887+0000 7fca3e59c700 1 -- 172.21.15.90:0/2005297342 >> v1:172.21.15.174:6789/0 conn(0x7fca4015e120 legacy=0x7fca400b3340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:05.894 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.887+0000 7fca3e59c700 1 -- 172.21.15.90:0/2005297342 >> v1:172.21.15.90:6789/0 conn(0x7fca400ca7a0 legacy=0x7fca4015da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:05.894 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.887+0000 7fca3e59c700 1 -- 172.21.15.90:0/2005297342 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca400cb3d0 con 0x7fca40154370 2023-06-09T04:42:05.894 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.887+0000 7fca3e59c700 1 --2- 172.21.15.90:0/2005297342 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fca40154370 0x7fca400c8b40 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fca30009850 tx=0x7fca30009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=655db1f23f25f62c server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:05.894 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.887+0000 7fca3dd9b700 1 -- 172.21.15.90:0/2005297342 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca30011830 con 0x7fca40154370 2023-06-09T04:42:05.895 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.887+0000 7fca3dd9b700 1 -- 172.21.15.90:0/2005297342 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca30011990 con 0x7fca40154370 2023-06-09T04:42:05.895 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.887+0000 7fca3dd9b700 1 -- 172.21.15.90:0/2005297342 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca30011d20 con 0x7fca40154370 2023-06-09T04:42:05.895 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.891+0000 7fca4493a700 1 -- 172.21.15.90:0/2005297342 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fca40154370 msgr2=0x7fca400c8b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:05.896 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.891+0000 7fca4493a700 1 --2- 172.21.15.90:0/2005297342 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fca40154370 0x7fca400c8b40 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fca30009850 tx=0x7fca30009b60 comp rx=0 tx=0).stop 2023-06-09T04:42:05.896 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.891+0000 7fca4493a700 1 -- 172.21.15.90:0/2005297342 shutdown_connections 2023-06-09T04:42:05.896 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.891+0000 7fca4493a700 1 --2- 172.21.15.90:0/2005297342 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fca40154370 0x7fca400c8b40 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:05.896 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.891+0000 7fca4493a700 1 -- 172.21.15.90:0/2005297342 >> 172.21.15.90:0/2005297342 conn(0x7fca4006c810 msgr2=0x7fca400b0000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:05.897 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.891+0000 7fca4493a700 1 -- 172.21.15.90:0/2005297342 shutdown_connections 2023-06-09T04:42:05.897 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.891+0000 7fca4493a700 1 -- 172.21.15.90:0/2005297342 wait complete. 2023-06-09T04:42:05.899 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.895+0000 7fca4493a700 1 Processor -- start 2023-06-09T04:42:05.899 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.895+0000 7fca4493a700 1 -- start start 2023-06-09T04:42:05.901 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.895+0000 7fca4493a700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fca400ca7a0 0x7fca401539e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:05.901 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.895+0000 7fca4493a700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fca40154370 0x7fca400af740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:05.901 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.895+0000 7fca4493a700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fca4015e120 0x7fca401595a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:05.901 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.895+0000 7fca4493a700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca400cf050 con 0x7fca40154370 2023-06-09T04:42:05.901 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.895+0000 7fca4493a700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca40153f20 con 0x7fca400ca7a0 2023-06-09T04:42:05.902 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.895+0000 7fca4493a700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca400ce4d0 con 0x7fca4015e120 2023-06-09T04:42:05.902 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.895+0000 7fca35d9b700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fca40154370 0x7fca400af740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:05.902 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.895+0000 7fca35d9b700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fca40154370 0x7fca400af740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:45884/0 (socket says 172.21.15.90:45884) 2023-06-09T04:42:05.902 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.895+0000 7fca35d9b700 1 -- 172.21.15.90:0/3575821857 learned_addr learned my addr 172.21.15.90:0/3575821857 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:05.903 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.895+0000 7fca3e59c700 1 --2- 172.21.15.90:0/3575821857 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fca400ca7a0 0x7fca401539e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:05.903 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.895+0000 7fca3ed9d700 1 --2- 172.21.15.90:0/3575821857 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fca4015e120 0x7fca401595a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:05.903 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.895+0000 7fca35d9b700 1 -- 172.21.15.90:0/3575821857 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fca4015e120 msgr2=0x7fca401595a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:05.903 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.895+0000 7fca35d9b700 1 --2- 172.21.15.90:0/3575821857 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fca4015e120 0x7fca401595a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:05.904 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.895+0000 7fca35d9b700 1 -- 172.21.15.90:0/3575821857 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fca400ca7a0 msgr2=0x7fca401539e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:05.904 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.895+0000 7fca35d9b700 1 --2- 172.21.15.90:0/3575821857 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fca400ca7a0 0x7fca401539e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:05.904 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.895+0000 7fca35d9b700 1 -- 172.21.15.90:0/3575821857 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca300094b0 con 0x7fca40154370 2023-06-09T04:42:05.904 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.895+0000 7fca3ed9d700 1 --2- 172.21.15.90:0/3575821857 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fca4015e120 0x7fca401595a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:42:05.904 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.895+0000 7fca35d9b700 1 --2- 172.21.15.90:0/3575821857 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fca40154370 0x7fca400af740 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fca2800c580 tx=0x7fca2800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:05.904 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.895+0000 7fca377fe700 1 -- 172.21.15.90:0/3575821857 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca28004ca0 con 0x7fca40154370 2023-06-09T04:42:05.904 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.895+0000 7fca4493a700 1 -- 172.21.15.90:0/3575821857 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca401548c0 con 0x7fca40154370 2023-06-09T04:42:05.905 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.895+0000 7fca377fe700 1 -- 172.21.15.90:0/3575821857 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca28004e00 con 0x7fca40154370 2023-06-09T04:42:05.905 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.895+0000 7fca377fe700 1 -- 172.21.15.90:0/3575821857 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca28007310 con 0x7fca40154370 2023-06-09T04:42:05.905 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.899+0000 7fca4493a700 1 -- 172.21.15.90:0/3575821857 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca400ce720 con 0x7fca40154370 2023-06-09T04:42:05.905 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.899+0000 7fca4493a700 1 -- 172.21.15.90:0/3575821857 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca400cb690 con 0x7fca40154370 2023-06-09T04:42:05.906 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.899+0000 7fca377fe700 1 -- 172.21.15.90:0/3575821857 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fca28007470 con 0x7fca40154370 2023-06-09T04:42:05.907 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.903+0000 7fca377fe700 1 --2- 172.21.15.90:0/3575821857 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fca20066320 0x7fca200687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:05.908 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.903+0000 7fca377fe700 1 -- 172.21.15.90:0/3575821857 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fca28083a00 con 0x7fca40154370 2023-06-09T04:42:05.908 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.903+0000 7fca3e59c700 1 --2- 172.21.15.90:0/3575821857 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fca20066320 0x7fca200687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:05.909 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.903+0000 7fca3e59c700 1 --2- 172.21.15.90:0/3575821857 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fca20066320 0x7fca200687d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fca300090b0 tx=0x7fca30008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:05.912 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:05.907+0000 7fca377fe700 1 -- 172.21.15.90:0/3575821857 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fca400cb690 con 0x7fca40154370 2023-06-09T04:42:06.082 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.075+0000 7fca4493a700 1 -- 172.21.15.90:0/3575821857 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fca400cf200 con 0x7fca40154370 2023-06-09T04:42:06.083 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.079+0000 7fca377fe700 1 -- 172.21.15.90:0/3575821857 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18279 (secure 0 0 0) 0x7fca400cf200 con 0x7fca40154370 2023-06-09T04:42:06.084 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:42:06.084 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":24,"fsid":"700369c0-a111-43b4-9415-844ad1742b70","created":"2023-06-09T04:41:28.180311+0000","modified":"2023-06-09T04:41:55.389425+0000","last_up_change":"2023-06-09T04:41:40.746475+0000","last_in_change":"2023-06-09T04:41:31.262765+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-09T04:41:42.402564+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-09T04:41:47.607323+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-09T04:41:52.543474+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-09T04:41:53.382940+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"46a4a7c5-babd-4ef3-9830-51487cff5eb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":2780271267},{"type":"v1","addr":"172.21.15.90:6809","nonce":2780271267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2780271267},{"type":"v1","addr":"172.21.15.90:6811","nonce":2780271267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2780271267},{"type":"v1","addr":"172.21.15.90:6815","nonce":2780271267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2780271267},{"type":"v1","addr":"172.21.15.90:6813","nonce":2780271267}]},"public_addr":"172.21.15.90:6809/2780271267","cluster_addr":"172.21.15.90:6811/2780271267","heartbeat_back_addr":"172.21.15.90:6815/2780271267","heartbeat_front_addr":"172.21.15.90:6813/2780271267","state":["exists","up"]},{"osd":1,"uuid":"1543988f-c498-494a-a6f9-fac8413db6ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":3064028136},{"type":"v1","addr":"172.21.15.90:6801","nonce":3064028136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":3064028136},{"type":"v1","addr":"172.21.15.90:6803","nonce":3064028136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":3064028136},{"type":"v1","addr":"172.21.15.90:6807","nonce":3064028136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":3064028136},{"type":"v1","addr":"172.21.15.90:6805","nonce":3064028136}]},"public_addr":"172.21.15.90:6801/3064028136","cluster_addr":"172.21.15.90:6803/3064028136","heartbeat_back_addr":"172.21.15.90:6807/3064028136","heartbeat_front_addr":"172.21.15.90:6805/3064028136","state":["exists","up"]},{"osd":2,"uuid":"79669dd6-ffc8-4197-b9f7-b3b372b2b9b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":3713146326},{"type":"v1","addr":"172.21.15.90:6825","nonce":3713146326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":3713146326},{"type":"v1","addr":"172.21.15.90:6827","nonce":3713146326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":3713146326},{"type":"v1","addr":"172.21.15.90:6831","nonce":3713146326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":3713146326},{"type":"v1","addr":"172.21.15.90:6829","nonce":3713146326}]},"public_addr":"172.21.15.90:6825/3713146326","cluster_addr":"172.21.15.90:6827/3713146326","heartbeat_back_addr":"172.21.15.90:6831/3713146326","heartbeat_front_addr":"172.21.15.90:6829/3713146326","state":["exists","up"]},{"osd":3,"uuid":"4062ab6f-ce40-450a-aa17-b10098766c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":3499839122},{"type":"v1","addr":"172.21.15.90:6817","nonce":3499839122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":3499839122},{"type":"v1","addr":"172.21.15.90:6819","nonce":3499839122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":3499839122},{"type":"v1","addr":"172.21.15.90:6823","nonce":3499839122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":3499839122},{"type":"v1","addr":"172.21.15.90:6821","nonce":3499839122}]},"public_addr":"172.21.15.90:6817/3499839122","cluster_addr":"172.21.15.90:6819/3499839122","heartbeat_back_addr":"172.21.15.90:6823/3499839122","heartbeat_front_addr":"172.21.15.90:6821/3499839122","state":["exists","up"]},{"osd":4,"uuid":"a10820e4-b348-4d92-9796-3b01484ace1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6817","nonce":1138565854},{"type":"v1","addr":"172.21.15.174:6819","nonce":1138565854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6821","nonce":1138565854},{"type":"v1","addr":"172.21.15.174:6823","nonce":1138565854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":1138565854},{"type":"v1","addr":"172.21.15.174:6831","nonce":1138565854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":1138565854},{"type":"v1","addr":"172.21.15.174:6829","nonce":1138565854}]},"public_addr":"172.21.15.174:6819/1138565854","cluster_addr":"172.21.15.174:6823/1138565854","heartbeat_back_addr":"172.21.15.174:6831/1138565854","heartbeat_front_addr":"172.21.15.174:6829/1138565854","state":["exists","up"]},{"osd":5,"uuid":"b4da1c32-be05-420b-9346-90d91aa70569","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":1707702879},{"type":"v1","addr":"172.21.15.174:6818","nonce":1707702879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":1707702879},{"type":"v1","addr":"172.21.15.174:6822","nonce":1707702879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6827","nonce":1707702879},{"type":"v1","addr":"172.21.15.174:6828","nonce":1707702879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":1707702879},{"type":"v1","addr":"172.21.15.174:6825","nonce":1707702879}]},"public_addr":"172.21.15.174:6818/1707702879","cluster_addr":"172.21.15.174:6822/1707702879","heartbeat_back_addr":"172.21.15.174:6828/1707702879","heartbeat_front_addr":"172.21.15.174:6825/1707702879","state":["exists","up"]},{"osd":6,"uuid":"d1b98041-d243-4355-bd0a-e22cf9875b32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":864450534},{"type":"v1","addr":"172.21.15.174:6801","nonce":864450534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":864450534},{"type":"v1","addr":"172.21.15.174:6803","nonce":864450534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":864450534},{"type":"v1","addr":"172.21.15.174:6807","nonce":864450534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":864450534},{"type":"v1","addr":"172.21.15.174:6805","nonce":864450534}]},"public_addr":"172.21.15.174:6801/864450534","cluster_addr":"172.21.15.174:6803/864450534","heartbeat_back_addr":"172.21.15.174:6807/864450534","heartbeat_front_addr":"172.21.15.174:6805/864450534","state":["exists","up"]},{"osd":7,"uuid":"5a207936-f89f-416b-b79b-34ec96f77c8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":2527640659},{"type":"v1","addr":"172.21.15.174:6809","nonce":2527640659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":2527640659},{"type":"v1","addr":"172.21.15.174:6811","nonce":2527640659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":2527640659},{"type":"v1","addr":"172.21.15.174:6815","nonce":2527640659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":2527640659},{"type":"v1","addr":"172.21.15.174:6813","nonce":2527640659}]},"public_addr":"172.21.15.174:6809/2527640659","cluster_addr":"172.21.15.174:6811/2527640659","heartbeat_back_addr":"172.21.15.174:6815/2527640659","heartbeat_front_addr":"172.21.15.174:6813/2527640659","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:36.972152+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:36.984561+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:36.998817+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:37.054944+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:37.085014+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:37.115125+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:36.854608+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:36.971685+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:42:06.086 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.079+0000 7fca4493a700 1 -- 172.21.15.90:0/3575821857 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fca20066320 msgr2=0x7fca200687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:06.086 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.079+0000 7fca4493a700 1 --2- 172.21.15.90:0/3575821857 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fca20066320 0x7fca200687d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fca300090b0 tx=0x7fca30008030 comp rx=0 tx=0).stop 2023-06-09T04:42:06.087 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.079+0000 7fca4493a700 1 -- 172.21.15.90:0/3575821857 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fca40154370 msgr2=0x7fca400af740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:06.087 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.079+0000 7fca4493a700 1 --2- 172.21.15.90:0/3575821857 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fca40154370 0x7fca400af740 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fca2800c580 tx=0x7fca2800c940 comp rx=0 tx=0).stop 2023-06-09T04:42:06.087 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.079+0000 7fca4493a700 1 -- 172.21.15.90:0/3575821857 shutdown_connections 2023-06-09T04:42:06.088 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.079+0000 7fca4493a700 1 --2- 172.21.15.90:0/3575821857 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fca20066320 0x7fca200687d0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:06.088 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.079+0000 7fca4493a700 1 --2- 172.21.15.90:0/3575821857 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fca4015e120 0x7fca401595a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:06.088 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.079+0000 7fca4493a700 1 --2- 172.21.15.90:0/3575821857 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fca40154370 0x7fca400af740 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:06.088 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.079+0000 7fca4493a700 1 --2- 172.21.15.90:0/3575821857 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fca400ca7a0 0x7fca401539e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:06.088 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.079+0000 7fca4493a700 1 -- 172.21.15.90:0/3575821857 >> 172.21.15.90:0/3575821857 conn(0x7fca4006c810 msgr2=0x7fca400c90c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:06.088 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.083+0000 7fca4493a700 1 -- 172.21.15.90:0/3575821857 shutdown_connections 2023-06-09T04:42:06.088 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.083+0000 7fca4493a700 1 -- 172.21.15.90:0/3575821857 wait complete. 2023-06-09T04:42:06.109 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-09T04:41:42.402564+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-09T04:41:47.607323+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-09T04:41:52.543474+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-09T04:41:53.382940+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-09T04:42:06.110 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-09T04:42:06.282 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.275+0000 7f674759e700 1 Processor -- start 2023-06-09T04:42:06.282 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.275+0000 7f674759e700 1 -- start start 2023-06-09T04:42:06.286 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.279+0000 7f674759e700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f67480ae220 0x7f674815c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:06.286 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.279+0000 7f674759e700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f674806cbe0 0x7f674806a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:06.286 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.279+0000 7f674759e700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67480b1bc0 con 0x7f674815c820 2023-06-09T04:42:06.287 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.279+0000 7f674759e700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f674815cca0 con 0x7f674806cbe0 2023-06-09T04:42:06.287 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.279+0000 7f674759e700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67480ae5f0 con 0x7f67480ae220 2023-06-09T04:42:06.287 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.279+0000 7f6746d9d700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f674806cbe0 0x7f674806a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:06.287 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.283+0000 7f6746d9d700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f674806cbe0 0x7f674806a1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:45886/0 (socket says 172.21.15.90:45886) 2023-06-09T04:42:06.287 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.283+0000 7f6746d9d700 1 -- 172.21.15.90:0/2605068066 learned_addr learned my addr 172.21.15.90:0/2605068066 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:06.288 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.283+0000 7f674659c700 1 --2- 172.21.15.90:0/2605068066 >> v2:172.21.15.174:3300/0 conn(0x7f67480ae220 0x7f674815c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:06.288 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.283+0000 7f6746d9d700 1 -- 172.21.15.90:0/2605068066 >> v2:172.21.15.174:3300/0 conn(0x7f67480ae220 msgr2=0x7f674815c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:06.289 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.283+0000 7f6746d9d700 1 --2- 172.21.15.90:0/2605068066 >> v2:172.21.15.174:3300/0 conn(0x7f67480ae220 0x7f674815c2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:06.289 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.283+0000 7f6746d9d700 1 -- 172.21.15.90:0/2605068066 >> v1:172.21.15.174:6789/0 conn(0x7f674815c820 legacy=0x7f674806c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:06.289 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.283+0000 7f6746d9d700 1 -- 172.21.15.90:0/2605068066 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f674815cea0 con 0x7f674806cbe0 2023-06-09T04:42:06.289 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.283+0000 7f6746d9d700 1 --2- 172.21.15.90:0/2605068066 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f674806cbe0 0x7f674806a1a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f6748071690 tx=0x7f674000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d40d520c1cd94578 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:06.289 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.283+0000 7f674559a700 1 -- 172.21.15.90:0/2605068066 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f674000e070 con 0x7f674806cbe0 2023-06-09T04:42:06.289 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.283+0000 7f674559a700 1 -- 172.21.15.90:0/2605068066 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6740003a40 con 0x7f674806cbe0 2023-06-09T04:42:06.289 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.283+0000 7f674559a700 1 -- 172.21.15.90:0/2605068066 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6740003df0 con 0x7f674806cbe0 2023-06-09T04:42:06.290 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.283+0000 7f674759e700 1 -- 172.21.15.90:0/2605068066 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f674806cbe0 msgr2=0x7f674806a1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:06.290 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.283+0000 7f674759e700 1 --2- 172.21.15.90:0/2605068066 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f674806cbe0 0x7f674806a1a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f6748071690 tx=0x7f674000b330 comp rx=0 tx=0).stop 2023-06-09T04:42:06.290 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.283+0000 7f674759e700 1 -- 172.21.15.90:0/2605068066 shutdown_connections 2023-06-09T04:42:06.291 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.283+0000 7f674759e700 1 --2- 172.21.15.90:0/2605068066 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f674806cbe0 0x7f674806a1a0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:06.291 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.283+0000 7f674759e700 1 --2- 172.21.15.90:0/2605068066 >> v2:172.21.15.174:3300/0 conn(0x7f67480ae220 0x7f674815c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:06.291 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.283+0000 7f674759e700 1 -- 172.21.15.90:0/2605068066 >> 172.21.15.90:0/2605068066 conn(0x7f67480cec10 msgr2=0x7f67480cefe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:06.291 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.283+0000 7f674759e700 1 -- 172.21.15.90:0/2605068066 shutdown_connections 2023-06-09T04:42:06.291 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.283+0000 7f674759e700 1 -- 172.21.15.90:0/2605068066 wait complete. 2023-06-09T04:42:06.292 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.287+0000 7f674759e700 1 Processor -- start 2023-06-09T04:42:06.292 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.287+0000 7f674759e700 1 -- start start 2023-06-09T04:42:06.293 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.287+0000 7f674759e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f674806cbe0 0x7f67481513b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:06.293 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.287+0000 7f674759e700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f67480ae220 0x7f674815db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:06.294 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.287+0000 7f674759e700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f674815c820 0x7f6748142650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:06.294 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.287+0000 7f674759e700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f674815ef30 con 0x7f67480ae220 2023-06-09T04:42:06.294 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.287+0000 7f674759e700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f674815e080 con 0x7f674815c820 2023-06-09T04:42:06.294 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.287+0000 7f674759e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6748142b90 con 0x7f674806cbe0 2023-06-09T04:42:06.294 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.287+0000 7f6745d9b700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f67480ae220 0x7f674815db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:06.294 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.287+0000 7f6745d9b700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f67480ae220 0x7f674815db40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:45894/0 (socket says 172.21.15.90:45894) 2023-06-09T04:42:06.294 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.287+0000 7f6745d9b700 1 -- 172.21.15.90:0/2802636913 learned_addr learned my addr 172.21.15.90:0/2802636913 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:06.295 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.287+0000 7f6746d9d700 1 --2- 172.21.15.90:0/2802636913 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f674815c820 0x7f6748142650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:06.296 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.287+0000 7f674659c700 1 --2- 172.21.15.90:0/2802636913 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f674806cbe0 0x7f67481513b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:06.296 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.287+0000 7f6745d9b700 1 -- 172.21.15.90:0/2802636913 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f674806cbe0 msgr2=0x7f67481513b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:06.296 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.287+0000 7f6745d9b700 1 --2- 172.21.15.90:0/2802636913 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f674806cbe0 0x7f67481513b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:06.296 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.287+0000 7f6745d9b700 1 -- 172.21.15.90:0/2802636913 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f674815c820 msgr2=0x7f6748142650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:06.296 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.287+0000 7f6745d9b700 1 --2- 172.21.15.90:0/2802636913 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f674815c820 0x7f6748142650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:06.296 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.287+0000 7f6745d9b700 1 -- 172.21.15.90:0/2802636913 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6740009b30 con 0x7f67480ae220 2023-06-09T04:42:06.296 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.287+0000 7f674659c700 1 --2- 172.21.15.90:0/2802636913 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f674806cbe0 0x7f67481513b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:42:06.297 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.291+0000 7f6745d9b700 1 --2- 172.21.15.90:0/2802636913 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f67480ae220 0x7f674815db40 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f673c00b4a0 tx=0x7f673c00b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:06.297 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.291+0000 7f6736ffd700 1 -- 172.21.15.90:0/2802636913 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f673c011830 con 0x7f67480ae220 2023-06-09T04:42:06.297 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.291+0000 7f6736ffd700 1 -- 172.21.15.90:0/2802636913 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f673c011990 con 0x7f67480ae220 2023-06-09T04:42:06.297 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.291+0000 7f6736ffd700 1 -- 172.21.15.90:0/2802636913 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f673c011d40 con 0x7f67480ae220 2023-06-09T04:42:06.297 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.291+0000 7f674759e700 1 -- 172.21.15.90:0/2802636913 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f674815e2b0 con 0x7f67480ae220 2023-06-09T04:42:06.297 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.291+0000 7f674759e700 1 -- 172.21.15.90:0/2802636913 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f674815e870 con 0x7f67480ae220 2023-06-09T04:42:06.298 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.291+0000 7f674759e700 1 -- 172.21.15.90:0/2802636913 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f674815f070 con 0x7f67480ae220 2023-06-09T04:42:06.298 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.295+0000 7f6736ffd700 1 -- 172.21.15.90:0/2802636913 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f673c01a400 con 0x7f67480ae220 2023-06-09T04:42:06.300 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.295+0000 7f6736ffd700 1 --2- 172.21.15.90:0/2802636913 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f67280662f0 0x7f67280687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:06.300 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.295+0000 7f6736ffd700 1 -- 172.21.15.90:0/2802636913 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f673c0839c0 con 0x7f67480ae220 2023-06-09T04:42:06.301 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.295+0000 7f674659c700 1 --2- 172.21.15.90:0/2802636913 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f67280662f0 0x7f67280687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:06.302 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.295+0000 7f674659c700 1 --2- 172.21.15.90:0/2802636913 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f67280662f0 0x7f67280687a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f67480ac5f0 tx=0x7f6738008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:06.307 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.303+0000 7f6736ffd700 1 -- 172.21.15.90:0/2802636913 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f674815f070 con 0x7f67480ae220 2023-06-09T04:42:06.478 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.471+0000 7f674759e700 1 -- 172.21.15.90:0/2802636913 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f674815f070 con 0x7f67480ae220 2023-06-09T04:42:06.479 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.475+0000 7f6736ffd700 1 -- 172.21.15.90:0/2802636913 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f674815f070 con 0x7f67480ae220 2023-06-09T04:42:06.479 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 1 2023-06-09T04:42:06.482 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.475+0000 7f674759e700 1 -- 172.21.15.90:0/2802636913 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f67280662f0 msgr2=0x7f67280687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:06.482 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.475+0000 7f674759e700 1 --2- 172.21.15.90:0/2802636913 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f67280662f0 0x7f67280687a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f67480ac5f0 tx=0x7f6738008040 comp rx=0 tx=0).stop 2023-06-09T04:42:06.482 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.475+0000 7f674759e700 1 -- 172.21.15.90:0/2802636913 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f67480ae220 msgr2=0x7f674815db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:06.482 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.475+0000 7f674759e700 1 --2- 172.21.15.90:0/2802636913 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f67480ae220 0x7f674815db40 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f673c00b4a0 tx=0x7f673c00b7b0 comp rx=0 tx=0).stop 2023-06-09T04:42:06.482 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.475+0000 7f674759e700 1 -- 172.21.15.90:0/2802636913 shutdown_connections 2023-06-09T04:42:06.483 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.475+0000 7f674759e700 1 --2- 172.21.15.90:0/2802636913 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f67280662f0 0x7f67280687a0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:06.483 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.475+0000 7f674759e700 1 --2- 172.21.15.90:0/2802636913 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f674815c820 0x7f6748142650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:06.483 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.475+0000 7f674759e700 1 --2- 172.21.15.90:0/2802636913 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f67480ae220 0x7f674815db40 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:06.483 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.475+0000 7f674759e700 1 --2- 172.21.15.90:0/2802636913 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f674806cbe0 0x7f67481513b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:06.483 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.475+0000 7f674759e700 1 -- 172.21.15.90:0/2802636913 >> 172.21.15.90:0/2802636913 conn(0x7f67480cec10 msgr2=0x7f67480ab890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:06.483 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.475+0000 7f674759e700 1 -- 172.21.15.90:0/2802636913 shutdown_connections 2023-06-09T04:42:06.483 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.475+0000 7f674759e700 1 -- 172.21.15.90:0/2802636913 wait complete. 2023-06-09T04:42:06.504 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-09T04:42:06.678 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.671+0000 7feea73ca700 1 Processor -- start 2023-06-09T04:42:06.679 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.671+0000 7feea73ca700 1 -- start start 2023-06-09T04:42:06.681 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.675+0000 7feea73ca700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7feea015a3b0 0x7feea006a230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:06.681 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.675+0000 7feea73ca700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feea00c8c90 con 0x7feea00cd5a0 2023-06-09T04:42:06.682 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.675+0000 7feea73ca700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feea006a770 con 0x7feea00cb3d0 2023-06-09T04:42:06.682 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.675+0000 7feea73ca700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feea015d9a0 con 0x7feea015a3b0 2023-06-09T04:42:06.682 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.675+0000 7feea6bc9700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7feea00cd5a0 0x7feea00cd9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:55554/0 (socket says 172.21.15.90:55554) 2023-06-09T04:42:06.682 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.675+0000 7feea6bc9700 1 -- 172.21.15.90:0/2966638175 learned_addr learned my addr 172.21.15.90:0/2966638175 (peer_addr_for_me v1:172.21.15.90:0/0) 2023-06-09T04:42:06.683 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.675+0000 7feea5bc7700 1 --2- 172.21.15.90:0/2966638175 >> v2:172.21.15.174:3300/0 conn(0x7feea015a3b0 0x7feea006a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:06.683 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.675+0000 7feea53c6700 1 -- 172.21.15.90:0/2966638175 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3208942083 0 0) 0x7feea00c8c90 con 0x7feea00cd5a0 2023-06-09T04:42:06.683 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.675+0000 7feea53c6700 1 -- 172.21.15.90:0/2966638175 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee8c0035d0 con 0x7feea00cd5a0 2023-06-09T04:42:06.684 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.679+0000 7feea53c6700 1 -- 172.21.15.90:0/2966638175 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4072765538 0 0) 0x7fee8c0035d0 con 0x7feea00cd5a0 2023-06-09T04:42:06.684 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.679+0000 7feea53c6700 1 -- 172.21.15.90:0/2966638175 >> v2:172.21.15.174:3300/0 conn(0x7feea015a3b0 msgr2=0x7feea006a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:06.684 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.679+0000 7feea53c6700 1 --2- 172.21.15.90:0/2966638175 >> v2:172.21.15.174:3300/0 conn(0x7feea015a3b0 0x7feea006a230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:06.685 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.679+0000 7feea53c6700 1 -- 172.21.15.90:0/2966638175 >> v1:172.21.15.174:6789/0 conn(0x7feea00cb3d0 legacy=0x7feea00ca2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:06.685 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.679+0000 7feea53c6700 1 -- 172.21.15.90:0/2966638175 --> v1:172.21.15.90:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feea015a990 con 0x7feea00cd5a0 2023-06-09T04:42:06.685 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.679+0000 7feea53c6700 1 -- 172.21.15.90:0/2966638175 <== mon.0 v1:172.21.15.90:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3604404106 0 0) 0x7fee980019f0 con 0x7feea00cd5a0 2023-06-09T04:42:06.685 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.679+0000 7feea53c6700 1 -- 172.21.15.90:0/2966638175 >> v1:172.21.15.90:6789/0 conn(0x7feea00cd5a0 legacy=0x7feea00cd9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:06.685 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.679+0000 7feea53c6700 1 --2- 172.21.15.90:0/2966638175 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fee8c003a20 0x7fee8c003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:06.685 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.679+0000 7feea53c6700 1 --2- 172.21.15.90:0/2966638175 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fee8c004410 0x7fee8c0048d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:06.685 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.679+0000 7feea53c6700 1 --2- 172.21.15.90:0/2966638175 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fee8c0050d0 0x7fee8c00ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:06.686 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.679+0000 7feea53c6700 1 -- 172.21.15.90:0/2966638175 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feea015d9a0 con 0x7fee8c004410 2023-06-09T04:42:06.686 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.679+0000 7feea53c6700 1 -- 172.21.15.90:0/2966638175 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee8c00c020 con 0x7fee8c003a20 2023-06-09T04:42:06.686 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.679+0000 7feea53c6700 1 -- 172.21.15.90:0/2966638175 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee8c00c1e0 con 0x7fee8c0050d0 2023-06-09T04:42:06.686 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.679+0000 7feea5bc7700 1 --2- 172.21.15.90:0/2966638175 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fee8c004410 0x7fee8c0048d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:06.686 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.679+0000 7feea63c8700 1 --2- 172.21.15.90:0/2966638175 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fee8c003a20 0x7fee8c003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:06.686 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.679+0000 7feea5bc7700 1 -- 172.21.15.90:0/2966638175 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fee8c0050d0 msgr2=0x7fee8c00ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:06.686 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.679+0000 7feea5bc7700 1 --2- 172.21.15.90:0/2966638175 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fee8c0050d0 0x7fee8c00ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:06.686 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.679+0000 7feea5bc7700 1 -- 172.21.15.90:0/2966638175 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fee8c003a20 msgr2=0x7fee8c003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:06.687 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.679+0000 7feea5bc7700 1 --2- 172.21.15.90:0/2966638175 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fee8c003a20 0x7fee8c003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:06.687 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.679+0000 7feea5bc7700 1 -- 172.21.15.90:0/2966638175 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee8c0035d0 con 0x7fee8c004410 2023-06-09T04:42:06.687 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.679+0000 7feea6bc9700 1 -- 172.21.15.90:0/2966638175 reap_dead start 2023-06-09T04:42:06.688 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.679+0000 7feea5bc7700 1 --2- 172.21.15.90:0/2966638175 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fee8c004410 0x7fee8c0048d0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fee90009b70 tx=0x7fee8c0058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8cfec5ad20fae11 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:06.688 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.679+0000 7feea53c6700 1 -- 172.21.15.90:0/2966638175 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee9000e6c0 con 0x7fee8c004410 2023-06-09T04:42:06.688 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.679+0000 7feea53c6700 1 -- 172.21.15.90:0/2966638175 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee9000e820 con 0x7fee8c004410 2023-06-09T04:42:06.688 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.679+0000 7feea53c6700 1 -- 172.21.15.90:0/2966638175 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee9000ebb0 con 0x7fee8c004410 2023-06-09T04:42:06.688 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.679+0000 7feea73ca700 1 -- 172.21.15.90:0/2966638175 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fee8c004410 msgr2=0x7fee8c0048d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:06.689 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.679+0000 7feea73ca700 1 --2- 172.21.15.90:0/2966638175 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fee8c004410 0x7fee8c0048d0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fee90009b70 tx=0x7fee8c0058a0 comp rx=0 tx=0).stop 2023-06-09T04:42:06.689 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.679+0000 7feea73ca700 1 -- 172.21.15.90:0/2966638175 shutdown_connections 2023-06-09T04:42:06.689 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.679+0000 7feea73ca700 1 --2- 172.21.15.90:0/2966638175 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fee8c004410 0x7fee8c0048d0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:06.689 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.679+0000 7feea73ca700 1 -- 172.21.15.90:0/2966638175 >> 172.21.15.90:0/2966638175 conn(0x7feea00aff00 msgr2=0x7feea00b0300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:06.689 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.679+0000 7feea73ca700 1 -- 172.21.15.90:0/2966638175 shutdown_connections 2023-06-09T04:42:06.689 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.679+0000 7feea73ca700 1 -- 172.21.15.90:0/2966638175 wait complete. 2023-06-09T04:42:06.689 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.683+0000 7feea73ca700 1 Processor -- start 2023-06-09T04:42:06.690 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.683+0000 7feea73ca700 1 -- start start 2023-06-09T04:42:06.691 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.683+0000 7feea73ca700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fee8c004410 0x7feea0152270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:06.691 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.683+0000 7feea73ca700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7feea00b1200 0x7feea0158e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:06.691 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.683+0000 7feea73ca700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7feea00af930 0x7feea01593c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:06.691 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.683+0000 7feea73ca700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feea00b2010 con 0x7fee8c004410 2023-06-09T04:42:06.691 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.683+0000 7feea73ca700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feea00b1770 con 0x7feea00af930 2023-06-09T04:42:06.691 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.683+0000 7feea73ca700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feea00b1a50 con 0x7feea00b1200 2023-06-09T04:42:06.692 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.683+0000 7feea63c8700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fee8c004410 0x7feea0152270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:06.692 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.683+0000 7feea5bc7700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7feea00b1200 0x7feea0158e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:06.692 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.683+0000 7feea63c8700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fee8c004410 0x7feea0152270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:45908/0 (socket says 172.21.15.90:45908) 2023-06-09T04:42:06.692 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.683+0000 7feea63c8700 1 -- 172.21.15.90:0/3223173553 learned_addr learned my addr 172.21.15.90:0/3223173553 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:06.692 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.683+0000 7feea6bc9700 1 --2- 172.21.15.90:0/3223173553 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7feea00af930 0x7feea01593c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:06.692 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.683+0000 7feea63c8700 1 -- 172.21.15.90:0/3223173553 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7feea00b1200 msgr2=0x7feea0158e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:06.692 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.683+0000 7feea63c8700 1 --2- 172.21.15.90:0/3223173553 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7feea00b1200 0x7feea0158e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:06.693 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.683+0000 7feea63c8700 1 -- 172.21.15.90:0/3223173553 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7feea00af930 msgr2=0x7feea01593c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:06.693 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.683+0000 7feea63c8700 1 --2- 172.21.15.90:0/3223173553 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7feea00af930 0x7feea01593c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:06.693 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.683+0000 7feea63c8700 1 -- 172.21.15.90:0/3223173553 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feea00b1d30 con 0x7fee8c004410 2023-06-09T04:42:06.693 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.687+0000 7feea63c8700 1 --2- 172.21.15.90:0/3223173553 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fee8c004410 0x7feea0152270 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fee9c00e4e0 tx=0x7fee9c00e7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:06.694 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.687+0000 7fee96ffd700 1 -- 172.21.15.90:0/3223173553 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee9c00ee70 con 0x7fee8c004410 2023-06-09T04:42:06.694 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.687+0000 7fee96ffd700 1 -- 172.21.15.90:0/3223173553 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee9c0052e0 con 0x7fee8c004410 2023-06-09T04:42:06.694 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.687+0000 7feea73ca700 1 -- 172.21.15.90:0/3223173553 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feea00c36f0 con 0x7fee8c004410 2023-06-09T04:42:06.694 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.687+0000 7fee96ffd700 1 -- 172.21.15.90:0/3223173553 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee9c0036a0 con 0x7fee8c004410 2023-06-09T04:42:06.694 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.687+0000 7feea73ca700 1 -- 172.21.15.90:0/3223173553 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feea00c8370 con 0x7fee8c004410 2023-06-09T04:42:06.694 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.687+0000 7feea73ca700 1 -- 172.21.15.90:0/3223173553 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feea00c3550 con 0x7fee8c004410 2023-06-09T04:42:06.695 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.687+0000 7fee96ffd700 1 -- 172.21.15.90:0/3223173553 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fee9c003800 con 0x7fee8c004410 2023-06-09T04:42:06.695 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.691+0000 7fee96ffd700 1 --2- 172.21.15.90:0/3223173553 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fee840662f0 0x7fee840687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:06.696 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.691+0000 7fee96ffd700 1 -- 172.21.15.90:0/3223173553 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fee9c0833c0 con 0x7fee8c004410 2023-06-09T04:42:06.696 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.691+0000 7feea5bc7700 1 --2- 172.21.15.90:0/3223173553 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fee840662f0 0x7fee840687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:06.697 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.691+0000 7feea5bc7700 1 --2- 172.21.15.90:0/3223173553 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fee840662f0 0x7fee840687a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fee900090b0 tx=0x7fee9001f040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:06.701 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.695+0000 7fee96ffd700 1 -- 172.21.15.90:0/3223173553 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7feea00c3550 con 0x7fee8c004410 2023-06-09T04:42:06.872 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.867+0000 7feea73ca700 1 -- 172.21.15.90:0/3223173553 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7feea00c3550 con 0x7fee8c004410 2023-06-09T04:42:06.873 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.867+0000 7fee96ffd700 1 -- 172.21.15.90:0/3223173553 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7feea00c3550 con 0x7fee8c004410 2023-06-09T04:42:06.873 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 8 2023-06-09T04:42:06.877 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.871+0000 7feea73ca700 1 -- 172.21.15.90:0/3223173553 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fee840662f0 msgr2=0x7fee840687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:06.878 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.871+0000 7feea73ca700 1 --2- 172.21.15.90:0/3223173553 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fee840662f0 0x7fee840687a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fee900090b0 tx=0x7fee9001f040 comp rx=0 tx=0).stop 2023-06-09T04:42:06.878 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.871+0000 7feea73ca700 1 -- 172.21.15.90:0/3223173553 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fee8c004410 msgr2=0x7feea0152270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:06.878 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.871+0000 7feea73ca700 1 --2- 172.21.15.90:0/3223173553 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fee8c004410 0x7feea0152270 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fee9c00e4e0 tx=0x7fee9c00e7f0 comp rx=0 tx=0).stop 2023-06-09T04:42:06.878 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.871+0000 7feea73ca700 1 -- 172.21.15.90:0/3223173553 shutdown_connections 2023-06-09T04:42:06.878 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.871+0000 7feea73ca700 1 --2- 172.21.15.90:0/3223173553 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fee840662f0 0x7fee840687a0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:06.879 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.871+0000 7feea73ca700 1 --2- 172.21.15.90:0/3223173553 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7feea00af930 0x7feea01593c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:06.879 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.871+0000 7feea73ca700 1 --2- 172.21.15.90:0/3223173553 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7feea00b1200 0x7feea0158e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:06.879 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.871+0000 7feea73ca700 1 --2- 172.21.15.90:0/3223173553 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fee8c004410 0x7feea0152270 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:06.879 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.871+0000 7feea73ca700 1 -- 172.21.15.90:0/3223173553 >> 172.21.15.90:0/3223173553 conn(0x7feea00aff00 msgr2=0x7feea00ade50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:06.879 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.871+0000 7feea73ca700 1 -- 172.21.15.90:0/3223173553 shutdown_connections 2023-06-09T04:42:06.879 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:06.871+0000 7feea73ca700 1 -- 172.21.15.90:0/3223173553 wait complete. 2023-06-09T04:42:06.898 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-09T04:42:07.080 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.075+0000 7f6dbb48c700 1 Processor -- start 2023-06-09T04:42:07.080 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.075+0000 7f6dbb48c700 1 -- start start 2023-06-09T04:42:07.082 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.075+0000 7f6dbb48c700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6db40ae220 0x7f6db415c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:07.083 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.079+0000 7f6dbb48c700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6db415cc70 con 0x7f6db406cbe0 2023-06-09T04:42:07.083 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.079+0000 7f6dbb48c700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6db40b1bc0 con 0x7f6db415c820 2023-06-09T04:42:07.083 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.079+0000 7f6dbb48c700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6db40ae5f0 con 0x7f6db40ae220 2023-06-09T04:42:07.084 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.079+0000 7f6dbac8b700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f6db406cbe0 0x7f6db406a1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:55568/0 (socket says 172.21.15.90:55568) 2023-06-09T04:42:07.084 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.079+0000 7f6dbac8b700 1 -- 172.21.15.90:0/3471877489 learned_addr learned my addr 172.21.15.90:0/3471877489 (peer_addr_for_me v1:172.21.15.90:0/0) 2023-06-09T04:42:07.084 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.079+0000 7f6dba48a700 1 --2- 172.21.15.90:0/3471877489 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6db40ae220 0x7f6db415c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:07.085 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.079+0000 7f6db9488700 1 -- 172.21.15.90:0/3471877489 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3950520991 0 0) 0x7f6db415cc70 con 0x7f6db406cbe0 2023-06-09T04:42:07.085 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.079+0000 7f6db9488700 1 -- 172.21.15.90:0/3471877489 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6da00035d0 con 0x7f6db406cbe0 2023-06-09T04:42:07.085 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.079+0000 7f6db9488700 1 -- 172.21.15.90:0/3471877489 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3258390813 0 0) 0x7f6db40b1bc0 con 0x7f6db415c820 2023-06-09T04:42:07.085 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.079+0000 7f6dba48a700 1 -- 172.21.15.90:0/3471877489 >> v1:172.21.15.174:6789/0 conn(0x7f6db415c820 legacy=0x7f6db406c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:07.086 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.079+0000 7f6dba48a700 1 -- 172.21.15.90:0/3471877489 >> v1:172.21.15.90:6789/0 conn(0x7f6db406cbe0 legacy=0x7f6db406a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:07.086 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.079+0000 7f6dba48a700 1 -- 172.21.15.90:0/3471877489 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6db415cea0 con 0x7f6db40ae220 2023-06-09T04:42:07.086 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.079+0000 7f6dba48a700 1 --2- 172.21.15.90:0/3471877489 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6db40ae220 0x7f6db415c2e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f6db0009880 tx=0x7f6db0009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1285c583cebdf8cf server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:07.086 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.079+0000 7f6db9488700 1 -- 172.21.15.90:0/3471877489 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6db0011830 con 0x7f6db40ae220 2023-06-09T04:42:07.087 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.079+0000 7f6db9488700 1 -- 172.21.15.90:0/3471877489 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6db0011990 con 0x7f6db40ae220 2023-06-09T04:42:07.087 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.079+0000 7f6db9488700 1 -- 172.21.15.90:0/3471877489 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6db0011d20 con 0x7f6db40ae220 2023-06-09T04:42:07.087 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.083+0000 7f6dbb48c700 1 -- 172.21.15.90:0/3471877489 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6db40ae220 msgr2=0x7f6db415c2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:07.087 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.083+0000 7f6dbb48c700 1 --2- 172.21.15.90:0/3471877489 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6db40ae220 0x7f6db415c2e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f6db0009880 tx=0x7f6db0009b90 comp rx=0 tx=0).stop 2023-06-09T04:42:07.088 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.083+0000 7f6dbb48c700 1 -- 172.21.15.90:0/3471877489 shutdown_connections 2023-06-09T04:42:07.088 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.083+0000 7f6dbb48c700 1 --2- 172.21.15.90:0/3471877489 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6db40ae220 0x7f6db415c2e0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:07.088 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.083+0000 7f6dbb48c700 1 -- 172.21.15.90:0/3471877489 >> 172.21.15.90:0/3471877489 conn(0x7f6db40cec10 msgr2=0x7f6db40cefe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:07.088 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.083+0000 7f6dbb48c700 1 -- 172.21.15.90:0/3471877489 shutdown_connections 2023-06-09T04:42:07.089 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.083+0000 7f6dbb48c700 1 -- 172.21.15.90:0/3471877489 wait complete. 2023-06-09T04:42:07.091 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.087+0000 7f6dbb48c700 1 Processor -- start 2023-06-09T04:42:07.091 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.087+0000 7f6dbb48c700 1 -- start start 2023-06-09T04:42:07.093 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.087+0000 7f6dbb48c700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6db406cbe0 0x7f6db41f4740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:07.093 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.087+0000 7f6dbb48c700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6db40ae220 0x7f6db41f17b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:07.093 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.087+0000 7f6dbb48c700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6db415c820 0x7f6db41f1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:07.094 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.087+0000 7f6dbb48c700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6db40aec90 con 0x7f6db40ae220 2023-06-09T04:42:07.094 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.087+0000 7f6dbb48c700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6db41f22f0 con 0x7f6db415c820 2023-06-09T04:42:07.094 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.087+0000 7f6dbb48c700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6db41f25d0 con 0x7f6db406cbe0 2023-06-09T04:42:07.095 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.087+0000 7f6db9c89700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6db40ae220 0x7f6db41f17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:07.095 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.087+0000 7f6db9c89700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6db40ae220 0x7f6db41f17b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:45916/0 (socket says 172.21.15.90:45916) 2023-06-09T04:42:07.095 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.087+0000 7f6db9c89700 1 -- 172.21.15.90:0/2927982496 learned_addr learned my addr 172.21.15.90:0/2927982496 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:07.096 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.087+0000 7f6dba48a700 1 --2- 172.21.15.90:0/2927982496 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6db406cbe0 0x7f6db41f4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:07.096 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.087+0000 7f6dbac8b700 1 --2- 172.21.15.90:0/2927982496 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6db415c820 0x7f6db41f1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:07.096 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.087+0000 7f6db9c89700 1 -- 172.21.15.90:0/2927982496 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6db406cbe0 msgr2=0x7f6db41f4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:07.096 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.087+0000 7f6db9c89700 1 --2- 172.21.15.90:0/2927982496 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6db406cbe0 0x7f6db41f4740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:07.096 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.087+0000 7f6db9c89700 1 -- 172.21.15.90:0/2927982496 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6db415c820 msgr2=0x7f6db41f1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:07.096 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.087+0000 7f6db9c89700 1 --2- 172.21.15.90:0/2927982496 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6db415c820 0x7f6db41f1cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:07.097 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.087+0000 7f6db9c89700 1 -- 172.21.15.90:0/2927982496 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6db00094b0 con 0x7f6db40ae220 2023-06-09T04:42:07.097 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.087+0000 7f6db9c89700 1 --2- 172.21.15.90:0/2927982496 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6db40ae220 0x7f6db41f17b0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f6da40011e0 tx=0x7f6da400cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:07.097 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.091+0000 7f6daaffd700 1 -- 172.21.15.90:0/2927982496 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6da40054e0 con 0x7f6db40ae220 2023-06-09T04:42:07.097 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.091+0000 7f6daaffd700 1 -- 172.21.15.90:0/2927982496 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6da40036a0 con 0x7f6db40ae220 2023-06-09T04:42:07.097 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.091+0000 7f6dbb48c700 1 -- 172.21.15.90:0/2927982496 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6db40ae8b0 con 0x7f6db40ae220 2023-06-09T04:42:07.097 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.091+0000 7f6daaffd700 1 -- 172.21.15.90:0/2927982496 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6da4003a50 con 0x7f6db40ae220 2023-06-09T04:42:07.097 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.091+0000 7f6dbb48c700 1 -- 172.21.15.90:0/2927982496 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6db41514e0 con 0x7f6db40ae220 2023-06-09T04:42:07.098 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.091+0000 7f6dbb48c700 1 -- 172.21.15.90:0/2927982496 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6db40aedd0 con 0x7f6db40ae220 2023-06-09T04:42:07.098 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.091+0000 7f6daaffd700 1 -- 172.21.15.90:0/2927982496 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6da4003bb0 con 0x7f6db40ae220 2023-06-09T04:42:07.100 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.095+0000 7f6daaffd700 1 --2- 172.21.15.90:0/2927982496 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f6d980662f0 0x7f6d980687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:07.100 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.095+0000 7f6daaffd700 1 -- 172.21.15.90:0/2927982496 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6da40831c0 con 0x7f6db40ae220 2023-06-09T04:42:07.100 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.095+0000 7f6dba48a700 1 --2- 172.21.15.90:0/2927982496 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f6d980662f0 0x7f6d980687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:07.101 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.095+0000 7f6dba48a700 1 --2- 172.21.15.90:0/2927982496 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f6d980662f0 0x7f6d980687a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f6db00090b0 tx=0x7f6db001c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:07.104 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.099+0000 7f6daaffd700 1 -- 172.21.15.90:0/2927982496 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6db40aedd0 con 0x7f6db40ae220 2023-06-09T04:42:07.278 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.271+0000 7f6dbb48c700 1 -- 172.21.15.90:0/2927982496 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6db40aedd0 con 0x7f6db40ae220 2023-06-09T04:42:07.279 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.275+0000 7f6daaffd700 1 -- 172.21.15.90:0/2927982496 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6db40aedd0 con 0x7f6db40ae220 2023-06-09T04:42:07.279 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 32 2023-06-09T04:42:07.281 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.275+0000 7f6dbb48c700 1 -- 172.21.15.90:0/2927982496 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f6d980662f0 msgr2=0x7f6d980687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:07.282 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.275+0000 7f6dbb48c700 1 --2- 172.21.15.90:0/2927982496 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f6d980662f0 0x7f6d980687a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f6db00090b0 tx=0x7f6db001c040 comp rx=0 tx=0).stop 2023-06-09T04:42:07.282 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.275+0000 7f6dbb48c700 1 -- 172.21.15.90:0/2927982496 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6db40ae220 msgr2=0x7f6db41f17b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:07.282 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.275+0000 7f6dbb48c700 1 --2- 172.21.15.90:0/2927982496 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6db40ae220 0x7f6db41f17b0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f6da40011e0 tx=0x7f6da400cae0 comp rx=0 tx=0).stop 2023-06-09T04:42:07.282 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.275+0000 7f6dbb48c700 1 -- 172.21.15.90:0/2927982496 shutdown_connections 2023-06-09T04:42:07.283 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.275+0000 7f6dbb48c700 1 --2- 172.21.15.90:0/2927982496 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f6d980662f0 0x7f6d980687a0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:07.283 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.275+0000 7f6dbb48c700 1 --2- 172.21.15.90:0/2927982496 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6db415c820 0x7f6db41f1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:07.283 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.275+0000 7f6dbb48c700 1 --2- 172.21.15.90:0/2927982496 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6db40ae220 0x7f6db41f17b0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:07.283 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.275+0000 7f6dbb48c700 1 --2- 172.21.15.90:0/2927982496 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6db406cbe0 0x7f6db41f4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:07.283 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.275+0000 7f6dbb48c700 1 -- 172.21.15.90:0/2927982496 >> 172.21.15.90:0/2927982496 conn(0x7f6db40cec10 msgr2=0x7f6db40acf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:07.283 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.275+0000 7f6dbb48c700 1 -- 172.21.15.90:0/2927982496 shutdown_connections 2023-06-09T04:42:07.284 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.275+0000 7f6dbb48c700 1 -- 172.21.15.90:0/2927982496 wait complete. 2023-06-09T04:42:07.302 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-09T04:42:07.484 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.479+0000 7f6a4e46d700 1 Processor -- start 2023-06-09T04:42:07.484 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.479+0000 7f6a4e46d700 1 -- start start 2023-06-09T04:42:07.487 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.483+0000 7f6a4e46d700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f6a4815bf60 0x7f6a480cda20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:07.488 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.483+0000 7f6a4e46d700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a4815c330 con 0x7f6a48160450 2023-06-09T04:42:07.488 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.483+0000 7f6a4e46d700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a4806f960 con 0x7f6a480cb370 2023-06-09T04:42:07.488 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.483+0000 7f6a4e46d700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a480c51f0 con 0x7f6a4815bf60 2023-06-09T04:42:07.489 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.483+0000 7f6a4cc6a700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f6a48160450 0x7f6a480cac60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:55578/0 (socket says 172.21.15.90:55578) 2023-06-09T04:42:07.489 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.483+0000 7f6a4cc6a700 1 -- 172.21.15.90:0/2649590546 learned_addr learned my addr 172.21.15.90:0/2649590546 (peer_addr_for_me v1:172.21.15.90:0/0) 2023-06-09T04:42:07.489 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.483+0000 7f6a4d46b700 1 --2- 172.21.15.90:0/2649590546 >> v2:172.21.15.90:3300/0 conn(0x7f6a4815bf60 0x7f6a480cda20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:07.489 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.483+0000 7f6a4d46b700 1 -- 172.21.15.90:0/2649590546 >> v1:172.21.15.174:6789/0 conn(0x7f6a480cb370 legacy=0x7f6a48069820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:07.490 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.483+0000 7f6a4d46b700 1 -- 172.21.15.90:0/2649590546 >> v1:172.21.15.90:6789/0 conn(0x7f6a48160450 legacy=0x7f6a480cac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:07.490 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.483+0000 7f6a4d46b700 1 -- 172.21.15.90:0/2649590546 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a480cc520 con 0x7f6a4815bf60 2023-06-09T04:42:07.490 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.483+0000 7f6a3ffff700 1 -- 172.21.15.90:0/2649590546 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3924300794 0 0) 0x7f6a4815c330 con 0x7f6a48160450 2023-06-09T04:42:07.490 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.483+0000 7f6a4d46b700 1 --2- 172.21.15.90:0/2649590546 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6a4815bf60 0x7f6a480cda20 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f6a44009850 tx=0x7f6a44009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72efb93165119af3 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:07.491 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.483+0000 7f6a3ffff700 1 -- 172.21.15.90:0/2649590546 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a44011830 con 0x7f6a4815bf60 2023-06-09T04:42:07.491 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.483+0000 7f6a3ffff700 1 -- 172.21.15.90:0/2649590546 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a44011990 con 0x7f6a4815bf60 2023-06-09T04:42:07.491 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.483+0000 7f6a3ffff700 1 -- 172.21.15.90:0/2649590546 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a44011d20 con 0x7f6a4815bf60 2023-06-09T04:42:07.492 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.487+0000 7f6a4e46d700 1 -- 172.21.15.90:0/2649590546 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6a4815bf60 msgr2=0x7f6a480cda20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:07.492 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.487+0000 7f6a4e46d700 1 --2- 172.21.15.90:0/2649590546 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6a4815bf60 0x7f6a480cda20 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f6a44009850 tx=0x7f6a44009b60 comp rx=0 tx=0).stop 2023-06-09T04:42:07.492 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.487+0000 7f6a4e46d700 1 -- 172.21.15.90:0/2649590546 shutdown_connections 2023-06-09T04:42:07.492 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.487+0000 7f6a4e46d700 1 --2- 172.21.15.90:0/2649590546 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6a4815bf60 0x7f6a480cda20 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:07.492 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.487+0000 7f6a4e46d700 1 -- 172.21.15.90:0/2649590546 >> 172.21.15.90:0/2649590546 conn(0x7f6a480aff00 msgr2=0x7f6a480b0300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:07.493 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.487+0000 7f6a4e46d700 1 -- 172.21.15.90:0/2649590546 shutdown_connections 2023-06-09T04:42:07.493 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.487+0000 7f6a4e46d700 1 -- 172.21.15.90:0/2649590546 wait complete. 2023-06-09T04:42:07.494 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.487+0000 7f6a4e46d700 1 Processor -- start 2023-06-09T04:42:07.494 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.487+0000 7f6a4e46d700 1 -- start start 2023-06-09T04:42:07.495 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.491+0000 7f6a4e46d700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6a480cb370 0x7f6a4814f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:07.495 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.491+0000 7f6a4e46d700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6a4815bf60 0x7f6a4815a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:07.495 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.491+0000 7f6a4e46d700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6a48160450 0x7f6a4815a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:07.495 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.491+0000 7f6a4e46d700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a4814ffd0 con 0x7f6a4815bf60 2023-06-09T04:42:07.496 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.491+0000 7f6a4e46d700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a481f1850 con 0x7f6a480cb370 2023-06-09T04:42:07.496 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.491+0000 7f6a4e46d700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a481f23c0 con 0x7f6a48160450 2023-06-09T04:42:07.496 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.491+0000 7f6a4cc6a700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6a4815bf60 0x7f6a4815a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:07.497 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.491+0000 7f6a4cc6a700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6a4815bf60 0x7f6a4815a050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:45948/0 (socket says 172.21.15.90:45948) 2023-06-09T04:42:07.497 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.491+0000 7f6a4cc6a700 1 -- 172.21.15.90:0/1324502413 learned_addr learned my addr 172.21.15.90:0/1324502413 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:07.497 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.491+0000 7f6a4d46b700 1 --2- 172.21.15.90:0/1324502413 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6a480cb370 0x7f6a4814f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:07.497 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.491+0000 7f6a4dc6c700 1 --2- 172.21.15.90:0/1324502413 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6a48160450 0x7f6a4815a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:07.498 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.491+0000 7f6a4cc6a700 1 -- 172.21.15.90:0/1324502413 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6a48160450 msgr2=0x7f6a4815a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:07.498 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.491+0000 7f6a4cc6a700 1 --2- 172.21.15.90:0/1324502413 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6a48160450 0x7f6a4815a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:07.498 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.491+0000 7f6a4cc6a700 1 -- 172.21.15.90:0/1324502413 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6a480cb370 msgr2=0x7f6a4814f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:07.498 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.491+0000 7f6a4cc6a700 1 --2- 172.21.15.90:0/1324502413 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6a480cb370 0x7f6a4814f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:07.498 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.491+0000 7f6a4cc6a700 1 -- 172.21.15.90:0/1324502413 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a440094b0 con 0x7f6a4815bf60 2023-06-09T04:42:07.498 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.491+0000 7f6a4dc6c700 1 --2- 172.21.15.90:0/1324502413 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6a48160450 0x7f6a4815a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:42:07.498 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.491+0000 7f6a4cc6a700 1 --2- 172.21.15.90:0/1324502413 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6a4815bf60 0x7f6a4815a050 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f6a3800c4d0 tx=0x7f6a3800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:07.498 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.491+0000 7f6a3dffb700 1 -- 172.21.15.90:0/1324502413 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a38004ca0 con 0x7f6a4815bf60 2023-06-09T04:42:07.499 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.491+0000 7f6a3dffb700 1 -- 172.21.15.90:0/1324502413 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a38004e00 con 0x7f6a4815bf60 2023-06-09T04:42:07.499 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.491+0000 7f6a4e46d700 1 -- 172.21.15.90:0/1324502413 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a481f1a90 con 0x7f6a4815bf60 2023-06-09T04:42:07.499 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.491+0000 7f6a3dffb700 1 -- 172.21.15.90:0/1324502413 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a38007310 con 0x7f6a4815bf60 2023-06-09T04:42:07.499 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.491+0000 7f6a4e46d700 1 -- 172.21.15.90:0/1324502413 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a481f2050 con 0x7f6a4815bf60 2023-06-09T04:42:07.499 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.491+0000 7f6a4e46d700 1 -- 172.21.15.90:0/1324502413 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a4804e380 con 0x7f6a4815bf60 2023-06-09T04:42:07.501 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.495+0000 7f6a3dffb700 1 -- 172.21.15.90:0/1324502413 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6a38007470 con 0x7f6a4815bf60 2023-06-09T04:42:07.502 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.495+0000 7f6a3dffb700 1 --2- 172.21.15.90:0/1324502413 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f6a2c0662f0 0x7f6a2c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:07.502 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.495+0000 7f6a3dffb700 1 -- 172.21.15.90:0/1324502413 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6a38083a50 con 0x7f6a4815bf60 2023-06-09T04:42:07.503 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.499+0000 7f6a4d46b700 1 --2- 172.21.15.90:0/1324502413 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f6a2c0662f0 0x7f6a2c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:07.504 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.499+0000 7f6a4d46b700 1 --2- 172.21.15.90:0/1324502413 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f6a2c0662f0 0x7f6a2c0687a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6a440090b0 tx=0x7f6a44008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:07.507 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.503+0000 7f6a3dffb700 1 -- 172.21.15.90:0/1324502413 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6a38050da0 con 0x7f6a4815bf60 2023-06-09T04:42:07.680 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.675+0000 7f6a4e46d700 1 -- 172.21.15.90:0/1324502413 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6a48071c20 con 0x7f6a4815bf60 2023-06-09T04:42:07.681 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.675+0000 7f6a3dffb700 1 -- 172.21.15.90:0/1324502413 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6a38007720 con 0x7f6a4815bf60 2023-06-09T04:42:07.681 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 64 2023-06-09T04:42:07.684 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.679+0000 7f6a4e46d700 1 -- 172.21.15.90:0/1324502413 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f6a2c0662f0 msgr2=0x7f6a2c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:07.684 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.679+0000 7f6a4e46d700 1 --2- 172.21.15.90:0/1324502413 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f6a2c0662f0 0x7f6a2c0687a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6a440090b0 tx=0x7f6a44008030 comp rx=0 tx=0).stop 2023-06-09T04:42:07.684 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.679+0000 7f6a4e46d700 1 -- 172.21.15.90:0/1324502413 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6a4815bf60 msgr2=0x7f6a4815a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:07.684 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.679+0000 7f6a4e46d700 1 --2- 172.21.15.90:0/1324502413 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6a4815bf60 0x7f6a4815a050 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f6a3800c4d0 tx=0x7f6a3800c890 comp rx=0 tx=0).stop 2023-06-09T04:42:07.684 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.679+0000 7f6a4e46d700 1 -- 172.21.15.90:0/1324502413 shutdown_connections 2023-06-09T04:42:07.685 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.679+0000 7f6a4e46d700 1 --2- 172.21.15.90:0/1324502413 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f6a2c0662f0 0x7f6a2c0687a0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:07.685 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.679+0000 7f6a4e46d700 1 --2- 172.21.15.90:0/1324502413 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6a48160450 0x7f6a4815a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:07.685 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.679+0000 7f6a4e46d700 1 --2- 172.21.15.90:0/1324502413 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6a4815bf60 0x7f6a4815a050 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:07.685 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.679+0000 7f6a4e46d700 1 --2- 172.21.15.90:0/1324502413 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6a480cb370 0x7f6a4814f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:07.685 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.679+0000 7f6a4e46d700 1 -- 172.21.15.90:0/1324502413 >> 172.21.15.90:0/1324502413 conn(0x7f6a480aff00 msgr2=0x7f6a480ab890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:07.686 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.679+0000 7f6a4e46d700 1 -- 172.21.15.90:0/1324502413 shutdown_connections 2023-06-09T04:42:07.686 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.679+0000 7f6a4e46d700 1 -- 172.21.15.90:0/1324502413 wait complete. 2023-06-09T04:42:07.706 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-09T04:42:07.875 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.867+0000 7f6246607700 1 Processor -- start 2023-06-09T04:42:07.875 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.871+0000 7f6246607700 1 -- start start 2023-06-09T04:42:07.877 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.871+0000 7f6246607700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f624015bf60 0x7f624006f960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:07.877 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.871+0000 7f6246607700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f62400cc0f0 0x7f62400cd750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:07.877 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.871+0000 7f6246607700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f62400cdc90 0x7f62400ab890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:07.878 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.871+0000 7f6246607700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f624006fea0 con 0x7f62400cdc90 2023-06-09T04:42:07.878 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.871+0000 7f6246607700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62400cc6b0 con 0x7f624015bf60 2023-06-09T04:42:07.878 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.871+0000 7f6246607700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62400cc990 con 0x7f62400cc0f0 2023-06-09T04:42:07.879 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.871+0000 7f6245e06700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f62400cdc90 0x7f62400ab890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:07.879 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.871+0000 7f6245e06700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f62400cdc90 0x7f62400ab890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:45962/0 (socket says 172.21.15.90:45962) 2023-06-09T04:42:07.879 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.871+0000 7f6245e06700 1 -- 172.21.15.90:0/3687545895 learned_addr learned my addr 172.21.15.90:0/3687545895 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:07.880 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.871+0000 7f6245605700 1 --2- 172.21.15.90:0/3687545895 >> v2:172.21.15.174:3300/0 conn(0x7f624015bf60 0x7f624006f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:07.880 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.871+0000 7f6244e04700 1 --2- 172.21.15.90:0/3687545895 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f62400cc0f0 0x7f62400cd750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:07.880 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.871+0000 7f6245e06700 1 -- 172.21.15.90:0/3687545895 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f62400cc0f0 msgr2=0x7f62400cd750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:07.880 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.871+0000 7f6245e06700 1 --2- 172.21.15.90:0/3687545895 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f62400cc0f0 0x7f62400cd750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:07.880 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.871+0000 7f6245e06700 1 -- 172.21.15.90:0/3687545895 >> v2:172.21.15.174:3300/0 conn(0x7f624015bf60 msgr2=0x7f624006f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:07.880 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.871+0000 7f6245e06700 1 --2- 172.21.15.90:0/3687545895 >> v2:172.21.15.174:3300/0 conn(0x7f624015bf60 0x7f624006f960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:07.880 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.871+0000 7f6245e06700 1 -- 172.21.15.90:0/3687545895 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62400ccc70 con 0x7f62400cdc90 2023-06-09T04:42:07.881 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.871+0000 7f6245605700 1 --2- 172.21.15.90:0/3687545895 >> v2:172.21.15.174:3300/0 conn(0x7f624015bf60 0x7f624006f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:42:07.881 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.875+0000 7f6245e06700 1 --2- 172.21.15.90:0/3687545895 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f62400cdc90 0x7f62400ab890 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f62400cbd70 tx=0x7f623800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d813fa22aec9a540 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:07.882 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.875+0000 7f6233fff700 1 -- 172.21.15.90:0/3687545895 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f623800e070 con 0x7f62400cdc90 2023-06-09T04:42:07.882 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.875+0000 7f6233fff700 1 -- 172.21.15.90:0/3687545895 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f623800b9c0 con 0x7f62400cdc90 2023-06-09T04:42:07.882 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.875+0000 7f6233fff700 1 -- 172.21.15.90:0/3687545895 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f623800bd70 con 0x7f62400cdc90 2023-06-09T04:42:07.882 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.875+0000 7f6246607700 1 -- 172.21.15.90:0/3687545895 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f62400cdc90 msgr2=0x7f62400ab890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:07.883 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.875+0000 7f6246607700 1 --2- 172.21.15.90:0/3687545895 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f62400cdc90 0x7f62400ab890 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f62400cbd70 tx=0x7f623800b330 comp rx=0 tx=0).stop 2023-06-09T04:42:07.883 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.875+0000 7f6246607700 1 -- 172.21.15.90:0/3687545895 shutdown_connections 2023-06-09T04:42:07.883 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.875+0000 7f6246607700 1 --2- 172.21.15.90:0/3687545895 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f62400cdc90 0x7f62400ab890 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:07.883 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.875+0000 7f6246607700 1 --2- 172.21.15.90:0/3687545895 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f62400cc0f0 0x7f62400cd750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:07.883 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.875+0000 7f6246607700 1 --2- 172.21.15.90:0/3687545895 >> v2:172.21.15.174:3300/0 conn(0x7f624015bf60 0x7f624006f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:07.883 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.875+0000 7f6246607700 1 -- 172.21.15.90:0/3687545895 >> 172.21.15.90:0/3687545895 conn(0x7f624006c690 msgr2=0x7f62400aff00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:07.883 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.875+0000 7f6246607700 1 -- 172.21.15.90:0/3687545895 shutdown_connections 2023-06-09T04:42:07.884 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.875+0000 7f6246607700 1 -- 172.21.15.90:0/3687545895 wait complete. 2023-06-09T04:42:07.885 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.879+0000 7f6246607700 1 Processor -- start 2023-06-09T04:42:07.885 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.879+0000 7f6246607700 1 -- start start 2023-06-09T04:42:07.887 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.883+0000 7f6246607700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f62400cc0f0 0x7f6240152d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:07.887 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.883+0000 7f6246607700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f62400cdc90 0x7f6240151820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:07.887 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.883+0000 7f6246607700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f624015bf60 0x7f6240154b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:07.887 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.883+0000 7f6246607700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62400b25f0 con 0x7f624015bf60 2023-06-09T04:42:07.887 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.883+0000 7f6246607700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62401532d0 con 0x7f62400cc0f0 2023-06-09T04:42:07.887 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.883+0000 7f6246607700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62400b2030 con 0x7f62400cdc90 2023-06-09T04:42:07.888 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.883+0000 7f6245e06700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f624015bf60 0x7f6240154b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:07.889 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.883+0000 7f6245e06700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f624015bf60 0x7f6240154b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:45968/0 (socket says 172.21.15.90:45968) 2023-06-09T04:42:07.889 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.883+0000 7f6245e06700 1 -- 172.21.15.90:0/1790209371 learned_addr learned my addr 172.21.15.90:0/1790209371 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:07.889 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.883+0000 7f6245605700 1 --2- 172.21.15.90:0/1790209371 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f62400cc0f0 0x7f6240152d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:07.889 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.883+0000 7f6244e04700 1 --2- 172.21.15.90:0/1790209371 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f62400cdc90 0x7f6240151820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:07.889 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.883+0000 7f6245e06700 1 -- 172.21.15.90:0/1790209371 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f62400cdc90 msgr2=0x7f6240151820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:07.889 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.883+0000 7f6245e06700 1 --2- 172.21.15.90:0/1790209371 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f62400cdc90 0x7f6240151820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:07.890 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.883+0000 7f6245e06700 1 -- 172.21.15.90:0/1790209371 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f62400cc0f0 msgr2=0x7f6240152d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:07.890 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.883+0000 7f6245e06700 1 --2- 172.21.15.90:0/1790209371 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f62400cc0f0 0x7f6240152d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:07.890 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.883+0000 7f6245e06700 1 -- 172.21.15.90:0/1790209371 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6238009b30 con 0x7f624015bf60 2023-06-09T04:42:07.890 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.883+0000 7f6245605700 1 --2- 172.21.15.90:0/1790209371 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f62400cc0f0 0x7f6240152d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:42:07.890 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.883+0000 7f6245e06700 1 --2- 172.21.15.90:0/1790209371 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f624015bf60 0x7f6240154b80 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f624006f620 tx=0x7f6238004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:07.891 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.883+0000 7f6231ffb700 1 -- 172.21.15.90:0/1790209371 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6238004250 con 0x7f624015bf60 2023-06-09T04:42:07.891 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.883+0000 7f6231ffb700 1 -- 172.21.15.90:0/1790209371 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62380043b0 con 0x7f624015bf60 2023-06-09T04:42:07.891 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.883+0000 7f6246607700 1 -- 172.21.15.90:0/1790209371 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62400b2310 con 0x7f624015bf60 2023-06-09T04:42:07.891 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.883+0000 7f6231ffb700 1 -- 172.21.15.90:0/1790209371 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6238004760 con 0x7f624015bf60 2023-06-09T04:42:07.891 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.883+0000 7f6246607700 1 -- 172.21.15.90:0/1790209371 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62400b2dd0 con 0x7f624015bf60 2023-06-09T04:42:07.892 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.887+0000 7f6246607700 1 -- 172.21.15.90:0/1790209371 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62400b2ff0 con 0x7f624015bf60 2023-06-09T04:42:07.893 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.887+0000 7f6231ffb700 1 -- 172.21.15.90:0/1790209371 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f623801c440 con 0x7f624015bf60 2023-06-09T04:42:07.895 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.891+0000 7f6231ffb700 1 --2- 172.21.15.90:0/1790209371 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f62240662f0 0x7f62240687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:07.895 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.891+0000 7f6231ffb700 1 -- 172.21.15.90:0/1790209371 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6238085480 con 0x7f624015bf60 2023-06-09T04:42:07.895 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.891+0000 7f6245605700 1 --2- 172.21.15.90:0/1790209371 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f62240662f0 0x7f62240687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:07.897 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.891+0000 7f6245605700 1 --2- 172.21.15.90:0/1790209371 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f62240662f0 0x7f62240687a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f62401f5d80 tx=0x7f623c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:07.901 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:07.895+0000 7f6231ffb700 1 -- 172.21.15.90:0/1790209371 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6238052990 con 0x7f624015bf60 2023-06-09T04:42:08.109 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.103+0000 7f6246607700 1 -- 172.21.15.90:0/1790209371 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f624004e380 con 0x7f624015bf60 2023-06-09T04:42:08.111 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.103+0000 7f6231ffb700 1 -- 172.21.15.90:0/1790209371 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4668 (secure 0 0 0) 0x7f6238055fb0 con 0x7f624015bf60 2023-06-09T04:42:08.111 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:42:08.111 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6836/271257743","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":271257743},{"type":"v1","addr":"172.21.15.174:6836","nonce":271257743}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4269,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6833/2861565528","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":2861565528},{"type":"v1","addr":"172.21.15.90:6833","nonce":2861565528}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/1212048840","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1212048840},{"type":"v1","addr":"172.21.15.90:6835","nonce":1212048840}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-09T04:41:54.383738+0000","modified":"2023-06-09T04:41:57.405504+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4306},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4306":{"gid":4306,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.174:6837/2976585572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6835","nonce":2976585572},{"type":"v1","addr":"172.21.15.174:6837","nonce":2976585572}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-06-09T04:42:08.113 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.107+0000 7f6246607700 1 -- 172.21.15.90:0/1790209371 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f62240662f0 msgr2=0x7f62240687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:08.113 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.107+0000 7f6246607700 1 --2- 172.21.15.90:0/1790209371 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f62240662f0 0x7f62240687a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f62401f5d80 tx=0x7f623c008040 comp rx=0 tx=0).stop 2023-06-09T04:42:08.114 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.107+0000 7f6246607700 1 -- 172.21.15.90:0/1790209371 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f624015bf60 msgr2=0x7f6240154b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:08.114 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.107+0000 7f6246607700 1 --2- 172.21.15.90:0/1790209371 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f624015bf60 0x7f6240154b80 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f624006f620 tx=0x7f6238004af0 comp rx=0 tx=0).stop 2023-06-09T04:42:08.114 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.107+0000 7f6246607700 1 -- 172.21.15.90:0/1790209371 shutdown_connections 2023-06-09T04:42:08.114 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.107+0000 7f6246607700 1 --2- 172.21.15.90:0/1790209371 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f62240662f0 0x7f62240687a0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:08.114 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.107+0000 7f6246607700 1 --2- 172.21.15.90:0/1790209371 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f624015bf60 0x7f6240154b80 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:08.114 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.107+0000 7f6246607700 1 --2- 172.21.15.90:0/1790209371 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f62400cdc90 0x7f6240151820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:08.114 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.107+0000 7f6246607700 1 --2- 172.21.15.90:0/1790209371 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f62400cc0f0 0x7f6240152d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:08.115 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.107+0000 7f6246607700 1 -- 172.21.15.90:0/1790209371 >> 172.21.15.90:0/1790209371 conn(0x7f624006c690 msgr2=0x7f62400ad170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:08.115 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.107+0000 7f6246607700 1 -- 172.21.15.90:0/1790209371 shutdown_connections 2023-06-09T04:42:08.115 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.107+0000 7f6246607700 1 -- 172.21.15.90:0/1790209371 wait complete. 2023-06-09T04:42:08.116 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 8 2023-06-09T04:42:08.135 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T04:42:08.299 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.291+0000 7fbfaf1f9700 1 Processor -- start 2023-06-09T04:42:08.299 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.295+0000 7fbfaf1f9700 1 -- start start 2023-06-09T04:42:08.302 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.295+0000 7fbfaf1f9700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fbfa815e120 0x7fbfa80c8b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:08.303 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.299+0000 7fbfaf1f9700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfa80caba0 con 0x7fbfa80ca7a0 2023-06-09T04:42:08.303 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.299+0000 7fbfaf1f9700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfa80cae10 con 0x7fbfa8154370 2023-06-09T04:42:08.303 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.299+0000 7fbfaf1f9700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfa80cb0f0 con 0x7fbfa815e120 2023-06-09T04:42:08.304 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.299+0000 7fbfad796700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7fbfa80ca7a0 0x7fbfa80b3340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:55592/0 (socket says 172.21.15.90:55592) 2023-06-09T04:42:08.304 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.299+0000 7fbfad796700 1 -- 172.21.15.90:0/786241041 learned_addr learned my addr 172.21.15.90:0/786241041 (peer_addr_for_me v1:172.21.15.90:0/0) 2023-06-09T04:42:08.304 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.299+0000 7fbf9ffff700 1 --2- 172.21.15.90:0/786241041 >> v2:172.21.15.174:3300/0 conn(0x7fbfa815e120 0x7fbfa80c8b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:08.304 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.299+0000 7fbf9f7fe700 1 -- 172.21.15.90:0/786241041 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2329532389 0 0) 0x7fbfa80caba0 con 0x7fbfa80ca7a0 2023-06-09T04:42:08.304 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.299+0000 7fbf9f7fe700 1 -- 172.21.15.90:0/786241041 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf900035d0 con 0x7fbfa80ca7a0 2023-06-09T04:42:08.305 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.299+0000 7fbf9ffff700 1 -- 172.21.15.90:0/786241041 >> v1:172.21.15.174:6789/0 conn(0x7fbfa8154370 legacy=0x7fbfa815da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:08.305 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.299+0000 7fbf9ffff700 1 -- 172.21.15.90:0/786241041 >> v1:172.21.15.90:6789/0 conn(0x7fbfa80ca7a0 legacy=0x7fbfa80b3340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:08.305 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.299+0000 7fbf9f7fe700 1 -- 172.21.15.90:0/786241041 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2773814302 0 0) 0x7fbfa80cae10 con 0x7fbfa8154370 2023-06-09T04:42:08.306 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.299+0000 7fbf9ffff700 1 -- 172.21.15.90:0/786241041 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfa80cb3d0 con 0x7fbfa815e120 2023-06-09T04:42:08.306 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.299+0000 7fbf9ffff700 1 --2- 172.21.15.90:0/786241041 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbfa815e120 0x7fbfa80c8b40 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fbf98009850 tx=0x7fbf98009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3e79822dbcbdeeae server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:08.306 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.299+0000 7fbf9f7fe700 1 -- 172.21.15.90:0/786241041 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf98011830 con 0x7fbfa815e120 2023-06-09T04:42:08.306 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.299+0000 7fbf9f7fe700 1 -- 172.21.15.90:0/786241041 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf98011990 con 0x7fbfa815e120 2023-06-09T04:42:08.307 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.299+0000 7fbf9f7fe700 1 -- 172.21.15.90:0/786241041 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf98011d40 con 0x7fbfa815e120 2023-06-09T04:42:08.307 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.303+0000 7fbfaf1f9700 1 -- 172.21.15.90:0/786241041 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbfa815e120 msgr2=0x7fbfa80c8b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:08.307 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.303+0000 7fbfaf1f9700 1 --2- 172.21.15.90:0/786241041 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbfa815e120 0x7fbfa80c8b40 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fbf98009850 tx=0x7fbf98009b60 comp rx=0 tx=0).stop 2023-06-09T04:42:08.308 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.303+0000 7fbfaf1f9700 1 -- 172.21.15.90:0/786241041 shutdown_connections 2023-06-09T04:42:08.308 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.303+0000 7fbfaf1f9700 1 --2- 172.21.15.90:0/786241041 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbfa815e120 0x7fbfa80c8b40 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:08.308 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.303+0000 7fbfaf1f9700 1 -- 172.21.15.90:0/786241041 >> 172.21.15.90:0/786241041 conn(0x7fbfa806c810 msgr2=0x7fbfa80b0000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:08.308 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.303+0000 7fbfaf1f9700 1 -- 172.21.15.90:0/786241041 shutdown_connections 2023-06-09T04:42:08.308 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.303+0000 7fbfaf1f9700 1 -- 172.21.15.90:0/786241041 wait complete. 2023-06-09T04:42:08.310 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.303+0000 7fbfaf1f9700 1 Processor -- start 2023-06-09T04:42:08.311 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.307+0000 7fbfaf1f9700 1 -- start start 2023-06-09T04:42:08.312 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.307+0000 7fbfaf1f9700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbfa80ca7a0 0x7fbfa80ad9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:08.312 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.307+0000 7fbfaf1f9700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbfa8154370 0x7fbfa80ccf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:08.312 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.307+0000 7fbfaf1f9700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbfa815e120 0x7fbfa8153590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:08.313 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.307+0000 7fbfaf1f9700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfa80ccaf0 con 0x7fbfa80ca7a0 2023-06-09T04:42:08.313 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.307+0000 7fbfaf1f9700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfa8153ad0 con 0x7fbfa8154370 2023-06-09T04:42:08.313 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.307+0000 7fbfaf1f9700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfa80adfe0 con 0x7fbfa815e120 2023-06-09T04:42:08.314 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.307+0000 7fbfacf95700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbfa80ca7a0 0x7fbfa80ad9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:08.314 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.307+0000 7fbfacf95700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbfa80ca7a0 0x7fbfa80ad9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:45974/0 (socket says 172.21.15.90:45974) 2023-06-09T04:42:08.314 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.307+0000 7fbfacf95700 1 -- 172.21.15.90:0/3808956307 learned_addr learned my addr 172.21.15.90:0/3808956307 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:08.314 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.307+0000 7fbf9ffff700 1 --2- 172.21.15.90:0/3808956307 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbfa8154370 0x7fbfa80ccf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:08.314 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.307+0000 7fbfad796700 1 --2- 172.21.15.90:0/3808956307 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbfa815e120 0x7fbfa8153590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:08.315 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.307+0000 7fbfacf95700 1 -- 172.21.15.90:0/3808956307 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbfa815e120 msgr2=0x7fbfa8153590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:08.315 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.307+0000 7fbfacf95700 1 --2- 172.21.15.90:0/3808956307 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbfa815e120 0x7fbfa8153590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:08.315 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.307+0000 7fbfacf95700 1 -- 172.21.15.90:0/3808956307 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbfa8154370 msgr2=0x7fbfa80ccf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:08.315 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.307+0000 7fbfacf95700 1 --2- 172.21.15.90:0/3808956307 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbfa8154370 0x7fbfa80ccf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:08.315 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.307+0000 7fbfacf95700 1 -- 172.21.15.90:0/3808956307 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf980094b0 con 0x7fbfa80ca7a0 2023-06-09T04:42:08.315 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.307+0000 7fbf9ffff700 1 --2- 172.21.15.90:0/3808956307 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbfa8154370 0x7fbfa80ccf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:42:08.315 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.307+0000 7fbfad796700 1 --2- 172.21.15.90:0/3808956307 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbfa815e120 0x7fbfa8153590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:42:08.316 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.307+0000 7fbfacf95700 1 --2- 172.21.15.90:0/3808956307 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbfa80ca7a0 0x7fbfa80ad9e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fbfa40011e0 tx=0x7fbfa400cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:08.316 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.307+0000 7fbf9d7fa700 1 -- 172.21.15.90:0/3808956307 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfa40054e0 con 0x7fbfa80ca7a0 2023-06-09T04:42:08.316 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.307+0000 7fbf9d7fa700 1 -- 172.21.15.90:0/3808956307 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfa40036a0 con 0x7fbfa80ca7a0 2023-06-09T04:42:08.316 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.307+0000 7fbfaf1f9700 1 -- 172.21.15.90:0/3808956307 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfa81548c0 con 0x7fbfa80ca7a0 2023-06-09T04:42:08.316 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.307+0000 7fbf9d7fa700 1 -- 172.21.15.90:0/3808956307 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfa4003a50 con 0x7fbfa80ca7a0 2023-06-09T04:42:08.317 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.307+0000 7fbfaf1f9700 1 -- 172.21.15.90:0/3808956307 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfa80cc710 con 0x7fbfa80ca7a0 2023-06-09T04:42:08.317 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.311+0000 7fbfaf1f9700 1 -- 172.21.15.90:0/3808956307 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfa80ae500 con 0x7fbfa80ca7a0 2023-06-09T04:42:08.317 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.311+0000 7fbf9d7fa700 1 -- 172.21.15.90:0/3808956307 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fbfa4003bb0 con 0x7fbfa80ca7a0 2023-06-09T04:42:08.319 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.315+0000 7fbf9d7fa700 1 --2- 172.21.15.90:0/3808956307 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fbf940662f0 0x7fbf940687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:08.320 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.315+0000 7fbf9d7fa700 1 -- 172.21.15.90:0/3808956307 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbfa4083420 con 0x7fbfa80ca7a0 2023-06-09T04:42:08.320 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.315+0000 7fbf9ffff700 1 --2- 172.21.15.90:0/3808956307 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fbf940662f0 0x7fbf940687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:08.321 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.315+0000 7fbf9ffff700 1 --2- 172.21.15.90:0/3808956307 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fbf940662f0 0x7fbf940687a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fbf980090b0 tx=0x7fbf9801c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:08.326 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.319+0000 7fbf9d7fa700 1 -- 172.21.15.90:0/3808956307 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fbfa80ae500 con 0x7fbfa80ca7a0 2023-06-09T04:42:08.498 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.491+0000 7fbfaf1f9700 1 -- 172.21.15.90:0/3808956307 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbfa80cc570 con 0x7fbfa80ca7a0 2023-06-09T04:42:08.501 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.495+0000 7fbf9d7fa700 1 -- 172.21.15.90:0/3808956307 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18279 (secure 0 0 0) 0x7fbfa80cc570 con 0x7fbfa80ca7a0 2023-06-09T04:42:08.502 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:42:08.502 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":24,"fsid":"700369c0-a111-43b4-9415-844ad1742b70","created":"2023-06-09T04:41:28.180311+0000","modified":"2023-06-09T04:41:55.389425+0000","last_up_change":"2023-06-09T04:41:40.746475+0000","last_in_change":"2023-06-09T04:41:31.262765+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-09T04:41:42.402564+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-09T04:41:47.607323+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-09T04:41:52.543474+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-09T04:41:53.382940+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"46a4a7c5-babd-4ef3-9830-51487cff5eb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":2780271267},{"type":"v1","addr":"172.21.15.90:6809","nonce":2780271267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2780271267},{"type":"v1","addr":"172.21.15.90:6811","nonce":2780271267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2780271267},{"type":"v1","addr":"172.21.15.90:6815","nonce":2780271267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2780271267},{"type":"v1","addr":"172.21.15.90:6813","nonce":2780271267}]},"public_addr":"172.21.15.90:6809/2780271267","cluster_addr":"172.21.15.90:6811/2780271267","heartbeat_back_addr":"172.21.15.90:6815/2780271267","heartbeat_front_addr":"172.21.15.90:6813/2780271267","state":["exists","up"]},{"osd":1,"uuid":"1543988f-c498-494a-a6f9-fac8413db6ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":3064028136},{"type":"v1","addr":"172.21.15.90:6801","nonce":3064028136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":3064028136},{"type":"v1","addr":"172.21.15.90:6803","nonce":3064028136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":3064028136},{"type":"v1","addr":"172.21.15.90:6807","nonce":3064028136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":3064028136},{"type":"v1","addr":"172.21.15.90:6805","nonce":3064028136}]},"public_addr":"172.21.15.90:6801/3064028136","cluster_addr":"172.21.15.90:6803/3064028136","heartbeat_back_addr":"172.21.15.90:6807/3064028136","heartbeat_front_addr":"172.21.15.90:6805/3064028136","state":["exists","up"]},{"osd":2,"uuid":"79669dd6-ffc8-4197-b9f7-b3b372b2b9b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":3713146326},{"type":"v1","addr":"172.21.15.90:6825","nonce":3713146326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":3713146326},{"type":"v1","addr":"172.21.15.90:6827","nonce":3713146326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":3713146326},{"type":"v1","addr":"172.21.15.90:6831","nonce":3713146326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":3713146326},{"type":"v1","addr":"172.21.15.90:6829","nonce":3713146326}]},"public_addr":"172.21.15.90:6825/3713146326","cluster_addr":"172.21.15.90:6827/3713146326","heartbeat_back_addr":"172.21.15.90:6831/3713146326","heartbeat_front_addr":"172.21.15.90:6829/3713146326","state":["exists","up"]},{"osd":3,"uuid":"4062ab6f-ce40-450a-aa17-b10098766c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":3499839122},{"type":"v1","addr":"172.21.15.90:6817","nonce":3499839122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":3499839122},{"type":"v1","addr":"172.21.15.90:6819","nonce":3499839122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":3499839122},{"type":"v1","addr":"172.21.15.90:6823","nonce":3499839122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":3499839122},{"type":"v1","addr":"172.21.15.90:6821","nonce":3499839122}]},"public_addr":"172.21.15.90:6817/3499839122","cluster_addr":"172.21.15.90:6819/3499839122","heartbeat_back_addr":"172.21.15.90:6823/3499839122","heartbeat_front_addr":"172.21.15.90:6821/3499839122","state":["exists","up"]},{"osd":4,"uuid":"a10820e4-b348-4d92-9796-3b01484ace1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6817","nonce":1138565854},{"type":"v1","addr":"172.21.15.174:6819","nonce":1138565854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6821","nonce":1138565854},{"type":"v1","addr":"172.21.15.174:6823","nonce":1138565854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":1138565854},{"type":"v1","addr":"172.21.15.174:6831","nonce":1138565854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":1138565854},{"type":"v1","addr":"172.21.15.174:6829","nonce":1138565854}]},"public_addr":"172.21.15.174:6819/1138565854","cluster_addr":"172.21.15.174:6823/1138565854","heartbeat_back_addr":"172.21.15.174:6831/1138565854","heartbeat_front_addr":"172.21.15.174:6829/1138565854","state":["exists","up"]},{"osd":5,"uuid":"b4da1c32-be05-420b-9346-90d91aa70569","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":1707702879},{"type":"v1","addr":"172.21.15.174:6818","nonce":1707702879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":1707702879},{"type":"v1","addr":"172.21.15.174:6822","nonce":1707702879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6827","nonce":1707702879},{"type":"v1","addr":"172.21.15.174:6828","nonce":1707702879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":1707702879},{"type":"v1","addr":"172.21.15.174:6825","nonce":1707702879}]},"public_addr":"172.21.15.174:6818/1707702879","cluster_addr":"172.21.15.174:6822/1707702879","heartbeat_back_addr":"172.21.15.174:6828/1707702879","heartbeat_front_addr":"172.21.15.174:6825/1707702879","state":["exists","up"]},{"osd":6,"uuid":"d1b98041-d243-4355-bd0a-e22cf9875b32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":864450534},{"type":"v1","addr":"172.21.15.174:6801","nonce":864450534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":864450534},{"type":"v1","addr":"172.21.15.174:6803","nonce":864450534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":864450534},{"type":"v1","addr":"172.21.15.174:6807","nonce":864450534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":864450534},{"type":"v1","addr":"172.21.15.174:6805","nonce":864450534}]},"public_addr":"172.21.15.174:6801/864450534","cluster_addr":"172.21.15.174:6803/864450534","heartbeat_back_addr":"172.21.15.174:6807/864450534","heartbeat_front_addr":"172.21.15.174:6805/864450534","state":["exists","up"]},{"osd":7,"uuid":"5a207936-f89f-416b-b79b-34ec96f77c8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":2527640659},{"type":"v1","addr":"172.21.15.174:6809","nonce":2527640659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":2527640659},{"type":"v1","addr":"172.21.15.174:6811","nonce":2527640659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":2527640659},{"type":"v1","addr":"172.21.15.174:6815","nonce":2527640659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":2527640659},{"type":"v1","addr":"172.21.15.174:6813","nonce":2527640659}]},"public_addr":"172.21.15.174:6809/2527640659","cluster_addr":"172.21.15.174:6811/2527640659","heartbeat_back_addr":"172.21.15.174:6815/2527640659","heartbeat_front_addr":"172.21.15.174:6813/2527640659","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:36.972152+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:36.984561+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:36.998817+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:37.054944+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:37.085014+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:37.115125+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:36.854608+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:36.971685+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:42:08.504 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.499+0000 7fbfaf1f9700 1 -- 172.21.15.90:0/3808956307 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fbf940662f0 msgr2=0x7fbf940687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:08.504 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.499+0000 7fbfaf1f9700 1 --2- 172.21.15.90:0/3808956307 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fbf940662f0 0x7fbf940687a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fbf980090b0 tx=0x7fbf9801c040 comp rx=0 tx=0).stop 2023-06-09T04:42:08.504 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.499+0000 7fbfaf1f9700 1 -- 172.21.15.90:0/3808956307 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbfa80ca7a0 msgr2=0x7fbfa80ad9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:08.505 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.499+0000 7fbfaf1f9700 1 --2- 172.21.15.90:0/3808956307 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbfa80ca7a0 0x7fbfa80ad9e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fbfa40011e0 tx=0x7fbfa400cae0 comp rx=0 tx=0).stop 2023-06-09T04:42:08.505 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.499+0000 7fbfaf1f9700 1 -- 172.21.15.90:0/3808956307 shutdown_connections 2023-06-09T04:42:08.505 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.499+0000 7fbfaf1f9700 1 --2- 172.21.15.90:0/3808956307 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fbf940662f0 0x7fbf940687a0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:08.506 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.499+0000 7fbfaf1f9700 1 --2- 172.21.15.90:0/3808956307 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbfa815e120 0x7fbfa8153590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:08.506 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.499+0000 7fbfaf1f9700 1 --2- 172.21.15.90:0/3808956307 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbfa8154370 0x7fbfa80ccf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:08.506 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.499+0000 7fbfaf1f9700 1 --2- 172.21.15.90:0/3808956307 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbfa80ca7a0 0x7fbfa80ad9e0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:08.506 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.499+0000 7fbfaf1f9700 1 -- 172.21.15.90:0/3808956307 >> 172.21.15.90:0/3808956307 conn(0x7fbfa806c810 msgr2=0x7fbfa80b3b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:08.506 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.499+0000 7fbfaf1f9700 1 -- 172.21.15.90:0/3808956307 shutdown_connections 2023-06-09T04:42:08.506 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.499+0000 7fbfaf1f9700 1 -- 172.21.15.90:0/3808956307 wait complete. 2023-06-09T04:42:08.529 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-09T04:41:42.402564+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-09T04:41:47.607323+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-09T04:41:52.543474+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-09T04:41:53.382940+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-09T04:42:08.531 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-09T04:42:08.711 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.707+0000 7f0ff8d01700 1 Processor -- start 2023-06-09T04:42:08.712 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.707+0000 7f0ff8d01700 1 -- start start 2023-06-09T04:42:08.715 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.711+0000 7f0ff8d01700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0ff40cb3a0 0x7f0ff40cdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:08.716 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.711+0000 7f0ff8d01700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0ff40c3350 0x7f0ff40c3780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:08.716 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.711+0000 7f0ff8d01700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f0ff4071020 0x7f0ff4071440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:08.716 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.711+0000 7f0ff8d01700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ff4071980 con 0x7f0ff40cb3a0 2023-06-09T04:42:08.716 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.711+0000 7f0ff8d01700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ff4070b90 con 0x7f0ff4071020 2023-06-09T04:42:08.716 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.711+0000 7f0ff8d01700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff40705b0 con 0x7f0ff40c3350 2023-06-09T04:42:08.717 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.711+0000 7f0ff259c700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0ff40cb3a0 0x7f0ff40cdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:08.717 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.711+0000 7f0ff259c700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0ff40cb3a0 0x7f0ff40cdcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:45978/0 (socket says 172.21.15.90:45978) 2023-06-09T04:42:08.718 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.711+0000 7f0ff259c700 1 -- 172.21.15.90:0/3991831156 learned_addr learned my addr 172.21.15.90:0/3991831156 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:08.718 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.711+0000 7f0ff1d9b700 1 --2- 172.21.15.90:0/3991831156 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0ff40c3350 0x7f0ff40c3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:08.718 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.711+0000 7f0ff2d9d700 1 --2- 172.21.15.90:0/3991831156 >> v2:172.21.15.174:3300/0 conn(0x7f0ff4071020 0x7f0ff4071440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:08.718 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.711+0000 7f0ff1d9b700 1 -- 172.21.15.90:0/3991831156 >> v2:172.21.15.174:3300/0 conn(0x7f0ff4071020 msgr2=0x7f0ff4071440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:08.718 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.711+0000 7f0ff1d9b700 1 --2- 172.21.15.90:0/3991831156 >> v2:172.21.15.174:3300/0 conn(0x7f0ff4071020 0x7f0ff4071440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:08.718 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.711+0000 7f0ff1d9b700 1 -- 172.21.15.90:0/3991831156 >> v2:172.21.15.90:3300/0 conn(0x7f0ff40cb3a0 msgr2=0x7f0ff40cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:08.719 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.711+0000 7f0ff1d9b700 1 --2- 172.21.15.90:0/3991831156 >> v2:172.21.15.90:3300/0 conn(0x7f0ff40cb3a0 0x7f0ff40cdcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:08.719 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.711+0000 7f0ff1d9b700 1 -- 172.21.15.90:0/3991831156 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ff40ce230 con 0x7f0ff40c3350 2023-06-09T04:42:08.719 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.711+0000 7f0ff1d9b700 1 --2- 172.21.15.90:0/3991831156 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0ff40c3350 0x7f0ff40c3780 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f0ff40cdac0 tx=0x7f0fe8009b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=37c5a76d43d02aa9 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:08.719 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.711+0000 7f0ff159a700 1 -- 172.21.15.90:0/3991831156 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fe8011830 con 0x7f0ff40c3350 2023-06-09T04:42:08.720 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.711+0000 7f0ff159a700 1 -- 172.21.15.90:0/3991831156 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fe8011990 con 0x7f0ff40c3350 2023-06-09T04:42:08.720 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.711+0000 7f0ff159a700 1 -- 172.21.15.90:0/3991831156 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fe8011d20 con 0x7f0ff40c3350 2023-06-09T04:42:08.720 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.715+0000 7f0ff8d01700 1 -- 172.21.15.90:0/3991831156 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0ff40c3350 msgr2=0x7f0ff40c3780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:08.720 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.715+0000 7f0ff8d01700 1 --2- 172.21.15.90:0/3991831156 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0ff40c3350 0x7f0ff40c3780 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f0ff40cdac0 tx=0x7f0fe8009b30 comp rx=0 tx=0).stop 2023-06-09T04:42:08.721 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.715+0000 7f0ff8d01700 1 -- 172.21.15.90:0/3991831156 shutdown_connections 2023-06-09T04:42:08.721 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.715+0000 7f0ff8d01700 1 --2- 172.21.15.90:0/3991831156 >> v2:172.21.15.174:3300/0 conn(0x7f0ff4071020 0x7f0ff4071440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:08.721 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.715+0000 7f0ff8d01700 1 --2- 172.21.15.90:0/3991831156 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0ff40c3350 0x7f0ff40c3780 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:08.721 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.715+0000 7f0ff8d01700 1 --2- 172.21.15.90:0/3991831156 >> v2:172.21.15.90:3300/0 conn(0x7f0ff40cb3a0 0x7f0ff40cdcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:08.721 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.715+0000 7f0ff8d01700 1 -- 172.21.15.90:0/3991831156 >> 172.21.15.90:0/3991831156 conn(0x7f0ff40b00e0 msgr2=0x7f0ff40b04b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:08.722 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.715+0000 7f0ff8d01700 1 -- 172.21.15.90:0/3991831156 shutdown_connections 2023-06-09T04:42:08.722 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.715+0000 7f0ff8d01700 1 -- 172.21.15.90:0/3991831156 wait complete. 2023-06-09T04:42:08.722 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.715+0000 7f0ff8d01700 1 Processor -- start 2023-06-09T04:42:08.722 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.715+0000 7f0ff8d01700 1 -- start start 2023-06-09T04:42:08.723 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.719+0000 7f0ff8d01700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0ff4071020 0x7f0ff40ad680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:08.724 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.719+0000 7f0ff8d01700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0ff40c3350 0x7f0ff41f6170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:08.724 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.719+0000 7f0ff8d01700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0ff40cb3a0 0x7f0ff41474c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:08.724 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.719+0000 7f0ff8d01700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff40adbc0 con 0x7f0ff4071020 2023-06-09T04:42:08.724 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.719+0000 7f0ff8d01700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff40b4290 con 0x7f0ff40cb3a0 2023-06-09T04:42:08.724 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.719+0000 7f0ff8d01700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff40c7dd0 con 0x7f0ff40c3350 2023-06-09T04:42:08.726 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.719+0000 7f0ff259c700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0ff4071020 0x7f0ff40ad680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:08.726 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.719+0000 7f0ff259c700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0ff4071020 0x7f0ff40ad680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:45988/0 (socket says 172.21.15.90:45988) 2023-06-09T04:42:08.726 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.719+0000 7f0ff259c700 1 -- 172.21.15.90:0/1477182696 learned_addr learned my addr 172.21.15.90:0/1477182696 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:08.726 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.719+0000 7f0ff2d9d700 1 --2- 172.21.15.90:0/1477182696 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0ff40cb3a0 0x7f0ff41474c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:08.726 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.719+0000 7f0ff1d9b700 1 --2- 172.21.15.90:0/1477182696 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0ff40c3350 0x7f0ff41f6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:08.727 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.719+0000 7f0ff259c700 1 -- 172.21.15.90:0/1477182696 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0ff40c3350 msgr2=0x7f0ff41f6170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:08.727 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.719+0000 7f0ff259c700 1 --2- 172.21.15.90:0/1477182696 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0ff40c3350 0x7f0ff41f6170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:08.727 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.719+0000 7f0ff259c700 1 -- 172.21.15.90:0/1477182696 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0ff40cb3a0 msgr2=0x7f0ff41474c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:08.727 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.719+0000 7f0ff259c700 1 --2- 172.21.15.90:0/1477182696 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0ff40cb3a0 0x7f0ff41474c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:08.727 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.719+0000 7f0ff259c700 1 -- 172.21.15.90:0/1477182696 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fe80094b0 con 0x7f0ff4071020 2023-06-09T04:42:08.727 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.719+0000 7f0ff1d9b700 1 --2- 172.21.15.90:0/1477182696 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0ff40c3350 0x7f0ff41f6170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:42:08.727 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.719+0000 7f0ff2d9d700 1 --2- 172.21.15.90:0/1477182696 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0ff40cb3a0 0x7f0ff41474c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:42:08.728 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.719+0000 7f0ff259c700 1 --2- 172.21.15.90:0/1477182696 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0ff4071020 0x7f0ff40ad680 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f0fe400e8c0 tx=0x7f0fe400ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:08.728 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.719+0000 7f0fe2ffd700 1 -- 172.21.15.90:0/1477182696 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fe4009620 con 0x7f0ff4071020 2023-06-09T04:42:08.728 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.719+0000 7f0fe2ffd700 1 -- 172.21.15.90:0/1477182696 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fe400eec0 con 0x7f0ff4071020 2023-06-09T04:42:08.728 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.719+0000 7f0fe2ffd700 1 -- 172.21.15.90:0/1477182696 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fe400ca90 con 0x7f0ff4071020 2023-06-09T04:42:08.728 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.719+0000 7f0ff8d01700 1 -- 172.21.15.90:0/1477182696 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ff40c80b0 con 0x7f0ff4071020 2023-06-09T04:42:08.728 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.719+0000 7f0ff8d01700 1 -- 172.21.15.90:0/1477182696 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ff41f5c50 con 0x7f0ff4071020 2023-06-09T04:42:08.729 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.723+0000 7f0ff8d01700 1 -- 172.21.15.90:0/1477182696 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ff41f5de0 con 0x7f0ff4071020 2023-06-09T04:42:08.729 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.723+0000 7f0fe2ffd700 1 -- 172.21.15.90:0/1477182696 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0fe400cbf0 con 0x7f0ff4071020 2023-06-09T04:42:08.730 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.723+0000 7f0fe2ffd700 1 --2- 172.21.15.90:0/1477182696 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f0fd40662f0 0x7f0fd40687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:08.730 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.723+0000 7f0fe2ffd700 1 -- 172.21.15.90:0/1477182696 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0fe4083db0 con 0x7f0ff4071020 2023-06-09T04:42:08.730 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.723+0000 7f0ff1d9b700 1 --2- 172.21.15.90:0/1477182696 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f0fd40662f0 0x7f0fd40687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:08.731 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.727+0000 7f0ff1d9b700 1 --2- 172.21.15.90:0/1477182696 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f0fd40662f0 0x7f0fd40687a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f0ff40c53c0 tx=0x7f0fe8008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:08.736 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.731+0000 7f0fe2ffd700 1 -- 172.21.15.90:0/1477182696 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0fe4088070 con 0x7f0ff4071020 2023-06-09T04:42:08.907 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.903+0000 7f0ff8d01700 1 -- 172.21.15.90:0/1477182696 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0ff40703d0 con 0x7f0ff4071020 2023-06-09T04:42:08.908 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.903+0000 7f0fe2ffd700 1 -- 172.21.15.90:0/1477182696 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0fe4017020 con 0x7f0ff4071020 2023-06-09T04:42:08.908 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 1 2023-06-09T04:42:08.910 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.903+0000 7f0ff8d01700 1 -- 172.21.15.90:0/1477182696 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f0fd40662f0 msgr2=0x7f0fd40687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:08.911 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.903+0000 7f0ff8d01700 1 --2- 172.21.15.90:0/1477182696 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f0fd40662f0 0x7f0fd40687a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f0ff40c53c0 tx=0x7f0fe8008030 comp rx=0 tx=0).stop 2023-06-09T04:42:08.911 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.903+0000 7f0ff8d01700 1 -- 172.21.15.90:0/1477182696 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0ff4071020 msgr2=0x7f0ff40ad680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:08.911 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.903+0000 7f0ff8d01700 1 --2- 172.21.15.90:0/1477182696 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0ff4071020 0x7f0ff40ad680 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f0fe400e8c0 tx=0x7f0fe400ec80 comp rx=0 tx=0).stop 2023-06-09T04:42:08.911 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.903+0000 7f0ff8d01700 1 -- 172.21.15.90:0/1477182696 shutdown_connections 2023-06-09T04:42:08.911 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.903+0000 7f0ff8d01700 1 --2- 172.21.15.90:0/1477182696 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f0fd40662f0 0x7f0fd40687a0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:08.912 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.903+0000 7f0ff8d01700 1 --2- 172.21.15.90:0/1477182696 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0ff40cb3a0 0x7f0ff41474c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:08.912 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.903+0000 7f0ff8d01700 1 --2- 172.21.15.90:0/1477182696 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0ff40c3350 0x7f0ff41f6170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:08.912 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.903+0000 7f0ff8d01700 1 --2- 172.21.15.90:0/1477182696 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0ff4071020 0x7f0ff40ad680 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:08.912 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.903+0000 7f0ff8d01700 1 -- 172.21.15.90:0/1477182696 >> 172.21.15.90:0/1477182696 conn(0x7f0ff40b00e0 msgr2=0x7f0ff4162c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:08.912 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.903+0000 7f0ff8d01700 1 -- 172.21.15.90:0/1477182696 shutdown_connections 2023-06-09T04:42:08.912 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:08.907+0000 7f0ff8d01700 1 -- 172.21.15.90:0/1477182696 wait complete. 2023-06-09T04:42:08.932 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-09T04:42:09.115 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.107+0000 7f4286feb700 1 Processor -- start 2023-06-09T04:42:09.115 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.111+0000 7f4286feb700 1 -- start start 2023-06-09T04:42:09.116 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.111+0000 7f4286feb700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f42801612e0 0x7f42800cda20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:09.117 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.111+0000 7f4286feb700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f42800c3170 0x7f42800c35f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:09.117 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.111+0000 7f4286feb700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42800cc230 con 0x7f428015de00 2023-06-09T04:42:09.117 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.111+0000 7f4286feb700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f428006ab90 con 0x7f42800c3170 2023-06-09T04:42:09.117 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.111+0000 7f4286feb700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42800c3b30 con 0x7f42801612e0 2023-06-09T04:42:09.118 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.111+0000 7f42867ea700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f42800c3170 0x7f42800c35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:09.118 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.111+0000 7f42857e8700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f42801612e0 0x7f42800cda20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:09.118 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.111+0000 7f42867ea700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f42800c3170 0x7f42800c35f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:46000/0 (socket says 172.21.15.90:46000) 2023-06-09T04:42:09.118 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.111+0000 7f42867ea700 1 -- 172.21.15.90:0/810384978 learned_addr learned my addr 172.21.15.90:0/810384978 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:09.119 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.111+0000 7f42867ea700 1 -- 172.21.15.90:0/810384978 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f42801612e0 msgr2=0x7f42800cda20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:09.119 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.111+0000 7f42867ea700 1 --2- 172.21.15.90:0/810384978 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f42801612e0 0x7f42800cda20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:09.119 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.111+0000 7f42867ea700 1 -- 172.21.15.90:0/810384978 >> v1:172.21.15.174:6789/0 conn(0x7f428015de00 legacy=0x7f42800c4640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:09.119 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.111+0000 7f42867ea700 1 -- 172.21.15.90:0/810384978 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f428015e1d0 con 0x7f42800c3170 2023-06-09T04:42:09.119 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.111+0000 7f42857e8700 1 --2- 172.21.15.90:0/810384978 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f42801612e0 0x7f42800cda20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:42:09.120 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.115+0000 7f42867ea700 1 --2- 172.21.15.90:0/810384978 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f42800c3170 0x7f42800c35f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f4278009e50 tx=0x7f427800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b71020d62b7a0a79 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:09.120 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.115+0000 7f4284fe7700 1 -- 172.21.15.90:0/810384978 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f427800e070 con 0x7f42800c3170 2023-06-09T04:42:09.120 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.115+0000 7f4284fe7700 1 -- 172.21.15.90:0/810384978 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f427800b910 con 0x7f42800c3170 2023-06-09T04:42:09.120 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.115+0000 7f4284fe7700 1 -- 172.21.15.90:0/810384978 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f427800bcc0 con 0x7f42800c3170 2023-06-09T04:42:09.121 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.115+0000 7f4286feb700 1 -- 172.21.15.90:0/810384978 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f42800c3170 msgr2=0x7f42800c35f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:09.121 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.115+0000 7f4286feb700 1 --2- 172.21.15.90:0/810384978 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f42800c3170 0x7f42800c35f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f4278009e50 tx=0x7f427800b330 comp rx=0 tx=0).stop 2023-06-09T04:42:09.121 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.115+0000 7f4286feb700 1 -- 172.21.15.90:0/810384978 shutdown_connections 2023-06-09T04:42:09.121 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.115+0000 7f4286feb700 1 --2- 172.21.15.90:0/810384978 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f42800c3170 0x7f42800c35f0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:09.121 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.115+0000 7f4286feb700 1 --2- 172.21.15.90:0/810384978 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f42801612e0 0x7f42800cda20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:09.122 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.115+0000 7f4286feb700 1 -- 172.21.15.90:0/810384978 >> 172.21.15.90:0/810384978 conn(0x7f42800aff00 msgr2=0x7f42800b0300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:09.122 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.115+0000 7f4286feb700 1 -- 172.21.15.90:0/810384978 shutdown_connections 2023-06-09T04:42:09.122 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.115+0000 7f4286feb700 1 -- 172.21.15.90:0/810384978 wait complete. 2023-06-09T04:42:09.124 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.119+0000 7f4286feb700 1 Processor -- start 2023-06-09T04:42:09.125 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.119+0000 7f4286feb700 1 -- start start 2023-06-09T04:42:09.127 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.123+0000 7f4286feb700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f42800c3170 0x7f42800c8920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:09.127 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.123+0000 7f4286feb700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f428015de00 0x7f42801474a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:09.127 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.123+0000 7f4286feb700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f42801612e0 0x7f4280069820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:09.127 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.123+0000 7f4286feb700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f428015f950 con 0x7f42800c3170 2023-06-09T04:42:09.127 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.123+0000 7f4286feb700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42800c8fb0 con 0x7f428015de00 2023-06-09T04:42:09.128 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.123+0000 7f4286feb700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42800c9290 con 0x7f42801612e0 2023-06-09T04:42:09.129 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.123+0000 7f4285fe9700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f42800c3170 0x7f42800c8920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:09.129 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.123+0000 7f4285fe9700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f42800c3170 0x7f42800c8920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:46002/0 (socket says 172.21.15.90:46002) 2023-06-09T04:42:09.129 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.123+0000 7f4285fe9700 1 -- 172.21.15.90:0/3539266929 learned_addr learned my addr 172.21.15.90:0/3539266929 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:09.129 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.123+0000 7f42857e8700 1 --2- 172.21.15.90:0/3539266929 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f428015de00 0x7f42801474a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:09.129 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.123+0000 7f42867ea700 1 --2- 172.21.15.90:0/3539266929 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f42801612e0 0x7f4280069820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:09.129 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.123+0000 7f4285fe9700 1 -- 172.21.15.90:0/3539266929 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f42801612e0 msgr2=0x7f4280069820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:09.130 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.123+0000 7f4285fe9700 1 --2- 172.21.15.90:0/3539266929 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f42801612e0 0x7f4280069820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:09.130 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.123+0000 7f4285fe9700 1 -- 172.21.15.90:0/3539266929 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f428015de00 msgr2=0x7f42801474a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:09.130 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.123+0000 7f4285fe9700 1 --2- 172.21.15.90:0/3539266929 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f428015de00 0x7f42801474a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:09.130 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.123+0000 7f4285fe9700 1 -- 172.21.15.90:0/3539266929 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42700094b0 con 0x7f42800c3170 2023-06-09T04:42:09.130 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.123+0000 7f4285fe9700 1 --2- 172.21.15.90:0/3539266929 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f42800c3170 0x7f42800c8920 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f427c00c500 tx=0x7f427c00c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:09.130 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.123+0000 7f42767fc700 1 -- 172.21.15.90:0/3539266929 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f427c0052d0 con 0x7f42800c3170 2023-06-09T04:42:09.130 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.123+0000 7f42767fc700 1 -- 172.21.15.90:0/3539266929 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f427c005430 con 0x7f42800c3170 2023-06-09T04:42:09.130 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.123+0000 7f4286feb700 1 -- 172.21.15.90:0/3539266929 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4278009b30 con 0x7f42800c3170 2023-06-09T04:42:09.131 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.123+0000 7f42767fc700 1 -- 172.21.15.90:0/3539266929 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f427c0055a0 con 0x7f42800c3170 2023-06-09T04:42:09.131 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.123+0000 7f4286feb700 1 -- 172.21.15.90:0/3539266929 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42800c9850 con 0x7f42800c3170 2023-06-09T04:42:09.131 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.127+0000 7f4286feb700 1 -- 172.21.15.90:0/3539266929 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f428004e380 con 0x7f42800c3170 2023-06-09T04:42:09.132 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.127+0000 7f42767fc700 1 -- 172.21.15.90:0/3539266929 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f427c0036a0 con 0x7f42800c3170 2023-06-09T04:42:09.133 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.127+0000 7f42767fc700 1 --2- 172.21.15.90:0/3539266929 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f42640662f0 0x7f42640687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:09.133 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.127+0000 7f42767fc700 1 -- 172.21.15.90:0/3539266929 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f427c082f90 con 0x7f42800c3170 2023-06-09T04:42:09.134 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.127+0000 7f42857e8700 1 --2- 172.21.15.90:0/3539266929 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f42640662f0 0x7f42640687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:09.135 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.131+0000 7f42857e8700 1 --2- 172.21.15.90:0/3539266929 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f42640662f0 0x7f42640687a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f42801f8c00 tx=0x7f4270009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:09.139 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.135+0000 7f42767fc700 1 -- 172.21.15.90:0/3539266929 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f427c050370 con 0x7f42800c3170 2023-06-09T04:42:09.310 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.303+0000 7f4286feb700 1 -- 172.21.15.90:0/3539266929 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f42800c3790 con 0x7f42800c3170 2023-06-09T04:42:09.310 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.303+0000 7f42767fc700 1 -- 172.21.15.90:0/3539266929 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7f427c053990 con 0x7f42800c3170 2023-06-09T04:42:09.311 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 8 2023-06-09T04:42:09.313 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.307+0000 7f4286feb700 1 -- 172.21.15.90:0/3539266929 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f42640662f0 msgr2=0x7f42640687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:09.313 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.307+0000 7f4286feb700 1 --2- 172.21.15.90:0/3539266929 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f42640662f0 0x7f42640687a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f42801f8c00 tx=0x7f4270009240 comp rx=0 tx=0).stop 2023-06-09T04:42:09.314 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.307+0000 7f4286feb700 1 -- 172.21.15.90:0/3539266929 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f42800c3170 msgr2=0x7f42800c8920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:09.314 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.307+0000 7f4286feb700 1 --2- 172.21.15.90:0/3539266929 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f42800c3170 0x7f42800c8920 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f427c00c500 tx=0x7f427c00c810 comp rx=0 tx=0).stop 2023-06-09T04:42:09.314 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.307+0000 7f4286feb700 1 -- 172.21.15.90:0/3539266929 shutdown_connections 2023-06-09T04:42:09.314 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.307+0000 7f4286feb700 1 --2- 172.21.15.90:0/3539266929 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f42640662f0 0x7f42640687a0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:09.315 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.307+0000 7f4286feb700 1 --2- 172.21.15.90:0/3539266929 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f42801612e0 0x7f4280069820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:09.315 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.307+0000 7f4286feb700 1 --2- 172.21.15.90:0/3539266929 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f428015de00 0x7f42801474a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:09.315 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.307+0000 7f4286feb700 1 --2- 172.21.15.90:0/3539266929 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f42800c3170 0x7f42800c8920 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:09.315 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.307+0000 7f4286feb700 1 -- 172.21.15.90:0/3539266929 >> 172.21.15.90:0/3539266929 conn(0x7f42800aff00 msgr2=0x7f428015fc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:09.315 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.307+0000 7f4286feb700 1 -- 172.21.15.90:0/3539266929 shutdown_connections 2023-06-09T04:42:09.315 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.307+0000 7f4286feb700 1 -- 172.21.15.90:0/3539266929 wait complete. 2023-06-09T04:42:09.332 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-09T04:42:09.511 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.507+0000 7feeafba0700 1 Processor -- start 2023-06-09T04:42:09.512 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.507+0000 7feeafba0700 1 -- start start 2023-06-09T04:42:09.514 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.507+0000 7feeafba0700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7feea80cb3a0 0x7feea80cdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:09.514 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.507+0000 7feeafba0700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7feea80c3350 0x7feea80c3780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:09.514 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.507+0000 7feeafba0700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feea8070b90 con 0x7feea8071020 2023-06-09T04:42:09.515 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.507+0000 7feeafba0700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feea80705b0 con 0x7feea80c3350 2023-06-09T04:42:09.515 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.507+0000 7feeafba0700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feea80ce230 con 0x7feea80cb3a0 2023-06-09T04:42:09.515 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.511+0000 7feead13b700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7feea80c3350 0x7feea80c3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:09.516 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.511+0000 7feead13b700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7feea80c3350 0x7feea80c3780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:46012/0 (socket says 172.21.15.90:46012) 2023-06-09T04:42:09.516 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.511+0000 7feeae13d700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7feea8071020 0x7feea8163fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:55596/0 (socket says 172.21.15.90:55596) 2023-06-09T04:42:09.516 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.511+0000 7feead13b700 1 -- 172.21.15.90:0/785436337 learned_addr learned my addr 172.21.15.90:0/785436337 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:09.516 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.511+0000 7feead93c700 1 --2- 172.21.15.90:0/785436337 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7feea80cb3a0 0x7feea80cdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:09.516 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.511+0000 7feead13b700 1 -- 172.21.15.90:0/785436337 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7feea80cb3a0 msgr2=0x7feea80cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:09.516 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.511+0000 7feead13b700 1 --2- 172.21.15.90:0/785436337 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7feea80cb3a0 0x7feea80cdcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:09.517 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.511+0000 7feead13b700 1 -- 172.21.15.90:0/785436337 >> v1:172.21.15.90:6789/0 conn(0x7feea8071020 legacy=0x7feea8163fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:09.517 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.511+0000 7feead13b700 1 -- 172.21.15.90:0/785436337 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feea80cc440 con 0x7feea80c3350 2023-06-09T04:42:09.517 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.511+0000 7feead93c700 1 --2- 172.21.15.90:0/785436337 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7feea80cb3a0 0x7feea80cdcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:42:09.518 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.511+0000 7feead13b700 1 --2- 172.21.15.90:0/785436337 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feea80c3350 0x7feea80c3780 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fee98009910 tx=0x7fee98009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d189df701f36de5 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:09.518 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.511+0000 7feeac93a700 1 -- 172.21.15.90:0/785436337 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee9800ba60 con 0x7feea80c3350 2023-06-09T04:42:09.518 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.511+0000 7feeac93a700 1 -- 172.21.15.90:0/785436337 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee9800bbc0 con 0x7feea80c3350 2023-06-09T04:42:09.518 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.511+0000 7feeac93a700 1 -- 172.21.15.90:0/785436337 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee98009e60 con 0x7feea80c3350 2023-06-09T04:42:09.519 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.511+0000 7feeafba0700 1 -- 172.21.15.90:0/785436337 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feea80c3350 msgr2=0x7feea80c3780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:09.519 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.511+0000 7feeafba0700 1 --2- 172.21.15.90:0/785436337 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feea80c3350 0x7feea80c3780 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fee98009910 tx=0x7fee98009c20 comp rx=0 tx=0).stop 2023-06-09T04:42:09.519 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.511+0000 7feeafba0700 1 -- 172.21.15.90:0/785436337 shutdown_connections 2023-06-09T04:42:09.519 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.511+0000 7feeafba0700 1 --2- 172.21.15.90:0/785436337 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feea80c3350 0x7feea80c3780 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:09.519 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.511+0000 7feeafba0700 1 --2- 172.21.15.90:0/785436337 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7feea80cb3a0 0x7feea80cdcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:09.519 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.511+0000 7feeafba0700 1 -- 172.21.15.90:0/785436337 >> 172.21.15.90:0/785436337 conn(0x7feea80b00e0 msgr2=0x7feea80b04b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:09.519 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.511+0000 7feeafba0700 1 -- 172.21.15.90:0/785436337 shutdown_connections 2023-06-09T04:42:09.520 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.511+0000 7feeafba0700 1 -- 172.21.15.90:0/785436337 wait complete. 2023-06-09T04:42:09.522 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.515+0000 7feeafba0700 1 Processor -- start 2023-06-09T04:42:09.523 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.519+0000 7feeafba0700 1 -- start start 2023-06-09T04:42:09.524 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.519+0000 7feeafba0700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feea8071020 0x7feea81f5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:09.524 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.519+0000 7feeafba0700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7feea80c3350 0x7feea81485e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:09.524 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.519+0000 7feeafba0700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7feea80cb3a0 0x7feea80a7480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:09.524 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.519+0000 7feeafba0700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feea80c94e0 con 0x7feea8071020 2023-06-09T04:42:09.525 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.519+0000 7feeafba0700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feea80a8550 con 0x7feea80cb3a0 2023-06-09T04:42:09.525 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.519+0000 7feeafba0700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feea80a8270 con 0x7feea80c3350 2023-06-09T04:42:09.526 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.519+0000 7feead93c700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feea8071020 0x7feea81f5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:09.526 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.519+0000 7feead93c700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feea8071020 0x7feea81f5710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:46022/0 (socket says 172.21.15.90:46022) 2023-06-09T04:42:09.526 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.519+0000 7feead93c700 1 -- 172.21.15.90:0/3564184004 learned_addr learned my addr 172.21.15.90:0/3564184004 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:09.526 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.519+0000 7feead13b700 1 --2- 172.21.15.90:0/3564184004 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7feea80c3350 0x7feea81485e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:09.526 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.519+0000 7feead93c700 1 -- 172.21.15.90:0/3564184004 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7feea80c3350 msgr2=0x7feea81485e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:09.526 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.519+0000 7feead93c700 1 --2- 172.21.15.90:0/3564184004 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7feea80c3350 0x7feea81485e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:09.527 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.519+0000 7feead93c700 1 -- 172.21.15.90:0/3564184004 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7feea80cb3a0 msgr2=0x7feea80a7480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:09.527 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.519+0000 7feeae13d700 1 --2- 172.21.15.90:0/3564184004 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7feea80cb3a0 0x7feea80a7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:09.527 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.519+0000 7feead93c700 1 --2- 172.21.15.90:0/3564184004 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7feea80cb3a0 0x7feea80a7480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:09.527 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.519+0000 7feead93c700 1 -- 172.21.15.90:0/3564184004 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee98009570 con 0x7feea8071020 2023-06-09T04:42:09.527 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.519+0000 7feead13b700 1 --2- 172.21.15.90:0/3564184004 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7feea80c3350 0x7feea81485e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:42:09.527 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.519+0000 7feeae13d700 1 --2- 172.21.15.90:0/3564184004 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7feea80cb3a0 0x7feea80a7480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:42:09.527 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.519+0000 7feead93c700 1 --2- 172.21.15.90:0/3564184004 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feea8071020 0x7feea81f5710 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7feea400e810 tx=0x7feea400ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:09.528 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.519+0000 7fee9e7fc700 1 -- 172.21.15.90:0/3564184004 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feea4004230 con 0x7feea8071020 2023-06-09T04:42:09.528 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.519+0000 7fee9e7fc700 1 -- 172.21.15.90:0/3564184004 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feea4004390 con 0x7feea8071020 2023-06-09T04:42:09.528 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.519+0000 7feeafba0700 1 -- 172.21.15.90:0/3564184004 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feea80c9780 con 0x7feea8071020 2023-06-09T04:42:09.528 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.519+0000 7fee9e7fc700 1 -- 172.21.15.90:0/3564184004 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feea40036c0 con 0x7feea8071020 2023-06-09T04:42:09.528 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.519+0000 7feeafba0700 1 -- 172.21.15.90:0/3564184004 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feea81f5c50 con 0x7feea8071020 2023-06-09T04:42:09.529 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.523+0000 7feeafba0700 1 -- 172.21.15.90:0/3564184004 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feea80c9340 con 0x7feea8071020 2023-06-09T04:42:09.529 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.523+0000 7fee9e7fc700 1 -- 172.21.15.90:0/3564184004 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7feea4003840 con 0x7feea8071020 2023-06-09T04:42:09.530 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.523+0000 7fee9e7fc700 1 --2- 172.21.15.90:0/3564184004 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fee8c0662f0 0x7fee8c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:09.531 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.523+0000 7fee9e7fc700 1 -- 172.21.15.90:0/3564184004 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7feea4083750 con 0x7feea8071020 2023-06-09T04:42:09.531 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.527+0000 7feead13b700 1 --2- 172.21.15.90:0/3564184004 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fee8c0662f0 0x7fee8c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:09.532 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.527+0000 7feead13b700 1 --2- 172.21.15.90:0/3564184004 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fee8c0662f0 0x7fee8c0687a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7feea80c88c0 tx=0x7fee98008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:09.536 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.531+0000 7fee9e7fc700 1 -- 172.21.15.90:0/3564184004 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7feea80c9340 con 0x7feea8071020 2023-06-09T04:42:09.706 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.699+0000 7feeafba0700 1 -- 172.21.15.90:0/3564184004 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7feea80c9340 con 0x7feea8071020 2023-06-09T04:42:09.707 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.703+0000 7fee9e7fc700 1 -- 172.21.15.90:0/3564184004 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7feea80c9340 con 0x7feea8071020 2023-06-09T04:42:09.707 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 32 2023-06-09T04:42:09.711 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.707+0000 7feeafba0700 1 -- 172.21.15.90:0/3564184004 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fee8c0662f0 msgr2=0x7fee8c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:09.712 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.707+0000 7feeafba0700 1 --2- 172.21.15.90:0/3564184004 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fee8c0662f0 0x7fee8c0687a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7feea80c88c0 tx=0x7fee98008030 comp rx=0 tx=0).stop 2023-06-09T04:42:09.712 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.707+0000 7feeafba0700 1 -- 172.21.15.90:0/3564184004 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feea8071020 msgr2=0x7feea81f5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:09.712 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.707+0000 7feeafba0700 1 --2- 172.21.15.90:0/3564184004 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feea8071020 0x7feea81f5710 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7feea400e810 tx=0x7feea400ebd0 comp rx=0 tx=0).stop 2023-06-09T04:42:09.712 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.707+0000 7feeafba0700 1 -- 172.21.15.90:0/3564184004 shutdown_connections 2023-06-09T04:42:09.712 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.707+0000 7feeafba0700 1 --2- 172.21.15.90:0/3564184004 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fee8c0662f0 0x7fee8c0687a0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:09.712 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.707+0000 7feeafba0700 1 --2- 172.21.15.90:0/3564184004 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7feea80cb3a0 0x7feea80a7480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:09.713 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.707+0000 7feeafba0700 1 --2- 172.21.15.90:0/3564184004 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7feea80c3350 0x7feea81485e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:09.713 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.707+0000 7feeafba0700 1 --2- 172.21.15.90:0/3564184004 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feea8071020 0x7feea81f5710 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:09.713 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.707+0000 7feeafba0700 1 -- 172.21.15.90:0/3564184004 >> 172.21.15.90:0/3564184004 conn(0x7feea80b00e0 msgr2=0x7feea80ae560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:09.713 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.707+0000 7feeafba0700 1 -- 172.21.15.90:0/3564184004 shutdown_connections 2023-06-09T04:42:09.713 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.707+0000 7feeafba0700 1 -- 172.21.15.90:0/3564184004 wait complete. 2023-06-09T04:42:09.733 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-09T04:42:09.902 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.895+0000 7fd4dee8c700 1 Processor -- start 2023-06-09T04:42:09.903 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.899+0000 7fd4dee8c700 1 -- start start 2023-06-09T04:42:09.906 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.899+0000 7fd4dee8c700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd4d815de00 0x7fd4d81612e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:09.907 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.899+0000 7fd4dee8c700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fd4d80c3170 0x7fd4d80c35f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:09.907 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.899+0000 7fd4dee8c700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4d80cc230 con 0x7fd4d80cda20 2023-06-09T04:42:09.907 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.899+0000 7fd4dee8c700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4d80cde90 con 0x7fd4d80c3170 2023-06-09T04:42:09.907 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.899+0000 7fd4dee8c700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4d806ab90 con 0x7fd4d815de00 2023-06-09T04:42:09.908 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.903+0000 7fd4dd689700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7fd4d80cda20 0x7fd4d80c4640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:55606/0 (socket says 172.21.15.90:55606) 2023-06-09T04:42:09.908 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.903+0000 7fd4dd689700 1 -- 172.21.15.90:0/1485730068 learned_addr learned my addr 172.21.15.90:0/1485730068 (peer_addr_for_me v1:172.21.15.90:0/0) 2023-06-09T04:42:09.908 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.903+0000 7fd4dde8a700 1 --2- 172.21.15.90:0/1485730068 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd4d815de00 0x7fd4d81612e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:09.908 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.903+0000 7fd4de68b700 1 --2- 172.21.15.90:0/1485730068 >> v2:172.21.15.174:3300/0 conn(0x7fd4d80c3170 0x7fd4d80c35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:09.908 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.903+0000 7fd4dce88700 1 -- 172.21.15.90:0/1485730068 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 873703250 0 0) 0x7fd4d80cc230 con 0x7fd4d80cda20 2023-06-09T04:42:09.908 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.903+0000 7fd4dce88700 1 -- 172.21.15.90:0/1485730068 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd4c40035d0 con 0x7fd4d80cda20 2023-06-09T04:42:09.909 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.903+0000 7fd4de68b700 1 -- 172.21.15.90:0/1485730068 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd4d815de00 msgr2=0x7fd4d81612e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:09.909 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.903+0000 7fd4de68b700 1 --2- 172.21.15.90:0/1485730068 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd4d815de00 0x7fd4d81612e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:09.909 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.903+0000 7fd4de68b700 1 -- 172.21.15.90:0/1485730068 >> v1:172.21.15.90:6789/0 conn(0x7fd4d80cda20 legacy=0x7fd4d80c4640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:09.910 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.903+0000 7fd4de68b700 1 -- 172.21.15.90:0/1485730068 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4d815e1d0 con 0x7fd4d80c3170 2023-06-09T04:42:09.910 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.903+0000 7fd4de68b700 1 --2- 172.21.15.90:0/1485730068 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd4d80c3170 0x7fd4d80c35f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fd4d0009850 tx=0x7fd4d0009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1dda5079d84a118a server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:09.910 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.903+0000 7fd4dce88700 1 -- 172.21.15.90:0/1485730068 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4d0011830 con 0x7fd4d80c3170 2023-06-09T04:42:09.910 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.903+0000 7fd4dce88700 1 -- 172.21.15.90:0/1485730068 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4d0011990 con 0x7fd4d80c3170 2023-06-09T04:42:09.910 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.903+0000 7fd4dce88700 1 -- 172.21.15.90:0/1485730068 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4d0011d40 con 0x7fd4d80c3170 2023-06-09T04:42:09.911 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.903+0000 7fd4dee8c700 1 -- 172.21.15.90:0/1485730068 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd4d80c3170 msgr2=0x7fd4d80c35f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:09.911 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.903+0000 7fd4dee8c700 1 --2- 172.21.15.90:0/1485730068 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd4d80c3170 0x7fd4d80c35f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fd4d0009850 tx=0x7fd4d0009b60 comp rx=0 tx=0).stop 2023-06-09T04:42:09.911 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.903+0000 7fd4dee8c700 1 -- 172.21.15.90:0/1485730068 shutdown_connections 2023-06-09T04:42:09.911 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.903+0000 7fd4dee8c700 1 --2- 172.21.15.90:0/1485730068 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd4d80c3170 0x7fd4d80c35f0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:09.911 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.903+0000 7fd4dee8c700 1 --2- 172.21.15.90:0/1485730068 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd4d815de00 0x7fd4d81612e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:09.912 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.903+0000 7fd4dee8c700 1 -- 172.21.15.90:0/1485730068 >> 172.21.15.90:0/1485730068 conn(0x7fd4d80aff00 msgr2=0x7fd4d80b0300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:09.912 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.903+0000 7fd4dee8c700 1 -- 172.21.15.90:0/1485730068 shutdown_connections 2023-06-09T04:42:09.912 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.903+0000 7fd4dee8c700 1 -- 172.21.15.90:0/1485730068 wait complete. 2023-06-09T04:42:09.912 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.907+0000 7fd4dee8c700 1 Processor -- start 2023-06-09T04:42:09.913 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.907+0000 7fd4dee8c700 1 -- start start 2023-06-09T04:42:09.914 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.907+0000 7fd4dee8c700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd4d80c3170 0x7fd4d814e610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:09.914 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.907+0000 7fd4dee8c700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd4d80cda20 0x7fd4d815e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:09.914 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.907+0000 7fd4dee8c700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd4d815de00 0x7fd4d815e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:09.914 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.907+0000 7fd4dee8c700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4d80c53c0 con 0x7fd4d80cda20 2023-06-09T04:42:09.914 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.907+0000 7fd4dee8c700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4d815c470 con 0x7fd4d815de00 2023-06-09T04:42:09.914 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.907+0000 7fd4dee8c700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4d815c750 con 0x7fd4d80c3170 2023-06-09T04:42:09.915 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.907+0000 7fd4dd689700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd4d80cda20 0x7fd4d815e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:09.916 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.907+0000 7fd4dd689700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd4d80cda20 0x7fd4d815e3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:46026/0 (socket says 172.21.15.90:46026) 2023-06-09T04:42:09.916 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.907+0000 7fd4dd689700 1 -- 172.21.15.90:0/2512417154 learned_addr learned my addr 172.21.15.90:0/2512417154 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:09.916 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.907+0000 7fd4de68b700 1 --2- 172.21.15.90:0/2512417154 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd4d815de00 0x7fd4d815e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:09.916 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.907+0000 7fd4dde8a700 1 --2- 172.21.15.90:0/2512417154 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd4d80c3170 0x7fd4d814e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:09.916 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.911+0000 7fd4dd689700 1 -- 172.21.15.90:0/2512417154 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd4d80c3170 msgr2=0x7fd4d814e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:09.916 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.911+0000 7fd4dd689700 1 --2- 172.21.15.90:0/2512417154 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd4d80c3170 0x7fd4d814e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:09.916 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.911+0000 7fd4dd689700 1 -- 172.21.15.90:0/2512417154 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd4d815de00 msgr2=0x7fd4d815e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:09.917 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.911+0000 7fd4dd689700 1 --2- 172.21.15.90:0/2512417154 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd4d815de00 0x7fd4d815e930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:09.917 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.911+0000 7fd4dd689700 1 -- 172.21.15.90:0/2512417154 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4d00094b0 con 0x7fd4d80cda20 2023-06-09T04:42:09.917 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.911+0000 7fd4dd689700 1 --2- 172.21.15.90:0/2512417154 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd4d80cda20 0x7fd4d815e3f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fd4c800c700 tx=0x7fd4c800ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:09.917 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.911+0000 7fd4ce7fc700 1 -- 172.21.15.90:0/2512417154 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4c8005d90 con 0x7fd4d80cda20 2023-06-09T04:42:09.918 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.911+0000 7fd4ce7fc700 1 -- 172.21.15.90:0/2512417154 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4c80070d0 con 0x7fd4d80cda20 2023-06-09T04:42:09.918 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.911+0000 7fd4ce7fc700 1 -- 172.21.15.90:0/2512417154 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4c8007480 con 0x7fd4d80cda20 2023-06-09T04:42:09.918 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.911+0000 7fd4dee8c700 1 -- 172.21.15.90:0/2512417154 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4d8161950 con 0x7fd4d80cda20 2023-06-09T04:42:09.918 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.911+0000 7fd4dee8c700 1 -- 172.21.15.90:0/2512417154 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4d8161f10 con 0x7fd4d80cda20 2023-06-09T04:42:09.918 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.911+0000 7fd4dee8c700 1 -- 172.21.15.90:0/2512417154 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4d8162100 con 0x7fd4d80cda20 2023-06-09T04:42:09.920 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.915+0000 7fd4ce7fc700 1 -- 172.21.15.90:0/2512417154 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd4c80075e0 con 0x7fd4d80cda20 2023-06-09T04:42:09.921 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.915+0000 7fd4ce7fc700 1 --2- 172.21.15.90:0/2512417154 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fd4bc0662f0 0x7fd4bc0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:09.922 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.915+0000 7fd4ce7fc700 1 -- 172.21.15.90:0/2512417154 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd4c8083180 con 0x7fd4d80cda20 2023-06-09T04:42:09.922 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.915+0000 7fd4dde8a700 1 --2- 172.21.15.90:0/2512417154 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fd4bc0662f0 0x7fd4bc0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:09.923 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.919+0000 7fd4dde8a700 1 --2- 172.21.15.90:0/2512417154 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fd4bc0662f0 0x7fd4bc0687a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fd4d40113e0 tx=0x7fd4d400b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:09.927 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:09.923+0000 7fd4ce7fc700 1 -- 172.21.15.90:0/2512417154 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd4c80505f0 con 0x7fd4d80cda20 2023-06-09T04:42:10.102 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:10.095+0000 7fd4dee8c700 1 -- 172.21.15.90:0/2512417154 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd4d804e380 con 0x7fd4d80cda20 2023-06-09T04:42:10.103 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:10.095+0000 7fd4ce7fc700 1 -- 172.21.15.90:0/2512417154 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd4c8053c10 con 0x7fd4d80cda20 2023-06-09T04:42:10.104 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 64 2023-06-09T04:42:10.106 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:10.099+0000 7fd4dee8c700 1 -- 172.21.15.90:0/2512417154 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fd4bc0662f0 msgr2=0x7fd4bc0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:10.106 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:10.099+0000 7fd4dee8c700 1 --2- 172.21.15.90:0/2512417154 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fd4bc0662f0 0x7fd4bc0687a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fd4d40113e0 tx=0x7fd4d400b040 comp rx=0 tx=0).stop 2023-06-09T04:42:10.106 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:10.099+0000 7fd4dee8c700 1 -- 172.21.15.90:0/2512417154 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd4d80cda20 msgr2=0x7fd4d815e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:10.106 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:10.099+0000 7fd4dee8c700 1 --2- 172.21.15.90:0/2512417154 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd4d80cda20 0x7fd4d815e3f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fd4c800c700 tx=0x7fd4c800ca10 comp rx=0 tx=0).stop 2023-06-09T04:42:10.106 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:10.099+0000 7fd4dee8c700 1 -- 172.21.15.90:0/2512417154 shutdown_connections 2023-06-09T04:42:10.106 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:10.099+0000 7fd4dee8c700 1 --2- 172.21.15.90:0/2512417154 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fd4bc0662f0 0x7fd4bc0687a0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:10.107 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:10.099+0000 7fd4dee8c700 1 --2- 172.21.15.90:0/2512417154 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd4d815de00 0x7fd4d815e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:10.107 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:10.099+0000 7fd4dee8c700 1 --2- 172.21.15.90:0/2512417154 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd4d80cda20 0x7fd4d815e3f0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:10.107 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:10.099+0000 7fd4dee8c700 1 --2- 172.21.15.90:0/2512417154 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd4d80c3170 0x7fd4d814e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:10.107 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:10.099+0000 7fd4dee8c700 1 -- 172.21.15.90:0/2512417154 >> 172.21.15.90:0/2512417154 conn(0x7fd4d80aff00 msgr2=0x7fd4d80c43a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:10.107 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:10.099+0000 7fd4dee8c700 1 -- 172.21.15.90:0/2512417154 shutdown_connections 2023-06-09T04:42:10.108 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:10.099+0000 7fd4dee8c700 1 -- 172.21.15.90:0/2512417154 wait complete. 2023-06-09T04:42:10.126 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-09T04:42:10.296 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:10.291+0000 7f916823b700 1 Processor -- start 2023-06-09T04:42:10.296 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:10.291+0000 7f916823b700 1 -- start start 2023-06-09T04:42:10.299 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:10.295+0000 7f916823b700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f916006cc50 0x7f916015ff30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:10.300 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:10.295+0000 7f916823b700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f91600b7840 0x7f91600b7c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:10.300 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:10.295+0000 7f916823b700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91600d17e0 con 0x7f91600d1220 2023-06-09T04:42:10.301 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:10.295+0000 7f916823b700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91600d0150 con 0x7f91600b7840 2023-06-09T04:42:10.301 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:10.295+0000 7f916823b700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f916015c8b0 con 0x7f916006cc50 2023-06-09T04:42:10.301 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:10.295+0000 7f91667d8700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f91600b7840 0x7f91600b7c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:10.301 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:10.295+0000 7f91667d8700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f91600b7840 0x7f91600b7c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:46030/0 (socket says 172.21.15.90:46030) 2023-06-09T04:42:10.301 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:10.295+0000 7f91667d8700 1 -- 172.21.15.90:0/2366874712 learned_addr learned my addr 172.21.15.90:0/2366874712 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:10.301 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:10.295+0000 7f9165fd7700 1 --2- 172.21.15.90:0/2366874712 >> v2:172.21.15.174:3300/0 conn(0x7f916006cc50 0x7f916015ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:10.302 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:10.295+0000 7f91667d8700 1 -- 172.21.15.90:0/2366874712 >> v2:172.21.15.174:3300/0 conn(0x7f916006cc50 msgr2=0x7f916015ff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:10.302 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:10.295+0000 7f91667d8700 1 --2- 172.21.15.90:0/2366874712 >> v2:172.21.15.174:3300/0 conn(0x7f916006cc50 0x7f916015ff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:10.302 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:10.295+0000 7f91667d8700 1 -- 172.21.15.90:0/2366874712 >> v1:172.21.15.174:6789/0 conn(0x7f91600d1220 legacy=0x7f9160160470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:10.303 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:10.295+0000 7f91667d8700 1 -- 172.21.15.90:0/2366874712 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91600cf390 con 0x7f91600b7840 2023-06-09T04:42:10.303 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:10.295+0000 7f9165fd7700 1 --2- 172.21.15.90:0/2366874712 >> v2:172.21.15.174:3300/0 conn(0x7f916006cc50 0x7f916015ff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:42:10.303 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:10.295+0000 7f91667d8700 1 --2- 172.21.15.90:0/2366874712 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f91600b7840 0x7f91600b7c60 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f91600b5460 tx=0x7f915800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c95fccc4bb7d1d59 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:10.303 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:10.295+0000 7f9164fd5700 1 -- 172.21.15.90:0/2366874712 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f915800e070 con 0x7f91600b7840 2023-06-09T04:42:10.303 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:10.295+0000 7f9164fd5700 1 -- 172.21.15.90:0/2366874712 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9158003a40 con 0x7f91600b7840 2023-06-09T04:42:10.303 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:10.295+0000 7f9164fd5700 1 -- 172.21.15.90:0/2366874712 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9158003df0 con 0x7f91600b7840 2023-06-09T04:42:10.304 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:10.295+0000 7f916823b700 1 -- 172.21.15.90:0/2366874712 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f91600b7840 msgr2=0x7f91600b7c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:10.304 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:10.295+0000 7f916823b700 1 --2- 172.21.15.90:0/2366874712 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f91600b7840 0x7f91600b7c60 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f91600b5460 tx=0x7f915800b330 comp rx=0 tx=0).stop 2023-06-09T04:42:10.304 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:10.299+0000 7f916823b700 1 -- 172.21.15.90:0/2366874712 shutdown_connections 2023-06-09T04:42:10.305 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:10.299+0000 7f916823b700 1 --2- 172.21.15.90:0/2366874712 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f91600b7840 0x7f91600b7c60 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:10.305 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:10.299+0000 7f916823b700 1 --2- 172.21.15.90:0/2366874712 >> v2:172.21.15.174:3300/0 conn(0x7f916006cc50 0x7f916015ff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:10.305 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:10.299+0000 7f916823b700 1 -- 172.21.15.90:0/2366874712 >> 172.21.15.90:0/2366874712 conn(0x7f91600b57f0 msgr2=0x7f91600b5bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:10.305 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:10.299+0000 7f916823b700 1 -- 172.21.15.90:0/2366874712 shutdown_connections 2023-06-09T04:42:10.305 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:10.299+0000 7f916823b700 1 -- 172.21.15.90:0/2366874712 wait complete. 2023-06-09T04:42:10.306 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:10.299+0000 7f916823b700 1 Processor -- start 2023-06-09T04:42:10.306 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:10.299+0000 7f916823b700 1 -- start start 2023-06-09T04:42:10.306 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:10.299+0000 7f916823b700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f916006cc50 0x7f91601f2470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:10.306 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:10.299+0000 7f916823b700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f91600b7840 0x7f9160150db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:10.307 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:10.299+0000 7f916823b700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f91600d1220 0x7f916015ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:10.307 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:10.299+0000 7f916823b700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f916015e050 con 0x7f916006cc50 2023-06-09T04:42:10.307 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:10.299+0000 7f916823b700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91601512f0 con 0x7f91600b7840 2023-06-09T04:42:10.307 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:10.299+0000 7f916823b700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f916015d310 con 0x7f91600d1220 2023-06-09T04:42:10.308 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:10.303+0000 7f9165fd7700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f916006cc50 0x7f91601f2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:10.308 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:10.303+0000 7f9165fd7700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f916006cc50 0x7f91601f2470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:46032/0 (socket says 172.21.15.90:46032) 2023-06-09T04:42:10.308 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:10.303+0000 7f9165fd7700 1 -- 172.21.15.90:0/3961733316 learned_addr learned my addr 172.21.15.90:0/3961733316 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:10.309 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:10.303+0000 7f91667d8700 1 --2- 172.21.15.90:0/3961733316 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f91600d1220 0x7f916015ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:10.309 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:10.303+0000 7f91657d6700 1 --2- 172.21.15.90:0/3961733316 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f91600b7840 0x7f9160150db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:10.309 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:10.303+0000 7f9165fd7700 1 -- 172.21.15.90:0/3961733316 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f91600d1220 msgr2=0x7f916015ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:10.309 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:10.303+0000 7f9165fd7700 1 --2- 172.21.15.90:0/3961733316 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f91600d1220 0x7f916015ca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:10.309 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:10.303+0000 7f9165fd7700 1 -- 172.21.15.90:0/3961733316 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f91600b7840 msgr2=0x7f9160150db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:10.309 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:10.303+0000 7f9165fd7700 1 --2- 172.21.15.90:0/3961733316 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f91600b7840 0x7f9160150db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:10.309 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:10.303+0000 7f9165fd7700 1 -- 172.21.15.90:0/3961733316 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9158009b30 con 0x7f916006cc50 2023-06-09T04:42:10.310 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:10.303+0000 7f91657d6700 1 --2- 172.21.15.90:0/3961733316 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f91600b7840 0x7f9160150db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:42:10.310 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:10.303+0000 7f9165fd7700 1 --2- 172.21.15.90:0/3961733316 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f916006cc50 0x7f91601f2470 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f915c00c7c0 tx=0x7f915c00cad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:10.310 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:10.303+0000 7f91567fc700 1 -- 172.21.15.90:0/3961733316 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f915c011800 con 0x7f916006cc50 2023-06-09T04:42:10.310 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:10.303+0000 7f91567fc700 1 -- 172.21.15.90:0/3961733316 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f915c011960 con 0x7f916006cc50 2023-06-09T04:42:10.310 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:10.303+0000 7f91567fc700 1 -- 172.21.15.90:0/3961733316 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f915c011cf0 con 0x7f916006cc50 2023-06-09T04:42:10.310 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:10.303+0000 7f916823b700 1 -- 172.21.15.90:0/3961733316 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f916015d5f0 con 0x7f916006cc50 2023-06-09T04:42:10.310 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:10.303+0000 7f916823b700 1 -- 172.21.15.90:0/3961733316 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f916015dc70 con 0x7f916006cc50 2023-06-09T04:42:10.311 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:10.303+0000 7f916823b700 1 -- 172.21.15.90:0/3961733316 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f916004db30 con 0x7f916006cc50 2023-06-09T04:42:10.311 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:10.307+0000 7f91567fc700 1 -- 172.21.15.90:0/3961733316 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f915c021350 con 0x7f916006cc50 2023-06-09T04:42:10.313 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:10.307+0000 7f91567fc700 1 --2- 172.21.15.90:0/3961733316 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f91440662f0 0x7f91440687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:10.313 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:10.307+0000 7f91567fc700 1 -- 172.21.15.90:0/3961733316 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f915c083c00 con 0x7f916006cc50 2023-06-09T04:42:10.314 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:10.307+0000 7f91657d6700 1 --2- 172.21.15.90:0/3961733316 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f91440662f0 0x7f91440687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:10.315 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:10.311+0000 7f91657d6700 1 --2- 172.21.15.90:0/3961733316 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f91440662f0 0x7f91440687a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f91600c8530 tx=0x7f9150009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:10.317 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:10.311+0000 7f91567fc700 1 -- 172.21.15.90:0/3961733316 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f915c054a80 con 0x7f916006cc50 2023-06-09T04:42:10.524 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:10.519+0000 7f916823b700 1 -- 172.21.15.90:0/3961733316 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f91600b63d0 con 0x7f916006cc50 2023-06-09T04:42:10.526 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:10.519+0000 7f91567fc700 1 -- 172.21.15.90:0/3961733316 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4668 (secure 0 0 0) 0x7f915c054610 con 0x7f916006cc50 2023-06-09T04:42:10.526 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:42:10.526 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6836/271257743","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":271257743},{"type":"v1","addr":"172.21.15.174:6836","nonce":271257743}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4269,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6833/2861565528","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":2861565528},{"type":"v1","addr":"172.21.15.90:6833","nonce":2861565528}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/1212048840","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1212048840},{"type":"v1","addr":"172.21.15.90:6835","nonce":1212048840}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-09T04:41:54.383738+0000","modified":"2023-06-09T04:41:57.405504+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4306},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4306":{"gid":4306,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.174:6837/2976585572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6835","nonce":2976585572},{"type":"v1","addr":"172.21.15.174:6837","nonce":2976585572}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-06-09T04:42:10.530 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:10.523+0000 7f916823b700 1 -- 172.21.15.90:0/3961733316 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f91440662f0 msgr2=0x7f91440687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:10.530 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:10.523+0000 7f916823b700 1 --2- 172.21.15.90:0/3961733316 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f91440662f0 0x7f91440687a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f91600c8530 tx=0x7f9150009040 comp rx=0 tx=0).stop 2023-06-09T04:42:10.530 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:10.523+0000 7f916823b700 1 -- 172.21.15.90:0/3961733316 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f916006cc50 msgr2=0x7f91601f2470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:10.531 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:10.523+0000 7f916823b700 1 --2- 172.21.15.90:0/3961733316 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f916006cc50 0x7f91601f2470 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f915c00c7c0 tx=0x7f915c00cad0 comp rx=0 tx=0).stop 2023-06-09T04:42:10.531 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:10.523+0000 7f916823b700 1 -- 172.21.15.90:0/3961733316 shutdown_connections 2023-06-09T04:42:10.531 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:10.523+0000 7f916823b700 1 --2- 172.21.15.90:0/3961733316 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f91440662f0 0x7f91440687a0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:10.531 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:10.523+0000 7f916823b700 1 --2- 172.21.15.90:0/3961733316 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f91600d1220 0x7f916015ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:10.531 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:10.523+0000 7f916823b700 1 --2- 172.21.15.90:0/3961733316 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f91600b7840 0x7f9160150db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:10.531 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:10.523+0000 7f916823b700 1 --2- 172.21.15.90:0/3961733316 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f916006cc50 0x7f91601f2470 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:10.531 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:10.523+0000 7f916823b700 1 -- 172.21.15.90:0/3961733316 >> 172.21.15.90:0/3961733316 conn(0x7f91600b57f0 msgr2=0x7f91600ce090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:10.532 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:10.523+0000 7f916823b700 1 -- 172.21.15.90:0/3961733316 shutdown_connections 2023-06-09T04:42:10.532 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:10.523+0000 7f916823b700 1 -- 172.21.15.90:0/3961733316 wait complete. 2023-06-09T04:42:10.533 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 8 2023-06-09T04:42:10.554 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T04:42:10.726 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:10.719+0000 7f2211bc1700 1 Processor -- start 2023-06-09T04:42:10.726 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:10.719+0000 7f2211bc1700 1 -- start start 2023-06-09T04:42:10.727 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:10.723+0000 7f2211bc1700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f220c158b30 0x7f220c15d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:10.727 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:10.723+0000 7f2211bc1700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f220c0cd3a0 con 0x7f220c070db0 2023-06-09T04:42:10.728 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:10.723+0000 7f2211bc1700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f220c071550 con 0x7f220c158f00 2023-06-09T04:42:10.728 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:10.723+0000 7f2211bc1700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f220c069f30 con 0x7f220c158b30 2023-06-09T04:42:10.728 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:10.723+0000 7f220b7fe700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f220c158b30 0x7f220c15d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:10.728 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:10.723+0000 7f220bfff700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f220c070db0 0x7f220c15c950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:55622/0 (socket says 172.21.15.90:55622) 2023-06-09T04:42:10.729 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:10.723+0000 7f220bfff700 1 -- 172.21.15.90:0/3811248430 learned_addr learned my addr 172.21.15.90:0/3811248430 (peer_addr_for_me v1:172.21.15.90:0/0) 2023-06-09T04:42:10.729 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:10.723+0000 7f2202ffd700 1 --1- 172.21.15.90:0/3811248430 >> v1:172.21.15.174:6789/0 conn(0x7f220c158f00 0x7f220c069820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.90:56194/0 (socket says 172.21.15.90:56194) 2023-06-09T04:42:10.729 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:10.723+0000 7f220b7fe700 1 -- 172.21.15.90:0/3811248430 >> v1:172.21.15.174:6789/0 conn(0x7f220c158f00 legacy=0x7f220c069820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:10.729 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:10.723+0000 7f220b7fe700 1 -- 172.21.15.90:0/3811248430 >> v1:172.21.15.90:6789/0 conn(0x7f220c070db0 legacy=0x7f220c15c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:10.730 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:10.723+0000 7f220b7fe700 1 -- 172.21.15.90:0/3811248430 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f220c071830 con 0x7f220c158b30 2023-06-09T04:42:10.730 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:10.723+0000 7f220b7fe700 1 --2- 172.21.15.90:0/3811248430 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f220c158b30 0x7f220c15d4f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f21fc009880 tx=0x7f21fc009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a5d8d872e773dfe7 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:10.730 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:10.723+0000 7f220affd700 1 -- 172.21.15.90:0/3811248430 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21fc011830 con 0x7f220c158b30 2023-06-09T04:42:10.731 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:10.723+0000 7f220affd700 1 -- 172.21.15.90:0/3811248430 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21fc011990 con 0x7f220c158b30 2023-06-09T04:42:10.731 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:10.723+0000 7f220affd700 1 -- 172.21.15.90:0/3811248430 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21fc011d20 con 0x7f220c158b30 2023-06-09T04:42:10.731 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:10.727+0000 7f2211bc1700 1 -- 172.21.15.90:0/3811248430 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f220c158b30 msgr2=0x7f220c15d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:10.732 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:10.727+0000 7f2211bc1700 1 --2- 172.21.15.90:0/3811248430 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f220c158b30 0x7f220c15d4f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f21fc009880 tx=0x7f21fc009b90 comp rx=0 tx=0).stop 2023-06-09T04:42:10.732 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:10.727+0000 7f2211bc1700 1 -- 172.21.15.90:0/3811248430 shutdown_connections 2023-06-09T04:42:10.732 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:10.727+0000 7f2211bc1700 1 --2- 172.21.15.90:0/3811248430 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f220c158b30 0x7f220c15d4f0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:10.732 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:10.727+0000 7f2211bc1700 1 -- 172.21.15.90:0/3811248430 >> 172.21.15.90:0/3811248430 conn(0x7f220c06c810 msgr2=0x7f220c0b0000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:10.732 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:10.727+0000 7f2211bc1700 1 -- 172.21.15.90:0/3811248430 shutdown_connections 2023-06-09T04:42:10.732 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:10.727+0000 7f2211bc1700 1 -- 172.21.15.90:0/3811248430 wait complete. 2023-06-09T04:42:10.733 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:10.727+0000 7f2211bc1700 1 Processor -- start 2023-06-09T04:42:10.734 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:10.727+0000 7f2211bc1700 1 -- start start 2023-06-09T04:42:10.735 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:10.731+0000 7f2211bc1700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f220c070db0 0x7f220c15b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:10.735 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:10.731+0000 7f2211bc1700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f220c158b30 0x7f220c0ae7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:10.735 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:10.731+0000 7f2211bc1700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f220c158f00 0x7f220c14a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:10.735 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:10.731+0000 7f2211bc1700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f220c15b750 con 0x7f220c070db0 2023-06-09T04:42:10.736 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:10.731+0000 7f2211bc1700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f220c15ba30 con 0x7f220c158b30 2023-06-09T04:42:10.736 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:10.731+0000 7f2211bc1700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f220c15bd10 con 0x7f220c158f00 2023-06-09T04:42:10.737 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:10.731+0000 7f220b7fe700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f220c070db0 0x7f220c15b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:10.737 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:10.731+0000 7f220b7fe700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f220c070db0 0x7f220c15b150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:46036/0 (socket says 172.21.15.90:46036) 2023-06-09T04:42:10.737 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:10.731+0000 7f220b7fe700 1 -- 172.21.15.90:0/1248514156 learned_addr learned my addr 172.21.15.90:0/1248514156 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:10.737 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:10.731+0000 7f2202ffd700 1 --2- 172.21.15.90:0/1248514156 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f220c158b30 0x7f220c0ae7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:10.738 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:10.731+0000 7f220bfff700 1 --2- 172.21.15.90:0/1248514156 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f220c158f00 0x7f220c14a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:10.738 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:10.731+0000 7f220b7fe700 1 -- 172.21.15.90:0/1248514156 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f220c158f00 msgr2=0x7f220c14a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:10.738 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:10.731+0000 7f220b7fe700 1 --2- 172.21.15.90:0/1248514156 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f220c158f00 0x7f220c14a020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:10.738 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:10.731+0000 7f220b7fe700 1 -- 172.21.15.90:0/1248514156 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f220c158b30 msgr2=0x7f220c0ae7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:10.738 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:10.731+0000 7f220b7fe700 1 --2- 172.21.15.90:0/1248514156 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f220c158b30 0x7f220c0ae7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:10.738 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:10.731+0000 7f220b7fe700 1 -- 172.21.15.90:0/1248514156 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21fc0094b0 con 0x7f220c070db0 2023-06-09T04:42:10.738 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:10.731+0000 7f220b7fe700 1 --2- 172.21.15.90:0/1248514156 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f220c070db0 0x7f220c15b150 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f220c06df10 tx=0x7f21fc004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:10.739 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:10.731+0000 7f2208ff9700 1 -- 172.21.15.90:0/1248514156 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21fc0045e0 con 0x7f220c070db0 2023-06-09T04:42:10.739 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:10.731+0000 7f2208ff9700 1 -- 172.21.15.90:0/1248514156 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21fc01f070 con 0x7f220c070db0 2023-06-09T04:42:10.739 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:10.731+0000 7f2211bc1700 1 -- 172.21.15.90:0/1248514156 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f220c15bff0 con 0x7f220c070db0 2023-06-09T04:42:10.739 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:10.731+0000 7f2208ff9700 1 -- 172.21.15.90:0/1248514156 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21fc003920 con 0x7f220c070db0 2023-06-09T04:42:10.739 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:10.731+0000 7f2211bc1700 1 -- 172.21.15.90:0/1248514156 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f220c14a560 con 0x7f220c070db0 2023-06-09T04:42:10.740 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:10.735+0000 7f2211bc1700 1 -- 172.21.15.90:0/1248514156 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f220c14a810 con 0x7f220c070db0 2023-06-09T04:42:10.740 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:10.735+0000 7f2208ff9700 1 -- 172.21.15.90:0/1248514156 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f21fc021030 con 0x7f220c070db0 2023-06-09T04:42:10.742 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:10.735+0000 7f2208ff9700 1 --2- 172.21.15.90:0/1248514156 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f21ec0662f0 0x7f21ec0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:10.742 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:10.735+0000 7f2208ff9700 1 -- 172.21.15.90:0/1248514156 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f21fc0852e0 con 0x7f220c070db0 2023-06-09T04:42:10.742 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:10.735+0000 7f2202ffd700 1 --2- 172.21.15.90:0/1248514156 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f21ec0662f0 0x7f21ec0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:10.743 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:10.739+0000 7f2202ffd700 1 --2- 172.21.15.90:0/1248514156 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f21ec0662f0 0x7f21ec0687a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f220c1f5060 tx=0x7f21f4007d50 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:10.748 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:10.743+0000 7f2208ff9700 1 -- 172.21.15.90:0/1248514156 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f21fc0527f0 con 0x7f220c070db0 2023-06-09T04:42:10.919 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:10.915+0000 7f2211bc1700 1 -- 172.21.15.90:0/1248514156 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f220c04db30 con 0x7f220c070db0 2023-06-09T04:42:10.922 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:10.915+0000 7f2208ff9700 1 -- 172.21.15.90:0/1248514156 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18279 (secure 0 0 0) 0x7f21fc055e10 con 0x7f220c070db0 2023-06-09T04:42:10.923 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:42:10.923 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":24,"fsid":"700369c0-a111-43b4-9415-844ad1742b70","created":"2023-06-09T04:41:28.180311+0000","modified":"2023-06-09T04:41:55.389425+0000","last_up_change":"2023-06-09T04:41:40.746475+0000","last_in_change":"2023-06-09T04:41:31.262765+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-09T04:41:42.402564+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-09T04:41:47.607323+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-09T04:41:52.543474+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-09T04:41:53.382940+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"46a4a7c5-babd-4ef3-9830-51487cff5eb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":2780271267},{"type":"v1","addr":"172.21.15.90:6809","nonce":2780271267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2780271267},{"type":"v1","addr":"172.21.15.90:6811","nonce":2780271267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2780271267},{"type":"v1","addr":"172.21.15.90:6815","nonce":2780271267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2780271267},{"type":"v1","addr":"172.21.15.90:6813","nonce":2780271267}]},"public_addr":"172.21.15.90:6809/2780271267","cluster_addr":"172.21.15.90:6811/2780271267","heartbeat_back_addr":"172.21.15.90:6815/2780271267","heartbeat_front_addr":"172.21.15.90:6813/2780271267","state":["exists","up"]},{"osd":1,"uuid":"1543988f-c498-494a-a6f9-fac8413db6ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":3064028136},{"type":"v1","addr":"172.21.15.90:6801","nonce":3064028136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":3064028136},{"type":"v1","addr":"172.21.15.90:6803","nonce":3064028136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":3064028136},{"type":"v1","addr":"172.21.15.90:6807","nonce":3064028136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":3064028136},{"type":"v1","addr":"172.21.15.90:6805","nonce":3064028136}]},"public_addr":"172.21.15.90:6801/3064028136","cluster_addr":"172.21.15.90:6803/3064028136","heartbeat_back_addr":"172.21.15.90:6807/3064028136","heartbeat_front_addr":"172.21.15.90:6805/3064028136","state":["exists","up"]},{"osd":2,"uuid":"79669dd6-ffc8-4197-b9f7-b3b372b2b9b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":3713146326},{"type":"v1","addr":"172.21.15.90:6825","nonce":3713146326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":3713146326},{"type":"v1","addr":"172.21.15.90:6827","nonce":3713146326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":3713146326},{"type":"v1","addr":"172.21.15.90:6831","nonce":3713146326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":3713146326},{"type":"v1","addr":"172.21.15.90:6829","nonce":3713146326}]},"public_addr":"172.21.15.90:6825/3713146326","cluster_addr":"172.21.15.90:6827/3713146326","heartbeat_back_addr":"172.21.15.90:6831/3713146326","heartbeat_front_addr":"172.21.15.90:6829/3713146326","state":["exists","up"]},{"osd":3,"uuid":"4062ab6f-ce40-450a-aa17-b10098766c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":3499839122},{"type":"v1","addr":"172.21.15.90:6817","nonce":3499839122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":3499839122},{"type":"v1","addr":"172.21.15.90:6819","nonce":3499839122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":3499839122},{"type":"v1","addr":"172.21.15.90:6823","nonce":3499839122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":3499839122},{"type":"v1","addr":"172.21.15.90:6821","nonce":3499839122}]},"public_addr":"172.21.15.90:6817/3499839122","cluster_addr":"172.21.15.90:6819/3499839122","heartbeat_back_addr":"172.21.15.90:6823/3499839122","heartbeat_front_addr":"172.21.15.90:6821/3499839122","state":["exists","up"]},{"osd":4,"uuid":"a10820e4-b348-4d92-9796-3b01484ace1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6817","nonce":1138565854},{"type":"v1","addr":"172.21.15.174:6819","nonce":1138565854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6821","nonce":1138565854},{"type":"v1","addr":"172.21.15.174:6823","nonce":1138565854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":1138565854},{"type":"v1","addr":"172.21.15.174:6831","nonce":1138565854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":1138565854},{"type":"v1","addr":"172.21.15.174:6829","nonce":1138565854}]},"public_addr":"172.21.15.174:6819/1138565854","cluster_addr":"172.21.15.174:6823/1138565854","heartbeat_back_addr":"172.21.15.174:6831/1138565854","heartbeat_front_addr":"172.21.15.174:6829/1138565854","state":["exists","up"]},{"osd":5,"uuid":"b4da1c32-be05-420b-9346-90d91aa70569","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":1707702879},{"type":"v1","addr":"172.21.15.174:6818","nonce":1707702879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":1707702879},{"type":"v1","addr":"172.21.15.174:6822","nonce":1707702879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6827","nonce":1707702879},{"type":"v1","addr":"172.21.15.174:6828","nonce":1707702879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":1707702879},{"type":"v1","addr":"172.21.15.174:6825","nonce":1707702879}]},"public_addr":"172.21.15.174:6818/1707702879","cluster_addr":"172.21.15.174:6822/1707702879","heartbeat_back_addr":"172.21.15.174:6828/1707702879","heartbeat_front_addr":"172.21.15.174:6825/1707702879","state":["exists","up"]},{"osd":6,"uuid":"d1b98041-d243-4355-bd0a-e22cf9875b32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":864450534},{"type":"v1","addr":"172.21.15.174:6801","nonce":864450534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":864450534},{"type":"v1","addr":"172.21.15.174:6803","nonce":864450534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":864450534},{"type":"v1","addr":"172.21.15.174:6807","nonce":864450534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":864450534},{"type":"v1","addr":"172.21.15.174:6805","nonce":864450534}]},"public_addr":"172.21.15.174:6801/864450534","cluster_addr":"172.21.15.174:6803/864450534","heartbeat_back_addr":"172.21.15.174:6807/864450534","heartbeat_front_addr":"172.21.15.174:6805/864450534","state":["exists","up"]},{"osd":7,"uuid":"5a207936-f89f-416b-b79b-34ec96f77c8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":2527640659},{"type":"v1","addr":"172.21.15.174:6809","nonce":2527640659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":2527640659},{"type":"v1","addr":"172.21.15.174:6811","nonce":2527640659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":2527640659},{"type":"v1","addr":"172.21.15.174:6815","nonce":2527640659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":2527640659},{"type":"v1","addr":"172.21.15.174:6813","nonce":2527640659}]},"public_addr":"172.21.15.174:6809/2527640659","cluster_addr":"172.21.15.174:6811/2527640659","heartbeat_back_addr":"172.21.15.174:6815/2527640659","heartbeat_front_addr":"172.21.15.174:6813/2527640659","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:36.972152+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:36.984561+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:36.998817+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:37.054944+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:37.085014+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:37.115125+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:36.854608+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:36.971685+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:42:10.925 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:10.919+0000 7f2211bc1700 1 -- 172.21.15.90:0/1248514156 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f21ec0662f0 msgr2=0x7f21ec0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:10.925 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:10.919+0000 7f2211bc1700 1 --2- 172.21.15.90:0/1248514156 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f21ec0662f0 0x7f21ec0687a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f220c1f5060 tx=0x7f21f4007d50 comp rx=0 tx=0).stop 2023-06-09T04:42:10.925 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:10.919+0000 7f2211bc1700 1 -- 172.21.15.90:0/1248514156 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f220c070db0 msgr2=0x7f220c15b150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:10.926 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:10.919+0000 7f2211bc1700 1 --2- 172.21.15.90:0/1248514156 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f220c070db0 0x7f220c15b150 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f220c06df10 tx=0x7f21fc004770 comp rx=0 tx=0).stop 2023-06-09T04:42:10.926 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:10.919+0000 7f2211bc1700 1 -- 172.21.15.90:0/1248514156 shutdown_connections 2023-06-09T04:42:10.926 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:10.919+0000 7f2211bc1700 1 --2- 172.21.15.90:0/1248514156 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f21ec0662f0 0x7f21ec0687a0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:10.926 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:10.919+0000 7f2211bc1700 1 --2- 172.21.15.90:0/1248514156 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f220c158f00 0x7f220c14a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:10.926 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:10.919+0000 7f2211bc1700 1 --2- 172.21.15.90:0/1248514156 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f220c158b30 0x7f220c0ae7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:10.926 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:10.919+0000 7f2211bc1700 1 --2- 172.21.15.90:0/1248514156 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f220c070db0 0x7f220c15b150 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:10.926 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:10.919+0000 7f2211bc1700 1 -- 172.21.15.90:0/1248514156 >> 172.21.15.90:0/1248514156 conn(0x7f220c06c810 msgr2=0x7f220c14c280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:10.927 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:10.919+0000 7f2211bc1700 1 -- 172.21.15.90:0/1248514156 shutdown_connections 2023-06-09T04:42:10.927 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:10.919+0000 7f2211bc1700 1 -- 172.21.15.90:0/1248514156 wait complete. 2023-06-09T04:42:10.951 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-09T04:42:11.126 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.119+0000 7fdaec225700 1 Processor -- start 2023-06-09T04:42:11.127 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.123+0000 7fdaec225700 1 -- start start 2023-06-09T04:42:11.129 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.123+0000 7fdaec225700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fdae415e120 0x7fdae40c8b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:11.129 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.123+0000 7fdaec225700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdae40caba0 con 0x7fdae40ca7a0 2023-06-09T04:42:11.129 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.123+0000 7fdaec225700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdae40cae10 con 0x7fdae4154370 2023-06-09T04:42:11.129 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.123+0000 7fdaec225700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdae40cb0f0 con 0x7fdae415e120 2023-06-09T04:42:11.130 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.123+0000 7fdaea7c2700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7fdae40ca7a0 0x7fdae40b3340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:55630/0 (socket says 172.21.15.90:55630) 2023-06-09T04:42:11.130 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.123+0000 7fdaea7c2700 1 -- 172.21.15.90:0/4178633894 learned_addr learned my addr 172.21.15.90:0/4178633894 (peer_addr_for_me v1:172.21.15.90:0/0) 2023-06-09T04:42:11.130 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.123+0000 7fdae97c0700 1 --2- 172.21.15.90:0/4178633894 >> v2:172.21.15.174:3300/0 conn(0x7fdae415e120 0x7fdae40c8b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:11.130 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.123+0000 7fdae8fbf700 1 -- 172.21.15.90:0/4178633894 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 751417341 0 0) 0x7fdae40caba0 con 0x7fdae40ca7a0 2023-06-09T04:42:11.131 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.123+0000 7fdae8fbf700 1 -- 172.21.15.90:0/4178633894 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdad00035d0 con 0x7fdae40ca7a0 2023-06-09T04:42:11.131 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.123+0000 7fdae97c0700 1 -- 172.21.15.90:0/4178633894 >> v1:172.21.15.174:6789/0 conn(0x7fdae4154370 legacy=0x7fdae415da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:11.131 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.123+0000 7fdae97c0700 1 -- 172.21.15.90:0/4178633894 >> v1:172.21.15.90:6789/0 conn(0x7fdae40ca7a0 legacy=0x7fdae40b3340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:11.131 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.123+0000 7fdae97c0700 1 -- 172.21.15.90:0/4178633894 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdae40cb3d0 con 0x7fdae415e120 2023-06-09T04:42:11.132 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.127+0000 7fdae97c0700 1 --2- 172.21.15.90:0/4178633894 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdae415e120 0x7fdae40c8b40 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fdad4009850 tx=0x7fdad4009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cd3ea3fd620982cc server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:11.132 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.127+0000 7fdae8fbf700 1 -- 172.21.15.90:0/4178633894 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdad4011830 con 0x7fdae415e120 2023-06-09T04:42:11.132 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.127+0000 7fdae8fbf700 1 -- 172.21.15.90:0/4178633894 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdad4011990 con 0x7fdae415e120 2023-06-09T04:42:11.132 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.127+0000 7fdae8fbf700 1 -- 172.21.15.90:0/4178633894 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdad4011d40 con 0x7fdae415e120 2023-06-09T04:42:11.133 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.127+0000 7fdaec225700 1 -- 172.21.15.90:0/4178633894 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdae415e120 msgr2=0x7fdae40c8b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:11.133 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.127+0000 7fdaec225700 1 --2- 172.21.15.90:0/4178633894 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdae415e120 0x7fdae40c8b40 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fdad4009850 tx=0x7fdad4009b60 comp rx=0 tx=0).stop 2023-06-09T04:42:11.133 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.127+0000 7fdaec225700 1 -- 172.21.15.90:0/4178633894 shutdown_connections 2023-06-09T04:42:11.133 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.127+0000 7fdaec225700 1 --2- 172.21.15.90:0/4178633894 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdae415e120 0x7fdae40c8b40 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:11.133 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.127+0000 7fdaec225700 1 -- 172.21.15.90:0/4178633894 >> 172.21.15.90:0/4178633894 conn(0x7fdae406c810 msgr2=0x7fdae40b0000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:11.134 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.127+0000 7fdaec225700 1 -- 172.21.15.90:0/4178633894 shutdown_connections 2023-06-09T04:42:11.134 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.127+0000 7fdaec225700 1 -- 172.21.15.90:0/4178633894 wait complete. 2023-06-09T04:42:11.135 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.131+0000 7fdaec225700 1 Processor -- start 2023-06-09T04:42:11.136 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.131+0000 7fdaec225700 1 -- start start 2023-06-09T04:42:11.137 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.131+0000 7fdaec225700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdae40ca7a0 0x7fdae40aee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:11.137 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.131+0000 7fdaec225700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdae4154370 0x7fdae4152c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:11.137 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.131+0000 7fdaec225700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdae415e120 0x7fdae4155460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:11.137 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.131+0000 7fdaec225700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdae41531a0 con 0x7fdae415e120 2023-06-09T04:42:11.138 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.131+0000 7fdaec225700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdae41559a0 con 0x7fdae40ca7a0 2023-06-09T04:42:11.138 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.131+0000 7fdaec225700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdae4156780 con 0x7fdae4154370 2023-06-09T04:42:11.139 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.131+0000 7fdaea7c2700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdae415e120 0x7fdae4155460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:11.139 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.131+0000 7fdaea7c2700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdae415e120 0x7fdae4155460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:46048/0 (socket says 172.21.15.90:46048) 2023-06-09T04:42:11.139 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.131+0000 7fdaea7c2700 1 -- 172.21.15.90:0/1168532529 learned_addr learned my addr 172.21.15.90:0/1168532529 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:11.139 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.131+0000 7fdae9fc1700 1 --2- 172.21.15.90:0/1168532529 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdae40ca7a0 0x7fdae40aee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:11.139 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.131+0000 7fdae97c0700 1 --2- 172.21.15.90:0/1168532529 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdae4154370 0x7fdae4152c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:11.140 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.131+0000 7fdaea7c2700 1 -- 172.21.15.90:0/1168532529 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdae4154370 msgr2=0x7fdae4152c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:11.140 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.131+0000 7fdaea7c2700 1 --2- 172.21.15.90:0/1168532529 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdae4154370 0x7fdae4152c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:11.140 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.131+0000 7fdaea7c2700 1 -- 172.21.15.90:0/1168532529 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdae40ca7a0 msgr2=0x7fdae40aee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:11.140 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.131+0000 7fdaea7c2700 1 --2- 172.21.15.90:0/1168532529 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdae40ca7a0 0x7fdae40aee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:11.140 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.131+0000 7fdaea7c2700 1 -- 172.21.15.90:0/1168532529 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdad40094b0 con 0x7fdae415e120 2023-06-09T04:42:11.140 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.135+0000 7fdaea7c2700 1 --2- 172.21.15.90:0/1168532529 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdae415e120 0x7fdae4155460 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fdadc00cb40 tx=0x7fdadc00cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:11.141 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.135+0000 7fdada7fc700 1 -- 172.21.15.90:0/1168532529 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdadc007500 con 0x7fdae415e120 2023-06-09T04:42:11.141 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.135+0000 7fdada7fc700 1 -- 172.21.15.90:0/1168532529 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdadc007660 con 0x7fdae415e120 2023-06-09T04:42:11.141 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.135+0000 7fdaec225700 1 -- 172.21.15.90:0/1168532529 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdae41548c0 con 0x7fdae415e120 2023-06-09T04:42:11.142 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.135+0000 7fdada7fc700 1 -- 172.21.15.90:0/1168532529 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdadc0079f0 con 0x7fdae415e120 2023-06-09T04:42:11.142 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.135+0000 7fdaec225700 1 -- 172.21.15.90:0/1168532529 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdae4155ee0 con 0x7fdae415e120 2023-06-09T04:42:11.142 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.135+0000 7fdaec225700 1 -- 172.21.15.90:0/1168532529 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdae4157db0 con 0x7fdae415e120 2023-06-09T04:42:11.142 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.139+0000 7fdada7fc700 1 -- 172.21.15.90:0/1168532529 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fdadc01b3b0 con 0x7fdae415e120 2023-06-09T04:42:11.144 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.139+0000 7fdada7fc700 1 --2- 172.21.15.90:0/1168532529 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fdac80662f0 0x7fdac80687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:11.144 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.139+0000 7fdada7fc700 1 -- 172.21.15.90:0/1168532529 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fdadc083730 con 0x7fdae415e120 2023-06-09T04:42:11.145 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.139+0000 7fdae9fc1700 1 --2- 172.21.15.90:0/1168532529 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fdac80662f0 0x7fdac80687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:11.146 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.139+0000 7fdae9fc1700 1 --2- 172.21.15.90:0/1168532529 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fdac80662f0 0x7fdac80687a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fdae0000f60 tx=0x7fdae0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:11.151 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.147+0000 7fdada7fc700 1 -- 172.21.15.90:0/1168532529 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fdadc050be0 con 0x7fdae415e120 2023-06-09T04:42:11.354 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.347+0000 7fdaec225700 1 -- 172.21.15.90:0/1168532529 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdae404db30 con 0x7fdae415e120 2023-06-09T04:42:11.355 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.351+0000 7fdada7fc700 1 -- 172.21.15.90:0/1168532529 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4668 (secure 0 0 0) 0x7fdadc054200 con 0x7fdae415e120 2023-06-09T04:42:11.355 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:42:11.355 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6836/271257743","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":271257743},{"type":"v1","addr":"172.21.15.174:6836","nonce":271257743}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4269,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6833/2861565528","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":2861565528},{"type":"v1","addr":"172.21.15.90:6833","nonce":2861565528}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/1212048840","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1212048840},{"type":"v1","addr":"172.21.15.90:6835","nonce":1212048840}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-09T04:41:54.383738+0000","modified":"2023-06-09T04:41:57.405504+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4306},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4306":{"gid":4306,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.174:6837/2976585572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6835","nonce":2976585572},{"type":"v1","addr":"172.21.15.174:6837","nonce":2976585572}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-06-09T04:42:11.358 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.351+0000 7fdaec225700 1 -- 172.21.15.90:0/1168532529 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fdac80662f0 msgr2=0x7fdac80687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:11.358 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.351+0000 7fdaec225700 1 --2- 172.21.15.90:0/1168532529 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fdac80662f0 0x7fdac80687a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fdae0000f60 tx=0x7fdae0009040 comp rx=0 tx=0).stop 2023-06-09T04:42:11.358 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.351+0000 7fdaec225700 1 -- 172.21.15.90:0/1168532529 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdae415e120 msgr2=0x7fdae4155460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:11.358 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.351+0000 7fdaec225700 1 --2- 172.21.15.90:0/1168532529 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdae415e120 0x7fdae4155460 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fdadc00cb40 tx=0x7fdadc00cb70 comp rx=0 tx=0).stop 2023-06-09T04:42:11.358 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.351+0000 7fdaec225700 1 -- 172.21.15.90:0/1168532529 shutdown_connections 2023-06-09T04:42:11.358 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.351+0000 7fdaec225700 1 --2- 172.21.15.90:0/1168532529 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fdac80662f0 0x7fdac80687a0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:11.359 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.351+0000 7fdaec225700 1 --2- 172.21.15.90:0/1168532529 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdae415e120 0x7fdae4155460 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:11.359 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.351+0000 7fdaec225700 1 --2- 172.21.15.90:0/1168532529 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdae4154370 0x7fdae4152c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:11.359 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.351+0000 7fdaec225700 1 --2- 172.21.15.90:0/1168532529 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdae40ca7a0 0x7fdae40aee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:11.359 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.351+0000 7fdaec225700 1 -- 172.21.15.90:0/1168532529 >> 172.21.15.90:0/1168532529 conn(0x7fdae406c810 msgr2=0x7fdae40700e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:11.359 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.351+0000 7fdaec225700 1 -- 172.21.15.90:0/1168532529 shutdown_connections 2023-06-09T04:42:11.360 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.351+0000 7fdaec225700 1 -- 172.21.15.90:0/1168532529 wait complete. 2023-06-09T04:42:11.360 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 8 2023-06-09T04:42:11.778 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-06-09T04:41:54.383738+0000', 'modified': '2023-06-09T04:41:57.405504+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4306}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4306': {'gid': 4306, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.174:6837/2976585572', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.174:6835', 'nonce': 2976585572}, {'type': 'v1', 'addr': '172.21.15.174:6837', 'nonce': 2976585572}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-06-09T04:42:11.779 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-06-09T04:42:11.779 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-06-09T04:42:11.957 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.951+0000 7ff0ef7d2700 1 Processor -- start 2023-06-09T04:42:11.957 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.951+0000 7ff0ef7d2700 1 -- start start 2023-06-09T04:42:11.960 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.955+0000 7ff0ef7d2700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7ff0e806fd10 0x7ff0e80afe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:11.961 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.955+0000 7ff0ef7d2700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0e80b1670 con 0x7ff0e815bf40 2023-06-09T04:42:11.961 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.955+0000 7ff0ef7d2700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0e80b0f90 con 0x7ff0e80b11f0 2023-06-09T04:42:11.961 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.955+0000 7ff0ef7d2700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0e80b0410 con 0x7ff0e806fd10 2023-06-09T04:42:11.961 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.955+0000 7ff0ed56e700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7ff0e815bf40 0x7ff0e806f600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:55642/0 (socket says 172.21.15.90:55642) 2023-06-09T04:42:11.961 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.955+0000 7ff0ed56e700 1 -- 172.21.15.90:0/1248394245 learned_addr learned my addr 172.21.15.90:0/1248394245 (peer_addr_for_me v1:172.21.15.90:0/0) 2023-06-09T04:42:11.963 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.955+0000 7ff0ecd6d700 1 --2- 172.21.15.90:0/1248394245 >> v2:172.21.15.90:3300/0 conn(0x7ff0e806fd10 0x7ff0e80afe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:11.963 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.955+0000 7ff0dffff700 1 -- 172.21.15.90:0/1248394245 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2478900489 0 0) 0x7ff0e80b1670 con 0x7ff0e815bf40 2023-06-09T04:42:11.963 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.955+0000 7ff0dffff700 1 -- 172.21.15.90:0/1248394245 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff0d40035d0 con 0x7ff0e815bf40 2023-06-09T04:42:11.963 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.955+0000 7ff0dffff700 1 -- 172.21.15.90:0/1248394245 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 698182918 0 0) 0x7ff0d40035d0 con 0x7ff0e815bf40 2023-06-09T04:42:11.963 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.955+0000 7ff0dffff700 1 -- 172.21.15.90:0/1248394245 >> v2:172.21.15.90:3300/0 conn(0x7ff0e806fd10 msgr2=0x7ff0e80afe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:11.963 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.955+0000 7ff0dffff700 1 --2- 172.21.15.90:0/1248394245 >> v2:172.21.15.90:3300/0 conn(0x7ff0e806fd10 0x7ff0e80afe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:11.964 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.955+0000 7ff0dffff700 1 -- 172.21.15.90:0/1248394245 >> v1:172.21.15.174:6789/0 conn(0x7ff0e80b11f0 legacy=0x7ff0e80caf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:11.964 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.955+0000 7ff0dffff700 1 -- 172.21.15.90:0/1248394245 --> v1:172.21.15.90:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0e80b06f0 con 0x7ff0e815bf40 2023-06-09T04:42:11.964 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.955+0000 7ff0dffff700 1 -- 172.21.15.90:0/1248394245 <== mon.0 v1:172.21.15.90:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3604404106 0 0) 0x7ff0e4001670 con 0x7ff0e815bf40 2023-06-09T04:42:11.964 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.955+0000 7ff0dffff700 1 -- 172.21.15.90:0/1248394245 >> v1:172.21.15.90:6789/0 conn(0x7ff0e815bf40 legacy=0x7ff0e806f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:11.964 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.955+0000 7ff0dffff700 1 --2- 172.21.15.90:0/1248394245 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff0d4003a20 0x7ff0d4003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:11.964 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.955+0000 7ff0dffff700 1 --2- 172.21.15.90:0/1248394245 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff0d4004870 0x7ff0d4004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:11.964 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.955+0000 7ff0dffff700 1 --2- 172.21.15.90:0/1248394245 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff0d4005220 0x7ff0d400ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:11.964 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.955+0000 7ff0dffff700 1 -- 172.21.15.90:0/1248394245 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e80b0410 con 0x7ff0d4005220 2023-06-09T04:42:11.965 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.955+0000 7ff0dffff700 1 -- 172.21.15.90:0/1248394245 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d400c0a0 con 0x7ff0d4004870 2023-06-09T04:42:11.965 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.955+0000 7ff0dffff700 1 -- 172.21.15.90:0/1248394245 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d400c260 con 0x7ff0d4003a20 2023-06-09T04:42:11.965 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.959+0000 7ff0edd6f700 1 --2- 172.21.15.90:0/1248394245 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff0d4005220 0x7ff0d400ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:11.967 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.959+0000 7ff0ecd6d700 1 --2- 172.21.15.90:0/1248394245 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff0d4004870 0x7ff0d4004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:11.967 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.959+0000 7ff0ed56e700 1 --2- 172.21.15.90:0/1248394245 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff0d4003a20 0x7ff0d4003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:11.967 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.959+0000 7ff0edd6f700 1 -- 172.21.15.90:0/1248394245 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff0d4003a20 msgr2=0x7ff0d4003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:11.967 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.959+0000 7ff0edd6f700 1 --2- 172.21.15.90:0/1248394245 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff0d4003a20 0x7ff0d4003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:11.967 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.959+0000 7ff0edd6f700 1 -- 172.21.15.90:0/1248394245 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff0d4004870 msgr2=0x7ff0d4004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:11.967 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.959+0000 7ff0edd6f700 1 --2- 172.21.15.90:0/1248394245 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff0d4004870 0x7ff0d4004ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:11.967 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.959+0000 7ff0edd6f700 1 -- 172.21.15.90:0/1248394245 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0d40035d0 con 0x7ff0d4005220 2023-06-09T04:42:11.968 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.959+0000 7ff0ecd6d700 1 --2- 172.21.15.90:0/1248394245 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff0d4004870 0x7ff0d4004ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:42:11.968 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.959+0000 7ff0edd6f700 1 -- 172.21.15.90:0/1248394245 reap_dead start 2023-06-09T04:42:11.968 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.959+0000 7ff0edd6f700 1 --2- 172.21.15.90:0/1248394245 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff0d4005220 0x7ff0d400ba30 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7ff0e000c190 tx=0x7ff0d40058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fe38e24c984ba1e server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:11.968 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.959+0000 7ff0dffff700 1 -- 172.21.15.90:0/1248394245 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0e0001db0 con 0x7ff0d4005220 2023-06-09T04:42:11.968 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.959+0000 7ff0dffff700 1 -- 172.21.15.90:0/1248394245 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0e000ccf0 con 0x7ff0d4005220 2023-06-09T04:42:11.968 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.959+0000 7ff0dffff700 1 -- 172.21.15.90:0/1248394245 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0e0003c60 con 0x7ff0d4005220 2023-06-09T04:42:11.968 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.959+0000 7ff0ef7d2700 1 -- 172.21.15.90:0/1248394245 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff0d4005220 msgr2=0x7ff0d400ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:11.969 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.959+0000 7ff0ef7d2700 1 --2- 172.21.15.90:0/1248394245 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff0d4005220 0x7ff0d400ba30 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7ff0e000c190 tx=0x7ff0d40058a0 comp rx=0 tx=0).stop 2023-06-09T04:42:11.969 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.959+0000 7ff0ef7d2700 1 -- 172.21.15.90:0/1248394245 shutdown_connections 2023-06-09T04:42:11.969 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.959+0000 7ff0ef7d2700 1 --2- 172.21.15.90:0/1248394245 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff0d4005220 0x7ff0d400ba30 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:11.969 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.959+0000 7ff0ef7d2700 1 -- 172.21.15.90:0/1248394245 >> 172.21.15.90:0/1248394245 conn(0x7ff0e80cdd70 msgr2=0x7ff0e80d0660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:11.969 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.959+0000 7ff0ef7d2700 1 -- 172.21.15.90:0/1248394245 shutdown_connections 2023-06-09T04:42:11.970 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.963+0000 7ff0ef7d2700 1 -- 172.21.15.90:0/1248394245 wait complete. 2023-06-09T04:42:11.970 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.963+0000 7ff0ef7d2700 1 Processor -- start 2023-06-09T04:42:11.971 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.963+0000 7ff0ef7d2700 1 -- start start 2023-06-09T04:42:11.974 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.967+0000 7ff0ef7d2700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff0d4005220 0x7ff0e8155260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:11.974 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.967+0000 7ff0ef7d2700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff0e81557a0 0x7ff0e81f4db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:11.975 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.967+0000 7ff0ef7d2700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff0e81f52f0 0x7ff0e80b3f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:11.975 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.967+0000 7ff0ef7d2700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e81f5790 con 0x7ff0e81557a0 2023-06-09T04:42:11.975 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.967+0000 7ff0ef7d2700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e81f2a90 con 0x7ff0d4005220 2023-06-09T04:42:11.975 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.967+0000 7ff0ef7d2700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e80b5290 con 0x7ff0e81f52f0 2023-06-09T04:42:11.976 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.967+0000 7ff0ecd6d700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff0e81557a0 0x7ff0e81f4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:11.976 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.967+0000 7ff0ecd6d700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff0e81557a0 0x7ff0e81f4db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:46076/0 (socket says 172.21.15.90:46076) 2023-06-09T04:42:11.976 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.967+0000 7ff0ecd6d700 1 -- 172.21.15.90:0/2070270720 learned_addr learned my addr 172.21.15.90:0/2070270720 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:11.976 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.967+0000 7ff0ed56e700 1 --2- 172.21.15.90:0/2070270720 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff0d4005220 0x7ff0e8155260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:11.977 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.967+0000 7ff0edd6f700 1 --2- 172.21.15.90:0/2070270720 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff0e81f52f0 0x7ff0e80b3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:11.977 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.967+0000 7ff0ecd6d700 1 -- 172.21.15.90:0/2070270720 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff0e81f52f0 msgr2=0x7ff0e80b3f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:11.977 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.967+0000 7ff0ecd6d700 1 --2- 172.21.15.90:0/2070270720 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff0e81f52f0 0x7ff0e80b3f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:11.977 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.967+0000 7ff0ecd6d700 1 -- 172.21.15.90:0/2070270720 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff0d4005220 msgr2=0x7ff0e8155260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:11.977 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.967+0000 7ff0ecd6d700 1 --2- 172.21.15.90:0/2070270720 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff0d4005220 0x7ff0e8155260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:11.978 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.967+0000 7ff0ecd6d700 1 -- 172.21.15.90:0/2070270720 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0e80b4cd0 con 0x7ff0e81557a0 2023-06-09T04:42:11.978 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.967+0000 7ff0edd6f700 1 --2- 172.21.15.90:0/2070270720 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff0e81f52f0 0x7ff0e80b3f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:42:11.978 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.967+0000 7ff0ecd6d700 1 --2- 172.21.15.90:0/2070270720 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff0e81557a0 0x7ff0e81f4db0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ff0d8011cd0 tx=0x7ff0d8009e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:11.979 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.967+0000 7ff0ddffb700 1 -- 172.21.15.90:0/2070270720 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d800fa00 con 0x7ff0e81557a0 2023-06-09T04:42:11.979 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.967+0000 7ff0ddffb700 1 -- 172.21.15.90:0/2070270720 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0d800fb60 con 0x7ff0e81557a0 2023-06-09T04:42:11.979 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.967+0000 7ff0ef7d2700 1 -- 172.21.15.90:0/2070270720 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0e80b4fb0 con 0x7ff0e81557a0 2023-06-09T04:42:11.979 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.967+0000 7ff0ddffb700 1 -- 172.21.15.90:0/2070270720 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d8004020 con 0x7ff0e81557a0 2023-06-09T04:42:11.980 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.967+0000 7ff0ef7d2700 1 -- 172.21.15.90:0/2070270720 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0e80b4470 con 0x7ff0e81557a0 2023-06-09T04:42:11.980 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.971+0000 7ff0ddffb700 1 -- 172.21.15.90:0/2070270720 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff0d8004180 con 0x7ff0e81557a0 2023-06-09T04:42:11.981 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.971+0000 7ff0ddffb700 1 --2- 172.21.15.90:0/2070270720 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7ff0cc0662f0 0x7ff0cc0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:11.981 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.975+0000 7ff0ddffb700 1 -- 172.21.15.90:0/2070270720 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff0d8084280 con 0x7ff0e81557a0 2023-06-09T04:42:11.981 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.975+0000 7ff0ed56e700 1 --2- 172.21.15.90:0/2070270720 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7ff0cc0662f0 0x7ff0cc0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:11.981 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.975+0000 7ff0f2a52740 1 Processor -- start 2023-06-09T04:42:11.981 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.975+0000 7ff0f2a52740 1 -- start start 2023-06-09T04:42:11.981 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.975+0000 7ff0ed56e700 1 --2- 172.21.15.90:0/2070270720 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7ff0cc0662f0 0x7ff0cc0687a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ff0e4001c90 tx=0x7ff0e4000ed0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:11.983 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.975+0000 7ff0f2a52740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x9ebeb0 0xca44d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:11.983 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.975+0000 7ff0f2a52740 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x9ebae0 0xc5aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:11.983 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.975+0000 7ff0f2a52740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x9eb710 0xc5b420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:11.983 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.975+0000 7ff0f2a52740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0xbeaee0 con 0x9eb710 2023-06-09T04:42:11.983 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.975+0000 7ff0f2a52740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0xb78690 con 0x9ebeb0 2023-06-09T04:42:11.983 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.975+0000 7ff0f2a52740 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0xbcb340 con 0x9ebae0 2023-06-09T04:42:11.984 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.975+0000 7ff0edd6f700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x9eb710 0xc5b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:11.984 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.975+0000 7ff0edd6f700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x9eb710 0xc5b420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:46088/0 (socket says 172.21.15.90:46088) 2023-06-09T04:42:11.984 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.975+0000 7ff0edd6f700 1 -- 172.21.15.90:0/3433071284 learned_addr learned my addr 172.21.15.90:0/3433071284 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:11.984 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.975+0000 7ff0ed56e700 1 --2- 172.21.15.90:0/3433071284 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x9ebeb0 0xca44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:11.984 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.975+0000 7ff0ecd6d700 1 --2- 172.21.15.90:0/3433071284 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x9ebae0 0xc5aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:11.984 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.975+0000 7ff0edd6f700 1 -- 172.21.15.90:0/3433071284 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x9ebae0 msgr2=0xc5aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:11.984 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.975+0000 7ff0edd6f700 1 --2- 172.21.15.90:0/3433071284 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x9ebae0 0xc5aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:11.985 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.975+0000 7ff0edd6f700 1 -- 172.21.15.90:0/3433071284 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x9ebeb0 msgr2=0xca44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:11.985 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.975+0000 7ff0edd6f700 1 --2- 172.21.15.90:0/3433071284 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x9ebeb0 0xca44d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:11.985 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.975+0000 7ff0edd6f700 1 -- 172.21.15.90:0/3433071284 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0xb769a0 con 0x9eb710 2023-06-09T04:42:11.985 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.975+0000 7ff0ed56e700 1 --2- 172.21.15.90:0/3433071284 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x9ebeb0 0xca44d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:42:11.985 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.975+0000 7ff0edd6f700 1 --2- 172.21.15.90:0/3433071284 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x9eb710 0xc5b420 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ff0e000c780 tx=0x7ff0e0011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b833c147bae080f3 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:11.985 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.975+0000 7ff0d2ffd700 1 -- 172.21.15.90:0/3433071284 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0e0001cd0 con 0x9eb710 2023-06-09T04:42:11.985 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.979+0000 7ff0d2ffd700 1 -- 172.21.15.90:0/3433071284 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0e0003a20 con 0x9eb710 2023-06-09T04:42:11.985 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.979+0000 7ff0d2ffd700 1 -- 172.21.15.90:0/3433071284 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0e0003d90 con 0x9eb710 2023-06-09T04:42:11.987 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.979+0000 7ff0f2a52740 1 -- 172.21.15.90:0/3433071284 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x9eb710 msgr2=0xc5b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:11.987 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.979+0000 7ff0f2a52740 1 --2- 172.21.15.90:0/3433071284 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x9eb710 0xc5b420 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ff0e000c780 tx=0x7ff0e0011000 comp rx=0 tx=0).stop 2023-06-09T04:42:11.987 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.979+0000 7ff0f2a52740 1 -- 172.21.15.90:0/3433071284 shutdown_connections 2023-06-09T04:42:11.987 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.979+0000 7ff0f2a52740 1 --2- 172.21.15.90:0/3433071284 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x9eb710 0xc5b420 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:11.988 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.979+0000 7ff0f2a52740 1 --2- 172.21.15.90:0/3433071284 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x9ebae0 0xc5aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:11.988 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.979+0000 7ff0f2a52740 1 --2- 172.21.15.90:0/3433071284 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x9ebeb0 0xca44d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:11.988 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.979+0000 7ff0f2a52740 1 -- 172.21.15.90:0/3433071284 >> 172.21.15.90:0/3433071284 conn(0xc55d10 msgr2=0xc87f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:11.988 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.979+0000 7ff0f2a52740 1 -- 172.21.15.90:0/3433071284 shutdown_connections 2023-06-09T04:42:11.988 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.979+0000 7ff0f2a52740 1 -- 172.21.15.90:0/3433071284 wait complete. 2023-06-09T04:42:11.988 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.979+0000 7ff0f2a52740 1 -- start start 2023-06-09T04:42:11.988 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.979+0000 7ff0f2a52740 1 Processor -- start 2023-06-09T04:42:11.989 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.979+0000 7ff0f2a52740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x9eb710 0xc85330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:11.989 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.979+0000 7ff0f2a52740 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x9ebae0 0xca09b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:11.989 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.979+0000 7ff0f2a52740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x9ebeb0 0xc5f520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:11.989 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.979+0000 7ff0f2a52740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0xbc45a0 con 0x9ebeb0 2023-06-09T04:42:11.989 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.979+0000 7ff0f2a52740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0xb86f20 con 0x9eb710 2023-06-09T04:42:11.989 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.979+0000 7ff0f2a52740 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0xb85890 con 0x9ebae0 2023-06-09T04:42:11.989 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.979+0000 7ff0f2a52740 10 client.0 _ll_register_callbacks cb 0xc177d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-06-09T04:42:11.989 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.979+0000 7ff0edd6f700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x9ebeb0 0xc5f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:11.990 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.983+0000 7ff0edd6f700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x9ebeb0 0xc5f520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:46100/0 (socket says 172.21.15.90:46100) 2023-06-09T04:42:11.990 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.983+0000 7ff0edd6f700 1 -- 172.21.15.90:0/1284351038 learned_addr learned my addr 172.21.15.90:0/1284351038 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:11.990 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.983+0000 7ff0ed56e700 1 --2- 172.21.15.90:0/1284351038 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x9eb710 0xc85330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:11.990 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.983+0000 7ff0ecd6d700 1 --2- 172.21.15.90:0/1284351038 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x9ebae0 0xca09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:11.992 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.983+0000 7ff0edd6f700 1 -- 172.21.15.90:0/1284351038 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x9ebae0 msgr2=0xca09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:11.992 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.983+0000 7ff0edd6f700 1 --2- 172.21.15.90:0/1284351038 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x9ebae0 0xca09b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:11.992 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.983+0000 7ff0edd6f700 1 -- 172.21.15.90:0/1284351038 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x9eb710 msgr2=0xc85330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:11.992 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.983+0000 7ff0edd6f700 1 --2- 172.21.15.90:0/1284351038 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x9eb710 0xc85330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:11.993 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.983+0000 7ff0edd6f700 1 -- 172.21.15.90:0/1284351038 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0d40035d0 con 0x9ebeb0 2023-06-09T04:42:11.993 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.983+0000 7ff0edd6f700 1 --2- 172.21.15.90:0/1284351038 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x9ebeb0 0xc5f520 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ff0e000c8a0 tx=0x7ff0e0001510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb26eae88377adde server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:11.993 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.983+0000 7ff0c7fff700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2023-06-09T04:42:11.993 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.983+0000 7ff0c7fff700 1 -- 172.21.15.90:0/1284351038 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0e0005020 con 0x9ebeb0 2023-06-09T04:42:11.993 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.983+0000 7ff0c7fff700 1 -- 172.21.15.90:0/1284351038 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff0e0031c50 con 0x9ebeb0 2023-06-09T04:42:11.993 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.983+0000 7ff0f2a52740 1 -- 172.21.15.90:0/1284351038 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0xbbd580 con 0x9ebeb0 2023-06-09T04:42:11.993 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.983+0000 7ff0c7fff700 1 -- 172.21.15.90:0/1284351038 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff0e0031e10 con 0x9ebeb0 2023-06-09T04:42:11.993 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.983+0000 7ff0f2a52740 10 client.4650 fetch_fsmap learned FSMap version 8 2023-06-09T04:42:11.994 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.983+0000 7ff0f2a52740 1 -- 172.21.15.90:0/1284351038 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0xa379e0 con 0x9ebeb0 2023-06-09T04:42:11.994 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.983+0000 7ff0c7fff700 1 -- 172.21.15.90:0/1284351038 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0xbbd580 con 0x9ebeb0 2023-06-09T04:42:11.994 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.983+0000 7ff0c7fff700 1 -- 172.21.15.90:0/1284351038 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 8) v1 ==== 3114+0+0 (secure 0 0 0) 0x7ff0e0005180 con 0x9ebeb0 2023-06-09T04:42:11.994 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.983+0000 7ff0f2a52740 10 client.4650 fetch_fsmap finished waiting for FSMap version 8 2023-06-09T04:42:11.994 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.983+0000 7ff0f2a52740 10 client.4650 resolve_mds: resolved name 'b' to daemon mds.b 2023-06-09T04:42:11.994 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.983+0000 7ff0f2a52740 20 client.4650 populate_metadata read hostname 'smithi090' 2023-06-09T04:42:11.994 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.983+0000 7ff0f2a52740 1 --2- 172.21.15.90:0/1284351038 >> [v2:172.21.15.174:6835/2976585572,v1:172.21.15.174:6837/2976585572] conn(0xa36790 0xc885b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:11.994 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.983+0000 7ff0f2a52740 4 client.4650 mds_command: new command op to 4306 tid=0[{"prefix": "get_command_descriptions"}] 2023-06-09T04:42:11.995 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.983+0000 7ff0f2a52740 1 -- 172.21.15.90:0/1284351038 --> [v2:172.21.15.174:6835/2976585572,v1:172.21.15.174:6837/2976585572] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0xbbd2a0 con 0xa36790 2023-06-09T04:42:11.995 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.983+0000 7ff0ed56e700 1 --2- 172.21.15.90:0/1284351038 >> [v2:172.21.15.174:6835/2976585572,v1:172.21.15.174:6837/2976585572] conn(0xa36790 0xc885b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:11.995 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.987+0000 7ff0ed56e700 1 --2- 172.21.15.90:0/1284351038 >> [v2:172.21.15.174:6835/2976585572,v1:172.21.15.174:6837/2976585572] conn(0xa36790 0xc885b0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=269bcaec61e0171e server_cookie=5d202db7e2b3c54f in_seq=0 out_seq=0 2023-06-09T04:42:11.995 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.987+0000 7ff0c7fff700 10 client.4650 ms_handle_connect on v2:172.21.15.174:6835/2976585572 2023-06-09T04:42:11.996 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.987+0000 7ff0c7fff700 1 -- 172.21.15.90:0/1284351038 <== mds.0 v2:172.21.15.174:6835/2976585572 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0xbbd2a0 con 0xa36790 2023-06-09T04:42:11.996 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.987+0000 7ff0c7fff700 10 client.4650 handle_command_reply: tid=0 2023-06-09T04:42:11.996 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.987+0000 7ff0f2a52740 1 client.4650 shutdown 2023-06-09T04:42:11.996 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.987+0000 7ff0f2a52740 1 -- 172.21.15.90:0/1284351038 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x9ebeb0 msgr2=0xc5f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:11.997 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.987+0000 7ff0f2a52740 1 --2- 172.21.15.90:0/1284351038 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x9ebeb0 0xc5f520 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ff0e000c8a0 tx=0x7ff0e0001510 comp rx=0 tx=0).stop 2023-06-09T04:42:11.997 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.987+0000 7ff0f2a52740 1 -- 172.21.15.90:0/1284351038 shutdown_connections 2023-06-09T04:42:11.997 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.987+0000 7ff0f2a52740 1 --2- 172.21.15.90:0/1284351038 >> [v2:172.21.15.174:6835/2976585572,v1:172.21.15.174:6837/2976585572] conn(0xa36790 0xc885b0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:11.997 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.987+0000 7ff0f2a52740 1 --2- 172.21.15.90:0/1284351038 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x9ebeb0 0xc5f520 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:11.997 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.987+0000 7ff0f2a52740 1 --2- 172.21.15.90:0/1284351038 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x9ebae0 0xca09b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:11.997 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.987+0000 7ff0c7fff700 0 client.4650 ms_handle_reset on v2:172.21.15.174:6835/2976585572 2023-06-09T04:42:11.997 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.987+0000 7ff0f2a52740 1 --2- 172.21.15.90:0/1284351038 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x9eb710 0xc85330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:11.998 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.987+0000 7ff0f2a52740 1 -- 172.21.15.90:0/1284351038 >> 172.21.15.90:0/1284351038 conn(0xc55d10 msgr2=0xc5a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:11.998 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.987+0000 7ff0f2a52740 1 -- 172.21.15.90:0/1284351038 shutdown_connections 2023-06-09T04:42:11.998 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.987+0000 7ff0f2a52740 1 -- 172.21.15.90:0/1284351038 wait complete. 2023-06-09T04:42:11.998 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:11.987+0000 7ff0f2a52740 20 client.4650 trim_cache size 0 max 16384 2023-06-09T04:42:12.016 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.011+0000 7ff0f2a52740 1 Processor -- start 2023-06-09T04:42:12.017 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.011+0000 7ff0f2a52740 1 -- start start 2023-06-09T04:42:12.018 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.011+0000 7ff0f2a52740 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x9eb710 0xc5da20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:12.019 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.011+0000 7ff0f2a52740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x9ebae0 0xc5df60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:12.019 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.011+0000 7ff0f2a52740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x9ebeb0 0xcfe770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:12.019 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.011+0000 7ff0f2a52740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0xa70b20 con 0x9ebeb0 2023-06-09T04:42:12.019 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.011+0000 7ff0f2a52740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0xbbea80 con 0x9ebae0 2023-06-09T04:42:12.019 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.011+0000 7ff0f2a52740 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0xbc19a0 con 0x9eb710 2023-06-09T04:42:12.020 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.015+0000 7ff0edd6f700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x9ebeb0 0xcfe770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:12.021 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.015+0000 7ff0ed56e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x9eb710 0xc5da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:12.021 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.015+0000 7ff0ecd6d700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x9ebae0 0xc5df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:12.021 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.015+0000 7ff0ed56e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x9eb710 0xc5da20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.90:35506/0 (socket says 172.21.15.90:35506) 2023-06-09T04:42:12.021 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.015+0000 7ff0ecd6d700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x9ebae0 0xc5df60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.90:58208/0 (socket says 172.21.15.90:58208) 2023-06-09T04:42:12.021 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.015+0000 7ff0ed56e700 1 -- 172.21.15.90:0/2842113310 learned_addr learned my addr 172.21.15.90:0/2842113310 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:12.022 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.015+0000 7ff0edd6f700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x9ebeb0 0xcfe770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:46112/0 (socket says 172.21.15.90:46112) 2023-06-09T04:42:12.022 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.015+0000 7ff0edd6f700 1 -- 172.21.15.90:0/2842113310 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x9eb710 msgr2=0xc5da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:12.022 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.015+0000 7ff0edd6f700 1 --2- 172.21.15.90:0/2842113310 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x9eb710 0xc5da20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:12.022 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.015+0000 7ff0edd6f700 1 -- 172.21.15.90:0/2842113310 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x9ebae0 msgr2=0xc5df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:12.022 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.015+0000 7ff0edd6f700 1 --2- 172.21.15.90:0/2842113310 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x9ebae0 0xc5df60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:12.022 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.015+0000 7ff0edd6f700 1 -- 172.21.15.90:0/2842113310 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0e80b4a50 con 0x9ebeb0 2023-06-09T04:42:12.022 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.015+0000 7ff0ecd6d700 1 --2- 172.21.15.90:0/2842113310 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x9ebae0 0xc5df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:42:12.023 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.015+0000 7ff0edd6f700 1 --2- 172.21.15.90:0/2842113310 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x9ebeb0 0xcfe770 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7ff0e0000f80 tx=0x7ff0e0029040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22fa76dcc739d86a server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:12.024 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.015+0000 7ff0d37fe700 1 -- 172.21.15.90:0/2842113310 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0e003f070 con 0x9ebeb0 2023-06-09T04:42:12.024 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.015+0000 7ff0d37fe700 1 -- 172.21.15.90:0/2842113310 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0e00015b0 con 0x9ebeb0 2023-06-09T04:42:12.024 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.015+0000 7ff0d37fe700 1 -- 172.21.15.90:0/2842113310 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0e0005220 con 0x9ebeb0 2023-06-09T04:42:12.024 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.019+0000 7ff0f2a52740 1 -- 172.21.15.90:0/2842113310 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x9ebeb0 msgr2=0xcfe770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:12.024 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.019+0000 7ff0f2a52740 1 --2- 172.21.15.90:0/2842113310 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x9ebeb0 0xcfe770 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7ff0e0000f80 tx=0x7ff0e0029040 comp rx=0 tx=0).stop 2023-06-09T04:42:12.024 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.019+0000 7ff0f2a52740 1 -- 172.21.15.90:0/2842113310 shutdown_connections 2023-06-09T04:42:12.025 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.019+0000 7ff0f2a52740 1 --2- 172.21.15.90:0/2842113310 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x9ebeb0 0xcfe770 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:12.025 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.019+0000 7ff0f2a52740 1 --2- 172.21.15.90:0/2842113310 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x9ebae0 0xc5df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:12.025 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.019+0000 7ff0f2a52740 1 --2- 172.21.15.90:0/2842113310 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x9eb710 0xc5da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:12.025 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.019+0000 7ff0f2a52740 1 -- 172.21.15.90:0/2842113310 >> 172.21.15.90:0/2842113310 conn(0xc55d10 msgr2=0xc841d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:12.025 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.019+0000 7ff0f2a52740 1 -- 172.21.15.90:0/2842113310 shutdown_connections 2023-06-09T04:42:12.025 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.019+0000 7ff0f2a52740 1 -- 172.21.15.90:0/2842113310 wait complete. 2023-06-09T04:42:12.026 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.019+0000 7ff0f2a52740 1 -- start start 2023-06-09T04:42:12.026 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.019+0000 7ff0f2a52740 1 Processor -- start 2023-06-09T04:42:12.026 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.019+0000 7ff0f2a52740 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x9eb710 0xc849c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:12.027 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.019+0000 7ff0f2a52740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x9ebae0 0xcbbee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:12.027 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.019+0000 7ff0f2a52740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x9ebeb0 0xd01ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:12.027 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.019+0000 7ff0f2a52740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0xbc32c0 con 0x9ebeb0 2023-06-09T04:42:12.027 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.019+0000 7ff0f2a52740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0xb7eb40 con 0x9ebae0 2023-06-09T04:42:12.027 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.019+0000 7ff0f2a52740 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0xbc7100 con 0x9eb710 2023-06-09T04:42:12.027 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.019+0000 7ff0f2a52740 10 client.0 _ll_register_callbacks cb 0xbc3170 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-06-09T04:42:12.028 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.023+0000 7ff0edd6f700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x9ebeb0 0xd01ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:12.029 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.023+0000 7ff0ed56e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x9eb710 0xc849c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:12.029 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.023+0000 7ff0ecd6d700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x9ebae0 0xcbbee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:12.029 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.023+0000 7ff0edd6f700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x9ebeb0 0xd01ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:46114/0 (socket says 172.21.15.90:46114) 2023-06-09T04:42:12.029 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.023+0000 7ff0edd6f700 1 -- 172.21.15.90:0/108504585 learned_addr learned my addr 172.21.15.90:0/108504585 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:12.029 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.023+0000 7ff0ecd6d700 1 -- 172.21.15.90:0/108504585 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x9eb710 msgr2=0xc849c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:12.029 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.023+0000 7ff0ecd6d700 1 --2- 172.21.15.90:0/108504585 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x9eb710 0xc849c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:12.029 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.023+0000 7ff0ecd6d700 1 -- 172.21.15.90:0/108504585 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x9ebeb0 msgr2=0xd01ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:12.029 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.023+0000 7ff0ecd6d700 1 --2- 172.21.15.90:0/108504585 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x9ebeb0 0xd01ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:12.030 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.023+0000 7ff0ecd6d700 1 -- 172.21.15.90:0/108504585 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0e80b4470 con 0x9ebae0 2023-06-09T04:42:12.030 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.023+0000 7ff0edd6f700 1 --2- 172.21.15.90:0/108504585 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x9ebeb0 0xd01ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:42:12.030 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.023+0000 7ff0ecd6d700 1 --2- 172.21.15.90:0/108504585 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x9ebae0 0xcbbee0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ff0d80826a0 tx=0x7ff0d80840b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4e9d94875c8f9ce8 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:12.030 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.023+0000 7ff0c7fff700 10 client.0 ms_handle_connect on v2:172.21.15.174:3300/0 2023-06-09T04:42:12.031 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.023+0000 7ff0c7fff700 1 -- 172.21.15.90:0/108504585 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d8059300 con 0x9ebae0 2023-06-09T04:42:12.031 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.023+0000 7ff0f2a52740 1 -- 172.21.15.90:0/108504585 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff0e0003a20 con 0x9ebae0 2023-06-09T04:42:12.032 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.023+0000 7ff0c7fff700 1 -- 172.21.15.90:0/108504585 <== mon.1 v2:172.21.15.174:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff0d805d690 con 0x9ebae0 2023-06-09T04:42:12.032 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.023+0000 7ff0c7fff700 1 -- 172.21.15.90:0/108504585 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff0d8054830 con 0x9ebae0 2023-06-09T04:42:12.032 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.023+0000 7ff0f2a52740 10 client.4714 fetch_fsmap learned FSMap version 8 2023-06-09T04:42:12.032 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.023+0000 7ff0f2a52740 1 -- 172.21.15.90:0/108504585 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0xa379e0 con 0x9ebae0 2023-06-09T04:42:12.032 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.023+0000 7ff0c7fff700 1 -- 172.21.15.90:0/108504585 <== mon.1 v2:172.21.15.174:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0e0003a20 con 0x9ebae0 2023-06-09T04:42:12.032 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.023+0000 7ff0c7fff700 1 -- 172.21.15.90:0/108504585 <== mon.1 v2:172.21.15.174:3300/0 5 ==== fsmap(e 8) v1 ==== 3114+0+0 (secure 0 0 0) 0x7ff0d805d200 con 0x9ebae0 2023-06-09T04:42:12.032 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.023+0000 7ff0f2a52740 10 client.4714 fetch_fsmap finished waiting for FSMap version 8 2023-06-09T04:42:12.033 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.023+0000 7ff0f2a52740 10 client.4714 resolve_mds: resolved name 'b' to daemon mds.b 2023-06-09T04:42:12.033 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.023+0000 7ff0f2a52740 20 client.4714 populate_metadata read hostname 'smithi090' 2023-06-09T04:42:12.033 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.023+0000 7ff0f2a52740 1 --2- 172.21.15.90:0/108504585 >> [v2:172.21.15.174:6835/2976585572,v1:172.21.15.174:6837/2976585572] conn(0xcbad20 0xcb82c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:12.033 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.023+0000 7ff0f2a52740 4 client.4714 mds_command: new command op to 4306 tid=0[{"prefix": "status"}] 2023-06-09T04:42:12.033 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.023+0000 7ff0f2a52740 1 -- 172.21.15.90:0/108504585 --> [v2:172.21.15.174:6835/2976585572,v1:172.21.15.174:6837/2976585572] -- command(tid 0: {"prefix": "status"}) v1 -- 0xa434e0 con 0xcbad20 2023-06-09T04:42:12.033 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.027+0000 7ff0ed56e700 1 --2- 172.21.15.90:0/108504585 >> [v2:172.21.15.174:6835/2976585572,v1:172.21.15.174:6837/2976585572] conn(0xcbad20 0xcb82c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:12.034 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.027+0000 7ff0ed56e700 1 --2- 172.21.15.90:0/108504585 >> [v2:172.21.15.174:6835/2976585572,v1:172.21.15.174:6837/2976585572] conn(0xcbad20 0xcb82c0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c38a56285018429 server_cookie=85537eb443fb1055 in_seq=0 out_seq=0 2023-06-09T04:42:12.035 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.027+0000 7ff0c7fff700 10 client.4714 ms_handle_connect on v2:172.21.15.174:6835/2976585572 2023-06-09T04:42:12.035 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.027+0000 7ff0c7fff700 1 -- 172.21.15.90:0/108504585 <== mds.0 v2:172.21.15.174:6835/2976585572 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0xa434e0 con 0xcbad20 2023-06-09T04:42:12.035 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.027+0000 7ff0c7fff700 10 client.4714 handle_command_reply: tid=0 2023-06-09T04:42:12.035 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.027+0000 7ff0f2a52740 1 client.4714 shutdown 2023-06-09T04:42:12.035 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.027+0000 7ff0f2a52740 1 -- 172.21.15.90:0/108504585 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x9ebae0 msgr2=0xcbbee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:12.035 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.027+0000 7ff0f2a52740 1 --2- 172.21.15.90:0/108504585 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x9ebae0 0xcbbee0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ff0d80826a0 tx=0x7ff0d80840b0 comp rx=0 tx=0).stop 2023-06-09T04:42:12.036 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.027+0000 7ff0f2a52740 1 -- 172.21.15.90:0/108504585 shutdown_connections 2023-06-09T04:42:12.036 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.027+0000 7ff0f2a52740 1 --2- 172.21.15.90:0/108504585 >> [v2:172.21.15.174:6835/2976585572,v1:172.21.15.174:6837/2976585572] conn(0xcbad20 0xcb82c0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:12.036 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.027+0000 7ff0f2a52740 1 --2- 172.21.15.90:0/108504585 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x9ebeb0 0xd01ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:12.036 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.027+0000 7ff0f2a52740 1 --2- 172.21.15.90:0/108504585 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x9ebae0 0xcbbee0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:12.036 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.027+0000 7ff0f2a52740 1 --2- 172.21.15.90:0/108504585 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x9eb710 0xc849c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:12.036 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.027+0000 7ff0c7fff700 0 client.4714 ms_handle_reset on v2:172.21.15.174:6835/2976585572 2023-06-09T04:42:12.036 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.027+0000 7ff0f2a52740 1 -- 172.21.15.90:0/108504585 >> 172.21.15.90:0/108504585 conn(0xc55d10 msgr2=0xcb3ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:12.037 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.027+0000 7ff0f2a52740 1 -- 172.21.15.90:0/108504585 shutdown_connections 2023-06-09T04:42:12.037 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.027+0000 7ff0f2a52740 1 -- 172.21.15.90:0/108504585 wait complete. 2023-06-09T04:42:12.037 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.027+0000 7ff0f2a52740 20 client.4714 trim_cache size 0 max 16384 2023-06-09T04:42:12.037 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2023-06-09T04:42:12.037 INFO:teuthology.orchestra.run.smithi090.stdout: "cluster_fsid": "700369c0-a111-43b4-9415-844ad1742b70", 2023-06-09T04:42:12.038 INFO:teuthology.orchestra.run.smithi090.stdout: "whoami": 0, 2023-06-09T04:42:12.038 INFO:teuthology.orchestra.run.smithi090.stdout: "id": 4306, 2023-06-09T04:42:12.038 INFO:teuthology.orchestra.run.smithi090.stdout: "want_state": "up:active", 2023-06-09T04:42:12.038 INFO:teuthology.orchestra.run.smithi090.stdout: "state": "up:active", 2023-06-09T04:42:12.038 INFO:teuthology.orchestra.run.smithi090.stdout: "fs_name": "cephfs", 2023-06-09T04:42:12.038 INFO:teuthology.orchestra.run.smithi090.stdout: "rank_uptime": 17.640497019000001, 2023-06-09T04:42:12.038 INFO:teuthology.orchestra.run.smithi090.stdout: "mdsmap_epoch": 8, 2023-06-09T04:42:12.038 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap_epoch": 24, 2023-06-09T04:42:12.039 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap_epoch_barrier": 24, 2023-06-09T04:42:12.039 INFO:teuthology.orchestra.run.smithi090.stdout: "uptime": 22.984211910999999 2023-06-09T04:42:12.039 INFO:teuthology.orchestra.run.smithi090.stdout:} 2023-06-09T04:42:12.040 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.031+0000 7ff0ef7d2700 1 -- 172.21.15.90:0/2070270720 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7ff0cc0662f0 msgr2=0x7ff0cc0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:12.040 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.031+0000 7ff0ef7d2700 1 --2- 172.21.15.90:0/2070270720 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7ff0cc0662f0 0x7ff0cc0687a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ff0e4001c90 tx=0x7ff0e4000ed0 comp rx=0 tx=0).stop 2023-06-09T04:42:12.040 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.031+0000 7ff0ef7d2700 1 -- 172.21.15.90:0/2070270720 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff0e81557a0 msgr2=0x7ff0e81f4db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:12.040 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.031+0000 7ff0ef7d2700 1 --2- 172.21.15.90:0/2070270720 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff0e81557a0 0x7ff0e81f4db0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ff0d8011cd0 tx=0x7ff0d8009e80 comp rx=0 tx=0).stop 2023-06-09T04:42:12.041 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.031+0000 7ff0ef7d2700 1 -- 172.21.15.90:0/2070270720 shutdown_connections 2023-06-09T04:42:12.041 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.031+0000 7ff0ef7d2700 1 --2- 172.21.15.90:0/2070270720 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7ff0cc0662f0 0x7ff0cc0687a0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:12.041 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.031+0000 7ff0ef7d2700 1 --2- 172.21.15.90:0/2070270720 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff0e81f52f0 0x7ff0e80b3f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:12.042 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.031+0000 7ff0ef7d2700 1 --2- 172.21.15.90:0/2070270720 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff0e81557a0 0x7ff0e81f4db0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:12.042 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.031+0000 7ff0ef7d2700 1 --2- 172.21.15.90:0/2070270720 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff0d4005220 0x7ff0e8155260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:12.042 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.031+0000 7ff0ef7d2700 1 -- 172.21.15.90:0/2070270720 >> 172.21.15.90:0/2070270720 conn(0x7ff0e80cdd70 msgr2=0x7ff0e80cbd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:12.042 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.031+0000 7ff0ef7d2700 1 -- 172.21.15.90:0/2070270720 shutdown_connections 2023-06-09T04:42:12.043 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.031+0000 7ff0ef7d2700 1 -- 172.21.15.90:0/2070270720 wait complete. 2023-06-09T04:42:12.058 INFO:teuthology.run_tasks:Running task kclient... 2023-06-09T04:42:12.082 INFO:tasks.kclient:Mounting kernel clients... 2023-06-09T04:42:12.083 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-06-09T04:42:12.083 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:42:12.084 DEBUG:teuthology.orchestra.run.smithi090:> ip netns list 2023-06-09T04:42:12.102 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:42:12.102 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip link delete ceph-brx 2023-06-09T04:42:12.185 INFO:teuthology.orchestra.run.smithi090.stderr:Cannot find device "ceph-brx" 2023-06-09T04:42:12.188 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-09T04:42:12.189 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:42:12.189 DEBUG:teuthology.orchestra.run.smithi090:> ip netns list 2023-06-09T04:42:12.248 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:42:12.248 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip link delete ceph-brx 2023-06-09T04:42:12.333 INFO:teuthology.orchestra.run.smithi090.stderr:Cannot find device "ceph-brx" 2023-06-09T04:42:12.337 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-09T04:42:12.337 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:42:12.338 DEBUG:teuthology.orchestra.run.smithi174:> ip netns list 2023-06-09T04:42:12.355 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:42:12.356 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip link delete ceph-brx 2023-06-09T04:42:12.440 INFO:teuthology.orchestra.run.smithi174.stderr:Cannot find device "ceph-brx" 2023-06-09T04:42:12.443 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-09T04:42:12.444 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:42:12.444 DEBUG:teuthology.orchestra.run.smithi174:> ip netns list 2023-06-09T04:42:12.506 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:42:12.506 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip link delete ceph-brx 2023-06-09T04:42:12.593 INFO:teuthology.orchestra.run.smithi174.stderr:Cannot find device "ceph-brx" 2023-06-09T04:42:12.595 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-09T04:42:12.596 INFO:tasks.kclient:client.0 config is {'syntax': 'v2'} 2023-06-09T04:42:12.596 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-06-09T04:42:12.597 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-06-09T04:42:12.597 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-06-09T04:42:12.769 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.763+0000 7f9ac8556700 1 Processor -- start 2023-06-09T04:42:12.769 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.763+0000 7f9ac8556700 1 -- start start 2023-06-09T04:42:12.770 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.763+0000 7f9ac8556700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9ac0158b30 0x7f9ac015d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:12.771 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.763+0000 7f9ac8556700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9ac0070db0 0x7f9ac015c950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:12.771 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.763+0000 7f9ac8556700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ac00cd3a0 con 0x7f9ac0158f00 2023-06-09T04:42:12.771 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.763+0000 7f9ac8556700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ac0069f30 con 0x7f9ac0158b30 2023-06-09T04:42:12.771 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.763+0000 7f9ac8556700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac0071550 con 0x7f9ac0070db0 2023-06-09T04:42:12.772 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.767+0000 7f9ac5af1700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f9ac0158f00 0x7f9ac0069820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:55656/0 (socket says 172.21.15.90:55656) 2023-06-09T04:42:12.773 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.767+0000 7f9ac5af1700 1 -- 172.21.15.90:0/2207652142 learned_addr learned my addr 172.21.15.90:0/2207652142 (peer_addr_for_me v1:172.21.15.90:0/0) 2023-06-09T04:42:12.773 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.767+0000 7f9ac62f2700 1 --2- 172.21.15.90:0/2207652142 >> v2:172.21.15.174:3300/0 conn(0x7f9ac0158b30 0x7f9ac015d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:12.773 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.767+0000 7f9ac6af3700 1 --2- 172.21.15.90:0/2207652142 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9ac0070db0 0x7f9ac015c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:12.773 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.767+0000 7f9ac52f0700 1 -- 172.21.15.90:0/2207652142 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1627971743 0 0) 0x7f9ac00cd3a0 con 0x7f9ac0158f00 2023-06-09T04:42:12.773 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.767+0000 7f9ac52f0700 1 -- 172.21.15.90:0/2207652142 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9aac0035d0 con 0x7f9ac0158f00 2023-06-09T04:42:12.773 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.767+0000 7f9ac52f0700 1 -- 172.21.15.90:0/2207652142 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3780003222 0 0) 0x7f9aac0035d0 con 0x7f9ac0158f00 2023-06-09T04:42:12.773 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.767+0000 7f9ac52f0700 1 -- 172.21.15.90:0/2207652142 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9ac0070db0 msgr2=0x7f9ac015c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:12.774 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.767+0000 7f9ac52f0700 1 --2- 172.21.15.90:0/2207652142 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9ac0070db0 0x7f9ac015c950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:12.774 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.767+0000 7f9ac52f0700 1 -- 172.21.15.90:0/2207652142 >> v2:172.21.15.174:3300/0 conn(0x7f9ac0158b30 msgr2=0x7f9ac015d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:12.774 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.767+0000 7f9ac52f0700 1 --2- 172.21.15.90:0/2207652142 >> v2:172.21.15.174:3300/0 conn(0x7f9ac0158b30 0x7f9ac015d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:12.774 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.767+0000 7f9ac52f0700 1 -- 172.21.15.90:0/2207652142 --> v1:172.21.15.90:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ac0071830 con 0x7f9ac0158f00 2023-06-09T04:42:12.774 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.767+0000 7f9ac52f0700 1 -- 172.21.15.90:0/2207652142 <== mon.0 v1:172.21.15.90:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3604404106 0 0) 0x7f9ab0001670 con 0x7f9ac0158f00 2023-06-09T04:42:12.774 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.767+0000 7f9ac52f0700 1 -- 172.21.15.90:0/2207652142 >> v1:172.21.15.90:6789/0 conn(0x7f9ac0158f00 legacy=0x7f9ac0069820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:12.774 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.767+0000 7f9ac52f0700 1 --2- 172.21.15.90:0/2207652142 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9aac003a20 0x7f9aac003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:12.774 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.767+0000 7f9ac52f0700 1 --2- 172.21.15.90:0/2207652142 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9aac004450 0x7f9aac004910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:12.775 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.767+0000 7f9ac52f0700 1 --2- 172.21.15.90:0/2207652142 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9ac0070db0 0x7f9aac005080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:12.775 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.767+0000 7f9ac52f0700 1 -- 172.21.15.90:0/2207652142 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac0069f30 con 0x7f9aac004450 2023-06-09T04:42:12.775 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.767+0000 7f9ac52f0700 1 -- 172.21.15.90:0/2207652142 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac0071550 con 0x7f9aac003a20 2023-06-09T04:42:12.775 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.767+0000 7f9ac52f0700 1 -- 172.21.15.90:0/2207652142 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9aac00ba30 con 0x7f9ac0070db0 2023-06-09T04:42:12.775 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.767+0000 7f9ac62f2700 1 --2- 172.21.15.90:0/2207652142 >> v2:172.21.15.174:3300/0 conn(0x7f9ac0158b30 0x7f9ac015d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:42:12.777 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.767+0000 7f9ac5af1700 1 --2- 172.21.15.90:0/2207652142 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9aac004450 0x7f9aac004910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:12.777 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.767+0000 7f9ac6af3700 1 --2- 172.21.15.90:0/2207652142 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9ac0070db0 0x7f9aac005080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:12.777 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.767+0000 7f9ac62f2700 1 --2- 172.21.15.90:0/2207652142 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9aac003a20 0x7f9aac003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:12.777 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.767+0000 7f9ac5af1700 1 -- 172.21.15.90:0/2207652142 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9ac0070db0 msgr2=0x7f9aac005080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:12.777 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.767+0000 7f9ac5af1700 1 --2- 172.21.15.90:0/2207652142 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9ac0070db0 0x7f9aac005080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:12.777 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.767+0000 7f9ac5af1700 1 -- 172.21.15.90:0/2207652142 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9aac003a20 msgr2=0x7f9aac003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:12.778 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.767+0000 7f9ac5af1700 1 --2- 172.21.15.90:0/2207652142 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9aac003a20 0x7f9aac003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:12.778 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.767+0000 7f9ac5af1700 1 -- 172.21.15.90:0/2207652142 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9aac0035d0 con 0x7f9aac004450 2023-06-09T04:42:12.778 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.767+0000 7f9ac62f2700 1 --2- 172.21.15.90:0/2207652142 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9aac003a20 0x7f9aac003e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:42:12.778 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.767+0000 7f9ac5af1700 1 --2- 172.21.15.90:0/2207652142 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9aac004450 0x7f9aac004910 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f9ab000c350 tx=0x7f9aac0058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31f91eec6cd6ac6c server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:12.778 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.771+0000 7f9ac52f0700 1 -- 172.21.15.90:0/2207652142 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ab000ce50 con 0x7f9aac004450 2023-06-09T04:42:12.778 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.771+0000 7f9ac52f0700 1 -- 172.21.15.90:0/2207652142 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ab0005980 con 0x7f9aac004450 2023-06-09T04:42:12.778 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.771+0000 7f9ac52f0700 1 -- 172.21.15.90:0/2207652142 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ab0005d10 con 0x7f9aac004450 2023-06-09T04:42:12.779 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.771+0000 7f9ac8556700 1 -- 172.21.15.90:0/2207652142 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9aac004450 msgr2=0x7f9aac004910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:12.779 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.771+0000 7f9ac8556700 1 --2- 172.21.15.90:0/2207652142 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9aac004450 0x7f9aac004910 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f9ab000c350 tx=0x7f9aac0058a0 comp rx=0 tx=0).stop 2023-06-09T04:42:12.779 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.771+0000 7f9ac6af3700 1 -- 172.21.15.90:0/2207652142 reap_dead start 2023-06-09T04:42:12.779 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.771+0000 7f9ac8556700 1 -- 172.21.15.90:0/2207652142 shutdown_connections 2023-06-09T04:42:12.779 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.771+0000 7f9ac8556700 1 -- 172.21.15.90:0/2207652142 >> 172.21.15.90:0/2207652142 conn(0x7f9ac006c810 msgr2=0x7f9ac00b0000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:12.779 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.771+0000 7f9ac8556700 1 -- 172.21.15.90:0/2207652142 shutdown_connections 2023-06-09T04:42:12.779 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.771+0000 7f9ac8556700 1 -- 172.21.15.90:0/2207652142 wait complete. 2023-06-09T04:42:12.780 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.775+0000 7f9ac8556700 1 Processor -- start 2023-06-09T04:42:12.780 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.775+0000 7f9ac8556700 1 -- start start 2023-06-09T04:42:12.781 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.775+0000 7f9ac8556700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9aac004450 0x7f9ac00b2800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:12.781 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.775+0000 7f9ac8556700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9ac00b1320 0x7f9ac0151570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:12.781 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.775+0000 7f9ac8556700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9ac00c2850 0x7f9ac0155a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:12.781 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.775+0000 7f9ac8556700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac0151fa0 con 0x7f9ac00b1320 2023-06-09T04:42:12.781 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.775+0000 7f9ac8556700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac00b2330 con 0x7f9aac004450 2023-06-09T04:42:12.781 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.775+0000 7f9ac8556700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac00b2d40 con 0x7f9ac00c2850 2023-06-09T04:42:12.782 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.775+0000 7f9ac5af1700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9ac00b1320 0x7f9ac0151570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:12.783 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.775+0000 7f9ac5af1700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9ac00b1320 0x7f9ac0151570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:46136/0 (socket says 172.21.15.90:46136) 2023-06-09T04:42:12.783 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.775+0000 7f9ac5af1700 1 -- 172.21.15.90:0/3782208320 learned_addr learned my addr 172.21.15.90:0/3782208320 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:12.783 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.775+0000 7f9ac62f2700 1 --2- 172.21.15.90:0/3782208320 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9aac004450 0x7f9ac00b2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:12.783 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.775+0000 7f9ac6af3700 1 --2- 172.21.15.90:0/3782208320 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9ac00c2850 0x7f9ac0155a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:12.783 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.775+0000 7f9ac5af1700 1 -- 172.21.15.90:0/3782208320 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9ac00c2850 msgr2=0x7f9ac0155a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:12.783 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.775+0000 7f9ac5af1700 1 --2- 172.21.15.90:0/3782208320 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9ac00c2850 0x7f9ac0155a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:12.783 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.775+0000 7f9ac5af1700 1 -- 172.21.15.90:0/3782208320 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9aac004450 msgr2=0x7f9ac00b2800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:12.784 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.775+0000 7f9ac5af1700 1 --2- 172.21.15.90:0/3782208320 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9aac004450 0x7f9ac00b2800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:12.784 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.775+0000 7f9ac5af1700 1 -- 172.21.15.90:0/3782208320 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ac0151ab0 con 0x7f9ac00b1320 2023-06-09T04:42:12.784 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.775+0000 7f9ac5af1700 1 --2- 172.21.15.90:0/3782208320 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9ac00b1320 0x7f9ac0151570 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f9aac005790 tx=0x7f9ab0001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:12.784 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.775+0000 7f9ab6ffd700 1 -- 172.21.15.90:0/3782208320 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ab0001680 con 0x7f9ac00b1320 2023-06-09T04:42:12.784 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.775+0000 7f9ab6ffd700 1 -- 172.21.15.90:0/3782208320 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ab0004aa0 con 0x7f9ac00b1320 2023-06-09T04:42:12.784 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.779+0000 7f9ac8556700 1 -- 172.21.15.90:0/3782208320 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ac00b1a90 con 0x7f9ac00b1320 2023-06-09T04:42:12.784 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.779+0000 7f9ab6ffd700 1 -- 172.21.15.90:0/3782208320 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ab0004e50 con 0x7f9ac00b1320 2023-06-09T04:42:12.785 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.779+0000 7f9ac8556700 1 -- 172.21.15.90:0/3782208320 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ac00b2050 con 0x7f9ac00b1320 2023-06-09T04:42:12.785 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.779+0000 7f9ac8556700 1 -- 172.21.15.90:0/3782208320 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ac0151d00 con 0x7f9ac00b1320 2023-06-09T04:42:12.785 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.779+0000 7f9ab6ffd700 1 -- 172.21.15.90:0/3782208320 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9ab0007070 con 0x7f9ac00b1320 2023-06-09T04:42:12.787 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.783+0000 7f9ab6ffd700 1 --2- 172.21.15.90:0/3782208320 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f9aa4066320 0x7f9aa40687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:12.788 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.783+0000 7f9ab6ffd700 1 -- 172.21.15.90:0/3782208320 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9ab0084f50 con 0x7f9ac00b1320 2023-06-09T04:42:12.788 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.783+0000 7f9ac62f2700 1 --2- 172.21.15.90:0/3782208320 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f9aa4066320 0x7f9aa40687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:12.789 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.783+0000 7f9ac62f2700 1 --2- 172.21.15.90:0/3782208320 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f9aa4066320 0x7f9aa40687d0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f9abc012710 tx=0x7f9abc00b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:12.794 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.787+0000 7f9ab6ffd700 1 -- 172.21.15.90:0/3782208320 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9ac0151d00 con 0x7f9ac00b1320 2023-06-09T04:42:13.000 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.995+0000 7f9ac8556700 1 -- 172.21.15.90:0/3782208320 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f9ac01520e0 con 0x7f9ac00b1320 2023-06-09T04:42:13.001 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.995+0000 7f9ab6ffd700 1 -- 172.21.15.90:0/3782208320 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f9ac01520e0 con 0x7f9ac00b1320 2023-06-09T04:42:13.001 INFO:teuthology.orchestra.run.smithi090.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-06-09T04:42:13.003 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.999+0000 7f9ac8556700 1 -- 172.21.15.90:0/3782208320 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f9aa4066320 msgr2=0x7f9aa40687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:13.004 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.999+0000 7f9ac8556700 1 --2- 172.21.15.90:0/3782208320 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f9aa4066320 0x7f9aa40687d0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f9abc012710 tx=0x7f9abc00b040 comp rx=0 tx=0).stop 2023-06-09T04:42:13.004 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.999+0000 7f9ac8556700 1 -- 172.21.15.90:0/3782208320 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9ac00b1320 msgr2=0x7f9ac0151570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:13.004 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.999+0000 7f9ac8556700 1 --2- 172.21.15.90:0/3782208320 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9ac00b1320 0x7f9ac0151570 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f9aac005790 tx=0x7f9ab0001a00 comp rx=0 tx=0).stop 2023-06-09T04:42:13.004 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.999+0000 7f9ac8556700 1 -- 172.21.15.90:0/3782208320 shutdown_connections 2023-06-09T04:42:13.004 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.999+0000 7f9ac8556700 1 --2- 172.21.15.90:0/3782208320 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f9aa4066320 0x7f9aa40687d0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:13.004 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.999+0000 7f9ac8556700 1 --2- 172.21.15.90:0/3782208320 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9ac00c2850 0x7f9ac0155a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:13.004 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.999+0000 7f9ac8556700 1 --2- 172.21.15.90:0/3782208320 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9ac00b1320 0x7f9ac0151570 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:13.005 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.999+0000 7f9ac8556700 1 --2- 172.21.15.90:0/3782208320 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9aac004450 0x7f9ac00b2800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:13.005 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.999+0000 7f9ac8556700 1 -- 172.21.15.90:0/3782208320 >> 172.21.15.90:0/3782208320 conn(0x7f9ac006c810 msgr2=0x7f9ac00ae4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:13.005 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.999+0000 7f9ac8556700 1 -- 172.21.15.90:0/3782208320 shutdown_connections 2023-06-09T04:42:13.005 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:12.999+0000 7f9ac8556700 1 -- 172.21.15.90:0/3782208320 wait complete. 2023-06-09T04:42:13.025 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-06-09T04:42:13.025 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-06-09T04:42:13.026 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi090.front.sepia.ceph.com 2023-06-09T04:42:13.026 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-06-09T04:42:13.026 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-06-09T04:42:13.026 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-06-09T04:42:13.026 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-06-09T04:42:13.026 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-06-09T04:42:13.027 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-06-09T04:42:13.027 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:42:13.027 DEBUG:teuthology.orchestra.run.smithi090:> ip addr 2023-06-09T04:42:13.043 INFO:teuthology.orchestra.run.smithi090.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-06-09T04:42:13.044 INFO:teuthology.orchestra.run.smithi090.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-06-09T04:42:13.044 INFO:teuthology.orchestra.run.smithi090.stdout: inet 127.0.0.1/8 scope host lo 2023-06-09T04:42:13.044 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:42:13.044 INFO:teuthology.orchestra.run.smithi090.stdout: inet6 ::1/128 scope host 2023-06-09T04:42:13.044 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:42:13.044 INFO:teuthology.orchestra.run.smithi090.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-09T04:42:13.045 INFO:teuthology.orchestra.run.smithi090.stdout: link/ether 0c:c4:7a:d8:a1:a8 brd ff:ff:ff:ff:ff:ff 2023-06-09T04:42:13.045 INFO:teuthology.orchestra.run.smithi090.stdout: altname enp7s0f0 2023-06-09T04:42:13.045 INFO:teuthology.orchestra.run.smithi090.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-09T04:42:13.045 INFO:teuthology.orchestra.run.smithi090.stdout: link/ether 0c:c4:7a:d8:a1:a9 brd ff:ff:ff:ff:ff:ff 2023-06-09T04:42:13.045 INFO:teuthology.orchestra.run.smithi090.stdout: altname enp7s0f1 2023-06-09T04:42:13.045 INFO:teuthology.orchestra.run.smithi090.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-09T04:42:13.045 INFO:teuthology.orchestra.run.smithi090.stdout: link/ether 0c:c4:7a:8f:d7:66 brd ff:ff:ff:ff:ff:ff 2023-06-09T04:42:13.045 INFO:teuthology.orchestra.run.smithi090.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-06-09T04:42:13.046 INFO:teuthology.orchestra.run.smithi090.stdout: link/ether 0c:c4:7a:8f:d7:67 brd ff:ff:ff:ff:ff:ff 2023-06-09T04:42:13.046 INFO:teuthology.orchestra.run.smithi090.stdout: inet 172.21.15.90/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-06-09T04:42:13.046 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft 42400sec preferred_lft 42400sec 2023-06-09T04:42:13.046 INFO:teuthology.orchestra.run.smithi090.stdout: inet6 fe80::ec4:7aff:fe8f:d767/64 scope link 2023-06-09T04:42:13.046 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:42:13.046 INFO:teuthology.orchestra.run.smithi090.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-06-09T04:42:13.046 INFO:teuthology.orchestra.run.smithi090.stdout: link/ether 02:42:ee:21:41:51 brd ff:ff:ff:ff:ff:ff 2023-06-09T04:42:13.047 INFO:teuthology.orchestra.run.smithi090.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-06-09T04:42:13.047 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:42:13.047 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-06-09T04:42:13.048 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:42:13.048 DEBUG:teuthology.orchestra.run.smithi090:> (cd / && exec bash -c ' 2023-06-09T04:42:13.048 DEBUG:teuthology.orchestra.run.smithi090:> set -e 2023-06-09T04:42:13.049 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip link add name ceph-brx type bridge 2023-06-09T04:42:13.049 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip addr flush dev ceph-brx 2023-06-09T04:42:13.049 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip link set ceph-brx up 2023-06-09T04:42:13.049 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-06-09T04:42:13.050 DEBUG:teuthology.orchestra.run.smithi090:> ') 2023-06-09T04:42:13.197 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:42:13.198 DEBUG:teuthology.orchestra.run.smithi090:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-06-09T04:42:13.228 INFO:teuthology.orchestra.run.smithi090.stdout:1 2023-06-09T04:42:13.231 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:42:13.231 DEBUG:teuthology.orchestra.run.smithi090:> route 2023-06-09T04:42:13.538 INFO:teuthology.orchestra.run.smithi090.stdout:Kernel IP routing table 2023-06-09T04:42:13.538 INFO:teuthology.orchestra.run.smithi090.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-06-09T04:42:13.539 INFO:teuthology.orchestra.run.smithi090.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-06-09T04:42:13.539 INFO:teuthology.orchestra.run.smithi090.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-06-09T04:42:13.539 INFO:teuthology.orchestra.run.smithi090.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-06-09T04:42:13.539 INFO:teuthology.orchestra.run.smithi090.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2023-06-09T04:42:13.539 INFO:teuthology.orchestra.run.smithi090.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-06-09T04:42:13.539 INFO:teuthology.orchestra.run.smithi090.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-06-09T04:42:13.540 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:42:13.540 DEBUG:teuthology.orchestra.run.smithi090:> (cd / && exec bash -c ' 2023-06-09T04:42:13.540 DEBUG:teuthology.orchestra.run.smithi090:> set -e 2023-06-09T04:42:13.541 DEBUG:teuthology.orchestra.run.smithi090:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-06-09T04:42:13.541 DEBUG:teuthology.orchestra.run.smithi090:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-06-09T04:42:13.541 DEBUG:teuthology.orchestra.run.smithi090:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-06-09T04:42:13.541 DEBUG:teuthology.orchestra.run.smithi090:> ') 2023-06-09T04:42:13.634 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:42:13.634 DEBUG:teuthology.orchestra.run.smithi090:> ip netns list 2023-06-09T04:42:13.651 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:42:13.651 DEBUG:teuthology.orchestra.run.smithi090:> ip netns list-id 2023-06-09T04:42:13.717 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:42:13.718 DEBUG:teuthology.orchestra.run.smithi090:> (cd / && exec bash -c ' 2023-06-09T04:42:13.718 DEBUG:teuthology.orchestra.run.smithi090:> set -e 2023-06-09T04:42:13.718 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-06-09T04:42:13.718 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-06-09T04:42:13.718 DEBUG:teuthology.orchestra.run.smithi090:> ') 2023-06-09T04:42:13.837 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-06-09T04:42:13.838 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:42:13.838 DEBUG:teuthology.orchestra.run.smithi090:> (cd / && exec bash -c ' 2023-06-09T04:42:13.839 DEBUG:teuthology.orchestra.run.smithi090:> set -e 2023-06-09T04:42:13.839 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-06-09T04:42:13.840 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-06-09T04:42:13.840 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-06-09T04:42:13.840 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-06-09T04:42:13.841 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-06-09T04:42:13.841 DEBUG:teuthology.orchestra.run.smithi090:> ') 2023-06-09T04:42:14.020 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:42:14.020 DEBUG:teuthology.orchestra.run.smithi090:> (cd / && exec bash -c ' 2023-06-09T04:42:14.021 DEBUG:teuthology.orchestra.run.smithi090:> set -e 2023-06-09T04:42:14.021 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip link set brx.0 up 2023-06-09T04:42:14.021 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip link set dev brx.0 master ceph-brx 2023-06-09T04:42:14.021 DEBUG:teuthology.orchestra.run.smithi090:> ') 2023-06-09T04:42:14.094 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-09T04:42:14.094 DEBUG:teuthology.orchestra.run.smithi090:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-06-09T04:42:14.109 INFO:teuthology.orchestra.run.smithi090.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-06-09T04:42:14.110 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-09T04:42:14.110 DEBUG:teuthology.orchestra.run.smithi090:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-06-09T04:42:14.170 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-06-09T04:42:14.170 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:42:14.170 DEBUG:teuthology.orchestra.run.smithi090:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-06-09T04:42:14.305 INFO:teuthology.orchestra.run.smithi090.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-06-09T04:42:14.305 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-06-09T04:42:14.448 INFO:teuthology.orchestra.run.smithi090.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-06-09T04:42:14.448 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-06-09T04:42:14.448 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: resolved to: "172.21.15.90:3300,172.21.15.174:3300,172.21.15.174:3301" 2023-06-09T04:42:14.448 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: trying mount with new device syntax: 0@700369c0-a111-43b4-9415-844ad1742b70.cephfs=/ 2023-06-09T04:42:14.449 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.90:3300/172.21.15.174:3300/172.21.15.174:3301" will pass to kernel 2023-06-09T04:42:14.454 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-06-09T04:42:14.454 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:42:14.455 DEBUG:teuthology.orchestra.run.smithi090:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-06-09T04:42:14.485 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:42:14.486 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-06-09T04:42:14.573 INFO:teuthology.orchestra.run.smithi090.stdout:client4665 2023-06-09T04:42:14.573 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2023-06-09T04:42:14.573 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-09T04:42:14.631 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:42:14.632 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-06-09T04:42:14.716 INFO:teuthology.orchestra.run.smithi090.stdout:client4665 2023-06-09T04:42:14.716 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:42:14.717 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-06-09T04:42:14.797 INFO:teuthology.orchestra.run.smithi090.stdout:client4665 2023-06-09T04:42:14.798 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:42:14.798 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/700369c0-a111-43b4-9415-844ad1742b70.client4665/status') 2023-06-09T04:42:14.891 INFO:teuthology.orchestra.run.smithi090.stdout:instance: client.4665 (3)192.168.0.1:0/416300703 2023-06-09T04:42:14.892 INFO:teuthology.orchestra.run.smithi090.stdout:blocklisted: false 2023-06-09T04:42:14.892 INFO:teuthology.orchestra.run.smithi090.stderr:0+1 records in 2023-06-09T04:42:14.893 INFO:teuthology.orchestra.run.smithi090.stderr:0+1 records out 2023-06-09T04:42:14.893 INFO:teuthology.orchestra.run.smithi090.stderr:68 bytes copied, 0.000161624 s, 421 kB/s 2023-06-09T04:42:14.895 INFO:tasks.kclient:client.2 config is {'syntax': 'v2'} 2023-06-09T04:42:14.895 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-06-09T04:42:14.895 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-06-09T04:42:14.896 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-06-09T04:42:15.066 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:15.059+0000 7f9e288cf700 1 Processor -- start 2023-06-09T04:42:15.067 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:15.063+0000 7f9e288cf700 1 -- start start 2023-06-09T04:42:15.069 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:15.063+0000 7f9e288cf700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9e240cafb0 0x7f9e240cc0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:15.070 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:15.063+0000 7f9e288cf700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e240cd8a0 con 0x7f9e24154350 2023-06-09T04:42:15.070 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:15.063+0000 7f9e288cf700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e240cb420 con 0x7f9e2415deb0 2023-06-09T04:42:15.070 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:15.063+0000 7f9e288cf700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e24154720 con 0x7f9e240cafb0 2023-06-09T04:42:15.070 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:15.063+0000 7f9e237fe700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f9e24154350 0x7f9e2415d7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:55670/0 (socket says 172.21.15.90:55670) 2023-06-09T04:42:15.071 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:15.063+0000 7f9e237fe700 1 -- 172.21.15.90:0/1648495771 learned_addr learned my addr 172.21.15.90:0/1648495771 (peer_addr_for_me v1:172.21.15.90:0/0) 2023-06-09T04:42:15.071 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:15.063+0000 7f9e22ffd700 1 --2- 172.21.15.90:0/1648495771 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9e240cafb0 0x7f9e240cc0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:15.071 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:15.063+0000 7f9e227fc700 1 -- 172.21.15.90:0/1648495771 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1461806185 0 0) 0x7f9e240cd8a0 con 0x7f9e24154350 2023-06-09T04:42:15.072 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:15.063+0000 7f9e227fc700 1 -- 172.21.15.90:0/1648495771 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9e0c0035d0 con 0x7f9e24154350 2023-06-09T04:42:15.072 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:15.067+0000 7f9e227fc700 1 -- 172.21.15.90:0/1648495771 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1005820522 0 0) 0x7f9e240cb420 con 0x7f9e2415deb0 2023-06-09T04:42:15.072 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:15.067+0000 7f9e227fc700 1 -- 172.21.15.90:0/1648495771 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9e240cd8a0 con 0x7f9e2415deb0 2023-06-09T04:42:15.072 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:15.067+0000 7f9e22ffd700 1 -- 172.21.15.90:0/1648495771 >> v1:172.21.15.174:6789/0 conn(0x7f9e2415deb0 legacy=0x7f9e24069c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:15.072 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:15.067+0000 7f9e22ffd700 1 -- 172.21.15.90:0/1648495771 >> v1:172.21.15.90:6789/0 conn(0x7f9e24154350 legacy=0x7f9e2415d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:15.072 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:15.067+0000 7f9e227fc700 1 -- 172.21.15.90:0/1648495771 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3165512806 0 0) 0x7f9e0c0035d0 con 0x7f9e24154350 2023-06-09T04:42:15.073 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:15.067+0000 7f9e22ffd700 1 -- 172.21.15.90:0/1648495771 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e240cdaf0 con 0x7f9e240cafb0 2023-06-09T04:42:15.073 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:15.067+0000 7f9e22ffd700 1 --2- 172.21.15.90:0/1648495771 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9e240cafb0 0x7f9e240cc0f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f9e18009880 tx=0x7f9e18009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c7f57ad2ead2d797 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:15.073 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:15.067+0000 7f9e227fc700 1 -- 172.21.15.90:0/1648495771 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e14001670 con 0x7f9e240cafb0 2023-06-09T04:42:15.073 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:15.067+0000 7f9e227fc700 1 -- 172.21.15.90:0/1648495771 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e18004030 con 0x7f9e240cafb0 2023-06-09T04:42:15.074 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:15.067+0000 7f9e227fc700 1 -- 172.21.15.90:0/1648495771 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e180043c0 con 0x7f9e240cafb0 2023-06-09T04:42:15.074 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:15.067+0000 7f9e288cf700 1 -- 172.21.15.90:0/1648495771 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9e240cafb0 msgr2=0x7f9e240cc0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:15.074 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:15.067+0000 7f9e288cf700 1 --2- 172.21.15.90:0/1648495771 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9e240cafb0 0x7f9e240cc0f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f9e18009880 tx=0x7f9e18009b90 comp rx=0 tx=0).stop 2023-06-09T04:42:15.074 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:15.067+0000 7f9e288cf700 1 -- 172.21.15.90:0/1648495771 shutdown_connections 2023-06-09T04:42:15.075 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:15.067+0000 7f9e288cf700 1 --2- 172.21.15.90:0/1648495771 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9e240cafb0 0x7f9e240cc0f0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:15.075 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:15.067+0000 7f9e288cf700 1 -- 172.21.15.90:0/1648495771 >> 172.21.15.90:0/1648495771 conn(0x7f9e2406c690 msgr2=0x7f9e240aff00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:15.075 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:15.067+0000 7f9e288cf700 1 -- 172.21.15.90:0/1648495771 shutdown_connections 2023-06-09T04:42:15.075 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:15.067+0000 7f9e288cf700 1 -- 172.21.15.90:0/1648495771 wait complete. 2023-06-09T04:42:15.076 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:15.071+0000 7f9e288cf700 1 Processor -- start 2023-06-09T04:42:15.077 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:15.071+0000 7f9e288cf700 1 -- start start 2023-06-09T04:42:15.078 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:15.071+0000 7f9e288cf700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9e240cafb0 0x7f9e2414dc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:15.078 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:15.071+0000 7f9e288cf700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9e24154350 0x7f9e24152420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:15.079 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:15.071+0000 7f9e288cf700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9e2415deb0 0x7f9e24070fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:15.079 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:15.071+0000 7f9e288cf700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e241f4f50 con 0x7f9e2415deb0 2023-06-09T04:42:15.079 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:15.071+0000 7f9e288cf700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e24152e30 con 0x7f9e24154350 2023-06-09T04:42:15.079 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:15.071+0000 7f9e288cf700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e241f51a0 con 0x7f9e240cafb0 2023-06-09T04:42:15.080 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:15.075+0000 7f9e23fff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9e2415deb0 0x7f9e24070fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:15.080 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:15.075+0000 7f9e23fff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9e2415deb0 0x7f9e24070fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:46140/0 (socket says 172.21.15.90:46140) 2023-06-09T04:42:15.080 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:15.075+0000 7f9e23fff700 1 -- 172.21.15.90:0/1395805927 learned_addr learned my addr 172.21.15.90:0/1395805927 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:15.080 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:15.075+0000 7f9e237fe700 1 --2- 172.21.15.90:0/1395805927 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9e240cafb0 0x7f9e2414dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:15.081 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:15.075+0000 7f9e22ffd700 1 --2- 172.21.15.90:0/1395805927 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9e24154350 0x7f9e24152420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:15.081 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:15.075+0000 7f9e23fff700 1 -- 172.21.15.90:0/1395805927 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9e240cafb0 msgr2=0x7f9e2414dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:15.081 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:15.075+0000 7f9e23fff700 1 --2- 172.21.15.90:0/1395805927 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9e240cafb0 0x7f9e2414dc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:15.081 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:15.075+0000 7f9e23fff700 1 -- 172.21.15.90:0/1395805927 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9e24154350 msgr2=0x7f9e24152420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:15.081 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:15.075+0000 7f9e23fff700 1 --2- 172.21.15.90:0/1395805927 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9e24154350 0x7f9e24152420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:15.081 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:15.075+0000 7f9e23fff700 1 -- 172.21.15.90:0/1395805927 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e180094b0 con 0x7f9e2415deb0 2023-06-09T04:42:15.081 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:15.075+0000 7f9e23fff700 1 --2- 172.21.15.90:0/1395805927 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9e2415deb0 0x7f9e24070fd0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f9e1c00cbc0 tx=0x7f9e1c00ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:15.082 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:15.075+0000 7f9e0bfff700 1 -- 172.21.15.90:0/1395805927 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e1c003c20 con 0x7f9e2415deb0 2023-06-09T04:42:15.082 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:15.075+0000 7f9e0bfff700 1 -- 172.21.15.90:0/1395805927 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e1c003d80 con 0x7f9e2415deb0 2023-06-09T04:42:15.082 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:15.075+0000 7f9e288cf700 1 -- 172.21.15.90:0/1395805927 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e241f5480 con 0x7f9e2415deb0 2023-06-09T04:42:15.082 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:15.075+0000 7f9e0bfff700 1 -- 172.21.15.90:0/1395805927 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e1c00aa20 con 0x7f9e2415deb0 2023-06-09T04:42:15.083 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:15.075+0000 7f9e288cf700 1 -- 172.21.15.90:0/1395805927 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e2414e1c0 con 0x7f9e2415deb0 2023-06-09T04:42:15.083 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:15.075+0000 7f9e288cf700 1 -- 172.21.15.90:0/1395805927 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e2406b390 con 0x7f9e2415deb0 2023-06-09T04:42:15.084 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:15.079+0000 7f9e0bfff700 1 -- 172.21.15.90:0/1395805927 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9e1c00ab80 con 0x7f9e2415deb0 2023-06-09T04:42:15.085 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:15.079+0000 7f9e0bfff700 1 --2- 172.21.15.90:0/1395805927 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f9e100662f0 0x7f9e100687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:15.086 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:15.079+0000 7f9e0bfff700 1 -- 172.21.15.90:0/1395805927 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9e1c083c50 con 0x7f9e2415deb0 2023-06-09T04:42:15.086 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:15.079+0000 7f9e237fe700 1 --2- 172.21.15.90:0/1395805927 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f9e100662f0 0x7f9e100687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:15.087 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:15.083+0000 7f9e237fe700 1 --2- 172.21.15.90:0/1395805927 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f9e100662f0 0x7f9e100687a0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f9e14001380 tx=0x7f9e14001770 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:15.091 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:15.087+0000 7f9e0bfff700 1 -- 172.21.15.90:0/1395805927 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9e1c0510c0 con 0x7f9e2415deb0 2023-06-09T04:42:15.298 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:15.291+0000 7f9e288cf700 1 -- 172.21.15.90:0/1395805927 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f9e241f59a0 con 0x7f9e2415deb0 2023-06-09T04:42:15.299 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:15.295+0000 7f9e0bfff700 1 -- 172.21.15.90:0/1395805927 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f9e241f59a0 con 0x7f9e2415deb0 2023-06-09T04:42:15.299 INFO:teuthology.orchestra.run.smithi090.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-06-09T04:42:15.301 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:15.295+0000 7f9e288cf700 1 -- 172.21.15.90:0/1395805927 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f9e100662f0 msgr2=0x7f9e100687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:15.302 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:15.295+0000 7f9e288cf700 1 --2- 172.21.15.90:0/1395805927 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f9e100662f0 0x7f9e100687a0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f9e14001380 tx=0x7f9e14001770 comp rx=0 tx=0).stop 2023-06-09T04:42:15.302 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:15.295+0000 7f9e288cf700 1 -- 172.21.15.90:0/1395805927 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9e2415deb0 msgr2=0x7f9e24070fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:15.302 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:15.295+0000 7f9e288cf700 1 --2- 172.21.15.90:0/1395805927 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9e2415deb0 0x7f9e24070fd0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f9e1c00cbc0 tx=0x7f9e1c00ced0 comp rx=0 tx=0).stop 2023-06-09T04:42:15.303 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:15.295+0000 7f9e288cf700 1 -- 172.21.15.90:0/1395805927 shutdown_connections 2023-06-09T04:42:15.303 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:15.295+0000 7f9e288cf700 1 --2- 172.21.15.90:0/1395805927 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f9e100662f0 0x7f9e100687a0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:15.303 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:15.295+0000 7f9e288cf700 1 --2- 172.21.15.90:0/1395805927 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9e2415deb0 0x7f9e24070fd0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:15.303 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:15.295+0000 7f9e288cf700 1 --2- 172.21.15.90:0/1395805927 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9e24154350 0x7f9e24152420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:15.303 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:15.295+0000 7f9e288cf700 1 --2- 172.21.15.90:0/1395805927 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9e240cafb0 0x7f9e2414dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:15.303 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:15.295+0000 7f9e288cf700 1 -- 172.21.15.90:0/1395805927 >> 172.21.15.90:0/1395805927 conn(0x7f9e2406c690 msgr2=0x7f9e240b2ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:15.303 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:15.295+0000 7f9e288cf700 1 -- 172.21.15.90:0/1395805927 shutdown_connections 2023-06-09T04:42:15.304 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:15.295+0000 7f9e288cf700 1 -- 172.21.15.90:0/1395805927 wait complete. 2023-06-09T04:42:15.324 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-06-09T04:42:15.324 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-06-09T04:42:15.325 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi090.front.sepia.ceph.com 2023-06-09T04:42:15.325 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-06-09T04:42:15.325 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-06-09T04:42:15.325 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-06-09T04:42:15.326 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-06-09T04:42:15.326 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-06-09T04:42:15.326 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-06-09T04:42:15.327 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:42:15.327 DEBUG:teuthology.orchestra.run.smithi090:> ip addr 2023-06-09T04:42:15.344 INFO:teuthology.orchestra.run.smithi090.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-06-09T04:42:15.345 INFO:teuthology.orchestra.run.smithi090.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-06-09T04:42:15.345 INFO:teuthology.orchestra.run.smithi090.stdout: inet 127.0.0.1/8 scope host lo 2023-06-09T04:42:15.345 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:42:15.345 INFO:teuthology.orchestra.run.smithi090.stdout: inet6 ::1/128 scope host 2023-06-09T04:42:15.345 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:42:15.345 INFO:teuthology.orchestra.run.smithi090.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-09T04:42:15.345 INFO:teuthology.orchestra.run.smithi090.stdout: link/ether 0c:c4:7a:d8:a1:a8 brd ff:ff:ff:ff:ff:ff 2023-06-09T04:42:15.346 INFO:teuthology.orchestra.run.smithi090.stdout: altname enp7s0f0 2023-06-09T04:42:15.346 INFO:teuthology.orchestra.run.smithi090.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-09T04:42:15.346 INFO:teuthology.orchestra.run.smithi090.stdout: link/ether 0c:c4:7a:d8:a1:a9 brd ff:ff:ff:ff:ff:ff 2023-06-09T04:42:15.346 INFO:teuthology.orchestra.run.smithi090.stdout: altname enp7s0f1 2023-06-09T04:42:15.346 INFO:teuthology.orchestra.run.smithi090.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-09T04:42:15.346 INFO:teuthology.orchestra.run.smithi090.stdout: link/ether 0c:c4:7a:8f:d7:66 brd ff:ff:ff:ff:ff:ff 2023-06-09T04:42:15.346 INFO:teuthology.orchestra.run.smithi090.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-06-09T04:42:15.346 INFO:teuthology.orchestra.run.smithi090.stdout: link/ether 0c:c4:7a:8f:d7:67 brd ff:ff:ff:ff:ff:ff 2023-06-09T04:42:15.347 INFO:teuthology.orchestra.run.smithi090.stdout: inet 172.21.15.90/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-06-09T04:42:15.347 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft 42398sec preferred_lft 42398sec 2023-06-09T04:42:15.347 INFO:teuthology.orchestra.run.smithi090.stdout: inet6 fe80::ec4:7aff:fe8f:d767/64 scope link 2023-06-09T04:42:15.347 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:42:15.347 INFO:teuthology.orchestra.run.smithi090.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-06-09T04:42:15.347 INFO:teuthology.orchestra.run.smithi090.stdout: link/ether 02:42:ee:21:41:51 brd ff:ff:ff:ff:ff:ff 2023-06-09T04:42:15.347 INFO:teuthology.orchestra.run.smithi090.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-06-09T04:42:15.347 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:42:15.348 INFO:teuthology.orchestra.run.smithi090.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-06-09T04:42:15.348 INFO:teuthology.orchestra.run.smithi090.stdout: link/ether de:ba:21:40:69:32 brd ff:ff:ff:ff:ff:ff 2023-06-09T04:42:15.348 INFO:teuthology.orchestra.run.smithi090.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-06-09T04:42:15.348 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:42:15.348 INFO:teuthology.orchestra.run.smithi090.stdout: inet6 fe80::8cde:dfff:fe51:9c9d/64 scope link 2023-06-09T04:42:15.348 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:42:15.348 INFO:teuthology.orchestra.run.smithi090.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-06-09T04:42:15.349 INFO:teuthology.orchestra.run.smithi090.stdout: link/ether de:ba:21:40:69:32 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-06-09T04:42:15.349 INFO:teuthology.orchestra.run.smithi090.stdout: inet6 fe80::dcba:21ff:fe40:6932/64 scope link tentative 2023-06-09T04:42:15.349 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:42:15.350 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:42:15.350 DEBUG:teuthology.orchestra.run.smithi090:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-06-09T04:42:15.432 INFO:teuthology.orchestra.run.smithi090.stdout:1 2023-06-09T04:42:15.435 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:42:15.435 DEBUG:teuthology.orchestra.run.smithi090:> route 2023-06-09T04:42:15.498 INFO:teuthology.orchestra.run.smithi090.stdout:Kernel IP routing table 2023-06-09T04:42:15.499 INFO:teuthology.orchestra.run.smithi090.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-06-09T04:42:15.499 INFO:teuthology.orchestra.run.smithi090.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-06-09T04:42:15.499 INFO:teuthology.orchestra.run.smithi090.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-06-09T04:42:15.500 INFO:teuthology.orchestra.run.smithi090.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-06-09T04:42:15.500 INFO:teuthology.orchestra.run.smithi090.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2023-06-09T04:42:15.500 INFO:teuthology.orchestra.run.smithi090.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-06-09T04:42:15.500 INFO:teuthology.orchestra.run.smithi090.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-06-09T04:42:15.501 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:42:15.501 DEBUG:teuthology.orchestra.run.smithi090:> (cd / && exec bash -c ' 2023-06-09T04:42:15.502 DEBUG:teuthology.orchestra.run.smithi090:> set -e 2023-06-09T04:42:15.503 DEBUG:teuthology.orchestra.run.smithi090:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-06-09T04:42:15.503 DEBUG:teuthology.orchestra.run.smithi090:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-06-09T04:42:15.503 DEBUG:teuthology.orchestra.run.smithi090:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-06-09T04:42:15.504 DEBUG:teuthology.orchestra.run.smithi090:> ') 2023-06-09T04:42:15.634 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:42:15.634 DEBUG:teuthology.orchestra.run.smithi090:> ip netns list 2023-06-09T04:42:15.651 INFO:teuthology.orchestra.run.smithi090.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-06-09T04:42:15.652 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:42:15.653 DEBUG:teuthology.orchestra.run.smithi090:> ip netns list-id 2023-06-09T04:42:15.717 INFO:teuthology.orchestra.run.smithi090.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-06-09T04:42:15.718 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:42:15.718 DEBUG:teuthology.orchestra.run.smithi090:> (cd / && exec bash -c ' 2023-06-09T04:42:15.719 DEBUG:teuthology.orchestra.run.smithi090:> set -e 2023-06-09T04:42:15.719 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-06-09T04:42:15.719 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-06-09T04:42:15.719 DEBUG:teuthology.orchestra.run.smithi090:> ') 2023-06-09T04:42:15.830 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:42:15.830 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-06-09T04:42:15.866 INFO:teuthology.orchestra.run.smithi090.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-06-09T04:42:15.866 INFO:teuthology.orchestra.run.smithi090.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-06-09T04:42:15.867 INFO:teuthology.orchestra.run.smithi090.stdout: inet 127.0.0.1/8 scope host lo 2023-06-09T04:42:15.867 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:42:15.867 INFO:teuthology.orchestra.run.smithi090.stdout: inet6 ::1/128 scope host 2023-06-09T04:42:15.867 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:42:15.867 INFO:teuthology.orchestra.run.smithi090.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-06-09T04:42:15.867 INFO:teuthology.orchestra.run.smithi090.stdout: link/ether 22:01:6e:2d:39:a0 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-06-09T04:42:15.867 INFO:teuthology.orchestra.run.smithi090.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-06-09T04:42:15.868 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:42:15.868 INFO:teuthology.orchestra.run.smithi090.stdout: inet6 fe80::2001:6eff:fe2d:39a0/64 scope link 2023-06-09T04:42:15.868 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:42:15.870 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:42:15.870 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-06-09T04:42:15.945 INFO:teuthology.orchestra.run.smithi090.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-06-09T04:42:15.946 INFO:teuthology.orchestra.run.smithi090.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-06-09T04:42:15.946 INFO:teuthology.orchestra.run.smithi090.stdout: inet 127.0.0.1/8 scope host lo 2023-06-09T04:42:15.946 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:42:15.946 INFO:teuthology.orchestra.run.smithi090.stdout: inet6 ::1/128 scope host 2023-06-09T04:42:15.946 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:42:15.946 INFO:teuthology.orchestra.run.smithi090.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-06-09T04:42:15.947 INFO:teuthology.orchestra.run.smithi090.stdout: link/ether 22:01:6e:2d:39:a0 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-06-09T04:42:15.947 INFO:teuthology.orchestra.run.smithi090.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-06-09T04:42:15.947 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:42:15.947 INFO:teuthology.orchestra.run.smithi090.stdout: inet6 fe80::2001:6eff:fe2d:39a0/64 scope link 2023-06-09T04:42:15.947 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:42:15.949 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-06-09T04:42:15.949 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:42:15.949 DEBUG:teuthology.orchestra.run.smithi090:> (cd / && exec bash -c ' 2023-06-09T04:42:15.949 DEBUG:teuthology.orchestra.run.smithi090:> set -e 2023-06-09T04:42:15.950 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-06-09T04:42:15.950 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-06-09T04:42:15.950 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-06-09T04:42:15.950 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-06-09T04:42:15.951 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-06-09T04:42:15.951 DEBUG:teuthology.orchestra.run.smithi090:> ') 2023-06-09T04:42:16.136 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:42:16.137 DEBUG:teuthology.orchestra.run.smithi090:> (cd / && exec bash -c ' 2023-06-09T04:42:16.137 DEBUG:teuthology.orchestra.run.smithi090:> set -e 2023-06-09T04:42:16.137 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip link set brx.1 up 2023-06-09T04:42:16.137 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip link set dev brx.1 master ceph-brx 2023-06-09T04:42:16.138 DEBUG:teuthology.orchestra.run.smithi090:> ') 2023-06-09T04:42:16.210 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-09T04:42:16.210 DEBUG:teuthology.orchestra.run.smithi090:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-06-09T04:42:16.224 INFO:teuthology.orchestra.run.smithi090.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-06-09T04:42:16.224 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-09T04:42:16.224 DEBUG:teuthology.orchestra.run.smithi090:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-06-09T04:42:16.286 INFO:tasks.cephfs.kernel_mount:mounting using device: 2@.cephfs=/ 2023-06-09T04:42:16.286 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:42:16.286 DEBUG:teuthology.orchestra.run.smithi090:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 2@.cephfs=/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-06-09T04:42:16.413 INFO:teuthology.orchestra.run.smithi090.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-06-09T04:42:16.414 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-06-09T04:42:16.438 INFO:teuthology.orchestra.run.smithi090.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-06-09T04:42:16.438 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-06-09T04:42:16.439 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: resolved to: "172.21.15.90:3300,172.21.15.174:3300,172.21.15.174:3301" 2023-06-09T04:42:16.439 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: trying mount with new device syntax: 2@700369c0-a111-43b4-9415-844ad1742b70.cephfs=/ 2023-06-09T04:42:16.439 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,ms_mode=prefer-crc,key=2,mon_addr=172.21.15.90:3300/172.21.15.174:3300/172.21.15.174:3301" will pass to kernel 2023-06-09T04:42:16.445 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-06-09T04:42:16.446 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:42:16.446 DEBUG:teuthology.orchestra.run.smithi090:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-06-09T04:42:16.475 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:42:16.476 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-06-09T04:42:16.551 INFO:teuthology.orchestra.run.smithi090.stdout:client4674 2023-06-09T04:42:16.551 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2023-06-09T04:42:16.552 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-09T04:42:16.613 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:42:16.613 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-06-09T04:42:16.680 INFO:teuthology.orchestra.run.smithi090.stdout:client4674 2023-06-09T04:42:16.681 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:42:16.681 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-06-09T04:42:16.756 INFO:teuthology.orchestra.run.smithi090.stdout:client4674 2023-06-09T04:42:16.756 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:42:16.757 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/700369c0-a111-43b4-9415-844ad1742b70.client4674/status') 2023-06-09T04:42:16.841 INFO:teuthology.orchestra.run.smithi090.stdout:instance: client.4674 (3)192.168.0.2:0/2617128550 2023-06-09T04:42:16.842 INFO:teuthology.orchestra.run.smithi090.stdout:blocklisted: false 2023-06-09T04:42:16.842 INFO:teuthology.orchestra.run.smithi090.stderr:0+1 records in 2023-06-09T04:42:16.842 INFO:teuthology.orchestra.run.smithi090.stderr:0+1 records out 2023-06-09T04:42:16.842 INFO:teuthology.orchestra.run.smithi090.stderr:69 bytes copied, 0.00013744 s, 502 kB/s 2023-06-09T04:42:16.844 INFO:tasks.kclient:client.1 config is {'syntax': 'v2'} 2023-06-09T04:42:16.844 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-06-09T04:42:16.845 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-06-09T04:42:16.845 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-06-09T04:42:17.056 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:17.055+0000 7f443138a700 1 Processor -- start 2023-06-09T04:42:17.057 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:17.055+0000 7f443138a700 1 -- start start 2023-06-09T04:42:17.058 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:17.055+0000 7f443138a700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f442c0b1ca0 0x7f442c160920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:17.058 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:17.055+0000 7f443138a700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f442c15c6b0 con 0x7f442c0b18d0 2023-06-09T04:42:17.058 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:17.055+0000 7f443138a700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f442c0cf6a0 con 0x7f442c0d2400 2023-06-09T04:42:17.058 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:17.055+0000 7f443138a700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f442c0cf980 con 0x7f442c0b1ca0 2023-06-09T04:42:17.059 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:17.055+0000 7f442bfff700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f442c0b18d0 0x7f442c0cee90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:57342/0 (socket says 172.21.15.90:57342) 2023-06-09T04:42:17.059 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:17.055+0000 7f442bfff700 1 -- 172.21.15.90:0/734813028 learned_addr learned my addr 172.21.15.90:0/734813028 (peer_addr_for_me v1:172.21.15.90:0/0) 2023-06-09T04:42:17.059 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:17.055+0000 7f442b7fe700 1 --2- 172.21.15.90:0/734813028 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f442c0b1ca0 0x7f442c160920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:17.060 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:17.059+0000 7f442affd700 1 -- 172.21.15.90:0/734813028 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1533485563 0 0) 0x7f442c0cf6a0 con 0x7f442c0d2400 2023-06-09T04:42:17.060 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:17.059+0000 7f442affd700 1 -- 172.21.15.90:0/734813028 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f44180035d0 con 0x7f442c0d2400 2023-06-09T04:42:17.060 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:17.059+0000 7f442affd700 1 -- 172.21.15.90:0/734813028 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2372471290 0 0) 0x7f442c15c6b0 con 0x7f442c0b18d0 2023-06-09T04:42:17.060 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:17.059+0000 7f442affd700 1 -- 172.21.15.90:0/734813028 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f442c0cf6a0 con 0x7f442c0b18d0 2023-06-09T04:42:17.060 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:17.059+0000 7f442b7fe700 1 -- 172.21.15.90:0/734813028 >> v1:172.21.15.174:6789/0 conn(0x7f442c0d2400 legacy=0x7f442c0d28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:17.061 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:17.059+0000 7f442b7fe700 1 -- 172.21.15.90:0/734813028 >> v1:172.21.15.90:6789/0 conn(0x7f442c0b18d0 legacy=0x7f442c0cee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:17.061 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:17.059+0000 7f442b7fe700 1 -- 172.21.15.90:0/734813028 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f442c0cfc60 con 0x7f442c0b1ca0 2023-06-09T04:42:17.061 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:17.059+0000 7f442b7fe700 1 --2- 172.21.15.90:0/734813028 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f442c0b1ca0 0x7f442c160920 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f44140098b0 tx=0x7f4414009bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a2df948b7da70715 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:17.062 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:17.059+0000 7f442affd700 1 -- 172.21.15.90:0/734813028 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4414011830 con 0x7f442c0b1ca0 2023-06-09T04:42:17.062 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:17.059+0000 7f442affd700 1 -- 172.21.15.90:0/734813028 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4414011990 con 0x7f442c0b1ca0 2023-06-09T04:42:17.062 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:17.059+0000 7f442affd700 1 -- 172.21.15.90:0/734813028 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4414011d20 con 0x7f442c0b1ca0 2023-06-09T04:42:17.062 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:17.059+0000 7f443138a700 1 -- 172.21.15.90:0/734813028 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f442c0b1ca0 msgr2=0x7f442c160920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:17.062 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:17.059+0000 7f443138a700 1 --2- 172.21.15.90:0/734813028 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f442c0b1ca0 0x7f442c160920 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f44140098b0 tx=0x7f4414009bc0 comp rx=0 tx=0).stop 2023-06-09T04:42:17.063 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:17.059+0000 7f443138a700 1 -- 172.21.15.90:0/734813028 shutdown_connections 2023-06-09T04:42:17.063 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:17.059+0000 7f443138a700 1 --2- 172.21.15.90:0/734813028 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f442c0b1ca0 0x7f442c160920 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:17.063 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:17.059+0000 7f443138a700 1 -- 172.21.15.90:0/734813028 >> 172.21.15.90:0/734813028 conn(0x7f442c09b9b0 msgr2=0x7f442c0b55d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:17.063 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:17.059+0000 7f443138a700 1 -- 172.21.15.90:0/734813028 shutdown_connections 2023-06-09T04:42:17.063 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:17.059+0000 7f443138a700 1 -- 172.21.15.90:0/734813028 wait complete. 2023-06-09T04:42:17.065 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:17.063+0000 7f443138a700 1 Processor -- start 2023-06-09T04:42:17.065 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:17.063+0000 7f443138a700 1 -- start start 2023-06-09T04:42:17.067 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:17.067+0000 7f443138a700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f442c0b18d0 0x7f442c1f11e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:17.067 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:17.067+0000 7f443138a700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f442c0b1ca0 0x7f442c0b2d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:17.068 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:17.067+0000 7f443138a700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f442c0d2400 0x7f442c0b3c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:17.068 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:17.067+0000 7f443138a700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f442c0b28b0 con 0x7f442c0d2400 2023-06-09T04:42:17.068 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:17.067+0000 7f443138a700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f442c1f1720 con 0x7f442c0b18d0 2023-06-09T04:42:17.068 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:17.067+0000 7f443138a700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f442c0b4aa0 con 0x7f442c0b1ca0 2023-06-09T04:42:17.069 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:17.067+0000 7f4430b89700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f442c0d2400 0x7f442c0b3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:17.069 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:17.067+0000 7f4430b89700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f442c0d2400 0x7f442c0b3c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:54054/0 (socket says 172.21.15.90:54054) 2023-06-09T04:42:17.069 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:17.067+0000 7f4430b89700 1 -- 172.21.15.90:0/2569621952 learned_addr learned my addr 172.21.15.90:0/2569621952 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:17.069 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:17.067+0000 7f442bfff700 1 --2- 172.21.15.90:0/2569621952 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f442c0b18d0 0x7f442c1f11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:17.069 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:17.067+0000 7f442b7fe700 1 --2- 172.21.15.90:0/2569621952 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f442c0b1ca0 0x7f442c0b2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:17.070 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:17.067+0000 7f4430b89700 1 -- 172.21.15.90:0/2569621952 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f442c0b1ca0 msgr2=0x7f442c0b2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:17.070 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:17.067+0000 7f4430b89700 1 --2- 172.21.15.90:0/2569621952 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f442c0b1ca0 0x7f442c0b2d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:17.070 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:17.067+0000 7f4430b89700 1 -- 172.21.15.90:0/2569621952 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f442c0b18d0 msgr2=0x7f442c1f11e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:17.070 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:17.067+0000 7f4430b89700 1 --2- 172.21.15.90:0/2569621952 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f442c0b18d0 0x7f442c1f11e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:17.070 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:17.067+0000 7f4430b89700 1 -- 172.21.15.90:0/2569621952 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44140094b0 con 0x7f442c0d2400 2023-06-09T04:42:17.070 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:17.067+0000 7f4430b89700 1 --2- 172.21.15.90:0/2569621952 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f442c0d2400 0x7f442c0b3c00 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f442400cc20 tx=0x7f442400cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:17.071 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:17.067+0000 7f4428ff9700 1 -- 172.21.15.90:0/2569621952 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4424003c20 con 0x7f442c0d2400 2023-06-09T04:42:17.071 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:17.067+0000 7f4428ff9700 1 -- 172.21.15.90:0/2569621952 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4424003d80 con 0x7f442c0d2400 2023-06-09T04:42:17.071 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:17.067+0000 7f443138a700 1 -- 172.21.15.90:0/2569621952 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f442c0b3a00 con 0x7f442c0d2400 2023-06-09T04:42:17.071 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:17.067+0000 7f4428ff9700 1 -- 172.21.15.90:0/2569621952 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f442400aae0 con 0x7f442c0d2400 2023-06-09T04:42:17.072 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:17.067+0000 7f443138a700 1 -- 172.21.15.90:0/2569621952 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f442c0b2260 con 0x7f442c0d2400 2023-06-09T04:42:17.072 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:17.071+0000 7f443138a700 1 -- 172.21.15.90:0/2569621952 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f442c0b2a20 con 0x7f442c0d2400 2023-06-09T04:42:17.073 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:17.071+0000 7f4428ff9700 1 -- 172.21.15.90:0/2569621952 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f442400ac40 con 0x7f442c0d2400 2023-06-09T04:42:17.075 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:17.075+0000 7f4428ff9700 1 --2- 172.21.15.90:0/2569621952 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f440c0662f0 0x7f440c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:17.076 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:17.075+0000 7f4428ff9700 1 -- 172.21.15.90:0/2569621952 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4424038030 con 0x7f442c0d2400 2023-06-09T04:42:17.076 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:17.075+0000 7f442bfff700 1 --2- 172.21.15.90:0/2569621952 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f440c0662f0 0x7f440c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:17.076 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:17.075+0000 7f4428ff9700 1 -- 172.21.15.90:0/2569621952 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4424051bf0 con 0x7f442c0d2400 2023-06-09T04:42:17.077 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:17.075+0000 7f442bfff700 1 --2- 172.21.15.90:0/2569621952 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f440c0662f0 0x7f440c0687a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f441c007fd0 tx=0x7f441c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:17.278 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:17.275+0000 7f443138a700 1 -- 172.21.15.90:0/2569621952 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f442c04e380 con 0x7f442c0d2400 2023-06-09T04:42:17.279 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:17.279+0000 7f4428ff9700 1 -- 172.21.15.90:0/2569621952 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f4424055210 con 0x7f442c0d2400 2023-06-09T04:42:17.279 INFO:teuthology.orchestra.run.smithi090.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-06-09T04:42:17.281 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:17.279+0000 7f443138a700 1 -- 172.21.15.90:0/2569621952 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f440c0662f0 msgr2=0x7f440c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:17.282 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:17.279+0000 7f443138a700 1 --2- 172.21.15.90:0/2569621952 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f440c0662f0 0x7f440c0687a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f441c007fd0 tx=0x7f441c009040 comp rx=0 tx=0).stop 2023-06-09T04:42:17.282 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:17.279+0000 7f443138a700 1 -- 172.21.15.90:0/2569621952 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f442c0d2400 msgr2=0x7f442c0b3c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:17.282 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:17.279+0000 7f443138a700 1 --2- 172.21.15.90:0/2569621952 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f442c0d2400 0x7f442c0b3c00 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f442400cc20 tx=0x7f442400cf30 comp rx=0 tx=0).stop 2023-06-09T04:42:17.282 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:17.279+0000 7f443138a700 1 -- 172.21.15.90:0/2569621952 shutdown_connections 2023-06-09T04:42:17.282 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:17.279+0000 7f443138a700 1 --2- 172.21.15.90:0/2569621952 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f440c0662f0 0x7f440c0687a0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:17.282 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:17.279+0000 7f443138a700 1 --2- 172.21.15.90:0/2569621952 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f442c0d2400 0x7f442c0b3c00 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:17.282 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:17.279+0000 7f443138a700 1 --2- 172.21.15.90:0/2569621952 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f442c0b1ca0 0x7f442c0b2d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:17.283 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:17.279+0000 7f443138a700 1 --2- 172.21.15.90:0/2569621952 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f442c0b18d0 0x7f442c1f11e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:17.283 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:17.279+0000 7f443138a700 1 -- 172.21.15.90:0/2569621952 >> 172.21.15.90:0/2569621952 conn(0x7f442c09b9b0 msgr2=0x7f442c15bbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:17.283 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:17.279+0000 7f443138a700 1 -- 172.21.15.90:0/2569621952 shutdown_connections 2023-06-09T04:42:17.283 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:17.279+0000 7f443138a700 1 -- 172.21.15.90:0/2569621952 wait complete. 2023-06-09T04:42:17.303 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-06-09T04:42:17.303 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-06-09T04:42:17.304 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi174.front.sepia.ceph.com 2023-06-09T04:42:17.304 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-06-09T04:42:17.304 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-06-09T04:42:17.304 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-06-09T04:42:17.304 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-06-09T04:42:17.304 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-06-09T04:42:17.305 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-06-09T04:42:17.305 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:42:17.305 DEBUG:teuthology.orchestra.run.smithi174:> ip addr 2023-06-09T04:42:17.323 INFO:teuthology.orchestra.run.smithi174.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-06-09T04:42:17.324 INFO:teuthology.orchestra.run.smithi174.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-06-09T04:42:17.324 INFO:teuthology.orchestra.run.smithi174.stdout: inet 127.0.0.1/8 scope host lo 2023-06-09T04:42:17.324 INFO:teuthology.orchestra.run.smithi174.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:42:17.324 INFO:teuthology.orchestra.run.smithi174.stdout: inet6 ::1/128 scope host 2023-06-09T04:42:17.324 INFO:teuthology.orchestra.run.smithi174.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:42:17.325 INFO:teuthology.orchestra.run.smithi174.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-09T04:42:17.325 INFO:teuthology.orchestra.run.smithi174.stdout: link/ether 0c:c4:7a:d9:36:e0 brd ff:ff:ff:ff:ff:ff 2023-06-09T04:42:17.325 INFO:teuthology.orchestra.run.smithi174.stdout: altname enp7s0f0 2023-06-09T04:42:17.325 INFO:teuthology.orchestra.run.smithi174.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-09T04:42:17.325 INFO:teuthology.orchestra.run.smithi174.stdout: link/ether 0c:c4:7a:d9:36:e1 brd ff:ff:ff:ff:ff:ff 2023-06-09T04:42:17.325 INFO:teuthology.orchestra.run.smithi174.stdout: altname enp7s0f1 2023-06-09T04:42:17.325 INFO:teuthology.orchestra.run.smithi174.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-09T04:42:17.326 INFO:teuthology.orchestra.run.smithi174.stdout: link/ether 0c:c4:7a:88:77:1a brd ff:ff:ff:ff:ff:ff 2023-06-09T04:42:17.326 INFO:teuthology.orchestra.run.smithi174.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-06-09T04:42:17.326 INFO:teuthology.orchestra.run.smithi174.stdout: link/ether 0c:c4:7a:88:77:1b brd ff:ff:ff:ff:ff:ff 2023-06-09T04:42:17.326 INFO:teuthology.orchestra.run.smithi174.stdout: inet 172.21.15.174/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-06-09T04:42:17.326 INFO:teuthology.orchestra.run.smithi174.stdout: valid_lft 42376sec preferred_lft 42376sec 2023-06-09T04:42:17.326 INFO:teuthology.orchestra.run.smithi174.stdout: inet6 fe80::ec4:7aff:fe88:771b/64 scope link 2023-06-09T04:42:17.326 INFO:teuthology.orchestra.run.smithi174.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:42:17.326 INFO:teuthology.orchestra.run.smithi174.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-06-09T04:42:17.327 INFO:teuthology.orchestra.run.smithi174.stdout: link/ether 02:42:7e:b8:eb:5a brd ff:ff:ff:ff:ff:ff 2023-06-09T04:42:17.327 INFO:teuthology.orchestra.run.smithi174.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-06-09T04:42:17.327 INFO:teuthology.orchestra.run.smithi174.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:42:17.327 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-06-09T04:42:17.328 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:42:17.328 DEBUG:teuthology.orchestra.run.smithi174:> (cd / && exec bash -c ' 2023-06-09T04:42:17.329 DEBUG:teuthology.orchestra.run.smithi174:> set -e 2023-06-09T04:42:17.329 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip link add name ceph-brx type bridge 2023-06-09T04:42:17.330 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip addr flush dev ceph-brx 2023-06-09T04:42:17.330 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip link set ceph-brx up 2023-06-09T04:42:17.331 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-06-09T04:42:17.331 DEBUG:teuthology.orchestra.run.smithi174:> ') 2023-06-09T04:42:17.481 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:42:17.482 DEBUG:teuthology.orchestra.run.smithi174:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-06-09T04:42:17.516 INFO:teuthology.orchestra.run.smithi174.stdout:1 2023-06-09T04:42:17.519 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:42:17.520 DEBUG:teuthology.orchestra.run.smithi174:> route 2023-06-09T04:42:17.597 INFO:teuthology.orchestra.run.smithi174.stdout:Kernel IP routing table 2023-06-09T04:42:17.597 INFO:teuthology.orchestra.run.smithi174.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-06-09T04:42:17.597 INFO:teuthology.orchestra.run.smithi174.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-06-09T04:42:17.597 INFO:teuthology.orchestra.run.smithi174.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-06-09T04:42:17.597 INFO:teuthology.orchestra.run.smithi174.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-06-09T04:42:17.598 INFO:teuthology.orchestra.run.smithi174.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2023-06-09T04:42:17.598 INFO:teuthology.orchestra.run.smithi174.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-06-09T04:42:17.598 INFO:teuthology.orchestra.run.smithi174.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-06-09T04:42:17.598 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:42:17.599 DEBUG:teuthology.orchestra.run.smithi174:> (cd / && exec bash -c ' 2023-06-09T04:42:17.599 DEBUG:teuthology.orchestra.run.smithi174:> set -e 2023-06-09T04:42:17.600 DEBUG:teuthology.orchestra.run.smithi174:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-06-09T04:42:17.600 DEBUG:teuthology.orchestra.run.smithi174:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-06-09T04:42:17.601 DEBUG:teuthology.orchestra.run.smithi174:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-06-09T04:42:17.601 DEBUG:teuthology.orchestra.run.smithi174:> ') 2023-06-09T04:42:17.733 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:42:17.734 DEBUG:teuthology.orchestra.run.smithi174:> ip netns list 2023-06-09T04:42:17.753 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:42:17.753 DEBUG:teuthology.orchestra.run.smithi174:> ip netns list-id 2023-06-09T04:42:17.812 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:42:17.813 DEBUG:teuthology.orchestra.run.smithi174:> (cd / && exec bash -c ' 2023-06-09T04:42:17.813 DEBUG:teuthology.orchestra.run.smithi174:> set -e 2023-06-09T04:42:17.813 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-06-09T04:42:17.814 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-06-09T04:42:17.814 DEBUG:teuthology.orchestra.run.smithi174:> ') 2023-06-09T04:42:17.936 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-06-09T04:42:17.937 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:42:17.937 DEBUG:teuthology.orchestra.run.smithi174:> (cd / && exec bash -c ' 2023-06-09T04:42:17.937 DEBUG:teuthology.orchestra.run.smithi174:> set -e 2023-06-09T04:42:17.938 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-06-09T04:42:17.938 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-06-09T04:42:17.938 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-06-09T04:42:17.939 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-06-09T04:42:17.939 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-06-09T04:42:17.939 DEBUG:teuthology.orchestra.run.smithi174:> ') 2023-06-09T04:42:18.101 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:42:18.102 DEBUG:teuthology.orchestra.run.smithi174:> (cd / && exec bash -c ' 2023-06-09T04:42:18.103 DEBUG:teuthology.orchestra.run.smithi174:> set -e 2023-06-09T04:42:18.103 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip link set brx.0 up 2023-06-09T04:42:18.104 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip link set dev brx.0 master ceph-brx 2023-06-09T04:42:18.104 DEBUG:teuthology.orchestra.run.smithi174:> ') 2023-06-09T04:42:18.114 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:42:18.121 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:42:18.175 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-09T04:42:18.176 DEBUG:teuthology.orchestra.run.smithi174:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-06-09T04:42:18.237 INFO:teuthology.orchestra.run.smithi174.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-06-09T04:42:18.238 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-09T04:42:18.238 DEBUG:teuthology.orchestra.run.smithi174:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-06-09T04:42:18.292 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-06-09T04:42:18.293 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:42:18.293 DEBUG:teuthology.orchestra.run.smithi174:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-06-09T04:42:18.432 INFO:teuthology.orchestra.run.smithi174.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-06-09T04:42:18.433 INFO:teuthology.orchestra.run.smithi174.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-06-09T04:42:18.567 INFO:teuthology.orchestra.run.smithi174.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-06-09T04:42:18.567 INFO:teuthology.orchestra.run.smithi174.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-06-09T04:42:18.567 INFO:teuthology.orchestra.run.smithi174.stdout:mount.ceph: resolved to: "172.21.15.90:3300,172.21.15.174:3300,172.21.15.174:3301" 2023-06-09T04:42:18.567 INFO:teuthology.orchestra.run.smithi174.stdout:mount.ceph: trying mount with new device syntax: 1@700369c0-a111-43b4-9415-844ad1742b70.cephfs=/ 2023-06-09T04:42:18.567 INFO:teuthology.orchestra.run.smithi174.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.90:3300/172.21.15.174:3300/172.21.15.174:3301" will pass to kernel 2023-06-09T04:42:18.573 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-06-09T04:42:18.574 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:42:18.574 DEBUG:teuthology.orchestra.run.smithi174:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-06-09T04:42:18.605 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:42:18.605 DEBUG:teuthology.orchestra.run.smithi174:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-06-09T04:42:18.682 INFO:teuthology.orchestra.run.smithi174.stdout:client4553 2023-06-09T04:42:18.682 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2023-06-09T04:42:18.682 DEBUG:teuthology.orchestra.run.smithi174:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-09T04:42:18.742 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:42:18.742 DEBUG:teuthology.orchestra.run.smithi174:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-06-09T04:42:18.814 INFO:teuthology.orchestra.run.smithi174.stdout:client4553 2023-06-09T04:42:18.814 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:42:18.815 DEBUG:teuthology.orchestra.run.smithi174:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-06-09T04:42:18.882 INFO:teuthology.orchestra.run.smithi174.stdout:client4553 2023-06-09T04:42:18.883 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:42:18.883 DEBUG:teuthology.orchestra.run.smithi174:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/700369c0-a111-43b4-9415-844ad1742b70.client4553/status') 2023-06-09T04:42:18.963 INFO:teuthology.orchestra.run.smithi174.stdout:instance: client.4553 (3)192.168.0.1:0/2305017086 2023-06-09T04:42:18.964 INFO:teuthology.orchestra.run.smithi174.stdout:blocklisted: false 2023-06-09T04:42:18.964 INFO:teuthology.orchestra.run.smithi174.stderr:0+1 records in 2023-06-09T04:42:18.964 INFO:teuthology.orchestra.run.smithi174.stderr:0+1 records out 2023-06-09T04:42:18.964 INFO:teuthology.orchestra.run.smithi174.stderr:69 bytes copied, 0.000156514 s, 441 kB/s 2023-06-09T04:42:18.966 INFO:tasks.kclient:client.3 config is {'syntax': 'v2'} 2023-06-09T04:42:18.966 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-06-09T04:42:18.967 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-06-09T04:42:18.967 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-06-09T04:42:19.148 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:19.147+0000 7f4868f9e700 1 Processor -- start 2023-06-09T04:42:19.148 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:19.147+0000 7f4868f9e700 1 -- start start 2023-06-09T04:42:19.150 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:19.147+0000 7f4868f9e700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f48640cafb0 0x7f48640cc0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:19.150 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:19.147+0000 7f4868f9e700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48640cd8a0 con 0x7f486415deb0 2023-06-09T04:42:19.150 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:19.147+0000 7f4868f9e700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48640cb420 con 0x7f4864154350 2023-06-09T04:42:19.150 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:19.147+0000 7f4868f9e700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4864154720 con 0x7f48640cafb0 2023-06-09T04:42:19.151 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:19.147+0000 7f4862ffd700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f48640cafb0 0x7f48640cc0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:19.151 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:19.147+0000 7f4862ffd700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f48640cafb0 0x7f48640cc0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:54058/0 (socket says 172.21.15.90:54058) 2023-06-09T04:42:19.151 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:19.147+0000 7f4862ffd700 1 -- 172.21.15.90:0/2305277483 learned_addr learned my addr 172.21.15.90:0/2305277483 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:19.152 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:19.151+0000 7f4862ffd700 1 -- 172.21.15.90:0/2305277483 >> v1:172.21.15.174:6789/0 conn(0x7f4864154350 legacy=0x7f486415d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:19.152 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:19.151+0000 7f4862ffd700 1 -- 172.21.15.90:0/2305277483 >> v1:172.21.15.90:6789/0 conn(0x7f486415deb0 legacy=0x7f4864069c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:19.152 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:19.151+0000 7f4862ffd700 1 -- 172.21.15.90:0/2305277483 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48640cdaf0 con 0x7f48640cafb0 2023-06-09T04:42:19.152 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:19.151+0000 7f4862ffd700 1 --2- 172.21.15.90:0/2305277483 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f48640cafb0 0x7f48640cc0f0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f4858009910 tx=0x7f4858009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52128a4b3621b576 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:19.153 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:19.151+0000 7f48627fc700 1 -- 172.21.15.90:0/2305277483 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4858004230 con 0x7f48640cafb0 2023-06-09T04:42:19.153 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:19.151+0000 7f48627fc700 1 -- 172.21.15.90:0/2305277483 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4858004390 con 0x7f48640cafb0 2023-06-09T04:42:19.153 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:19.151+0000 7f48627fc700 1 -- 172.21.15.90:0/2305277483 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4858009e60 con 0x7f48640cafb0 2023-06-09T04:42:19.154 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:19.151+0000 7f4868f9e700 1 -- 172.21.15.90:0/2305277483 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f48640cafb0 msgr2=0x7f48640cc0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:19.154 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:19.151+0000 7f4868f9e700 1 --2- 172.21.15.90:0/2305277483 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f48640cafb0 0x7f48640cc0f0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f4858009910 tx=0x7f4858009c20 comp rx=0 tx=0).stop 2023-06-09T04:42:19.154 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:19.151+0000 7f4868f9e700 1 -- 172.21.15.90:0/2305277483 shutdown_connections 2023-06-09T04:42:19.154 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:19.151+0000 7f4868f9e700 1 --2- 172.21.15.90:0/2305277483 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f48640cafb0 0x7f48640cc0f0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:19.154 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:19.151+0000 7f4868f9e700 1 -- 172.21.15.90:0/2305277483 >> 172.21.15.90:0/2305277483 conn(0x7f486406c690 msgr2=0x7f48640aff00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:19.154 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:19.151+0000 7f4868f9e700 1 -- 172.21.15.90:0/2305277483 shutdown_connections 2023-06-09T04:42:19.154 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:19.151+0000 7f4868f9e700 1 -- 172.21.15.90:0/2305277483 wait complete. 2023-06-09T04:42:19.157 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:19.155+0000 7f4868f9e700 1 Processor -- start 2023-06-09T04:42:19.158 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:19.155+0000 7f4868f9e700 1 -- start start 2023-06-09T04:42:19.160 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:19.159+0000 7f4868f9e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f48640cafb0 0x7f4864070830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:19.161 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:19.159+0000 7f4868f9e700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4864154350 0x7f48641e3fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:19.161 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:19.159+0000 7f4868f9e700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f486415deb0 0x7f486414bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:19.161 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:19.159+0000 7f4868f9e700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4864071390 con 0x7f4864154350 2023-06-09T04:42:19.161 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:19.159+0000 7f4868f9e700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48640710b0 con 0x7f486415deb0 2023-06-09T04:42:19.161 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:19.159+0000 7f4868f9e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f486415c050 con 0x7f48640cafb0 2023-06-09T04:42:19.161 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:19.159+0000 7f4862ffd700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4864154350 0x7f48641e3fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:19.161 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:19.159+0000 7f4862ffd700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4864154350 0x7f48641e3fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:54070/0 (socket says 172.21.15.90:54070) 2023-06-09T04:42:19.162 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:19.159+0000 7f4862ffd700 1 -- 172.21.15.90:0/52300394 learned_addr learned my addr 172.21.15.90:0/52300394 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:19.162 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:19.159+0000 7f48637fe700 1 --2- 172.21.15.90:0/52300394 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f48640cafb0 0x7f4864070830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:19.163 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:19.159+0000 7f4863fff700 1 --2- 172.21.15.90:0/52300394 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f486415deb0 0x7f486414bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:19.163 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:19.159+0000 7f4862ffd700 1 -- 172.21.15.90:0/52300394 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f48640cafb0 msgr2=0x7f4864070830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:19.163 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:19.159+0000 7f4862ffd700 1 --2- 172.21.15.90:0/52300394 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f48640cafb0 0x7f4864070830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:19.163 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:19.159+0000 7f4862ffd700 1 -- 172.21.15.90:0/52300394 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f486415deb0 msgr2=0x7f486414bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:19.163 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:19.159+0000 7f4862ffd700 1 --2- 172.21.15.90:0/52300394 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f486415deb0 0x7f486414bb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:19.163 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:19.159+0000 7f4862ffd700 1 -- 172.21.15.90:0/52300394 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4858009570 con 0x7f4864154350 2023-06-09T04:42:19.163 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:19.159+0000 7f4862ffd700 1 --2- 172.21.15.90:0/52300394 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4864154350 0x7f48641e3fb0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f4858004000 tx=0x7f4858004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:19.164 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:19.159+0000 7f484bfff700 1 -- 172.21.15.90:0/52300394 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48580036c0 con 0x7f4864154350 2023-06-09T04:42:19.164 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:19.159+0000 7f484bfff700 1 -- 172.21.15.90:0/52300394 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4858003840 con 0x7f4864154350 2023-06-09T04:42:19.164 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:19.159+0000 7f4868f9e700 1 -- 172.21.15.90:0/52300394 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f486415c330 con 0x7f4864154350 2023-06-09T04:42:19.164 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:19.159+0000 7f484bfff700 1 -- 172.21.15.90:0/52300394 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4858003bf0 con 0x7f4864154350 2023-06-09T04:42:19.164 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:19.159+0000 7f4868f9e700 1 -- 172.21.15.90:0/52300394 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4864070d70 con 0x7f4864154350 2023-06-09T04:42:19.165 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:19.163+0000 7f4868f9e700 1 -- 172.21.15.90:0/52300394 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f486406b390 con 0x7f4864154350 2023-06-09T04:42:19.166 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:19.163+0000 7f484bfff700 1 -- 172.21.15.90:0/52300394 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4858022070 con 0x7f4864154350 2023-06-09T04:42:19.168 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:19.167+0000 7f484bfff700 1 --2- 172.21.15.90:0/52300394 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f48500662f0 0x7f48500687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:19.168 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:19.167+0000 7f484bfff700 1 -- 172.21.15.90:0/52300394 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4858085920 con 0x7f4864154350 2023-06-09T04:42:19.169 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:19.167+0000 7f48637fe700 1 --2- 172.21.15.90:0/52300394 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f48500662f0 0x7f48500687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:19.170 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:19.167+0000 7f48637fe700 1 --2- 172.21.15.90:0/52300394 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f48500662f0 0x7f48500687a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f48540016e0 tx=0x7f4854009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:19.172 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:19.171+0000 7f484bfff700 1 -- 172.21.15.90:0/52300394 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4858052e30 con 0x7f4864154350 2023-06-09T04:42:19.381 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:19.379+0000 7f4868f9e700 1 -- 172.21.15.90:0/52300394 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f486415c850 con 0x7f4864154350 2023-06-09T04:42:19.381 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:19.379+0000 7f484bfff700 1 -- 172.21.15.90:0/52300394 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f486415c850 con 0x7f4864154350 2023-06-09T04:42:19.382 INFO:teuthology.orchestra.run.smithi090.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-06-09T04:42:19.386 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:19.383+0000 7f4868f9e700 1 -- 172.21.15.90:0/52300394 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f48500662f0 msgr2=0x7f48500687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:19.386 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:19.383+0000 7f4868f9e700 1 --2- 172.21.15.90:0/52300394 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f48500662f0 0x7f48500687a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f48540016e0 tx=0x7f4854009040 comp rx=0 tx=0).stop 2023-06-09T04:42:19.386 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:19.383+0000 7f4868f9e700 1 -- 172.21.15.90:0/52300394 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4864154350 msgr2=0x7f48641e3fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:19.386 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:19.383+0000 7f4868f9e700 1 --2- 172.21.15.90:0/52300394 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4864154350 0x7f48641e3fb0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f4858004000 tx=0x7f4858004770 comp rx=0 tx=0).stop 2023-06-09T04:42:19.387 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:19.383+0000 7f4868f9e700 1 -- 172.21.15.90:0/52300394 shutdown_connections 2023-06-09T04:42:19.387 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:19.383+0000 7f4868f9e700 1 --2- 172.21.15.90:0/52300394 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f48500662f0 0x7f48500687a0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:19.388 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:19.383+0000 7f4868f9e700 1 --2- 172.21.15.90:0/52300394 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f486415deb0 0x7f486414bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:19.388 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:19.383+0000 7f4868f9e700 1 --2- 172.21.15.90:0/52300394 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4864154350 0x7f48641e3fb0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:19.388 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:19.383+0000 7f4868f9e700 1 --2- 172.21.15.90:0/52300394 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f48640cafb0 0x7f4864070830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:19.388 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:19.383+0000 7f4868f9e700 1 -- 172.21.15.90:0/52300394 >> 172.21.15.90:0/52300394 conn(0x7f486406c690 msgr2=0x7f486415a680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:19.388 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:19.383+0000 7f4868f9e700 1 -- 172.21.15.90:0/52300394 shutdown_connections 2023-06-09T04:42:19.388 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:19.383+0000 7f4868f9e700 1 -- 172.21.15.90:0/52300394 wait complete. 2023-06-09T04:42:19.408 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-06-09T04:42:19.408 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-06-09T04:42:19.409 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi174.front.sepia.ceph.com 2023-06-09T04:42:19.409 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-06-09T04:42:19.409 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-06-09T04:42:19.409 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-06-09T04:42:19.409 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-06-09T04:42:19.410 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-06-09T04:42:19.410 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-06-09T04:42:19.410 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:42:19.410 DEBUG:teuthology.orchestra.run.smithi174:> ip addr 2023-06-09T04:42:19.429 INFO:teuthology.orchestra.run.smithi174.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-06-09T04:42:19.429 INFO:teuthology.orchestra.run.smithi174.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-06-09T04:42:19.429 INFO:teuthology.orchestra.run.smithi174.stdout: inet 127.0.0.1/8 scope host lo 2023-06-09T04:42:19.429 INFO:teuthology.orchestra.run.smithi174.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:42:19.430 INFO:teuthology.orchestra.run.smithi174.stdout: inet6 ::1/128 scope host 2023-06-09T04:42:19.430 INFO:teuthology.orchestra.run.smithi174.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:42:19.430 INFO:teuthology.orchestra.run.smithi174.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-09T04:42:19.430 INFO:teuthology.orchestra.run.smithi174.stdout: link/ether 0c:c4:7a:d9:36:e0 brd ff:ff:ff:ff:ff:ff 2023-06-09T04:42:19.430 INFO:teuthology.orchestra.run.smithi174.stdout: altname enp7s0f0 2023-06-09T04:42:19.430 INFO:teuthology.orchestra.run.smithi174.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-09T04:42:19.430 INFO:teuthology.orchestra.run.smithi174.stdout: link/ether 0c:c4:7a:d9:36:e1 brd ff:ff:ff:ff:ff:ff 2023-06-09T04:42:19.431 INFO:teuthology.orchestra.run.smithi174.stdout: altname enp7s0f1 2023-06-09T04:42:19.431 INFO:teuthology.orchestra.run.smithi174.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-09T04:42:19.431 INFO:teuthology.orchestra.run.smithi174.stdout: link/ether 0c:c4:7a:88:77:1a brd ff:ff:ff:ff:ff:ff 2023-06-09T04:42:19.431 INFO:teuthology.orchestra.run.smithi174.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-06-09T04:42:19.431 INFO:teuthology.orchestra.run.smithi174.stdout: link/ether 0c:c4:7a:88:77:1b brd ff:ff:ff:ff:ff:ff 2023-06-09T04:42:19.431 INFO:teuthology.orchestra.run.smithi174.stdout: inet 172.21.15.174/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-06-09T04:42:19.431 INFO:teuthology.orchestra.run.smithi174.stdout: valid_lft 42373sec preferred_lft 42373sec 2023-06-09T04:42:19.431 INFO:teuthology.orchestra.run.smithi174.stdout: inet6 fe80::ec4:7aff:fe88:771b/64 scope link 2023-06-09T04:42:19.432 INFO:teuthology.orchestra.run.smithi174.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:42:19.432 INFO:teuthology.orchestra.run.smithi174.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-06-09T04:42:19.432 INFO:teuthology.orchestra.run.smithi174.stdout: link/ether 02:42:7e:b8:eb:5a brd ff:ff:ff:ff:ff:ff 2023-06-09T04:42:19.432 INFO:teuthology.orchestra.run.smithi174.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-06-09T04:42:19.432 INFO:teuthology.orchestra.run.smithi174.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:42:19.432 INFO:teuthology.orchestra.run.smithi174.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-06-09T04:42:19.432 INFO:teuthology.orchestra.run.smithi174.stdout: link/ether be:49:e3:32:6b:71 brd ff:ff:ff:ff:ff:ff 2023-06-09T04:42:19.433 INFO:teuthology.orchestra.run.smithi174.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-06-09T04:42:19.433 INFO:teuthology.orchestra.run.smithi174.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:42:19.433 INFO:teuthology.orchestra.run.smithi174.stdout: inet6 fe80::f06e:76ff:fe94:6ca0/64 scope link 2023-06-09T04:42:19.433 INFO:teuthology.orchestra.run.smithi174.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:42:19.433 INFO:teuthology.orchestra.run.smithi174.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-06-09T04:42:19.433 INFO:teuthology.orchestra.run.smithi174.stdout: link/ether be:49:e3:32:6b:71 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-06-09T04:42:19.433 INFO:teuthology.orchestra.run.smithi174.stdout: inet6 fe80::bc49:e3ff:fe32:6b71/64 scope link tentative 2023-06-09T04:42:19.433 INFO:teuthology.orchestra.run.smithi174.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:42:19.434 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:42:19.435 DEBUG:teuthology.orchestra.run.smithi174:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-06-09T04:42:19.518 INFO:teuthology.orchestra.run.smithi174.stdout:1 2023-06-09T04:42:19.521 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:42:19.521 DEBUG:teuthology.orchestra.run.smithi174:> route 2023-06-09T04:42:19.582 INFO:teuthology.orchestra.run.smithi174.stdout:Kernel IP routing table 2023-06-09T04:42:19.582 INFO:teuthology.orchestra.run.smithi174.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-06-09T04:42:19.582 INFO:teuthology.orchestra.run.smithi174.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-06-09T04:42:19.583 INFO:teuthology.orchestra.run.smithi174.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-06-09T04:42:19.583 INFO:teuthology.orchestra.run.smithi174.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-06-09T04:42:19.583 INFO:teuthology.orchestra.run.smithi174.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2023-06-09T04:42:19.583 INFO:teuthology.orchestra.run.smithi174.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-06-09T04:42:19.583 INFO:teuthology.orchestra.run.smithi174.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-06-09T04:42:19.584 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:42:19.584 DEBUG:teuthology.orchestra.run.smithi174:> (cd / && exec bash -c ' 2023-06-09T04:42:19.585 DEBUG:teuthology.orchestra.run.smithi174:> set -e 2023-06-09T04:42:19.585 DEBUG:teuthology.orchestra.run.smithi174:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-06-09T04:42:19.585 DEBUG:teuthology.orchestra.run.smithi174:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-06-09T04:42:19.585 DEBUG:teuthology.orchestra.run.smithi174:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-06-09T04:42:19.585 DEBUG:teuthology.orchestra.run.smithi174:> ') 2023-06-09T04:42:19.717 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:42:19.718 DEBUG:teuthology.orchestra.run.smithi174:> ip netns list 2023-06-09T04:42:19.731 INFO:teuthology.orchestra.run.smithi174.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-06-09T04:42:19.732 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:42:19.732 DEBUG:teuthology.orchestra.run.smithi174:> ip netns list-id 2023-06-09T04:42:19.796 INFO:teuthology.orchestra.run.smithi174.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-06-09T04:42:19.797 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:42:19.797 DEBUG:teuthology.orchestra.run.smithi174:> (cd / && exec bash -c ' 2023-06-09T04:42:19.797 DEBUG:teuthology.orchestra.run.smithi174:> set -e 2023-06-09T04:42:19.798 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-06-09T04:42:19.798 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-06-09T04:42:19.798 DEBUG:teuthology.orchestra.run.smithi174:> ') 2023-06-09T04:42:19.909 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:42:19.909 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-06-09T04:42:19.941 INFO:teuthology.orchestra.run.smithi174.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-06-09T04:42:19.942 INFO:teuthology.orchestra.run.smithi174.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-06-09T04:42:19.942 INFO:teuthology.orchestra.run.smithi174.stdout: inet 127.0.0.1/8 scope host lo 2023-06-09T04:42:19.942 INFO:teuthology.orchestra.run.smithi174.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:42:19.942 INFO:teuthology.orchestra.run.smithi174.stdout: inet6 ::1/128 scope host 2023-06-09T04:42:19.942 INFO:teuthology.orchestra.run.smithi174.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:42:19.942 INFO:teuthology.orchestra.run.smithi174.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-06-09T04:42:19.942 INFO:teuthology.orchestra.run.smithi174.stdout: link/ether e6:27:e0:c4:70:73 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-06-09T04:42:19.943 INFO:teuthology.orchestra.run.smithi174.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-06-09T04:42:19.943 INFO:teuthology.orchestra.run.smithi174.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:42:19.943 INFO:teuthology.orchestra.run.smithi174.stdout: inet6 fe80::e427:e0ff:fec4:7073/64 scope link 2023-06-09T04:42:19.943 INFO:teuthology.orchestra.run.smithi174.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:42:19.945 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:42:19.945 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-06-09T04:42:20.023 INFO:teuthology.orchestra.run.smithi174.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-06-09T04:42:20.024 INFO:teuthology.orchestra.run.smithi174.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-06-09T04:42:20.024 INFO:teuthology.orchestra.run.smithi174.stdout: inet 127.0.0.1/8 scope host lo 2023-06-09T04:42:20.024 INFO:teuthology.orchestra.run.smithi174.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:42:20.024 INFO:teuthology.orchestra.run.smithi174.stdout: inet6 ::1/128 scope host 2023-06-09T04:42:20.024 INFO:teuthology.orchestra.run.smithi174.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:42:20.025 INFO:teuthology.orchestra.run.smithi174.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-06-09T04:42:20.025 INFO:teuthology.orchestra.run.smithi174.stdout: link/ether e6:27:e0:c4:70:73 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-06-09T04:42:20.025 INFO:teuthology.orchestra.run.smithi174.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-06-09T04:42:20.025 INFO:teuthology.orchestra.run.smithi174.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:42:20.025 INFO:teuthology.orchestra.run.smithi174.stdout: inet6 fe80::e427:e0ff:fec4:7073/64 scope link 2023-06-09T04:42:20.025 INFO:teuthology.orchestra.run.smithi174.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:42:20.027 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-06-09T04:42:20.028 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:42:20.028 DEBUG:teuthology.orchestra.run.smithi174:> (cd / && exec bash -c ' 2023-06-09T04:42:20.028 DEBUG:teuthology.orchestra.run.smithi174:> set -e 2023-06-09T04:42:20.028 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-06-09T04:42:20.029 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-06-09T04:42:20.029 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-06-09T04:42:20.029 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-06-09T04:42:20.029 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-06-09T04:42:20.030 DEBUG:teuthology.orchestra.run.smithi174:> ') 2023-06-09T04:42:20.221 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:42:20.221 DEBUG:teuthology.orchestra.run.smithi174:> (cd / && exec bash -c ' 2023-06-09T04:42:20.221 DEBUG:teuthology.orchestra.run.smithi174:> set -e 2023-06-09T04:42:20.222 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip link set brx.1 up 2023-06-09T04:42:20.222 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip link set dev brx.1 master ceph-brx 2023-06-09T04:42:20.222 DEBUG:teuthology.orchestra.run.smithi174:> ') 2023-06-09T04:42:20.295 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-09T04:42:20.295 DEBUG:teuthology.orchestra.run.smithi174:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-06-09T04:42:20.309 INFO:teuthology.orchestra.run.smithi174.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-06-09T04:42:20.310 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-09T04:42:20.310 DEBUG:teuthology.orchestra.run.smithi174:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-06-09T04:42:20.376 INFO:tasks.cephfs.kernel_mount:mounting using device: 3@.cephfs=/ 2023-06-09T04:42:20.376 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:42:20.377 DEBUG:teuthology.orchestra.run.smithi174:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 3@.cephfs=/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-06-09T04:42:20.511 INFO:teuthology.orchestra.run.smithi174.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-06-09T04:42:20.511 INFO:teuthology.orchestra.run.smithi174.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-06-09T04:42:20.535 INFO:teuthology.orchestra.run.smithi174.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-06-09T04:42:20.535 INFO:teuthology.orchestra.run.smithi174.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-06-09T04:42:20.536 INFO:teuthology.orchestra.run.smithi174.stdout:mount.ceph: resolved to: "172.21.15.90:3300,172.21.15.174:3300,172.21.15.174:3301" 2023-06-09T04:42:20.536 INFO:teuthology.orchestra.run.smithi174.stdout:mount.ceph: trying mount with new device syntax: 3@700369c0-a111-43b4-9415-844ad1742b70.cephfs=/ 2023-06-09T04:42:20.536 INFO:teuthology.orchestra.run.smithi174.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,ms_mode=prefer-crc,key=3,mon_addr=172.21.15.90:3300/172.21.15.174:3300/172.21.15.174:3301" will pass to kernel 2023-06-09T04:42:20.541 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-06-09T04:42:20.542 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:42:20.542 DEBUG:teuthology.orchestra.run.smithi174:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-06-09T04:42:20.574 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:42:20.575 DEBUG:teuthology.orchestra.run.smithi174:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-06-09T04:42:20.643 INFO:teuthology.orchestra.run.smithi174.stdout:client4692 2023-06-09T04:42:20.643 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2023-06-09T04:42:20.643 DEBUG:teuthology.orchestra.run.smithi174:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-09T04:42:20.708 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:42:20.708 DEBUG:teuthology.orchestra.run.smithi174:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-06-09T04:42:20.776 INFO:teuthology.orchestra.run.smithi174.stdout:client4692 2023-06-09T04:42:20.777 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:42:20.777 DEBUG:teuthology.orchestra.run.smithi174:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-06-09T04:42:20.845 INFO:teuthology.orchestra.run.smithi174.stdout:client4692 2023-06-09T04:42:20.845 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:42:20.846 DEBUG:teuthology.orchestra.run.smithi174:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/700369c0-a111-43b4-9415-844ad1742b70.client4692/status') 2023-06-09T04:42:20.923 INFO:teuthology.orchestra.run.smithi174.stdout:instance: client.4692 (3)172.21.15.174:0/4002371290 2023-06-09T04:42:20.923 INFO:teuthology.orchestra.run.smithi174.stdout:blocklisted: false 2023-06-09T04:42:20.924 INFO:teuthology.orchestra.run.smithi174.stderr:0+1 records in 2023-06-09T04:42:20.924 INFO:teuthology.orchestra.run.smithi174.stderr:0+1 records out 2023-06-09T04:42:20.924 INFO:teuthology.orchestra.run.smithi174.stderr:71 bytes copied, 0.000136123 s, 522 kB/s 2023-06-09T04:42:20.925 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-06-09T04:42:20.942 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T04:42:21.119 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.119+0000 7f2a3c836700 1 Processor -- start 2023-06-09T04:42:21.120 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.119+0000 7f2a3c836700 1 -- start start 2023-06-09T04:42:21.121 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.119+0000 7f2a3c836700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2a380b18d0 0x7f2a38160920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:21.121 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.119+0000 7f2a3c836700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f2a380b1ca0 0x7f2a380cee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:21.122 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.119+0000 7f2a3c836700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a3815c6b0 con 0x7f2a380d2400 2023-06-09T04:42:21.122 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.119+0000 7f2a3c836700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a380cf3d0 con 0x7f2a380b1ca0 2023-06-09T04:42:21.122 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.119+0000 7f2a3c836700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a380cf6a0 con 0x7f2a380b18d0 2023-06-09T04:42:21.123 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.119+0000 7f2a37fff700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f2a380d2400 0x7f2a380d28a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:57348/0 (socket says 172.21.15.90:57348) 2023-06-09T04:42:21.123 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.119+0000 7f2a37fff700 1 -- 172.21.15.90:0/1829499280 learned_addr learned my addr 172.21.15.90:0/1829499280 (peer_addr_for_me v1:172.21.15.90:0/0) 2023-06-09T04:42:21.123 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.119+0000 7f2a377fe700 1 --2- 172.21.15.90:0/1829499280 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2a380b18d0 0x7f2a38160920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:21.123 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.119+0000 7f2a36ffd700 1 --2- 172.21.15.90:0/1829499280 >> v2:172.21.15.174:3300/0 conn(0x7f2a380b1ca0 0x7f2a380cee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:21.123 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.119+0000 7f2a367fc700 1 -- 172.21.15.90:0/1829499280 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 892113412 0 0) 0x7f2a3815c6b0 con 0x7f2a380d2400 2023-06-09T04:42:21.123 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.123+0000 7f2a367fc700 1 -- 172.21.15.90:0/1829499280 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2a200035d0 con 0x7f2a380d2400 2023-06-09T04:42:21.124 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.123+0000 7f2a377fe700 1 -- 172.21.15.90:0/1829499280 >> v2:172.21.15.174:3300/0 conn(0x7f2a380b1ca0 msgr2=0x7f2a380cee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:21.124 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.123+0000 7f2a377fe700 1 --2- 172.21.15.90:0/1829499280 >> v2:172.21.15.174:3300/0 conn(0x7f2a380b1ca0 0x7f2a380cee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:21.124 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.123+0000 7f2a377fe700 1 -- 172.21.15.90:0/1829499280 >> v1:172.21.15.90:6789/0 conn(0x7f2a380d2400 legacy=0x7f2a380d28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:21.124 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.123+0000 7f2a377fe700 1 -- 172.21.15.90:0/1829499280 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a380cf980 con 0x7f2a380b18d0 2023-06-09T04:42:21.125 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.123+0000 7f2a377fe700 1 --2- 172.21.15.90:0/1829499280 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2a380b18d0 0x7f2a38160920 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f2a28009870 tx=0x7f2a28009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9c29064422134907 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:21.125 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.123+0000 7f2a367fc700 1 -- 172.21.15.90:0/1829499280 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a28005e50 con 0x7f2a380b18d0 2023-06-09T04:42:21.125 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.123+0000 7f2a367fc700 1 -- 172.21.15.90:0/1829499280 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a28006030 con 0x7f2a380b18d0 2023-06-09T04:42:21.126 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.123+0000 7f2a367fc700 1 -- 172.21.15.90:0/1829499280 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a280063c0 con 0x7f2a380b18d0 2023-06-09T04:42:21.126 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.123+0000 7f2a3c836700 1 -- 172.21.15.90:0/1829499280 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2a380b18d0 msgr2=0x7f2a38160920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:21.126 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.123+0000 7f2a3c836700 1 --2- 172.21.15.90:0/1829499280 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2a380b18d0 0x7f2a38160920 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f2a28009870 tx=0x7f2a28009b80 comp rx=0 tx=0).stop 2023-06-09T04:42:21.126 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.123+0000 7f2a3c836700 1 -- 172.21.15.90:0/1829499280 shutdown_connections 2023-06-09T04:42:21.126 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.123+0000 7f2a3c836700 1 --2- 172.21.15.90:0/1829499280 >> v2:172.21.15.174:3300/0 conn(0x7f2a380b1ca0 0x7f2a380cee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:21.126 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.123+0000 7f2a3c836700 1 --2- 172.21.15.90:0/1829499280 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2a380b18d0 0x7f2a38160920 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:21.126 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.123+0000 7f2a3c836700 1 -- 172.21.15.90:0/1829499280 >> 172.21.15.90:0/1829499280 conn(0x7f2a3809b9b0 msgr2=0x7f2a380b55d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:21.127 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.123+0000 7f2a3c836700 1 -- 172.21.15.90:0/1829499280 shutdown_connections 2023-06-09T04:42:21.127 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.123+0000 7f2a3c836700 1 -- 172.21.15.90:0/1829499280 wait complete. 2023-06-09T04:42:21.127 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.127+0000 7f2a3c836700 1 Processor -- start 2023-06-09T04:42:21.128 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.127+0000 7f2a3c836700 1 -- start start 2023-06-09T04:42:21.130 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.127+0000 7f2a3c836700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2a380b18d0 0x7f2a380c9750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:21.130 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.127+0000 7f2a3c836700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2a380b1ca0 0x7f2a380cb350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:21.130 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.127+0000 7f2a3c836700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2a380d2400 0x7f2a380cb890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:21.130 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.127+0000 7f2a3c836700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a381f12b0 con 0x7f2a380b1ca0 2023-06-09T04:42:21.130 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.127+0000 7f2a3c836700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a380b4b00 con 0x7f2a380b18d0 2023-06-09T04:42:21.130 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.127+0000 7f2a3c836700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a3815d550 con 0x7f2a380d2400 2023-06-09T04:42:21.131 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.127+0000 7f2a36ffd700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2a380b1ca0 0x7f2a380cb350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:21.131 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.127+0000 7f2a36ffd700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2a380b1ca0 0x7f2a380cb350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:54080/0 (socket says 172.21.15.90:54080) 2023-06-09T04:42:21.131 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.127+0000 7f2a36ffd700 1 -- 172.21.15.90:0/1306363191 learned_addr learned my addr 172.21.15.90:0/1306363191 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:21.131 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.127+0000 7f2a377fe700 1 --2- 172.21.15.90:0/1306363191 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2a380b18d0 0x7f2a380c9750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:21.132 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.127+0000 7f2a37fff700 1 --2- 172.21.15.90:0/1306363191 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2a380d2400 0x7f2a380cb890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:21.132 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.127+0000 7f2a36ffd700 1 -- 172.21.15.90:0/1306363191 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2a380d2400 msgr2=0x7f2a380cb890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:21.133 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.127+0000 7f2a36ffd700 1 --2- 172.21.15.90:0/1306363191 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2a380d2400 0x7f2a380cb890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:21.133 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.127+0000 7f2a36ffd700 1 -- 172.21.15.90:0/1306363191 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2a380b18d0 msgr2=0x7f2a380c9750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:21.133 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.127+0000 7f2a36ffd700 1 --2- 172.21.15.90:0/1306363191 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2a380b18d0 0x7f2a380c9750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:21.133 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.127+0000 7f2a36ffd700 1 -- 172.21.15.90:0/1306363191 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a28009450 con 0x7f2a380b1ca0 2023-06-09T04:42:21.133 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.127+0000 7f2a377fe700 1 --2- 172.21.15.90:0/1306363191 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2a380b18d0 0x7f2a380c9750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:42:21.133 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.131+0000 7f2a36ffd700 1 --2- 172.21.15.90:0/1306363191 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2a380b1ca0 0x7f2a380cb350 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f2a2c00e9a0 tx=0x7f2a2c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:21.133 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.131+0000 7f2a1ffff700 1 -- 172.21.15.90:0/1306363191 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a2c009720 con 0x7f2a380b1ca0 2023-06-09T04:42:21.134 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.131+0000 7f2a1ffff700 1 -- 172.21.15.90:0/1306363191 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a2c00c690 con 0x7f2a380b1ca0 2023-06-09T04:42:21.134 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.131+0000 7f2a1ffff700 1 -- 172.21.15.90:0/1306363191 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a2c00ca40 con 0x7f2a380b1ca0 2023-06-09T04:42:21.134 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.131+0000 7f2a3c836700 1 -- 172.21.15.90:0/1306363191 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a3815d830 con 0x7f2a380b1ca0 2023-06-09T04:42:21.134 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.131+0000 7f2a3c836700 1 -- 172.21.15.90:0/1306363191 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a3815ddf0 con 0x7f2a380b1ca0 2023-06-09T04:42:21.134 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.131+0000 7f2a3c836700 1 -- 172.21.15.90:0/1306363191 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a3804e380 con 0x7f2a380b1ca0 2023-06-09T04:42:21.135 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.135+0000 7f2a1ffff700 1 -- 172.21.15.90:0/1306363191 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2a2c00cba0 con 0x7f2a380b1ca0 2023-06-09T04:42:21.136 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.135+0000 7f2a1ffff700 1 --2- 172.21.15.90:0/1306363191 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f2a240662f0 0x7f2a240687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:21.136 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.135+0000 7f2a1ffff700 1 -- 172.21.15.90:0/1306363191 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2a2c083ce0 con 0x7f2a380b1ca0 2023-06-09T04:42:21.137 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.135+0000 7f2a377fe700 1 --2- 172.21.15.90:0/1306363191 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f2a240662f0 0x7f2a240687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:21.138 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.135+0000 7f2a377fe700 1 --2- 172.21.15.90:0/1306363191 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f2a240662f0 0x7f2a240687a0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f2a28009bc0 tx=0x7f2a28008070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:21.141 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.139+0000 7f2a1ffff700 1 -- 172.21.15.90:0/1306363191 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2a2c054b70 con 0x7f2a380b1ca0 2023-06-09T04:42:21.313 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.311+0000 7f2a3c836700 1 -- 172.21.15.90:0/1306363191 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2a380d33d0 con 0x7f2a380b1ca0 2023-06-09T04:42:21.316 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.315+0000 7f2a1ffff700 1 -- 172.21.15.90:0/1306363191 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18279 (secure 0 0 0) 0x7f2a2c054700 con 0x7f2a380b1ca0 2023-06-09T04:42:21.317 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:42:21.317 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":24,"fsid":"700369c0-a111-43b4-9415-844ad1742b70","created":"2023-06-09T04:41:28.180311+0000","modified":"2023-06-09T04:41:55.389425+0000","last_up_change":"2023-06-09T04:41:40.746475+0000","last_in_change":"2023-06-09T04:41:31.262765+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-09T04:41:42.402564+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-09T04:41:47.607323+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-09T04:41:52.543474+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-09T04:41:53.382940+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"46a4a7c5-babd-4ef3-9830-51487cff5eb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":2780271267},{"type":"v1","addr":"172.21.15.90:6809","nonce":2780271267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2780271267},{"type":"v1","addr":"172.21.15.90:6811","nonce":2780271267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2780271267},{"type":"v1","addr":"172.21.15.90:6815","nonce":2780271267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2780271267},{"type":"v1","addr":"172.21.15.90:6813","nonce":2780271267}]},"public_addr":"172.21.15.90:6809/2780271267","cluster_addr":"172.21.15.90:6811/2780271267","heartbeat_back_addr":"172.21.15.90:6815/2780271267","heartbeat_front_addr":"172.21.15.90:6813/2780271267","state":["exists","up"]},{"osd":1,"uuid":"1543988f-c498-494a-a6f9-fac8413db6ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":3064028136},{"type":"v1","addr":"172.21.15.90:6801","nonce":3064028136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":3064028136},{"type":"v1","addr":"172.21.15.90:6803","nonce":3064028136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":3064028136},{"type":"v1","addr":"172.21.15.90:6807","nonce":3064028136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":3064028136},{"type":"v1","addr":"172.21.15.90:6805","nonce":3064028136}]},"public_addr":"172.21.15.90:6801/3064028136","cluster_addr":"172.21.15.90:6803/3064028136","heartbeat_back_addr":"172.21.15.90:6807/3064028136","heartbeat_front_addr":"172.21.15.90:6805/3064028136","state":["exists","up"]},{"osd":2,"uuid":"79669dd6-ffc8-4197-b9f7-b3b372b2b9b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":3713146326},{"type":"v1","addr":"172.21.15.90:6825","nonce":3713146326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":3713146326},{"type":"v1","addr":"172.21.15.90:6827","nonce":3713146326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":3713146326},{"type":"v1","addr":"172.21.15.90:6831","nonce":3713146326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":3713146326},{"type":"v1","addr":"172.21.15.90:6829","nonce":3713146326}]},"public_addr":"172.21.15.90:6825/3713146326","cluster_addr":"172.21.15.90:6827/3713146326","heartbeat_back_addr":"172.21.15.90:6831/3713146326","heartbeat_front_addr":"172.21.15.90:6829/3713146326","state":["exists","up"]},{"osd":3,"uuid":"4062ab6f-ce40-450a-aa17-b10098766c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":3499839122},{"type":"v1","addr":"172.21.15.90:6817","nonce":3499839122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":3499839122},{"type":"v1","addr":"172.21.15.90:6819","nonce":3499839122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":3499839122},{"type":"v1","addr":"172.21.15.90:6823","nonce":3499839122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":3499839122},{"type":"v1","addr":"172.21.15.90:6821","nonce":3499839122}]},"public_addr":"172.21.15.90:6817/3499839122","cluster_addr":"172.21.15.90:6819/3499839122","heartbeat_back_addr":"172.21.15.90:6823/3499839122","heartbeat_front_addr":"172.21.15.90:6821/3499839122","state":["exists","up"]},{"osd":4,"uuid":"a10820e4-b348-4d92-9796-3b01484ace1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6817","nonce":1138565854},{"type":"v1","addr":"172.21.15.174:6819","nonce":1138565854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6821","nonce":1138565854},{"type":"v1","addr":"172.21.15.174:6823","nonce":1138565854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":1138565854},{"type":"v1","addr":"172.21.15.174:6831","nonce":1138565854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":1138565854},{"type":"v1","addr":"172.21.15.174:6829","nonce":1138565854}]},"public_addr":"172.21.15.174:6819/1138565854","cluster_addr":"172.21.15.174:6823/1138565854","heartbeat_back_addr":"172.21.15.174:6831/1138565854","heartbeat_front_addr":"172.21.15.174:6829/1138565854","state":["exists","up"]},{"osd":5,"uuid":"b4da1c32-be05-420b-9346-90d91aa70569","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":1707702879},{"type":"v1","addr":"172.21.15.174:6818","nonce":1707702879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":1707702879},{"type":"v1","addr":"172.21.15.174:6822","nonce":1707702879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6827","nonce":1707702879},{"type":"v1","addr":"172.21.15.174:6828","nonce":1707702879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":1707702879},{"type":"v1","addr":"172.21.15.174:6825","nonce":1707702879}]},"public_addr":"172.21.15.174:6818/1707702879","cluster_addr":"172.21.15.174:6822/1707702879","heartbeat_back_addr":"172.21.15.174:6828/1707702879","heartbeat_front_addr":"172.21.15.174:6825/1707702879","state":["exists","up"]},{"osd":6,"uuid":"d1b98041-d243-4355-bd0a-e22cf9875b32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":864450534},{"type":"v1","addr":"172.21.15.174:6801","nonce":864450534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":864450534},{"type":"v1","addr":"172.21.15.174:6803","nonce":864450534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":864450534},{"type":"v1","addr":"172.21.15.174:6807","nonce":864450534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":864450534},{"type":"v1","addr":"172.21.15.174:6805","nonce":864450534}]},"public_addr":"172.21.15.174:6801/864450534","cluster_addr":"172.21.15.174:6803/864450534","heartbeat_back_addr":"172.21.15.174:6807/864450534","heartbeat_front_addr":"172.21.15.174:6805/864450534","state":["exists","up"]},{"osd":7,"uuid":"5a207936-f89f-416b-b79b-34ec96f77c8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":2527640659},{"type":"v1","addr":"172.21.15.174:6809","nonce":2527640659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":2527640659},{"type":"v1","addr":"172.21.15.174:6811","nonce":2527640659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":2527640659},{"type":"v1","addr":"172.21.15.174:6815","nonce":2527640659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":2527640659},{"type":"v1","addr":"172.21.15.174:6813","nonce":2527640659}]},"public_addr":"172.21.15.174:6809/2527640659","cluster_addr":"172.21.15.174:6811/2527640659","heartbeat_back_addr":"172.21.15.174:6815/2527640659","heartbeat_front_addr":"172.21.15.174:6813/2527640659","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:36.972152+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:36.984561+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:36.998817+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:37.054944+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:37.085014+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:37.115125+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:36.854608+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:36.971685+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:42:21.319 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.319+0000 7f2a3c836700 1 -- 172.21.15.90:0/1306363191 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f2a240662f0 msgr2=0x7f2a240687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:21.319 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.319+0000 7f2a3c836700 1 --2- 172.21.15.90:0/1306363191 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f2a240662f0 0x7f2a240687a0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f2a28009bc0 tx=0x7f2a28008070 comp rx=0 tx=0).stop 2023-06-09T04:42:21.320 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.319+0000 7f2a3c836700 1 -- 172.21.15.90:0/1306363191 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2a380b1ca0 msgr2=0x7f2a380cb350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:21.320 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.319+0000 7f2a3c836700 1 --2- 172.21.15.90:0/1306363191 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2a380b1ca0 0x7f2a380cb350 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f2a2c00e9a0 tx=0x7f2a2c00ecb0 comp rx=0 tx=0).stop 2023-06-09T04:42:21.320 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.319+0000 7f2a3c836700 1 -- 172.21.15.90:0/1306363191 shutdown_connections 2023-06-09T04:42:21.320 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.319+0000 7f2a3c836700 1 --2- 172.21.15.90:0/1306363191 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f2a240662f0 0x7f2a240687a0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:21.320 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.319+0000 7f2a3c836700 1 --2- 172.21.15.90:0/1306363191 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2a380d2400 0x7f2a380cb890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:21.320 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.319+0000 7f2a3c836700 1 --2- 172.21.15.90:0/1306363191 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2a380b1ca0 0x7f2a380cb350 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:21.321 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.319+0000 7f2a3c836700 1 --2- 172.21.15.90:0/1306363191 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2a380b18d0 0x7f2a380c9750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:21.321 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.319+0000 7f2a3c836700 1 -- 172.21.15.90:0/1306363191 >> 172.21.15.90:0/1306363191 conn(0x7f2a3809b9b0 msgr2=0x7f2a3815bbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:21.321 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.319+0000 7f2a3c836700 1 -- 172.21.15.90:0/1306363191 shutdown_connections 2023-06-09T04:42:21.321 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.319+0000 7f2a3c836700 1 -- 172.21.15.90:0/1306363191 wait complete. 2023-06-09T04:42:21.340 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-09T04:41:42.402564+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-09T04:41:47.607323+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-09T04:41:52.543474+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-09T04:41:53.382940+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-09T04:42:21.341 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-09T04:42:21.518 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.515+0000 7f2728fd9700 1 Processor -- start 2023-06-09T04:42:21.518 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.515+0000 7f2728fd9700 1 -- start start 2023-06-09T04:42:21.520 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.519+0000 7f2728fd9700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f27240b1ca0 0x7f2724160920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:21.521 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.519+0000 7f2728fd9700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f272415c6b0 con 0x7f27240b18d0 2023-06-09T04:42:21.521 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.519+0000 7f2728fd9700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27240cf6a0 con 0x7f27240d2400 2023-06-09T04:42:21.521 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.519+0000 7f2728fd9700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27240cf980 con 0x7f27240b1ca0 2023-06-09T04:42:21.522 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.519+0000 7f271affd700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f27240b1ca0 0x7f2724160920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:21.522 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.519+0000 7f271affd700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f27240b1ca0 0x7f2724160920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:54088/0 (socket says 172.21.15.90:54088) 2023-06-09T04:42:21.522 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.519+0000 7f271affd700 1 -- 172.21.15.90:0/3998080244 learned_addr learned my addr 172.21.15.90:0/3998080244 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:21.522 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.519+0000 7f2722ffd700 1 -- 172.21.15.90:0/3998080244 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3508757151 0 0) 0x7f272415c6b0 con 0x7f27240b18d0 2023-06-09T04:42:21.522 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.519+0000 7f2722ffd700 1 -- 172.21.15.90:0/3998080244 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27100035d0 con 0x7f27240b18d0 2023-06-09T04:42:21.522 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.519+0000 7f271affd700 1 -- 172.21.15.90:0/3998080244 >> v1:172.21.15.174:6789/0 conn(0x7f27240d2400 legacy=0x7f27240d28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:21.523 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.519+0000 7f271affd700 1 -- 172.21.15.90:0/3998080244 >> v1:172.21.15.90:6789/0 conn(0x7f27240b18d0 legacy=0x7f27240cee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:21.523 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.519+0000 7f271affd700 1 -- 172.21.15.90:0/3998080244 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27240cfc60 con 0x7f27240b1ca0 2023-06-09T04:42:21.523 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.519+0000 7f271affd700 1 --2- 172.21.15.90:0/3998080244 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f27240b1ca0 0x7f2724160920 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f270c009910 tx=0x7f270c009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66f1ff9017bc4177 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:21.524 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.523+0000 7f2722ffd700 1 -- 172.21.15.90:0/3998080244 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f270c011830 con 0x7f27240b1ca0 2023-06-09T04:42:21.524 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.523+0000 7f2722ffd700 1 -- 172.21.15.90:0/3998080244 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f270c011990 con 0x7f27240b1ca0 2023-06-09T04:42:21.524 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.523+0000 7f2722ffd700 1 -- 172.21.15.90:0/3998080244 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f270c011d20 con 0x7f27240b1ca0 2023-06-09T04:42:21.524 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.523+0000 7f2728fd9700 1 -- 172.21.15.90:0/3998080244 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f27240b1ca0 msgr2=0x7f2724160920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:21.525 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.523+0000 7f2728fd9700 1 --2- 172.21.15.90:0/3998080244 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f27240b1ca0 0x7f2724160920 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f270c009910 tx=0x7f270c009c20 comp rx=0 tx=0).stop 2023-06-09T04:42:21.525 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.523+0000 7f2728fd9700 1 -- 172.21.15.90:0/3998080244 shutdown_connections 2023-06-09T04:42:21.525 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.523+0000 7f2728fd9700 1 --2- 172.21.15.90:0/3998080244 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f27240b1ca0 0x7f2724160920 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:21.525 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.523+0000 7f2728fd9700 1 -- 172.21.15.90:0/3998080244 >> 172.21.15.90:0/3998080244 conn(0x7f272409b9b0 msgr2=0x7f27240b55d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:21.525 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.523+0000 7f2728fd9700 1 -- 172.21.15.90:0/3998080244 shutdown_connections 2023-06-09T04:42:21.525 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.523+0000 7f2728fd9700 1 -- 172.21.15.90:0/3998080244 wait complete. 2023-06-09T04:42:21.526 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.523+0000 7f2728fd9700 1 Processor -- start 2023-06-09T04:42:21.527 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.527+0000 7f2728fd9700 1 -- start start 2023-06-09T04:42:21.528 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.527+0000 7f2728fd9700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f27240b18d0 0x7f27240c9750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:21.528 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.527+0000 7f2728fd9700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f27240b1ca0 0x7f27241f4990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:21.528 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.527+0000 7f2728fd9700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f27240d2400 0x7f27241f4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:21.528 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.527+0000 7f2728fd9700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27240b2300 con 0x7f27240b1ca0 2023-06-09T04:42:21.529 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.527+0000 7f2728fd9700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f272415e970 con 0x7f27240d2400 2023-06-09T04:42:21.529 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.527+0000 7f2728fd9700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f272415ec50 con 0x7f27240b18d0 2023-06-09T04:42:21.530 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.527+0000 7f271affd700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f27240b1ca0 0x7f27241f4990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:21.530 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.527+0000 7f271affd700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f27240b1ca0 0x7f27241f4990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:54098/0 (socket says 172.21.15.90:54098) 2023-06-09T04:42:21.530 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.527+0000 7f271affd700 1 -- 172.21.15.90:0/4046663390 learned_addr learned my addr 172.21.15.90:0/4046663390 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:21.530 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.527+0000 7f2723fff700 1 --2- 172.21.15.90:0/4046663390 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f27240d2400 0x7f27241f4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:21.530 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.527+0000 7f27237fe700 1 --2- 172.21.15.90:0/4046663390 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f27240b18d0 0x7f27240c9750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:21.530 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.527+0000 7f271affd700 1 -- 172.21.15.90:0/4046663390 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f27240b18d0 msgr2=0x7f27240c9750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:21.530 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.527+0000 7f271affd700 1 --2- 172.21.15.90:0/4046663390 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f27240b18d0 0x7f27240c9750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:21.531 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.527+0000 7f271affd700 1 -- 172.21.15.90:0/4046663390 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f27240d2400 msgr2=0x7f27241f4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:21.531 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.527+0000 7f271affd700 1 --2- 172.21.15.90:0/4046663390 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f27240d2400 0x7f27241f4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:21.531 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.527+0000 7f271affd700 1 -- 172.21.15.90:0/4046663390 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f270c009570 con 0x7f27240b1ca0 2023-06-09T04:42:21.532 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.527+0000 7f271affd700 1 --2- 172.21.15.90:0/4046663390 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f27240b1ca0 0x7f27241f4990 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f270c000c00 tx=0x7f270c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:21.532 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.527+0000 7f2720ff9700 1 -- 172.21.15.90:0/4046663390 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f270c004450 con 0x7f27240b1ca0 2023-06-09T04:42:21.532 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.527+0000 7f2720ff9700 1 -- 172.21.15.90:0/4046663390 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f270c01f070 con 0x7f27240b1ca0 2023-06-09T04:42:21.532 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.527+0000 7f2720ff9700 1 -- 172.21.15.90:0/4046663390 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f270c003900 con 0x7f27240b1ca0 2023-06-09T04:42:21.533 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.527+0000 7f2728fd9700 1 -- 172.21.15.90:0/4046663390 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f272415ef30 con 0x7f27240b1ca0 2023-06-09T04:42:21.533 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.531+0000 7f2728fd9700 1 -- 172.21.15.90:0/4046663390 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27240c9c90 con 0x7f27240b1ca0 2023-06-09T04:42:21.533 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.531+0000 7f2728fd9700 1 -- 172.21.15.90:0/4046663390 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f272404e380 con 0x7f27240b1ca0 2023-06-09T04:42:21.533 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.531+0000 7f2720ff9700 1 -- 172.21.15.90:0/4046663390 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f270c003a60 con 0x7f27240b1ca0 2023-06-09T04:42:21.535 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.535+0000 7f2720ff9700 1 --2- 172.21.15.90:0/4046663390 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f27040662f0 0x7f27040687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:21.535 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.535+0000 7f2720ff9700 1 -- 172.21.15.90:0/4046663390 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f270c021070 con 0x7f27240b1ca0 2023-06-09T04:42:21.536 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.535+0000 7f27237fe700 1 --2- 172.21.15.90:0/4046663390 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f27040662f0 0x7f27040687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:21.537 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.535+0000 7f27237fe700 1 --2- 172.21.15.90:0/4046663390 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f27040662f0 0x7f27040687a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f2714001250 tx=0x7f2714009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:21.539 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.539+0000 7f2720ff9700 1 -- 172.21.15.90:0/4046663390 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f270c052850 con 0x7f27240b1ca0 2023-06-09T04:42:21.708 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.707+0000 7f2728fd9700 1 -- 172.21.15.90:0/4046663390 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f27240d33d0 con 0x7f27240b1ca0 2023-06-09T04:42:21.708 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.707+0000 7f2720ff9700 1 -- 172.21.15.90:0/4046663390 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f270c006da0 con 0x7f27240b1ca0 2023-06-09T04:42:21.709 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 1 2023-06-09T04:42:21.711 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.711+0000 7f2728fd9700 1 -- 172.21.15.90:0/4046663390 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f27040662f0 msgr2=0x7f27040687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:21.711 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.711+0000 7f2728fd9700 1 --2- 172.21.15.90:0/4046663390 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f27040662f0 0x7f27040687a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f2714001250 tx=0x7f2714009040 comp rx=0 tx=0).stop 2023-06-09T04:42:21.711 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.711+0000 7f2728fd9700 1 -- 172.21.15.90:0/4046663390 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f27240b1ca0 msgr2=0x7f27241f4990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:21.712 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.711+0000 7f2728fd9700 1 --2- 172.21.15.90:0/4046663390 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f27240b1ca0 0x7f27241f4990 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f270c000c00 tx=0x7f270c004770 comp rx=0 tx=0).stop 2023-06-09T04:42:21.712 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.711+0000 7f2728fd9700 1 -- 172.21.15.90:0/4046663390 shutdown_connections 2023-06-09T04:42:21.712 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.711+0000 7f2728fd9700 1 --2- 172.21.15.90:0/4046663390 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f27040662f0 0x7f27040687a0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:21.712 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.711+0000 7f2728fd9700 1 --2- 172.21.15.90:0/4046663390 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f27240d2400 0x7f27241f4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:21.712 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.711+0000 7f2728fd9700 1 --2- 172.21.15.90:0/4046663390 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f27240b1ca0 0x7f27241f4990 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:21.712 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.711+0000 7f2728fd9700 1 --2- 172.21.15.90:0/4046663390 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f27240b18d0 0x7f27240c9750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:21.712 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.711+0000 7f2728fd9700 1 -- 172.21.15.90:0/4046663390 >> 172.21.15.90:0/4046663390 conn(0x7f272409b9b0 msgr2=0x7f27240ce9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:21.713 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.711+0000 7f2728fd9700 1 -- 172.21.15.90:0/4046663390 shutdown_connections 2023-06-09T04:42:21.713 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.711+0000 7f2728fd9700 1 -- 172.21.15.90:0/4046663390 wait complete. 2023-06-09T04:42:21.733 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-09T04:42:21.909 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.907+0000 7f37ceb8b700 1 Processor -- start 2023-06-09T04:42:21.909 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.907+0000 7f37ceb8b700 1 -- start start 2023-06-09T04:42:21.911 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.911+0000 7f37ceb8b700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f37c00e29f0 0x7f37c0055490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:21.911 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.911+0000 7f37ceb8b700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f37c0038560 0x7f37c003ac20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:21.911 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.911+0000 7f37ceb8b700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37c0007360 con 0x7f37c003b160 2023-06-09T04:42:21.911 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.911+0000 7f37ceb8b700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37c003b600 con 0x7f37c0038560 2023-06-09T04:42:21.912 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.911+0000 7f37ceb8b700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37c00e2dc0 con 0x7f37c00e29f0 2023-06-09T04:42:21.913 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.911+0000 7f37ce38a700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f37c003b160 0x7f37c00e64c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:57376/0 (socket says 172.21.15.90:57376) 2023-06-09T04:42:21.913 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.911+0000 7f37ce38a700 1 -- 172.21.15.90:0/167214089 learned_addr learned my addr 172.21.15.90:0/167214089 (peer_addr_for_me v1:172.21.15.90:0/0) 2023-06-09T04:42:21.913 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.911+0000 7f37cdb89700 1 --2- 172.21.15.90:0/167214089 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f37c00e29f0 0x7f37c0055490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:21.913 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.911+0000 7f37cd388700 1 --2- 172.21.15.90:0/167214089 >> v2:172.21.15.174:3300/0 conn(0x7f37c0038560 0x7f37c003ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:21.913 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.911+0000 7f37ccb87700 1 -- 172.21.15.90:0/167214089 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3872007230 0 0) 0x7f37c0007360 con 0x7f37c003b160 2023-06-09T04:42:21.914 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.911+0000 7f37ccb87700 1 -- 172.21.15.90:0/167214089 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f37b40035d0 con 0x7f37c003b160 2023-06-09T04:42:21.914 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.911+0000 7f37ccb87700 1 -- 172.21.15.90:0/167214089 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2122407549 0 0) 0x7f37b40035d0 con 0x7f37c003b160 2023-06-09T04:42:21.914 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.911+0000 7f37ccb87700 1 -- 172.21.15.90:0/167214089 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f37c00e29f0 msgr2=0x7f37c0055490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:21.914 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.911+0000 7f37ccb87700 1 --2- 172.21.15.90:0/167214089 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f37c00e29f0 0x7f37c0055490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:21.914 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.911+0000 7f37ccb87700 1 -- 172.21.15.90:0/167214089 >> v2:172.21.15.174:3300/0 conn(0x7f37c0038560 msgr2=0x7f37c003ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:21.914 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.911+0000 7f37ccb87700 1 --2- 172.21.15.90:0/167214089 >> v2:172.21.15.174:3300/0 conn(0x7f37c0038560 0x7f37c003ac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:21.914 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.911+0000 7f37ccb87700 1 -- 172.21.15.90:0/167214089 --> v1:172.21.15.90:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37c0053f70 con 0x7f37c003b160 2023-06-09T04:42:21.915 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.911+0000 7f37ccb87700 1 -- 172.21.15.90:0/167214089 <== mon.0 v1:172.21.15.90:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3604404106 0 0) 0x7f37c8067a60 con 0x7f37c003b160 2023-06-09T04:42:21.915 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.911+0000 7f37ccb87700 1 -- 172.21.15.90:0/167214089 >> v1:172.21.15.90:6789/0 conn(0x7f37c003b160 legacy=0x7f37c00e64c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:21.915 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.911+0000 7f37ccb87700 1 --2- 172.21.15.90:0/167214089 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f37b4003a50 0x7f37b4003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:21.915 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.911+0000 7f37ccb87700 1 --2- 172.21.15.90:0/167214089 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f37b40043e0 0x7f37b40048b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:21.915 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.911+0000 7f37ccb87700 1 --2- 172.21.15.90:0/167214089 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f37b4004f70 0x7f37b400ba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:21.915 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.911+0000 7f37ccb87700 1 -- 172.21.15.90:0/167214089 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37c00e2dc0 con 0x7f37b4004f70 2023-06-09T04:42:21.915 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.911+0000 7f37ccb87700 1 -- 172.21.15.90:0/167214089 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37b400bf60 con 0x7f37b40043e0 2023-06-09T04:42:21.915 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.911+0000 7f37ccb87700 1 -- 172.21.15.90:0/167214089 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37b400c0a0 con 0x7f37b4003a50 2023-06-09T04:42:21.917 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.911+0000 7f37ce38a700 1 --2- 172.21.15.90:0/167214089 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f37b4004f70 0x7f37b400ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:21.917 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.911+0000 7f37cdb89700 1 --2- 172.21.15.90:0/167214089 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f37b4003a50 0x7f37b4003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:21.917 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.911+0000 7f37cd388700 1 --2- 172.21.15.90:0/167214089 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f37b40043e0 0x7f37b40048b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:21.917 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.911+0000 7f37ce38a700 1 -- 172.21.15.90:0/167214089 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f37b4003a50 msgr2=0x7f37b4003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:21.917 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.911+0000 7f37ce38a700 1 --2- 172.21.15.90:0/167214089 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f37b4003a50 0x7f37b4003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:21.917 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.911+0000 7f37ce38a700 1 -- 172.21.15.90:0/167214089 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f37b40043e0 msgr2=0x7f37b40048b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:21.917 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.911+0000 7f37ce38a700 1 --2- 172.21.15.90:0/167214089 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f37b40043e0 0x7f37b40048b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:21.918 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.911+0000 7f37ce38a700 1 -- 172.21.15.90:0/167214089 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37b40035d0 con 0x7f37b4004f70 2023-06-09T04:42:21.918 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.911+0000 7f37ce38a700 1 --2- 172.21.15.90:0/167214089 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f37b4004f70 0x7f37b400ba20 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f37c8068540 tx=0x7f37b40058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5d2a8303af8ebc0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:21.918 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.915+0000 7f37ccb87700 1 -- 172.21.15.90:0/167214089 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37c80668e0 con 0x7f37b4004f70 2023-06-09T04:42:21.918 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.915+0000 7f37ccb87700 1 -- 172.21.15.90:0/167214089 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37c8066a60 con 0x7f37b4004f70 2023-06-09T04:42:21.918 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.915+0000 7f37ccb87700 1 -- 172.21.15.90:0/167214089 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37c8065e10 con 0x7f37b4004f70 2023-06-09T04:42:21.918 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.915+0000 7f37ceb8b700 1 -- 172.21.15.90:0/167214089 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f37b4004f70 msgr2=0x7f37b400ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:21.918 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.915+0000 7f37ceb8b700 1 --2- 172.21.15.90:0/167214089 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f37b4004f70 0x7f37b400ba20 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f37c8068540 tx=0x7f37b40058a0 comp rx=0 tx=0).stop 2023-06-09T04:42:21.918 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.915+0000 7f37ce38a700 1 -- 172.21.15.90:0/167214089 reap_dead start 2023-06-09T04:42:21.919 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.915+0000 7f37ceb8b700 1 -- 172.21.15.90:0/167214089 shutdown_connections 2023-06-09T04:42:21.919 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.915+0000 7f37ceb8b700 1 -- 172.21.15.90:0/167214089 >> 172.21.15.90:0/167214089 conn(0x7f37c0055c20 msgr2=0x7f37c0056020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:21.919 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.915+0000 7f37ceb8b700 1 -- 172.21.15.90:0/167214089 shutdown_connections 2023-06-09T04:42:21.919 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.915+0000 7f37ceb8b700 1 -- 172.21.15.90:0/167214089 wait complete. 2023-06-09T04:42:21.919 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.919+0000 7f37ceb8b700 1 Processor -- start 2023-06-09T04:42:21.920 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.919+0000 7f37ceb8b700 1 -- start start 2023-06-09T04:42:21.920 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.919+0000 7f37ceb8b700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f37b4004f70 0x7f37c00dd760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:21.920 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.919+0000 7f37ceb8b700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f37c0178470 0x7f37c0179620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:21.921 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.919+0000 7f37ceb8b700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f37c004e910 0x7f37c00393a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:21.921 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.919+0000 7f37ceb8b700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37c00ddca0 con 0x7f37c004e910 2023-06-09T04:42:21.921 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.919+0000 7f37ceb8b700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37c0179b60 con 0x7f37c0178470 2023-06-09T04:42:21.921 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.919+0000 7f37ceb8b700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37c0178960 con 0x7f37b4004f70 2023-06-09T04:42:21.922 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.919+0000 7f37ce38a700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f37c004e910 0x7f37c00393a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:21.922 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.919+0000 7f37ce38a700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f37c004e910 0x7f37c00393a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:54120/0 (socket says 172.21.15.90:54120) 2023-06-09T04:42:21.922 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.919+0000 7f37ce38a700 1 -- 172.21.15.90:0/1753135549 learned_addr learned my addr 172.21.15.90:0/1753135549 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:21.923 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.919+0000 7f37cd388700 1 --2- 172.21.15.90:0/1753135549 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f37c0178470 0x7f37c0179620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:21.923 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.919+0000 7f37cdb89700 1 --2- 172.21.15.90:0/1753135549 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f37b4004f70 0x7f37c00dd760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:21.923 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.919+0000 7f37ce38a700 1 -- 172.21.15.90:0/1753135549 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f37b4004f70 msgr2=0x7f37c00dd760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:21.923 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.919+0000 7f37ce38a700 1 --2- 172.21.15.90:0/1753135549 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f37b4004f70 0x7f37c00dd760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:21.923 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.919+0000 7f37ce38a700 1 -- 172.21.15.90:0/1753135549 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f37c0178470 msgr2=0x7f37c0179620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:21.923 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.919+0000 7f37ce38a700 1 --2- 172.21.15.90:0/1753135549 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f37c0178470 0x7f37c0179620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:21.923 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.919+0000 7f37ce38a700 1 -- 172.21.15.90:0/1753135549 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37c0178c40 con 0x7f37c004e910 2023-06-09T04:42:21.923 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.919+0000 7f37cdb89700 1 --2- 172.21.15.90:0/1753135549 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f37b4004f70 0x7f37c00dd760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:42:21.924 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.919+0000 7f37ce38a700 1 --2- 172.21.15.90:0/1753135549 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f37c004e910 0x7f37c00393a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f37c804ee10 tx=0x7f37c8068a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:21.924 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.919+0000 7f37be7fc700 1 -- 172.21.15.90:0/1753135549 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37c8066bd0 con 0x7f37c004e910 2023-06-09T04:42:21.924 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.919+0000 7f37be7fc700 1 -- 172.21.15.90:0/1753135549 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37c80668e0 con 0x7f37c004e910 2023-06-09T04:42:21.924 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.919+0000 7f37be7fc700 1 -- 172.21.15.90:0/1753135549 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37c8069a30 con 0x7f37c004e910 2023-06-09T04:42:21.924 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.919+0000 7f37ceb8b700 1 -- 172.21.15.90:0/1753135549 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37c0178f20 con 0x7f37c004e910 2023-06-09T04:42:21.924 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.919+0000 7f37ceb8b700 1 -- 172.21.15.90:0/1753135549 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37c004ed90 con 0x7f37c004e910 2023-06-09T04:42:21.925 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.923+0000 7f37ceb8b700 1 -- 172.21.15.90:0/1753135549 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37c0005570 con 0x7f37c004e910 2023-06-09T04:42:21.925 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.923+0000 7f37be7fc700 1 -- 172.21.15.90:0/1753135549 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f37c8069b90 con 0x7f37c004e910 2023-06-09T04:42:21.926 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.923+0000 7f37be7fc700 1 --2- 172.21.15.90:0/1753135549 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f37ac066320 0x7f37ac0687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:21.926 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.923+0000 7f37be7fc700 1 -- 172.21.15.90:0/1753135549 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f37c80fd790 con 0x7f37c004e910 2023-06-09T04:42:21.927 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.927+0000 7f37cdb89700 1 --2- 172.21.15.90:0/1753135549 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f37ac066320 0x7f37ac0687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:21.928 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.927+0000 7f37cdb89700 1 --2- 172.21.15.90:0/1753135549 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f37ac066320 0x7f37ac0687d0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f37c0012210 tx=0x7f37c4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:21.932 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:21.931+0000 7f37be7fc700 1 -- 172.21.15.90:0/1753135549 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f37c80cac20 con 0x7f37c004e910 2023-06-09T04:42:22.102 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.099+0000 7f37ceb8b700 1 -- 172.21.15.90:0/1753135549 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f37c00077b0 con 0x7f37c004e910 2023-06-09T04:42:22.103 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.099+0000 7f37be7fc700 1 -- 172.21.15.90:0/1753135549 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7f37c80ce240 con 0x7f37c004e910 2023-06-09T04:42:22.103 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 8 2023-06-09T04:42:22.105 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.103+0000 7f37ceb8b700 1 -- 172.21.15.90:0/1753135549 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f37ac066320 msgr2=0x7f37ac0687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:22.106 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.103+0000 7f37ceb8b700 1 --2- 172.21.15.90:0/1753135549 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f37ac066320 0x7f37ac0687d0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f37c0012210 tx=0x7f37c4008040 comp rx=0 tx=0).stop 2023-06-09T04:42:22.106 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.103+0000 7f37ceb8b700 1 -- 172.21.15.90:0/1753135549 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f37c004e910 msgr2=0x7f37c00393a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:22.106 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.103+0000 7f37ceb8b700 1 --2- 172.21.15.90:0/1753135549 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f37c004e910 0x7f37c00393a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f37c804ee10 tx=0x7f37c8068a30 comp rx=0 tx=0).stop 2023-06-09T04:42:22.106 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.103+0000 7f37ceb8b700 1 -- 172.21.15.90:0/1753135549 shutdown_connections 2023-06-09T04:42:22.107 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.103+0000 7f37ceb8b700 1 --2- 172.21.15.90:0/1753135549 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f37ac066320 0x7f37ac0687d0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:22.107 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.103+0000 7f37ceb8b700 1 --2- 172.21.15.90:0/1753135549 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f37c004e910 0x7f37c00393a0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:22.107 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.103+0000 7f37ceb8b700 1 --2- 172.21.15.90:0/1753135549 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f37c0178470 0x7f37c0179620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:22.107 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.103+0000 7f37ceb8b700 1 --2- 172.21.15.90:0/1753135549 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f37b4004f70 0x7f37c00dd760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:22.108 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.103+0000 7f37ceb8b700 1 -- 172.21.15.90:0/1753135549 >> 172.21.15.90:0/1753135549 conn(0x7f37c0055c20 msgr2=0x7f37c00066b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:22.108 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.103+0000 7f37ceb8b700 1 -- 172.21.15.90:0/1753135549 shutdown_connections 2023-06-09T04:42:22.108 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.103+0000 7f37ceb8b700 1 -- 172.21.15.90:0/1753135549 wait complete. 2023-06-09T04:42:22.128 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-09T04:42:22.299 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.299+0000 7f4a75658700 1 Processor -- start 2023-06-09T04:42:22.300 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.299+0000 7f4a75658700 1 -- start start 2023-06-09T04:42:22.303 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.303+0000 7f4a75658700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f4a7015c670 0x7f4a7015cad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:22.303 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.303+0000 7f4a75658700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f4a7015d010 0x7f4a700d06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:22.304 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.303+0000 7f4a75658700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a700ce270 con 0x7f4a7015c2a0 2023-06-09T04:42:22.304 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.303+0000 7f4a75658700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a7006a9f0 con 0x7f4a7015c670 2023-06-09T04:42:22.304 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.303+0000 7f4a75658700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a700ce060 con 0x7f4a7015d010 2023-06-09T04:42:22.305 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.303+0000 7f4a6e7fc700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f4a7015c670 0x7f4a7015cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:22.305 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.303+0000 7f4a6e7fc700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f4a7015c670 0x7f4a7015cad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:54130/0 (socket says 172.21.15.90:54130) 2023-06-09T04:42:22.305 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.303+0000 7f4a6e7fc700 1 -- 172.21.15.90:0/3610052356 learned_addr learned my addr 172.21.15.90:0/3610052356 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:22.305 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.303+0000 7f4a6e7fc700 1 -- 172.21.15.90:0/3610052356 >> v2:172.21.15.174:3300/0 conn(0x7f4a7015d010 msgr2=0x7f4a700d06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:22.306 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.303+0000 7f4a6f7fe700 1 --2- 172.21.15.90:0/3610052356 >> v2:172.21.15.174:3300/0 conn(0x7f4a7015d010 0x7f4a700d06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:22.306 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.303+0000 7f4a6e7fc700 1 --2- 172.21.15.90:0/3610052356 >> v2:172.21.15.174:3300/0 conn(0x7f4a7015d010 0x7f4a700d06d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:22.306 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.303+0000 7f4a6e7fc700 1 -- 172.21.15.90:0/3610052356 >> v1:172.21.15.174:6789/0 conn(0x7f4a7015c2a0 legacy=0x7f4a7006a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:22.306 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.303+0000 7f4a6e7fc700 1 -- 172.21.15.90:0/3610052356 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a700ce550 con 0x7f4a7015c670 2023-06-09T04:42:22.306 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.303+0000 7f4a6f7fe700 1 --2- 172.21.15.90:0/3610052356 >> v2:172.21.15.174:3300/0 conn(0x7f4a7015d010 0x7f4a700d06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:42:22.306 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.303+0000 7f4a6e7fc700 1 --2- 172.21.15.90:0/3610052356 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4a7015c670 0x7f4a7015cad0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f4a700699b0 tx=0x7f4a64009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6c2b905d936cc server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:22.306 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.303+0000 7f4a6dffb700 1 -- 172.21.15.90:0/3610052356 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a64004230 con 0x7f4a7015c670 2023-06-09T04:42:22.307 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.303+0000 7f4a6dffb700 1 -- 172.21.15.90:0/3610052356 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a64004390 con 0x7f4a7015c670 2023-06-09T04:42:22.307 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.303+0000 7f4a6dffb700 1 -- 172.21.15.90:0/3610052356 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a640036c0 con 0x7f4a7015c670 2023-06-09T04:42:22.307 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.303+0000 7f4a75658700 1 -- 172.21.15.90:0/3610052356 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4a7015c670 msgr2=0x7f4a7015cad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:22.308 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.303+0000 7f4a75658700 1 --2- 172.21.15.90:0/3610052356 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4a7015c670 0x7f4a7015cad0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f4a700699b0 tx=0x7f4a64009bf0 comp rx=0 tx=0).stop 2023-06-09T04:42:22.308 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.303+0000 7f4a75658700 1 -- 172.21.15.90:0/3610052356 shutdown_connections 2023-06-09T04:42:22.308 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.303+0000 7f4a75658700 1 --2- 172.21.15.90:0/3610052356 >> v2:172.21.15.174:3300/0 conn(0x7f4a7015d010 0x7f4a700d06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:22.308 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.303+0000 7f4a75658700 1 --2- 172.21.15.90:0/3610052356 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4a7015c670 0x7f4a7015cad0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:22.308 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.303+0000 7f4a75658700 1 -- 172.21.15.90:0/3610052356 >> 172.21.15.90:0/3610052356 conn(0x7f4a700b4ee0 msgr2=0x7f4a700d2720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:22.308 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.303+0000 7f4a75658700 1 -- 172.21.15.90:0/3610052356 shutdown_connections 2023-06-09T04:42:22.308 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.303+0000 7f4a75658700 1 -- 172.21.15.90:0/3610052356 wait complete. 2023-06-09T04:42:22.309 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.307+0000 7f4a75658700 1 Processor -- start 2023-06-09T04:42:22.309 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.307+0000 7f4a75658700 1 -- start start 2023-06-09T04:42:22.309 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.307+0000 7f4a75658700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4a7015c2a0 0x7f4a700c6c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:22.310 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.307+0000 7f4a75658700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4a7015c670 0x7f4a700cab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:22.310 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.307+0000 7f4a75658700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4a7015d010 0x7f4a701536f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:22.310 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.307+0000 7f4a75658700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a700ca6a0 con 0x7f4a7015c2a0 2023-06-09T04:42:22.310 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.307+0000 7f4a75658700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a700c97f0 con 0x7f4a7015c670 2023-06-09T04:42:22.310 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.307+0000 7f4a75658700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a700c71a0 con 0x7f4a7015d010 2023-06-09T04:42:22.311 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.307+0000 7f4a6e7fc700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4a7015c670 0x7f4a700cab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:22.312 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.307+0000 7f4a6effd700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4a7015c2a0 0x7f4a700c6c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:22.312 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.307+0000 7f4a6e7fc700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4a7015c670 0x7f4a700cab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.90:51276/0 (socket says 172.21.15.90:51276) 2023-06-09T04:42:22.312 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.307+0000 7f4a6e7fc700 1 -- 172.21.15.90:0/2806936236 learned_addr learned my addr 172.21.15.90:0/2806936236 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:22.312 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.307+0000 7f4a6f7fe700 1 --2- 172.21.15.90:0/2806936236 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4a7015d010 0x7f4a701536f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:22.312 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.311+0000 7f4a6e7fc700 1 -- 172.21.15.90:0/2806936236 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4a7015d010 msgr2=0x7f4a701536f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:22.312 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.311+0000 7f4a6e7fc700 1 --2- 172.21.15.90:0/2806936236 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4a7015d010 0x7f4a701536f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:22.312 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.311+0000 7f4a6e7fc700 1 -- 172.21.15.90:0/2806936236 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4a7015c2a0 msgr2=0x7f4a700c6c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:22.312 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.311+0000 7f4a6e7fc700 1 --2- 172.21.15.90:0/2806936236 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4a7015c2a0 0x7f4a700c6c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:22.313 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.311+0000 7f4a6e7fc700 1 -- 172.21.15.90:0/2806936236 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a64009570 con 0x7f4a7015c670 2023-06-09T04:42:22.313 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.311+0000 7f4a6effd700 1 --2- 172.21.15.90:0/2806936236 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4a7015c2a0 0x7f4a700c6c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:42:22.313 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.311+0000 7f4a6f7fe700 1 --2- 172.21.15.90:0/2806936236 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4a7015d010 0x7f4a701536f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:42:22.313 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.311+0000 7f4a6e7fc700 1 --2- 172.21.15.90:0/2806936236 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4a7015c670 0x7f4a700cab30 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f4a64000c00 tx=0x7f4a64004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:22.313 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.311+0000 7f4a577fe700 1 -- 172.21.15.90:0/2806936236 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a64003db0 con 0x7f4a7015c670 2023-06-09T04:42:22.313 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.311+0000 7f4a577fe700 1 -- 172.21.15.90:0/2806936236 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a6401f070 con 0x7f4a7015c670 2023-06-09T04:42:22.313 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.311+0000 7f4a577fe700 1 -- 172.21.15.90:0/2806936236 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a6400b8a0 con 0x7f4a7015c670 2023-06-09T04:42:22.314 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.311+0000 7f4a75658700 1 -- 172.21.15.90:0/2806936236 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a700c9a90 con 0x7f4a7015c670 2023-06-09T04:42:22.314 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.311+0000 7f4a75658700 1 -- 172.21.15.90:0/2806936236 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a700ca050 con 0x7f4a7015c670 2023-06-09T04:42:22.314 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.311+0000 7f4a75658700 1 -- 172.21.15.90:0/2806936236 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a700ca810 con 0x7f4a7015c670 2023-06-09T04:42:22.315 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.315+0000 7f4a577fe700 1 -- 172.21.15.90:0/2806936236 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4a64021030 con 0x7f4a7015c670 2023-06-09T04:42:22.316 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.315+0000 7f4a577fe700 1 --2- 172.21.15.90:0/2806936236 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f4a5c066320 0x7f4a5c0687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:22.317 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.315+0000 7f4a577fe700 1 -- 172.21.15.90:0/2806936236 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4a640853d0 con 0x7f4a7015c670 2023-06-09T04:42:22.317 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.315+0000 7f4a6effd700 1 --2- 172.21.15.90:0/2806936236 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f4a5c066320 0x7f4a5c0687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:22.318 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.315+0000 7f4a6effd700 1 --2- 172.21.15.90:0/2806936236 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f4a5c066320 0x7f4a5c0687d0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f4a60004510 tx=0x7f4a60007ee0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:22.325 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.323+0000 7f4a577fe700 1 -- 172.21.15.90:0/2806936236 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4a64052840 con 0x7f4a7015c670 2023-06-09T04:42:22.494 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.491+0000 7f4a75658700 1 -- 172.21.15.90:0/2806936236 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4a700ca810 con 0x7f4a7015c670 2023-06-09T04:42:22.495 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.491+0000 7f4a577fe700 1 -- 172.21.15.90:0/2806936236 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4a64055e60 con 0x7f4a7015c670 2023-06-09T04:42:22.495 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 32 2023-06-09T04:42:22.500 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.499+0000 7f4a75658700 1 -- 172.21.15.90:0/2806936236 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f4a5c066320 msgr2=0x7f4a5c0687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:22.500 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.499+0000 7f4a75658700 1 --2- 172.21.15.90:0/2806936236 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f4a5c066320 0x7f4a5c0687d0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f4a60004510 tx=0x7f4a60007ee0 comp rx=0 tx=0).stop 2023-06-09T04:42:22.500 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.499+0000 7f4a75658700 1 -- 172.21.15.90:0/2806936236 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4a7015c670 msgr2=0x7f4a700cab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:22.501 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.499+0000 7f4a75658700 1 --2- 172.21.15.90:0/2806936236 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4a7015c670 0x7f4a700cab30 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f4a64000c00 tx=0x7f4a64004770 comp rx=0 tx=0).stop 2023-06-09T04:42:22.501 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.499+0000 7f4a75658700 1 -- 172.21.15.90:0/2806936236 shutdown_connections 2023-06-09T04:42:22.501 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.499+0000 7f4a75658700 1 --2- 172.21.15.90:0/2806936236 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f4a5c066320 0x7f4a5c0687d0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:22.501 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.499+0000 7f4a75658700 1 --2- 172.21.15.90:0/2806936236 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4a7015d010 0x7f4a701536f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:22.501 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.499+0000 7f4a75658700 1 --2- 172.21.15.90:0/2806936236 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4a7015c670 0x7f4a700cab30 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:22.501 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.499+0000 7f4a75658700 1 --2- 172.21.15.90:0/2806936236 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4a7015c2a0 0x7f4a700c6c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:22.501 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.499+0000 7f4a75658700 1 -- 172.21.15.90:0/2806936236 >> 172.21.15.90:0/2806936236 conn(0x7f4a700b4ee0 msgr2=0x7f4a700cd650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:22.502 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.499+0000 7f4a75658700 1 -- 172.21.15.90:0/2806936236 shutdown_connections 2023-06-09T04:42:22.502 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.499+0000 7f4a75658700 1 -- 172.21.15.90:0/2806936236 wait complete. 2023-06-09T04:42:22.521 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-09T04:42:22.700 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.699+0000 7f94d675f700 1 Processor -- start 2023-06-09T04:42:22.701 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.699+0000 7f94d675f700 1 -- start start 2023-06-09T04:42:22.703 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.703+0000 7f94d675f700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f94d0159e40 0x7f94d00cc300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:22.704 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.703+0000 7f94d675f700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f94d00b1a10 0x7f94d006f600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:22.705 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.703+0000 7f94d675f700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f94d006fb40 0x7f94d00af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:22.705 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.703+0000 7f94d675f700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94d006ffa0 con 0x7f94d0159e40 2023-06-09T04:42:22.705 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.703+0000 7f94d675f700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94d00ce1c0 con 0x7f94d00b1a10 2023-06-09T04:42:22.705 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.703+0000 7f94d675f700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94d015a210 con 0x7f94d006fb40 2023-06-09T04:42:22.705 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.703+0000 7f94d575d700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f94d0159e40 0x7f94d00cc300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:22.705 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.703+0000 7f94d575d700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f94d0159e40 0x7f94d00cc300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:54146/0 (socket says 172.21.15.90:54146) 2023-06-09T04:42:22.705 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.703+0000 7f94d575d700 1 -- 172.21.15.90:0/1499327796 learned_addr learned my addr 172.21.15.90:0/1499327796 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:22.705 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.703+0000 7f94d4f5c700 1 --2- 172.21.15.90:0/1499327796 >> v2:172.21.15.174:3300/0 conn(0x7f94d00b1a10 0x7f94d006f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:22.706 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.703+0000 7f94d5f5e700 1 --2- 172.21.15.90:0/1499327796 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f94d006fb40 0x7f94d00af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:22.707 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.703+0000 7f94d575d700 1 -- 172.21.15.90:0/1499327796 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f94d006fb40 msgr2=0x7f94d00af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:22.707 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.703+0000 7f94d575d700 1 --2- 172.21.15.90:0/1499327796 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f94d006fb40 0x7f94d00af720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:22.707 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.703+0000 7f94d575d700 1 -- 172.21.15.90:0/1499327796 >> v2:172.21.15.174:3300/0 conn(0x7f94d00b1a10 msgr2=0x7f94d006f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:22.707 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.703+0000 7f94d575d700 1 --2- 172.21.15.90:0/1499327796 >> v2:172.21.15.174:3300/0 conn(0x7f94d00b1a10 0x7f94d006f600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:22.707 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.703+0000 7f94d575d700 1 -- 172.21.15.90:0/1499327796 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94d00ccc30 con 0x7f94d0159e40 2023-06-09T04:42:22.707 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.703+0000 7f94d4f5c700 1 --2- 172.21.15.90:0/1499327796 >> v2:172.21.15.174:3300/0 conn(0x7f94d00b1a10 0x7f94d006f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:42:22.707 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.703+0000 7f94d575d700 1 --2- 172.21.15.90:0/1499327796 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f94d0159e40 0x7f94d00cc300 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f94d0072040 tx=0x7f94cc009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1dc04a53ff9ed873 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:22.708 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.703+0000 7f94c7fff700 1 -- 172.21.15.90:0/1499327796 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94cc011830 con 0x7f94d0159e40 2023-06-09T04:42:22.708 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.703+0000 7f94c7fff700 1 -- 172.21.15.90:0/1499327796 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94cc011990 con 0x7f94d0159e40 2023-06-09T04:42:22.708 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.703+0000 7f94c7fff700 1 -- 172.21.15.90:0/1499327796 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94cc011d20 con 0x7f94d0159e40 2023-06-09T04:42:22.708 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.707+0000 7f94d675f700 1 -- 172.21.15.90:0/1499327796 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f94d0159e40 msgr2=0x7f94d00cc300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:22.709 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.707+0000 7f94d675f700 1 --2- 172.21.15.90:0/1499327796 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f94d0159e40 0x7f94d00cc300 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f94d0072040 tx=0x7f94cc009bf0 comp rx=0 tx=0).stop 2023-06-09T04:42:22.709 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.707+0000 7f94d675f700 1 -- 172.21.15.90:0/1499327796 shutdown_connections 2023-06-09T04:42:22.709 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.707+0000 7f94d675f700 1 --2- 172.21.15.90:0/1499327796 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f94d006fb40 0x7f94d00af720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:22.709 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.707+0000 7f94d675f700 1 --2- 172.21.15.90:0/1499327796 >> v2:172.21.15.174:3300/0 conn(0x7f94d00b1a10 0x7f94d006f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:22.709 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.707+0000 7f94d675f700 1 --2- 172.21.15.90:0/1499327796 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f94d0159e40 0x7f94d00cc300 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:22.709 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.707+0000 7f94d675f700 1 -- 172.21.15.90:0/1499327796 >> 172.21.15.90:0/1499327796 conn(0x7f94d00d05f0 msgr2=0x7f94d00d09f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:22.709 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.707+0000 7f94d675f700 1 -- 172.21.15.90:0/1499327796 shutdown_connections 2023-06-09T04:42:22.710 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.707+0000 7f94d675f700 1 -- 172.21.15.90:0/1499327796 wait complete. 2023-06-09T04:42:22.711 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.711+0000 7f94d675f700 1 Processor -- start 2023-06-09T04:42:22.711 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.711+0000 7f94d675f700 1 -- start start 2023-06-09T04:42:22.712 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.711+0000 7f94d675f700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f94d006fb40 0x7f94d00b4910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:22.713 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.711+0000 7f94d675f700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f94d00b1a10 0x7f94d01f39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:22.713 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.711+0000 7f94d675f700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f94d0159e40 0x7f94d01f3f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:22.713 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.711+0000 7f94d675f700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94d01f5550 con 0x7f94d006fb40 2023-06-09T04:42:22.713 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.711+0000 7f94d675f700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94d0144cb0 con 0x7f94d00b1a10 2023-06-09T04:42:22.713 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.711+0000 7f94d675f700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94d01f5270 con 0x7f94d0159e40 2023-06-09T04:42:22.714 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.711+0000 7f94d575d700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f94d006fb40 0x7f94d00b4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:22.714 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.711+0000 7f94d575d700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f94d006fb40 0x7f94d00b4910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:54150/0 (socket says 172.21.15.90:54150) 2023-06-09T04:42:22.714 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.711+0000 7f94d575d700 1 -- 172.21.15.90:0/2125486578 learned_addr learned my addr 172.21.15.90:0/2125486578 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:22.714 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.711+0000 7f94d4f5c700 1 --2- 172.21.15.90:0/2125486578 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f94d00b1a10 0x7f94d01f39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:22.715 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.711+0000 7f94d5f5e700 1 --2- 172.21.15.90:0/2125486578 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f94d0159e40 0x7f94d01f3f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:22.715 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.711+0000 7f94d575d700 1 -- 172.21.15.90:0/2125486578 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f94d0159e40 msgr2=0x7f94d01f3f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:22.715 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.711+0000 7f94d575d700 1 --2- 172.21.15.90:0/2125486578 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f94d0159e40 0x7f94d01f3f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:22.715 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.711+0000 7f94d575d700 1 -- 172.21.15.90:0/2125486578 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f94d00b1a10 msgr2=0x7f94d01f39d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:22.715 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.711+0000 7f94d575d700 1 --2- 172.21.15.90:0/2125486578 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f94d00b1a10 0x7f94d01f39d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:22.715 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.711+0000 7f94d575d700 1 -- 172.21.15.90:0/2125486578 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94c00094b0 con 0x7f94d006fb40 2023-06-09T04:42:22.715 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.711+0000 7f94d575d700 1 --2- 172.21.15.90:0/2125486578 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f94d006fb40 0x7f94d00b4910 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f94d00720f0 tx=0x7f94cc004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:22.716 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.711+0000 7f94c5ffb700 1 -- 172.21.15.90:0/2125486578 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94cc004510 con 0x7f94d006fb40 2023-06-09T04:42:22.716 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.711+0000 7f94c5ffb700 1 -- 172.21.15.90:0/2125486578 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94cc01e070 con 0x7f94d006fb40 2023-06-09T04:42:22.716 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.715+0000 7f94d675f700 1 -- 172.21.15.90:0/2125486578 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94cc009570 con 0x7f94d006fb40 2023-06-09T04:42:22.716 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.715+0000 7f94c5ffb700 1 -- 172.21.15.90:0/2125486578 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94cc003900 con 0x7f94d006fb40 2023-06-09T04:42:22.717 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.715+0000 7f94d675f700 1 -- 172.21.15.90:0/2125486578 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94d0145190 con 0x7f94d006fb40 2023-06-09T04:42:22.717 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.715+0000 7f94d675f700 1 -- 172.21.15.90:0/2125486578 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94d004e380 con 0x7f94d006fb40 2023-06-09T04:42:22.718 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.715+0000 7f94c5ffb700 1 -- 172.21.15.90:0/2125486578 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f94cc003a60 con 0x7f94d006fb40 2023-06-09T04:42:22.720 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.719+0000 7f94c5ffb700 1 --2- 172.21.15.90:0/2125486578 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f94b40662f0 0x7f94b40687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:22.720 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.719+0000 7f94c5ffb700 1 -- 172.21.15.90:0/2125486578 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f94cc084ec0 con 0x7f94d006fb40 2023-06-09T04:42:22.720 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.719+0000 7f94d4f5c700 1 --2- 172.21.15.90:0/2125486578 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f94b40662f0 0x7f94b40687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:22.721 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.719+0000 7f94d4f5c700 1 --2- 172.21.15.90:0/2125486578 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f94b40662f0 0x7f94b40687a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f94d0148cd0 tx=0x7f94c0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:22.725 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.723+0000 7f94c5ffb700 1 -- 172.21.15.90:0/2125486578 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f94cc052330 con 0x7f94d006fb40 2023-06-09T04:42:22.894 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.891+0000 7f94d675f700 1 -- 172.21.15.90:0/2125486578 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f94d00730b0 con 0x7f94d006fb40 2023-06-09T04:42:22.894 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.891+0000 7f94c5ffb700 1 -- 172.21.15.90:0/2125486578 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f94cc0150a0 con 0x7f94d006fb40 2023-06-09T04:42:22.895 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 64 2023-06-09T04:42:22.899 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.899+0000 7f94d675f700 1 -- 172.21.15.90:0/2125486578 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f94b40662f0 msgr2=0x7f94b40687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:22.899 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.899+0000 7f94d675f700 1 --2- 172.21.15.90:0/2125486578 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f94b40662f0 0x7f94b40687a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f94d0148cd0 tx=0x7f94c0008040 comp rx=0 tx=0).stop 2023-06-09T04:42:22.899 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.899+0000 7f94d675f700 1 -- 172.21.15.90:0/2125486578 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f94d006fb40 msgr2=0x7f94d00b4910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:22.899 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.899+0000 7f94d675f700 1 --2- 172.21.15.90:0/2125486578 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f94d006fb40 0x7f94d00b4910 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f94d00720f0 tx=0x7f94cc004770 comp rx=0 tx=0).stop 2023-06-09T04:42:22.899 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.899+0000 7f94d675f700 1 -- 172.21.15.90:0/2125486578 shutdown_connections 2023-06-09T04:42:22.900 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.899+0000 7f94d675f700 1 --2- 172.21.15.90:0/2125486578 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f94b40662f0 0x7f94b40687a0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:22.900 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.899+0000 7f94d675f700 1 --2- 172.21.15.90:0/2125486578 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f94d0159e40 0x7f94d01f3f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:22.900 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.899+0000 7f94d675f700 1 --2- 172.21.15.90:0/2125486578 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f94d00b1a10 0x7f94d01f39d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:22.900 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.899+0000 7f94d675f700 1 --2- 172.21.15.90:0/2125486578 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f94d006fb40 0x7f94d00b4910 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:22.901 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.899+0000 7f94d675f700 1 -- 172.21.15.90:0/2125486578 >> 172.21.15.90:0/2125486578 conn(0x7f94d00d05f0 msgr2=0x7f94d00d09c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:22.901 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.899+0000 7f94d675f700 1 -- 172.21.15.90:0/2125486578 shutdown_connections 2023-06-09T04:42:22.901 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:22.899+0000 7f94d675f700 1 -- 172.21.15.90:0/2125486578 wait complete. 2023-06-09T04:42:22.921 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T04:42:23.095 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.095+0000 7fe3a2e8c700 1 Processor -- start 2023-06-09T04:42:23.096 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.095+0000 7fe3a2e8c700 1 -- start start 2023-06-09T04:42:23.097 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.095+0000 7fe3a2e8c700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fe39c06ce40 0x7fe39c0b1950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:23.097 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.095+0000 7fe3a2e8c700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fe39c160560 0x7fe39c0d2400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:23.097 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.095+0000 7fe3a2e8c700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe39c06d210 con 0x7fe39c0d2940 2023-06-09T04:42:23.097 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.095+0000 7fe3a2e8c700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe39c160ab0 con 0x7fe39c160560 2023-06-09T04:42:23.098 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.095+0000 7fe3a2e8c700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe39c0b8080 con 0x7fe39c06ce40 2023-06-09T04:42:23.098 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.095+0000 7fe3a1689700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fe39c160560 0x7fe39c0d2400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:23.098 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.095+0000 7fe3a268b700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7fe39c0d2940 0x7fe39c0cefe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:57392/0 (socket says 172.21.15.90:57392) 2023-06-09T04:42:23.099 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.095+0000 7fe3a268b700 1 -- 172.21.15.90:0/4107803275 learned_addr learned my addr 172.21.15.90:0/4107803275 (peer_addr_for_me v1:172.21.15.90:0/0) 2023-06-09T04:42:23.099 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.095+0000 7fe3a1e8a700 1 --2- 172.21.15.90:0/4107803275 >> v2:172.21.15.174:3300/0 conn(0x7fe39c06ce40 0x7fe39c0b1950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:23.099 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.095+0000 7fe3a0e88700 1 -- 172.21.15.90:0/4107803275 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 285070089 0 0) 0x7fe39c06d210 con 0x7fe39c0d2940 2023-06-09T04:42:23.099 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.095+0000 7fe3a0e88700 1 -- 172.21.15.90:0/4107803275 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe3880035d0 con 0x7fe39c0d2940 2023-06-09T04:42:23.099 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.095+0000 7fe3a1e8a700 1 -- 172.21.15.90:0/4107803275 >> v2:172.21.15.90:3300/0 conn(0x7fe39c160560 msgr2=0x7fe39c0d2400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:23.100 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.095+0000 7fe3a1e8a700 1 --2- 172.21.15.90:0/4107803275 >> v2:172.21.15.90:3300/0 conn(0x7fe39c160560 0x7fe39c0d2400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:23.100 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.095+0000 7fe3a1e8a700 1 -- 172.21.15.90:0/4107803275 >> v1:172.21.15.90:6789/0 conn(0x7fe39c0d2940 legacy=0x7fe39c0cefe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:23.100 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.095+0000 7fe3a1e8a700 1 -- 172.21.15.90:0/4107803275 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe39c0b8510 con 0x7fe39c06ce40 2023-06-09T04:42:23.100 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.099+0000 7fe3a1e8a700 1 --2- 172.21.15.90:0/4107803275 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe39c06ce40 0x7fe39c0b1950 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fe39c0d00c0 tx=0x7fe398009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a50a448f760ff676 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:23.101 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.099+0000 7fe3a0e88700 1 -- 172.21.15.90:0/4107803275 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe398011830 con 0x7fe39c06ce40 2023-06-09T04:42:23.101 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.099+0000 7fe3a0e88700 1 -- 172.21.15.90:0/4107803275 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe398011990 con 0x7fe39c06ce40 2023-06-09T04:42:23.101 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.099+0000 7fe3a0e88700 1 -- 172.21.15.90:0/4107803275 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe398011d20 con 0x7fe39c06ce40 2023-06-09T04:42:23.101 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.099+0000 7fe3a2e8c700 1 -- 172.21.15.90:0/4107803275 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe39c06ce40 msgr2=0x7fe39c0b1950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:23.101 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.099+0000 7fe3a2e8c700 1 --2- 172.21.15.90:0/4107803275 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe39c06ce40 0x7fe39c0b1950 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fe39c0d00c0 tx=0x7fe398009b30 comp rx=0 tx=0).stop 2023-06-09T04:42:23.102 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.099+0000 7fe3a2e8c700 1 -- 172.21.15.90:0/4107803275 shutdown_connections 2023-06-09T04:42:23.102 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.099+0000 7fe3a2e8c700 1 --2- 172.21.15.90:0/4107803275 >> v2:172.21.15.90:3300/0 conn(0x7fe39c160560 0x7fe39c0d2400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:23.102 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.099+0000 7fe3a2e8c700 1 --2- 172.21.15.90:0/4107803275 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe39c06ce40 0x7fe39c0b1950 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:23.102 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.099+0000 7fe3a2e8c700 1 -- 172.21.15.90:0/4107803275 >> 172.21.15.90:0/4107803275 conn(0x7fe39c09b960 msgr2=0x7fe39c0b5560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:23.103 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.099+0000 7fe3a2e8c700 1 -- 172.21.15.90:0/4107803275 shutdown_connections 2023-06-09T04:42:23.103 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.099+0000 7fe3a2e8c700 1 -- 172.21.15.90:0/4107803275 wait complete. 2023-06-09T04:42:23.104 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.103+0000 7fe3a2e8c700 1 Processor -- start 2023-06-09T04:42:23.104 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.103+0000 7fe3a2e8c700 1 -- start start 2023-06-09T04:42:23.105 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.103+0000 7fe3a2e8c700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe39c06ce40 0x7fe39c0c6760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:23.105 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.103+0000 7fe3a2e8c700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe39c0d2940 0x7fe39c0b04a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:23.105 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.103+0000 7fe3a2e8c700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe39c160560 0x7fe39c0b09e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:23.106 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.103+0000 7fe3a2e8c700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe39c0c6ca0 con 0x7fe39c0d2940 2023-06-09T04:42:23.106 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.103+0000 7fe3a2e8c700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe39c1f1c20 con 0x7fe39c06ce40 2023-06-09T04:42:23.106 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.103+0000 7fe3a2e8c700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe39c1f1f00 con 0x7fe39c160560 2023-06-09T04:42:23.107 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.103+0000 7fe3a1689700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe39c0d2940 0x7fe39c0b04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:23.107 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.103+0000 7fe3a1689700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe39c0d2940 0x7fe39c0b04a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:54164/0 (socket says 172.21.15.90:54164) 2023-06-09T04:42:23.107 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.103+0000 7fe3a1689700 1 -- 172.21.15.90:0/2708415836 learned_addr learned my addr 172.21.15.90:0/2708415836 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:23.107 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.103+0000 7fe3a1e8a700 1 --2- 172.21.15.90:0/2708415836 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe39c06ce40 0x7fe39c0c6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:23.107 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.103+0000 7fe3a268b700 1 --2- 172.21.15.90:0/2708415836 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe39c160560 0x7fe39c0b09e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:23.107 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.103+0000 7fe3a1689700 1 -- 172.21.15.90:0/2708415836 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe39c160560 msgr2=0x7fe39c0b09e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:23.108 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.103+0000 7fe3a1689700 1 --2- 172.21.15.90:0/2708415836 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe39c160560 0x7fe39c0b09e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:23.108 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.103+0000 7fe3a1689700 1 -- 172.21.15.90:0/2708415836 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe39c06ce40 msgr2=0x7fe39c0c6760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:23.108 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.103+0000 7fe3a1689700 1 --2- 172.21.15.90:0/2708415836 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe39c06ce40 0x7fe39c0c6760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:23.108 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.103+0000 7fe3a1689700 1 -- 172.21.15.90:0/2708415836 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3980094b0 con 0x7fe39c0d2940 2023-06-09T04:42:23.108 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.103+0000 7fe3a268b700 1 --2- 172.21.15.90:0/2708415836 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe39c160560 0x7fe39c0b09e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:42:23.108 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.107+0000 7fe3a1689700 1 --2- 172.21.15.90:0/2708415836 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe39c0d2940 0x7fe39c0b04a0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fe38c00e9d0 tx=0x7fe38c00ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:23.109 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.107+0000 7fe3927fc700 1 -- 172.21.15.90:0/2708415836 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe38c009720 con 0x7fe39c0d2940 2023-06-09T04:42:23.109 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.107+0000 7fe3927fc700 1 -- 172.21.15.90:0/2708415836 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe38c00c850 con 0x7fe39c0d2940 2023-06-09T04:42:23.109 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.107+0000 7fe3a2e8c700 1 -- 172.21.15.90:0/2708415836 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe39c1f21e0 con 0x7fe39c0d2940 2023-06-09T04:42:23.109 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.107+0000 7fe3927fc700 1 -- 172.21.15.90:0/2708415836 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe38c00cbc0 con 0x7fe39c0d2940 2023-06-09T04:42:23.109 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.107+0000 7fe3a2e8c700 1 -- 172.21.15.90:0/2708415836 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe39c1f27a0 con 0x7fe39c0d2940 2023-06-09T04:42:23.110 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.107+0000 7fe3a2e8c700 1 -- 172.21.15.90:0/2708415836 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe39c04e380 con 0x7fe39c0d2940 2023-06-09T04:42:23.110 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.107+0000 7fe3927fc700 1 -- 172.21.15.90:0/2708415836 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe38c00cd20 con 0x7fe39c0d2940 2023-06-09T04:42:23.112 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.111+0000 7fe3927fc700 1 --2- 172.21.15.90:0/2708415836 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fe3800662f0 0x7fe3800687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:23.112 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.111+0000 7fe3927fc700 1 -- 172.21.15.90:0/2708415836 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe38c083ea0 con 0x7fe39c0d2940 2023-06-09T04:42:23.113 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.111+0000 7fe3a1e8a700 1 --2- 172.21.15.90:0/2708415836 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fe3800662f0 0x7fe3800687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:23.114 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.111+0000 7fe3a1e8a700 1 --2- 172.21.15.90:0/2708415836 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fe3800662f0 0x7fe3800687a0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fe398000c00 tx=0x7fe398008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:23.116 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.115+0000 7fe3927fc700 1 -- 172.21.15.90:0/2708415836 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe38c054d10 con 0x7fe39c0d2940 2023-06-09T04:42:23.290 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.287+0000 7fe3a2e8c700 1 -- 172.21.15.90:0/2708415836 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe39c0d3360 con 0x7fe39c0d2940 2023-06-09T04:42:23.292 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.291+0000 7fe3927fc700 1 -- 172.21.15.90:0/2708415836 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18279 (secure 0 0 0) 0x7fe38c017090 con 0x7fe39c0d2940 2023-06-09T04:42:23.293 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:42:23.293 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":24,"fsid":"700369c0-a111-43b4-9415-844ad1742b70","created":"2023-06-09T04:41:28.180311+0000","modified":"2023-06-09T04:41:55.389425+0000","last_up_change":"2023-06-09T04:41:40.746475+0000","last_in_change":"2023-06-09T04:41:31.262765+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-09T04:41:42.402564+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-09T04:41:47.607323+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-09T04:41:52.543474+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-09T04:41:53.382940+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"46a4a7c5-babd-4ef3-9830-51487cff5eb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":2780271267},{"type":"v1","addr":"172.21.15.90:6809","nonce":2780271267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2780271267},{"type":"v1","addr":"172.21.15.90:6811","nonce":2780271267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2780271267},{"type":"v1","addr":"172.21.15.90:6815","nonce":2780271267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2780271267},{"type":"v1","addr":"172.21.15.90:6813","nonce":2780271267}]},"public_addr":"172.21.15.90:6809/2780271267","cluster_addr":"172.21.15.90:6811/2780271267","heartbeat_back_addr":"172.21.15.90:6815/2780271267","heartbeat_front_addr":"172.21.15.90:6813/2780271267","state":["exists","up"]},{"osd":1,"uuid":"1543988f-c498-494a-a6f9-fac8413db6ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":3064028136},{"type":"v1","addr":"172.21.15.90:6801","nonce":3064028136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":3064028136},{"type":"v1","addr":"172.21.15.90:6803","nonce":3064028136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":3064028136},{"type":"v1","addr":"172.21.15.90:6807","nonce":3064028136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":3064028136},{"type":"v1","addr":"172.21.15.90:6805","nonce":3064028136}]},"public_addr":"172.21.15.90:6801/3064028136","cluster_addr":"172.21.15.90:6803/3064028136","heartbeat_back_addr":"172.21.15.90:6807/3064028136","heartbeat_front_addr":"172.21.15.90:6805/3064028136","state":["exists","up"]},{"osd":2,"uuid":"79669dd6-ffc8-4197-b9f7-b3b372b2b9b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":3713146326},{"type":"v1","addr":"172.21.15.90:6825","nonce":3713146326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":3713146326},{"type":"v1","addr":"172.21.15.90:6827","nonce":3713146326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":3713146326},{"type":"v1","addr":"172.21.15.90:6831","nonce":3713146326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":3713146326},{"type":"v1","addr":"172.21.15.90:6829","nonce":3713146326}]},"public_addr":"172.21.15.90:6825/3713146326","cluster_addr":"172.21.15.90:6827/3713146326","heartbeat_back_addr":"172.21.15.90:6831/3713146326","heartbeat_front_addr":"172.21.15.90:6829/3713146326","state":["exists","up"]},{"osd":3,"uuid":"4062ab6f-ce40-450a-aa17-b10098766c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":3499839122},{"type":"v1","addr":"172.21.15.90:6817","nonce":3499839122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":3499839122},{"type":"v1","addr":"172.21.15.90:6819","nonce":3499839122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":3499839122},{"type":"v1","addr":"172.21.15.90:6823","nonce":3499839122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":3499839122},{"type":"v1","addr":"172.21.15.90:6821","nonce":3499839122}]},"public_addr":"172.21.15.90:6817/3499839122","cluster_addr":"172.21.15.90:6819/3499839122","heartbeat_back_addr":"172.21.15.90:6823/3499839122","heartbeat_front_addr":"172.21.15.90:6821/3499839122","state":["exists","up"]},{"osd":4,"uuid":"a10820e4-b348-4d92-9796-3b01484ace1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6817","nonce":1138565854},{"type":"v1","addr":"172.21.15.174:6819","nonce":1138565854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6821","nonce":1138565854},{"type":"v1","addr":"172.21.15.174:6823","nonce":1138565854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":1138565854},{"type":"v1","addr":"172.21.15.174:6831","nonce":1138565854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":1138565854},{"type":"v1","addr":"172.21.15.174:6829","nonce":1138565854}]},"public_addr":"172.21.15.174:6819/1138565854","cluster_addr":"172.21.15.174:6823/1138565854","heartbeat_back_addr":"172.21.15.174:6831/1138565854","heartbeat_front_addr":"172.21.15.174:6829/1138565854","state":["exists","up"]},{"osd":5,"uuid":"b4da1c32-be05-420b-9346-90d91aa70569","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":1707702879},{"type":"v1","addr":"172.21.15.174:6818","nonce":1707702879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":1707702879},{"type":"v1","addr":"172.21.15.174:6822","nonce":1707702879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6827","nonce":1707702879},{"type":"v1","addr":"172.21.15.174:6828","nonce":1707702879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":1707702879},{"type":"v1","addr":"172.21.15.174:6825","nonce":1707702879}]},"public_addr":"172.21.15.174:6818/1707702879","cluster_addr":"172.21.15.174:6822/1707702879","heartbeat_back_addr":"172.21.15.174:6828/1707702879","heartbeat_front_addr":"172.21.15.174:6825/1707702879","state":["exists","up"]},{"osd":6,"uuid":"d1b98041-d243-4355-bd0a-e22cf9875b32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":864450534},{"type":"v1","addr":"172.21.15.174:6801","nonce":864450534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":864450534},{"type":"v1","addr":"172.21.15.174:6803","nonce":864450534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":864450534},{"type":"v1","addr":"172.21.15.174:6807","nonce":864450534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":864450534},{"type":"v1","addr":"172.21.15.174:6805","nonce":864450534}]},"public_addr":"172.21.15.174:6801/864450534","cluster_addr":"172.21.15.174:6803/864450534","heartbeat_back_addr":"172.21.15.174:6807/864450534","heartbeat_front_addr":"172.21.15.174:6805/864450534","state":["exists","up"]},{"osd":7,"uuid":"5a207936-f89f-416b-b79b-34ec96f77c8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":2527640659},{"type":"v1","addr":"172.21.15.174:6809","nonce":2527640659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":2527640659},{"type":"v1","addr":"172.21.15.174:6811","nonce":2527640659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":2527640659},{"type":"v1","addr":"172.21.15.174:6815","nonce":2527640659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":2527640659},{"type":"v1","addr":"172.21.15.174:6813","nonce":2527640659}]},"public_addr":"172.21.15.174:6809/2527640659","cluster_addr":"172.21.15.174:6811/2527640659","heartbeat_back_addr":"172.21.15.174:6815/2527640659","heartbeat_front_addr":"172.21.15.174:6813/2527640659","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:36.972152+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:36.984561+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:36.998817+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:37.054944+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:37.085014+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:37.115125+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:36.854608+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:36.971685+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:42:23.295 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.295+0000 7fe3a2e8c700 1 -- 172.21.15.90:0/2708415836 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fe3800662f0 msgr2=0x7fe3800687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:23.295 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.295+0000 7fe3a2e8c700 1 --2- 172.21.15.90:0/2708415836 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fe3800662f0 0x7fe3800687a0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fe398000c00 tx=0x7fe398008030 comp rx=0 tx=0).stop 2023-06-09T04:42:23.295 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.295+0000 7fe3a2e8c700 1 -- 172.21.15.90:0/2708415836 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe39c0d2940 msgr2=0x7fe39c0b04a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:23.296 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.295+0000 7fe3a2e8c700 1 --2- 172.21.15.90:0/2708415836 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe39c0d2940 0x7fe39c0b04a0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fe38c00e9d0 tx=0x7fe38c00ed90 comp rx=0 tx=0).stop 2023-06-09T04:42:23.296 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.295+0000 7fe3a2e8c700 1 -- 172.21.15.90:0/2708415836 shutdown_connections 2023-06-09T04:42:23.296 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.295+0000 7fe3a2e8c700 1 --2- 172.21.15.90:0/2708415836 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fe3800662f0 0x7fe3800687a0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:23.296 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.295+0000 7fe3a2e8c700 1 --2- 172.21.15.90:0/2708415836 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe39c160560 0x7fe39c0b09e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:23.296 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.295+0000 7fe3a2e8c700 1 --2- 172.21.15.90:0/2708415836 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe39c0d2940 0x7fe39c0b04a0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:23.296 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.295+0000 7fe3a2e8c700 1 --2- 172.21.15.90:0/2708415836 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe39c06ce40 0x7fe39c0c6760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:23.296 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.295+0000 7fe3a2e8c700 1 -- 172.21.15.90:0/2708415836 >> 172.21.15.90:0/2708415836 conn(0x7fe39c09b960 msgr2=0x7fe39c15a890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:23.297 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.295+0000 7fe3a2e8c700 1 -- 172.21.15.90:0/2708415836 shutdown_connections 2023-06-09T04:42:23.297 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.295+0000 7fe3a2e8c700 1 -- 172.21.15.90:0/2708415836 wait complete. 2023-06-09T04:42:23.316 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-09T04:41:42.402564+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-09T04:41:47.607323+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-09T04:41:52.543474+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-09T04:41:53.382940+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-09T04:42:23.317 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-09T04:42:23.496 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.495+0000 7f3fa359e700 1 Processor -- start 2023-06-09T04:42:23.497 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.495+0000 7f3fa359e700 1 -- start start 2023-06-09T04:42:23.499 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.499+0000 7f3fa359e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3fa40b18d0 0x7f3fa4160920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:23.500 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.499+0000 7f3fa359e700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f3fa40b1ca0 0x7f3fa40cee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:23.500 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.499+0000 7f3fa359e700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fa415c6b0 con 0x7f3fa40d2400 2023-06-09T04:42:23.500 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.499+0000 7f3fa359e700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fa40cf3d0 con 0x7f3fa40b1ca0 2023-06-09T04:42:23.500 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.499+0000 7f3fa359e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa40cf6a0 con 0x7f3fa40b18d0 2023-06-09T04:42:23.501 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.499+0000 7f3fa2d9d700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f3fa40d2400 0x7f3fa40d28a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:57398/0 (socket says 172.21.15.90:57398) 2023-06-09T04:42:23.501 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.499+0000 7f3fa2d9d700 1 -- 172.21.15.90:0/3655362026 learned_addr learned my addr 172.21.15.90:0/3655362026 (peer_addr_for_me v1:172.21.15.90:0/0) 2023-06-09T04:42:23.501 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.499+0000 7f3fa1d9b700 1 --2- 172.21.15.90:0/3655362026 >> v2:172.21.15.174:3300/0 conn(0x7f3fa40b1ca0 0x7f3fa40cee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:23.501 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.499+0000 7f3fa259c700 1 --2- 172.21.15.90:0/3655362026 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3fa40b18d0 0x7f3fa4160920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:23.502 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.499+0000 7f3fa159a700 1 -- 172.21.15.90:0/3655362026 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1730739492 0 0) 0x7f3fa415c6b0 con 0x7f3fa40d2400 2023-06-09T04:42:23.502 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.499+0000 7f3fa159a700 1 -- 172.21.15.90:0/3655362026 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f8c0035d0 con 0x7f3fa40d2400 2023-06-09T04:42:23.502 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.499+0000 7f3fa1d9b700 1 -- 172.21.15.90:0/3655362026 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3fa40b18d0 msgr2=0x7f3fa4160920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:23.502 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.499+0000 7f3fa1d9b700 1 --2- 172.21.15.90:0/3655362026 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3fa40b18d0 0x7f3fa4160920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:23.502 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.499+0000 7f3fa1d9b700 1 -- 172.21.15.90:0/3655362026 >> v1:172.21.15.90:6789/0 conn(0x7f3fa40d2400 legacy=0x7f3fa40d28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:23.502 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.499+0000 7f3fa1d9b700 1 -- 172.21.15.90:0/3655362026 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fa40cf980 con 0x7f3fa40b1ca0 2023-06-09T04:42:23.503 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.499+0000 7f3fa1d9b700 1 --2- 172.21.15.90:0/3655362026 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3fa40b1ca0 0x7f3fa40cee90 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f3f98009880 tx=0x7f3f98009b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5958b77fb98ced3f server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:23.503 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.499+0000 7f3fa159a700 1 -- 172.21.15.90:0/3655362026 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f98011830 con 0x7f3fa40b1ca0 2023-06-09T04:42:23.503 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.499+0000 7f3fa159a700 1 -- 172.21.15.90:0/3655362026 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f98011990 con 0x7f3fa40b1ca0 2023-06-09T04:42:23.504 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.499+0000 7f3fa159a700 1 -- 172.21.15.90:0/3655362026 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f98011d20 con 0x7f3fa40b1ca0 2023-06-09T04:42:23.504 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.503+0000 7f3fa359e700 1 -- 172.21.15.90:0/3655362026 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3fa40b1ca0 msgr2=0x7f3fa40cee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:23.504 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.503+0000 7f3fa359e700 1 --2- 172.21.15.90:0/3655362026 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3fa40b1ca0 0x7f3fa40cee90 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f3f98009880 tx=0x7f3f98009b90 comp rx=0 tx=0).stop 2023-06-09T04:42:23.504 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.503+0000 7f3fa359e700 1 -- 172.21.15.90:0/3655362026 shutdown_connections 2023-06-09T04:42:23.505 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.503+0000 7f3fa359e700 1 --2- 172.21.15.90:0/3655362026 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3fa40b1ca0 0x7f3fa40cee90 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:23.505 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.503+0000 7f3fa359e700 1 --2- 172.21.15.90:0/3655362026 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3fa40b18d0 0x7f3fa4160920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:23.505 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.503+0000 7f3fa359e700 1 -- 172.21.15.90:0/3655362026 >> 172.21.15.90:0/3655362026 conn(0x7f3fa409b9b0 msgr2=0x7f3fa40b55d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:23.505 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.503+0000 7f3fa359e700 1 -- 172.21.15.90:0/3655362026 shutdown_connections 2023-06-09T04:42:23.505 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.503+0000 7f3fa359e700 1 -- 172.21.15.90:0/3655362026 wait complete. 2023-06-09T04:42:23.506 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.503+0000 7f3fa359e700 1 Processor -- start 2023-06-09T04:42:23.507 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.507+0000 7f3fa359e700 1 -- start start 2023-06-09T04:42:23.508 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.507+0000 7f3fa359e700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3fa40b18d0 0x7f3fa40ca880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:23.508 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.507+0000 7f3fa359e700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3fa40b1ca0 0x7f3fa40b4520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:23.508 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.507+0000 7f3fa359e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3fa40d2400 0x7f3fa415ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:23.509 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.507+0000 7f3fa359e700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa40cbe00 con 0x7f3fa40b1ca0 2023-06-09T04:42:23.509 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.507+0000 7f3fa359e700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa40cb180 con 0x7f3fa40b18d0 2023-06-09T04:42:23.509 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.507+0000 7f3fa359e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa40cb460 con 0x7f3fa40d2400 2023-06-09T04:42:23.510 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.507+0000 7f3fa1d9b700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3fa40b1ca0 0x7f3fa40b4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:23.510 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.507+0000 7f3fa1d9b700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3fa40b1ca0 0x7f3fa40b4520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:54180/0 (socket says 172.21.15.90:54180) 2023-06-09T04:42:23.510 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.507+0000 7f3fa1d9b700 1 -- 172.21.15.90:0/2722655813 learned_addr learned my addr 172.21.15.90:0/2722655813 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:23.510 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.507+0000 7f3fa259c700 1 --2- 172.21.15.90:0/2722655813 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3fa40b18d0 0x7f3fa40ca880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:23.510 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.507+0000 7f3fa2d9d700 1 --2- 172.21.15.90:0/2722655813 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3fa40d2400 0x7f3fa415ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:23.510 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.507+0000 7f3fa1d9b700 1 -- 172.21.15.90:0/2722655813 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3fa40d2400 msgr2=0x7f3fa415ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:23.511 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.507+0000 7f3fa1d9b700 1 --2- 172.21.15.90:0/2722655813 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3fa40d2400 0x7f3fa415ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:23.511 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.507+0000 7f3fa1d9b700 1 -- 172.21.15.90:0/2722655813 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3fa40b18d0 msgr2=0x7f3fa40ca880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:23.511 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.507+0000 7f3fa1d9b700 1 --2- 172.21.15.90:0/2722655813 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3fa40b18d0 0x7f3fa40ca880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:23.511 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.507+0000 7f3fa1d9b700 1 -- 172.21.15.90:0/2722655813 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f980094b0 con 0x7f3fa40b1ca0 2023-06-09T04:42:23.511 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.507+0000 7f3fa2d9d700 1 --2- 172.21.15.90:0/2722655813 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3fa40d2400 0x7f3fa415ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:42:23.511 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.507+0000 7f3fa1d9b700 1 --2- 172.21.15.90:0/2722655813 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3fa40b1ca0 0x7f3fa40b4520 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f3f980090b0 tx=0x7f3f98004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:23.512 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.507+0000 7f3f92ffd700 1 -- 172.21.15.90:0/2722655813 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f98004480 con 0x7f3fa40b1ca0 2023-06-09T04:42:23.512 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.507+0000 7f3fa359e700 1 -- 172.21.15.90:0/2722655813 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fa40cb740 con 0x7f3fa40b1ca0 2023-06-09T04:42:23.512 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.507+0000 7f3f92ffd700 1 -- 172.21.15.90:0/2722655813 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f9801f070 con 0x7f3fa40b1ca0 2023-06-09T04:42:23.512 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.507+0000 7f3f92ffd700 1 -- 172.21.15.90:0/2722655813 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f98003900 con 0x7f3fa40b1ca0 2023-06-09T04:42:23.512 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.507+0000 7f3fa359e700 1 -- 172.21.15.90:0/2722655813 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fa40cadc0 con 0x7f3fa40b1ca0 2023-06-09T04:42:23.513 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.511+0000 7f3fa359e700 1 -- 172.21.15.90:0/2722655813 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fa40caf50 con 0x7f3fa40b1ca0 2023-06-09T04:42:23.513 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.511+0000 7f3f92ffd700 1 -- 172.21.15.90:0/2722655813 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f3f98021030 con 0x7f3fa40b1ca0 2023-06-09T04:42:23.514 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.511+0000 7f3f92ffd700 1 --2- 172.21.15.90:0/2722655813 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f3f840662f0 0x7f3f840687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:23.514 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.511+0000 7f3f92ffd700 1 -- 172.21.15.90:0/2722655813 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3f98085130 con 0x7f3fa40b1ca0 2023-06-09T04:42:23.515 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.515+0000 7f3fa259c700 1 --2- 172.21.15.90:0/2722655813 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f3f840662f0 0x7f3f840687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:23.516 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.515+0000 7f3fa259c700 1 --2- 172.21.15.90:0/2722655813 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f3f840662f0 0x7f3f840687a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f3f94009b40 tx=0x7f3f940091c0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:23.521 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.519+0000 7f3f92ffd700 1 -- 172.21.15.90:0/2722655813 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3f98052640 con 0x7f3fa40b1ca0 2023-06-09T04:42:23.689 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.687+0000 7f3fa359e700 1 -- 172.21.15.90:0/2722655813 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3fa404e380 con 0x7f3fa40b1ca0 2023-06-09T04:42:23.690 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.687+0000 7f3f92ffd700 1 -- 172.21.15.90:0/2722655813 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3f98055c60 con 0x7f3fa40b1ca0 2023-06-09T04:42:23.690 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 1 2023-06-09T04:42:23.693 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.691+0000 7f3fa359e700 1 -- 172.21.15.90:0/2722655813 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f3f840662f0 msgr2=0x7f3f840687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:23.693 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.691+0000 7f3fa359e700 1 --2- 172.21.15.90:0/2722655813 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f3f840662f0 0x7f3f840687a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f3f94009b40 tx=0x7f3f940091c0 comp rx=0 tx=0).stop 2023-06-09T04:42:23.693 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.691+0000 7f3fa359e700 1 -- 172.21.15.90:0/2722655813 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3fa40b1ca0 msgr2=0x7f3fa40b4520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:23.693 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.691+0000 7f3fa359e700 1 --2- 172.21.15.90:0/2722655813 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3fa40b1ca0 0x7f3fa40b4520 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f3f980090b0 tx=0x7f3f98004770 comp rx=0 tx=0).stop 2023-06-09T04:42:23.693 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.691+0000 7f3fa359e700 1 -- 172.21.15.90:0/2722655813 shutdown_connections 2023-06-09T04:42:23.693 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.691+0000 7f3fa359e700 1 --2- 172.21.15.90:0/2722655813 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f3f840662f0 0x7f3f840687a0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:23.694 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.691+0000 7f3fa359e700 1 --2- 172.21.15.90:0/2722655813 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3fa40d2400 0x7f3fa415ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:23.694 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.691+0000 7f3fa359e700 1 --2- 172.21.15.90:0/2722655813 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3fa40b1ca0 0x7f3fa40b4520 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:23.694 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.691+0000 7f3fa359e700 1 --2- 172.21.15.90:0/2722655813 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3fa40b18d0 0x7f3fa40ca880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:23.694 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.691+0000 7f3fa359e700 1 -- 172.21.15.90:0/2722655813 >> 172.21.15.90:0/2722655813 conn(0x7f3fa409b9b0 msgr2=0x7f3fa40ce6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:23.694 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.691+0000 7f3fa359e700 1 -- 172.21.15.90:0/2722655813 shutdown_connections 2023-06-09T04:42:23.695 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.691+0000 7f3fa359e700 1 -- 172.21.15.90:0/2722655813 wait complete. 2023-06-09T04:42:23.716 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-09T04:42:23.899 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.895+0000 7f7118848700 1 Processor -- start 2023-06-09T04:42:23.899 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.899+0000 7f7118848700 1 -- start start 2023-06-09T04:42:23.900 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.899+0000 7f7118848700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f71140cb3d0 0x7f711415a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:23.901 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.899+0000 7f7118848700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f71140cd5a0 0x7f71140cd9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:23.901 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.899+0000 7f7118848700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71140c8c90 con 0x7f711406a230 2023-06-09T04:42:23.901 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.899+0000 7f7118848700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71140cdf00 con 0x7f71140cb3d0 2023-06-09T04:42:23.901 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.899+0000 7f7118848700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f711415d9a0 con 0x7f71140cd5a0 2023-06-09T04:42:23.902 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.899+0000 7f710bfff700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f711406a230 0x7f71140ca2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:57400/0 (socket says 172.21.15.90:57400) 2023-06-09T04:42:23.902 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.899+0000 7f710bfff700 1 -- 172.21.15.90:0/25403556 learned_addr learned my addr 172.21.15.90:0/25403556 (peer_addr_for_me v1:172.21.15.90:0/0) 2023-06-09T04:42:23.902 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.899+0000 7f71137fe700 1 --2- 172.21.15.90:0/25403556 >> v2:172.21.15.90:3300/0 conn(0x7f71140cb3d0 0x7f711415a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:23.902 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.899+0000 7f7113fff700 1 --2- 172.21.15.90:0/25403556 >> v2:172.21.15.174:3300/0 conn(0x7f71140cd5a0 0x7f71140cd9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:23.902 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.899+0000 7f7112ffd700 1 -- 172.21.15.90:0/25403556 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1829208057 0 0) 0x7f71140c8c90 con 0x7f711406a230 2023-06-09T04:42:23.903 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.899+0000 7f7112ffd700 1 -- 172.21.15.90:0/25403556 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f71000035d0 con 0x7f711406a230 2023-06-09T04:42:23.903 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.899+0000 7f71137fe700 1 -- 172.21.15.90:0/25403556 >> v2:172.21.15.174:3300/0 conn(0x7f71140cd5a0 msgr2=0x7f71140cd9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:23.903 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.899+0000 7f71137fe700 1 --2- 172.21.15.90:0/25403556 >> v2:172.21.15.174:3300/0 conn(0x7f71140cd5a0 0x7f71140cd9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:23.903 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.899+0000 7f71137fe700 1 -- 172.21.15.90:0/25403556 >> v1:172.21.15.90:6789/0 conn(0x7f711406a230 legacy=0x7f71140ca2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:23.903 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.899+0000 7f71137fe700 1 -- 172.21.15.90:0/25403556 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f711406a6d0 con 0x7f71140cb3d0 2023-06-09T04:42:23.904 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.903+0000 7f71137fe700 1 --2- 172.21.15.90:0/25403556 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f71140cb3d0 0x7f711415a3b0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f711406f710 tx=0x7f7104009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28c88780e74edb6c server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:23.904 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.903+0000 7f7112ffd700 1 -- 172.21.15.90:0/25403556 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7104011830 con 0x7f71140cb3d0 2023-06-09T04:42:23.904 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.903+0000 7f7112ffd700 1 -- 172.21.15.90:0/25403556 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7104011990 con 0x7f71140cb3d0 2023-06-09T04:42:23.905 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.903+0000 7f7112ffd700 1 -- 172.21.15.90:0/25403556 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7104011d20 con 0x7f71140cb3d0 2023-06-09T04:42:23.905 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.903+0000 7f7118848700 1 -- 172.21.15.90:0/25403556 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f71140cb3d0 msgr2=0x7f711415a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:23.905 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.903+0000 7f7118848700 1 --2- 172.21.15.90:0/25403556 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f71140cb3d0 0x7f711415a3b0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f711406f710 tx=0x7f7104009b30 comp rx=0 tx=0).stop 2023-06-09T04:42:23.905 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.903+0000 7f7118848700 1 -- 172.21.15.90:0/25403556 shutdown_connections 2023-06-09T04:42:23.906 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.903+0000 7f7118848700 1 --2- 172.21.15.90:0/25403556 >> v2:172.21.15.174:3300/0 conn(0x7f71140cd5a0 0x7f71140cd9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:23.906 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.903+0000 7f7118848700 1 --2- 172.21.15.90:0/25403556 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f71140cb3d0 0x7f711415a3b0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:23.906 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.903+0000 7f7118848700 1 -- 172.21.15.90:0/25403556 >> 172.21.15.90:0/25403556 conn(0x7f71140aff00 msgr2=0x7f71140b0300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:23.906 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.903+0000 7f7118848700 1 -- 172.21.15.90:0/25403556 shutdown_connections 2023-06-09T04:42:23.906 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.903+0000 7f7118848700 1 -- 172.21.15.90:0/25403556 wait complete. 2023-06-09T04:42:23.907 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.907+0000 7f7118848700 1 Processor -- start 2023-06-09T04:42:23.907 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.907+0000 7f7118848700 1 -- start start 2023-06-09T04:42:23.909 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.907+0000 7f7118848700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f711406a230 0x7f71140c7a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:23.909 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.907+0000 7f7118848700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f71140cb3d0 0x7f71141509f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:23.909 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.907+0000 7f7118848700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71140cd5a0 0x7f7114158e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:23.909 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.907+0000 7f7118848700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71141f18d0 con 0x7f711406a230 2023-06-09T04:42:23.909 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.907+0000 7f7118848700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71141f28d0 con 0x7f71140cd5a0 2023-06-09T04:42:23.909 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.907+0000 7f7118848700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71140c8240 con 0x7f71140cb3d0 2023-06-09T04:42:23.910 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.907+0000 7f71137fe700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f711406a230 0x7f71140c7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:23.910 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.907+0000 7f71137fe700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f711406a230 0x7f71140c7a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:54200/0 (socket says 172.21.15.90:54200) 2023-06-09T04:42:23.911 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.907+0000 7f71137fe700 1 -- 172.21.15.90:0/4062661141 learned_addr learned my addr 172.21.15.90:0/4062661141 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:23.911 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.907+0000 7f7113fff700 1 --2- 172.21.15.90:0/4062661141 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71140cd5a0 0x7f7114158e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:23.911 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.907+0000 7f710bfff700 1 --2- 172.21.15.90:0/4062661141 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f71140cb3d0 0x7f71141509f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:23.911 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.907+0000 7f71137fe700 1 -- 172.21.15.90:0/4062661141 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f71140cb3d0 msgr2=0x7f71141509f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:23.911 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.907+0000 7f71137fe700 1 --2- 172.21.15.90:0/4062661141 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f71140cb3d0 0x7f71141509f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:23.911 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.907+0000 7f71137fe700 1 -- 172.21.15.90:0/4062661141 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71140cd5a0 msgr2=0x7f7114158e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:23.911 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.907+0000 7f71137fe700 1 --2- 172.21.15.90:0/4062661141 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71140cd5a0 0x7f7114158e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:23.912 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.907+0000 7f71137fe700 1 -- 172.21.15.90:0/4062661141 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71040094b0 con 0x7f711406a230 2023-06-09T04:42:23.912 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.907+0000 7f710bfff700 1 --2- 172.21.15.90:0/4062661141 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f71140cb3d0 0x7f71141509f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:42:23.912 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.907+0000 7f71137fe700 1 --2- 172.21.15.90:0/4062661141 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f711406a230 0x7f71140c7a10 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f7104014040 tx=0x7f7104004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:23.912 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.907+0000 7f7110ff9700 1 -- 172.21.15.90:0/4062661141 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7104004610 con 0x7f711406a230 2023-06-09T04:42:23.913 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.911+0000 7f7110ff9700 1 -- 172.21.15.90:0/4062661141 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f710401e070 con 0x7f711406a230 2023-06-09T04:42:23.913 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.911+0000 7f7110ff9700 1 -- 172.21.15.90:0/4062661141 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71040038e0 con 0x7f711406a230 2023-06-09T04:42:23.913 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.911+0000 7f7118848700 1 -- 172.21.15.90:0/4062661141 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71141f1b10 con 0x7f711406a230 2023-06-09T04:42:23.913 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.911+0000 7f7118848700 1 -- 172.21.15.90:0/4062661141 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71141f20d0 con 0x7f711406a230 2023-06-09T04:42:23.913 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.911+0000 7f7118848700 1 -- 172.21.15.90:0/4062661141 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f711404e380 con 0x7f711406a230 2023-06-09T04:42:23.914 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.911+0000 7f7110ff9700 1 -- 172.21.15.90:0/4062661141 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7104003a40 con 0x7f711406a230 2023-06-09T04:42:23.916 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.915+0000 7f7110ff9700 1 --2- 172.21.15.90:0/4062661141 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f70f40662f0 0x7f70f40687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:23.916 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.915+0000 7f7110ff9700 1 -- 172.21.15.90:0/4062661141 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7104084d70 con 0x7f711406a230 2023-06-09T04:42:23.916 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.915+0000 7f710bfff700 1 --2- 172.21.15.90:0/4062661141 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f70f40662f0 0x7f70f40687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:23.917 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.915+0000 7f710bfff700 1 --2- 172.21.15.90:0/4062661141 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f70f40662f0 0x7f70f40687a0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f71140c3c30 tx=0x7f70fc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:23.920 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:23.919+0000 7f7110ff9700 1 -- 172.21.15.90:0/4062661141 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f71040521e0 con 0x7f711406a230 2023-06-09T04:42:24.090 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.087+0000 7f7118848700 1 -- 172.21.15.90:0/4062661141 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f71140c8720 con 0x7f711406a230 2023-06-09T04:42:24.090 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.087+0000 7f7110ff9700 1 -- 172.21.15.90:0/4062661141 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7f71040200a0 con 0x7f711406a230 2023-06-09T04:42:24.091 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 8 2023-06-09T04:42:24.093 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.091+0000 7f7118848700 1 -- 172.21.15.90:0/4062661141 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f70f40662f0 msgr2=0x7f70f40687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:24.094 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.091+0000 7f7118848700 1 --2- 172.21.15.90:0/4062661141 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f70f40662f0 0x7f70f40687a0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f71140c3c30 tx=0x7f70fc009040 comp rx=0 tx=0).stop 2023-06-09T04:42:24.094 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.091+0000 7f7118848700 1 -- 172.21.15.90:0/4062661141 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f711406a230 msgr2=0x7f71140c7a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:24.094 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.091+0000 7f7118848700 1 --2- 172.21.15.90:0/4062661141 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f711406a230 0x7f71140c7a10 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f7104014040 tx=0x7f7104004770 comp rx=0 tx=0).stop 2023-06-09T04:42:24.094 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.091+0000 7f7118848700 1 -- 172.21.15.90:0/4062661141 shutdown_connections 2023-06-09T04:42:24.095 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.091+0000 7f7118848700 1 --2- 172.21.15.90:0/4062661141 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f70f40662f0 0x7f70f40687a0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:24.095 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.091+0000 7f7118848700 1 --2- 172.21.15.90:0/4062661141 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71140cd5a0 0x7f7114158e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:24.095 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.091+0000 7f7118848700 1 --2- 172.21.15.90:0/4062661141 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f71140cb3d0 0x7f71141509f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:24.095 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.091+0000 7f7118848700 1 --2- 172.21.15.90:0/4062661141 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f711406a230 0x7f71140c7a10 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:24.095 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.091+0000 7f7118848700 1 -- 172.21.15.90:0/4062661141 >> 172.21.15.90:0/4062661141 conn(0x7f71140aff00 msgr2=0x7f71140add70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:24.095 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.091+0000 7f7118848700 1 -- 172.21.15.90:0/4062661141 shutdown_connections 2023-06-09T04:42:24.096 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.091+0000 7f7118848700 1 -- 172.21.15.90:0/4062661141 wait complete. 2023-06-09T04:42:24.114 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-09T04:42:24.288 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.287+0000 7f5f7f59e700 1 Processor -- start 2023-06-09T04:42:24.288 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.287+0000 7f5f7f59e700 1 -- start start 2023-06-09T04:42:24.291 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.291+0000 7f5f7f59e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5f800cf020 0x7f5f800b3100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:24.291 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.291+0000 7f5f7f59e700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f80160b50 con 0x7f5f8015c300 2023-06-09T04:42:24.291 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.291+0000 7f5f7f59e700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f800c9f60 con 0x7f5f80070b80 2023-06-09T04:42:24.292 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.291+0000 7f5f7f59e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f800cb710 con 0x7f5f800cf020 2023-06-09T04:42:24.292 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.291+0000 7f5f7dd9b700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f5f8015c300 0x7f5f800cb000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:57412/0 (socket says 172.21.15.90:57412) 2023-06-09T04:42:24.292 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.291+0000 7f5f7dd9b700 1 -- 172.21.15.90:0/2534410010 learned_addr learned my addr 172.21.15.90:0/2534410010 (peer_addr_for_me v1:172.21.15.90:0/0) 2023-06-09T04:42:24.293 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.291+0000 7f5f7ed9d700 1 --2- 172.21.15.90:0/2534410010 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5f800cf020 0x7f5f800b3100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:24.293 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.291+0000 7f5f7d59a700 1 -- 172.21.15.90:0/2534410010 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 403885038 0 0) 0x7f5f80160b50 con 0x7f5f8015c300 2023-06-09T04:42:24.293 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.291+0000 7f5f7d59a700 1 -- 172.21.15.90:0/2534410010 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f680035d0 con 0x7f5f8015c300 2023-06-09T04:42:24.294 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.291+0000 7f5f7d59a700 1 -- 172.21.15.90:0/2534410010 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1126720950 0 0) 0x7f5f800c9f60 con 0x7f5f80070b80 2023-06-09T04:42:24.294 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.291+0000 7f5f7d59a700 1 -- 172.21.15.90:0/2534410010 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f80160b50 con 0x7f5f80070b80 2023-06-09T04:42:24.294 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.291+0000 7f5f7d59a700 1 -- 172.21.15.90:0/2534410010 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2987912127 0 0) 0x7f5f680035d0 con 0x7f5f8015c300 2023-06-09T04:42:24.295 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.291+0000 7f5f7d59a700 1 -- 172.21.15.90:0/2534410010 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5f800cf020 msgr2=0x7f5f800b3100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:24.295 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.291+0000 7f5f7d59a700 1 --2- 172.21.15.90:0/2534410010 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5f800cf020 0x7f5f800b3100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:24.295 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.291+0000 7f5f7d59a700 1 -- 172.21.15.90:0/2534410010 >> v1:172.21.15.174:6789/0 conn(0x7f5f80070b80 legacy=0x7f5f80070f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:24.295 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.291+0000 7f5f7d59a700 1 -- 172.21.15.90:0/2534410010 --> v1:172.21.15.90:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f800ca240 con 0x7f5f8015c300 2023-06-09T04:42:24.295 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.291+0000 7f5f7d59a700 1 -- 172.21.15.90:0/2534410010 <== mon.0 v1:172.21.15.90:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3604404106 0 0) 0x7f5f74001670 con 0x7f5f8015c300 2023-06-09T04:42:24.295 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.291+0000 7f5f7d59a700 1 -- 172.21.15.90:0/2534410010 >> v1:172.21.15.90:6789/0 conn(0x7f5f8015c300 legacy=0x7f5f800cb000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:24.295 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.291+0000 7f5f7d59a700 1 --2- 172.21.15.90:0/2534410010 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5f68003be0 0x7f5f68003fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:24.296 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.291+0000 7f5f7d59a700 1 --2- 172.21.15.90:0/2534410010 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5f68004870 0x7f5f68004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:24.296 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.291+0000 7f5f7d59a700 1 --2- 172.21.15.90:0/2534410010 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5f68005220 0x7f5f6800ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:24.296 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.291+0000 7f5f7d59a700 1 -- 172.21.15.90:0/2534410010 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f800cb710 con 0x7f5f68004870 2023-06-09T04:42:24.296 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.291+0000 7f5f7d59a700 1 -- 172.21.15.90:0/2534410010 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f6800bff0 con 0x7f5f68005220 2023-06-09T04:42:24.296 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.291+0000 7f5f7d59a700 1 -- 172.21.15.90:0/2534410010 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f6800c1b0 con 0x7f5f68003be0 2023-06-09T04:42:24.296 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.291+0000 7f5f7ed9d700 1 --2- 172.21.15.90:0/2534410010 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5f800cf020 0x7f5f800b3100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:42:24.296 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.291+0000 7f5f7dd9b700 1 --2- 172.21.15.90:0/2534410010 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5f68004870 0x7f5f68004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:24.296 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.291+0000 7f5f7dd9b700 1 -- 172.21.15.90:0/2534410010 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5f68003be0 msgr2=0x7f5f68003fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:24.297 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.291+0000 7f5f7dd9b700 1 --2- 172.21.15.90:0/2534410010 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5f68003be0 0x7f5f68003fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:24.297 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.291+0000 7f5f7dd9b700 1 -- 172.21.15.90:0/2534410010 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5f68005220 msgr2=0x7f5f6800ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:24.297 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.291+0000 7f5f7dd9b700 1 --2- 172.21.15.90:0/2534410010 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5f68005220 0x7f5f6800ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:24.297 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.291+0000 7f5f7dd9b700 1 -- 172.21.15.90:0/2534410010 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f680035d0 con 0x7f5f68004870 2023-06-09T04:42:24.297 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.291+0000 7f5f7dd9b700 1 --2- 172.21.15.90:0/2534410010 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5f68004870 0x7f5f68004ce0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f5f74007fd0 tx=0x7f5f680058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad60cd1726f0ccae server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:24.298 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.291+0000 7f5f7d59a700 1 -- 172.21.15.90:0/2534410010 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f7400cc40 con 0x7f5f68004870 2023-06-09T04:42:24.298 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.295+0000 7f5f7d59a700 1 -- 172.21.15.90:0/2534410010 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f7400cda0 con 0x7f5f68004870 2023-06-09T04:42:24.298 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.295+0000 7f5f7d59a700 1 -- 172.21.15.90:0/2534410010 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f74005ba0 con 0x7f5f68004870 2023-06-09T04:42:24.298 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.295+0000 7f5f7f59e700 1 -- 172.21.15.90:0/2534410010 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5f68004870 msgr2=0x7f5f68004ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:24.298 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.295+0000 7f5f7f59e700 1 --2- 172.21.15.90:0/2534410010 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5f68004870 0x7f5f68004ce0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f5f74007fd0 tx=0x7f5f680058a0 comp rx=0 tx=0).stop 2023-06-09T04:42:24.299 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.295+0000 7f5f7ed9d700 1 -- 172.21.15.90:0/2534410010 reap_dead start 2023-06-09T04:42:24.299 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.295+0000 7f5f7f59e700 1 -- 172.21.15.90:0/2534410010 shutdown_connections 2023-06-09T04:42:24.299 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.295+0000 7f5f7f59e700 1 -- 172.21.15.90:0/2534410010 >> 172.21.15.90:0/2534410010 conn(0x7f5f800b1c30 msgr2=0x7f5f800cf410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:24.299 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.295+0000 7f5f7f59e700 1 -- 172.21.15.90:0/2534410010 shutdown_connections 2023-06-09T04:42:24.299 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.295+0000 7f5f7f59e700 1 -- 172.21.15.90:0/2534410010 wait complete. 2023-06-09T04:42:24.300 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.299+0000 7f5f7f59e700 1 Processor -- start 2023-06-09T04:42:24.300 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.299+0000 7f5f7f59e700 1 -- start start 2023-06-09T04:42:24.301 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.299+0000 7f5f7f59e700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5f68004870 0x7f5f800c43a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:24.301 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.299+0000 7f5f7f59e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5f800c3860 0x7f5f80159500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:24.302 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.299+0000 7f5f7f59e700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5f80159ae0 0x7f5f800af9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:24.302 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.299+0000 7f5f7f59e700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f8006d090 con 0x7f5f68004870 2023-06-09T04:42:24.302 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.299+0000 7f5f7f59e700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f800c4980 con 0x7f5f80159ae0 2023-06-09T04:42:24.302 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.299+0000 7f5f7f59e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f800c2d80 con 0x7f5f800c3860 2023-06-09T04:42:24.303 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.299+0000 7f5f7e59c700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5f68004870 0x7f5f800c43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:24.303 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.299+0000 7f5f7e59c700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5f68004870 0x7f5f800c43a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:54220/0 (socket says 172.21.15.90:54220) 2023-06-09T04:42:24.303 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.299+0000 7f5f7e59c700 1 -- 172.21.15.90:0/1817388681 learned_addr learned my addr 172.21.15.90:0/1817388681 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:24.303 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.299+0000 7f5f7ed9d700 1 --2- 172.21.15.90:0/1817388681 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5f80159ae0 0x7f5f800af9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:24.303 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.299+0000 7f5f7dd9b700 1 --2- 172.21.15.90:0/1817388681 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5f800c3860 0x7f5f80159500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:24.303 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.299+0000 7f5f7e59c700 1 -- 172.21.15.90:0/1817388681 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5f800c3860 msgr2=0x7f5f80159500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:24.304 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.299+0000 7f5f7e59c700 1 --2- 172.21.15.90:0/1817388681 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5f800c3860 0x7f5f80159500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:24.304 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.299+0000 7f5f7e59c700 1 -- 172.21.15.90:0/1817388681 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5f80159ae0 msgr2=0x7f5f800af9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:24.304 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.299+0000 7f5f7e59c700 1 --2- 172.21.15.90:0/1817388681 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5f80159ae0 0x7f5f800af9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:24.304 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.299+0000 7f5f7e59c700 1 -- 172.21.15.90:0/1817388681 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f800c3060 con 0x7f5f68004870 2023-06-09T04:42:24.305 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.303+0000 7f5f7e59c700 1 --2- 172.21.15.90:0/1817388681 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5f68004870 0x7f5f800c43a0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f5f7000c700 tx=0x7f5f7000cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:24.305 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.303+0000 7f5f6effd700 1 -- 172.21.15.90:0/1817388681 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f700052d0 con 0x7f5f68004870 2023-06-09T04:42:24.305 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.303+0000 7f5f6effd700 1 -- 172.21.15.90:0/1817388681 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f70005430 con 0x7f5f68004870 2023-06-09T04:42:24.305 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.303+0000 7f5f7f59e700 1 -- 172.21.15.90:0/1817388681 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f800c3340 con 0x7f5f68004870 2023-06-09T04:42:24.305 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.303+0000 7f5f6effd700 1 -- 172.21.15.90:0/1817388681 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f700055a0 con 0x7f5f68004870 2023-06-09T04:42:24.306 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.303+0000 7f5f7f59e700 1 -- 172.21.15.90:0/1817388681 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f800aff20 con 0x7f5f68004870 2023-06-09T04:42:24.306 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.303+0000 7f5f7f59e700 1 -- 172.21.15.90:0/1817388681 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f80067380 con 0x7f5f68004870 2023-06-09T04:42:24.307 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.307+0000 7f5f6effd700 1 -- 172.21.15.90:0/1817388681 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5f700038e0 con 0x7f5f68004870 2023-06-09T04:42:24.309 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.307+0000 7f5f6effd700 1 --2- 172.21.15.90:0/1817388681 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f5f600662f0 0x7f5f600687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:24.309 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.307+0000 7f5f6effd700 1 -- 172.21.15.90:0/1817388681 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5f70083810 con 0x7f5f68004870 2023-06-09T04:42:24.309 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.307+0000 7f5f7dd9b700 1 --2- 172.21.15.90:0/1817388681 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f5f600662f0 0x7f5f600687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:24.311 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.311+0000 7f5f7dd9b700 1 --2- 172.21.15.90:0/1817388681 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f5f600662f0 0x7f5f600687a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f5f80159a40 tx=0x7f5f7400a000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:24.314 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.311+0000 7f5f6effd700 1 -- 172.21.15.90:0/1817388681 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5f70050c00 con 0x7f5f68004870 2023-06-09T04:42:24.485 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.483+0000 7f5f7f59e700 1 -- 172.21.15.90:0/1817388681 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5f800c2be0 con 0x7f5f68004870 2023-06-09T04:42:24.486 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.483+0000 7f5f6effd700 1 -- 172.21.15.90:0/1817388681 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5f800c2be0 con 0x7f5f68004870 2023-06-09T04:42:24.486 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 32 2023-06-09T04:42:24.488 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.487+0000 7f5f7f59e700 1 -- 172.21.15.90:0/1817388681 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f5f600662f0 msgr2=0x7f5f600687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:24.488 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.487+0000 7f5f7f59e700 1 --2- 172.21.15.90:0/1817388681 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f5f600662f0 0x7f5f600687a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f5f80159a40 tx=0x7f5f7400a000 comp rx=0 tx=0).stop 2023-06-09T04:42:24.488 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.487+0000 7f5f7f59e700 1 -- 172.21.15.90:0/1817388681 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5f68004870 msgr2=0x7f5f800c43a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:24.488 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.487+0000 7f5f7f59e700 1 --2- 172.21.15.90:0/1817388681 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5f68004870 0x7f5f800c43a0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f5f7000c700 tx=0x7f5f7000cac0 comp rx=0 tx=0).stop 2023-06-09T04:42:24.489 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.487+0000 7f5f7f59e700 1 -- 172.21.15.90:0/1817388681 shutdown_connections 2023-06-09T04:42:24.489 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.487+0000 7f5f7f59e700 1 --2- 172.21.15.90:0/1817388681 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f5f600662f0 0x7f5f600687a0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:24.489 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.487+0000 7f5f7f59e700 1 --2- 172.21.15.90:0/1817388681 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5f80159ae0 0x7f5f800af9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:24.489 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.487+0000 7f5f7f59e700 1 --2- 172.21.15.90:0/1817388681 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5f800c3860 0x7f5f80159500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:24.490 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.487+0000 7f5f7f59e700 1 --2- 172.21.15.90:0/1817388681 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5f68004870 0x7f5f800c43a0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:24.490 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.487+0000 7f5f7f59e700 1 -- 172.21.15.90:0/1817388681 >> 172.21.15.90:0/1817388681 conn(0x7f5f800b1c30 msgr2=0x7f5f80070f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:24.490 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.487+0000 7f5f7f59e700 1 -- 172.21.15.90:0/1817388681 shutdown_connections 2023-06-09T04:42:24.490 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.487+0000 7f5f7f59e700 1 -- 172.21.15.90:0/1817388681 wait complete. 2023-06-09T04:42:24.510 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-09T04:42:24.690 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.687+0000 7f3ac1889700 1 Processor -- start 2023-06-09T04:42:24.690 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.687+0000 7f3ac1889700 1 -- start start 2023-06-09T04:42:24.692 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.691+0000 7f3ac1889700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3abc06d9d0 0x7f3abc06ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:24.692 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.691+0000 7f3ac1889700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f3abc159240 0x7f3abc15be90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:24.692 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.691+0000 7f3ac1889700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f3abc0ce0e0 0x7f3abc0ce560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:24.693 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.691+0000 7f3ac1889700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3abc0ceaa0 con 0x7f3abc159240 2023-06-09T04:42:24.693 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.691+0000 7f3ac1889700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3abc06d230 con 0x7f3abc0ce0e0 2023-06-09T04:42:24.693 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.691+0000 7f3ac1889700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3abc15cdc0 con 0x7f3abc06d9d0 2023-06-09T04:42:24.694 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.691+0000 7f3aba7fc700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f3abc159240 0x7f3abc15be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:24.694 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.691+0000 7f3abaffd700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3abc06d9d0 0x7f3abc06ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:24.694 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.691+0000 7f3aba7fc700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f3abc159240 0x7f3abc15be90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:54226/0 (socket says 172.21.15.90:54226) 2023-06-09T04:42:24.694 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.691+0000 7f3aba7fc700 1 -- 172.21.15.90:0/1673217707 learned_addr learned my addr 172.21.15.90:0/1673217707 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:24.694 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.691+0000 7f3abbfff700 1 --2- 172.21.15.90:0/1673217707 >> v2:172.21.15.174:3300/0 conn(0x7f3abc0ce0e0 0x7f3abc0ce560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:24.695 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.691+0000 7f3aba7fc700 1 -- 172.21.15.90:0/1673217707 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3abc06d9d0 msgr2=0x7f3abc06ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:24.695 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.691+0000 7f3aba7fc700 1 --2- 172.21.15.90:0/1673217707 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3abc06d9d0 0x7f3abc06ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:24.695 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.691+0000 7f3aba7fc700 1 -- 172.21.15.90:0/1673217707 >> v2:172.21.15.174:3300/0 conn(0x7f3abc0ce0e0 msgr2=0x7f3abc0ce560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:24.695 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.691+0000 7f3aba7fc700 1 --2- 172.21.15.90:0/1673217707 >> v2:172.21.15.174:3300/0 conn(0x7f3abc0ce0e0 0x7f3abc0ce560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:24.695 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.691+0000 7f3aba7fc700 1 -- 172.21.15.90:0/1673217707 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3abc15c800 con 0x7f3abc159240 2023-06-09T04:42:24.695 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.691+0000 7f3aba7fc700 1 --2- 172.21.15.90:0/1673217707 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3abc159240 0x7f3abc15be90 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f3abc0d0440 tx=0x7f3ab0009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aea4ad214034aede server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:24.696 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.691+0000 7f3ab9ffb700 1 -- 172.21.15.90:0/1673217707 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ab0011830 con 0x7f3abc159240 2023-06-09T04:42:24.696 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.691+0000 7f3ab9ffb700 1 -- 172.21.15.90:0/1673217707 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ab0011990 con 0x7f3abc159240 2023-06-09T04:42:24.696 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.691+0000 7f3ab9ffb700 1 -- 172.21.15.90:0/1673217707 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ab0011d20 con 0x7f3abc159240 2023-06-09T04:42:24.697 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.695+0000 7f3ac1889700 1 -- 172.21.15.90:0/1673217707 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3abc159240 msgr2=0x7f3abc15be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:24.697 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.695+0000 7f3ac1889700 1 --2- 172.21.15.90:0/1673217707 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3abc159240 0x7f3abc15be90 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f3abc0d0440 tx=0x7f3ab0009bf0 comp rx=0 tx=0).stop 2023-06-09T04:42:24.697 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.695+0000 7f3ac1889700 1 -- 172.21.15.90:0/1673217707 shutdown_connections 2023-06-09T04:42:24.697 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.695+0000 7f3ac1889700 1 --2- 172.21.15.90:0/1673217707 >> v2:172.21.15.174:3300/0 conn(0x7f3abc0ce0e0 0x7f3abc0ce560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:24.697 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.695+0000 7f3ac1889700 1 --2- 172.21.15.90:0/1673217707 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3abc159240 0x7f3abc15be90 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:24.697 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.695+0000 7f3ac1889700 1 --2- 172.21.15.90:0/1673217707 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3abc06d9d0 0x7f3abc06ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:24.697 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.695+0000 7f3ac1889700 1 -- 172.21.15.90:0/1673217707 >> 172.21.15.90:0/1673217707 conn(0x7f3abc0d0510 msgr2=0x7f3abc0d0910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:24.697 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.695+0000 7f3ac1889700 1 -- 172.21.15.90:0/1673217707 shutdown_connections 2023-06-09T04:42:24.698 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.695+0000 7f3ac1889700 1 -- 172.21.15.90:0/1673217707 wait complete. 2023-06-09T04:42:24.698 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.695+0000 7f3ac1889700 1 Processor -- start 2023-06-09T04:42:24.698 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.695+0000 7f3ac1889700 1 -- start start 2023-06-09T04:42:24.701 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.699+0000 7f3ac1889700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3abc06d9d0 0x7f3abc0c4040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:24.702 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.699+0000 7f3ac1889700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3abc0ce0e0 0x7f3abc155970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:24.702 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.699+0000 7f3ac1889700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3abc0c6de0 0x7f3abc14c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:24.702 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.699+0000 7f3ac1889700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3abc0c5b30 con 0x7f3abc0c6de0 2023-06-09T04:42:24.702 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.699+0000 7f3ac1889700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3abc0c5d40 con 0x7f3abc0ce0e0 2023-06-09T04:42:24.702 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.699+0000 7f3ac1889700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3abc0c6020 con 0x7f3abc06d9d0 2023-06-09T04:42:24.702 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.699+0000 7f3abbfff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3abc0c6de0 0x7f3abc14c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:24.703 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.699+0000 7f3abbfff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3abc0c6de0 0x7f3abc14c2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:54234/0 (socket says 172.21.15.90:54234) 2023-06-09T04:42:24.703 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.699+0000 7f3abbfff700 1 -- 172.21.15.90:0/667722354 learned_addr learned my addr 172.21.15.90:0/667722354 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:24.703 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.699+0000 7f3abaffd700 1 --2- 172.21.15.90:0/667722354 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3abc06d9d0 0x7f3abc0c4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:24.703 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.699+0000 7f3aba7fc700 1 --2- 172.21.15.90:0/667722354 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3abc0ce0e0 0x7f3abc155970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:24.703 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.699+0000 7f3abbfff700 1 -- 172.21.15.90:0/667722354 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3abc06d9d0 msgr2=0x7f3abc0c4040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:24.703 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.699+0000 7f3abbfff700 1 --2- 172.21.15.90:0/667722354 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3abc06d9d0 0x7f3abc0c4040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:24.703 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.699+0000 7f3abbfff700 1 -- 172.21.15.90:0/667722354 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3abc0ce0e0 msgr2=0x7f3abc155970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:24.703 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.699+0000 7f3abbfff700 1 --2- 172.21.15.90:0/667722354 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3abc0ce0e0 0x7f3abc155970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:24.704 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.699+0000 7f3abbfff700 1 -- 172.21.15.90:0/667722354 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ab0009570 con 0x7f3abc0c6de0 2023-06-09T04:42:24.704 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.699+0000 7f3aba7fc700 1 --2- 172.21.15.90:0/667722354 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3abc0ce0e0 0x7f3abc155970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:42:24.704 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.699+0000 7f3abbfff700 1 --2- 172.21.15.90:0/667722354 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3abc0c6de0 0x7f3abc14c2b0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f3ab400efc0 tx=0x7f3ab400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:24.704 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.699+0000 7f3aa3fff700 1 -- 172.21.15.90:0/667722354 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ab4009ea0 con 0x7f3abc0c6de0 2023-06-09T04:42:24.704 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.699+0000 7f3aa3fff700 1 -- 172.21.15.90:0/667722354 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ab400f040 con 0x7f3abc0c6de0 2023-06-09T04:42:24.704 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.699+0000 7f3ac1889700 1 -- 172.21.15.90:0/667722354 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3abc0c6300 con 0x7f3abc0c6de0 2023-06-09T04:42:24.704 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.699+0000 7f3aa3fff700 1 -- 172.21.15.90:0/667722354 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ab4014480 con 0x7f3abc0c6de0 2023-06-09T04:42:24.705 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.699+0000 7f3ac1889700 1 -- 172.21.15.90:0/667722354 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3abc0c68c0 con 0x7f3abc0c6de0 2023-06-09T04:42:24.705 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.703+0000 7f3ac1889700 1 -- 172.21.15.90:0/667722354 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3abc0c6ab0 con 0x7f3abc0c6de0 2023-06-09T04:42:24.705 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.703+0000 7f3aa3fff700 1 -- 172.21.15.90:0/667722354 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f3ab40145e0 con 0x7f3abc0c6de0 2023-06-09T04:42:24.706 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.703+0000 7f3aa3fff700 1 --2- 172.21.15.90:0/667722354 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f3aa8066320 0x7f3aa80687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:24.706 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.703+0000 7f3aa3fff700 1 -- 172.21.15.90:0/667722354 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3ab4084600 con 0x7f3abc0c6de0 2023-06-09T04:42:24.707 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.707+0000 7f3abaffd700 1 --2- 172.21.15.90:0/667722354 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f3aa8066320 0x7f3aa80687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:24.708 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.707+0000 7f3abaffd700 1 --2- 172.21.15.90:0/667722354 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f3aa8066320 0x7f3aa80687d0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f3aac009ad0 tx=0x7f3aac009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:24.711 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.711+0000 7f3aa3fff700 1 -- 172.21.15.90:0/667722354 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3ab40519e0 con 0x7f3abc0c6de0 2023-06-09T04:42:24.887 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.887+0000 7f3ac1889700 1 -- 172.21.15.90:0/667722354 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3abc04db30 con 0x7f3abc0c6de0 2023-06-09T04:42:24.888 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.887+0000 7f3aa3fff700 1 -- 172.21.15.90:0/667722354 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3ab4055000 con 0x7f3abc0c6de0 2023-06-09T04:42:24.888 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 64 2023-06-09T04:42:24.891 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.887+0000 7f3ac1889700 1 -- 172.21.15.90:0/667722354 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f3aa8066320 msgr2=0x7f3aa80687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:24.891 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.887+0000 7f3ac1889700 1 --2- 172.21.15.90:0/667722354 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f3aa8066320 0x7f3aa80687d0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f3aac009ad0 tx=0x7f3aac009240 comp rx=0 tx=0).stop 2023-06-09T04:42:24.891 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.887+0000 7f3ac1889700 1 -- 172.21.15.90:0/667722354 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3abc0c6de0 msgr2=0x7f3abc14c2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:24.891 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.887+0000 7f3ac1889700 1 --2- 172.21.15.90:0/667722354 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3abc0c6de0 0x7f3abc14c2b0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f3ab400efc0 tx=0x7f3ab400c3a0 comp rx=0 tx=0).stop 2023-06-09T04:42:24.891 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.891+0000 7f3ac1889700 1 -- 172.21.15.90:0/667722354 shutdown_connections 2023-06-09T04:42:24.892 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.891+0000 7f3ac1889700 1 --2- 172.21.15.90:0/667722354 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f3aa8066320 0x7f3aa80687d0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:24.892 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.891+0000 7f3ac1889700 1 --2- 172.21.15.90:0/667722354 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3abc0c6de0 0x7f3abc14c2b0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:24.892 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.891+0000 7f3ac1889700 1 --2- 172.21.15.90:0/667722354 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3abc0ce0e0 0x7f3abc155970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:24.892 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.891+0000 7f3ac1889700 1 --2- 172.21.15.90:0/667722354 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3abc06d9d0 0x7f3abc0c4040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:24.892 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.891+0000 7f3ac1889700 1 -- 172.21.15.90:0/667722354 >> 172.21.15.90:0/667722354 conn(0x7f3abc0d0510 msgr2=0x7f3abc156810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:24.893 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.891+0000 7f3ac1889700 1 -- 172.21.15.90:0/667722354 shutdown_connections 2023-06-09T04:42:24.893 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:24.891+0000 7f3ac1889700 1 -- 172.21.15.90:0/667722354 wait complete. 2023-06-09T04:42:24.915 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T04:42:25.090 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.087+0000 7f008f59e700 1 Processor -- start 2023-06-09T04:42:25.090 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.087+0000 7f008f59e700 1 -- start start 2023-06-09T04:42:25.093 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.091+0000 7f008f59e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f009015deb0 0x7f00900cc0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:25.093 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.091+0000 7f008f59e700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00900cd8a0 con 0x7f00900cafb0 2023-06-09T04:42:25.093 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.091+0000 7f008f59e700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00900cb420 con 0x7f0090154350 2023-06-09T04:42:25.094 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.091+0000 7f008f59e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0090154720 con 0x7f009015deb0 2023-06-09T04:42:25.094 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.091+0000 7f008dd9b700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f00900cafb0 0x7f0090069c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:57420/0 (socket says 172.21.15.90:57420) 2023-06-09T04:42:25.094 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.091+0000 7f008dd9b700 1 -- 172.21.15.90:0/3824587146 learned_addr learned my addr 172.21.15.90:0/3824587146 (peer_addr_for_me v1:172.21.15.90:0/0) 2023-06-09T04:42:25.098 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.091+0000 7f008ed9d700 1 --2- 172.21.15.90:0/3824587146 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f009015deb0 0x7f00900cc0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:25.099 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.091+0000 7f008d59a700 1 -- 172.21.15.90:0/3824587146 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3574514224 0 0) 0x7f00900cd8a0 con 0x7f00900cafb0 2023-06-09T04:42:25.099 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.091+0000 7f008d59a700 1 -- 172.21.15.90:0/3824587146 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00780035d0 con 0x7f00900cafb0 2023-06-09T04:42:25.099 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.091+0000 7f008d59a700 1 -- 172.21.15.90:0/3824587146 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1702663705 0 0) 0x7f00900cb420 con 0x7f0090154350 2023-06-09T04:42:25.099 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.091+0000 7f008d59a700 1 -- 172.21.15.90:0/3824587146 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00900cd8a0 con 0x7f0090154350 2023-06-09T04:42:25.100 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.091+0000 7f008d59a700 1 -- 172.21.15.90:0/3824587146 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 447293117 0 0) 0x7f00780035d0 con 0x7f00900cafb0 2023-06-09T04:42:25.100 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.091+0000 7f008d59a700 1 -- 172.21.15.90:0/3824587146 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f009015deb0 msgr2=0x7f00900cc0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:25.100 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.091+0000 7f008d59a700 1 --2- 172.21.15.90:0/3824587146 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f009015deb0 0x7f00900cc0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:25.100 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.091+0000 7f008d59a700 1 -- 172.21.15.90:0/3824587146 >> v1:172.21.15.174:6789/0 conn(0x7f0090154350 legacy=0x7f009015d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:25.101 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.091+0000 7f008d59a700 1 -- 172.21.15.90:0/3824587146 --> v1:172.21.15.90:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00900cdaf0 con 0x7f00900cafb0 2023-06-09T04:42:25.101 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.091+0000 7f008d59a700 1 -- 172.21.15.90:0/3824587146 <== mon.0 v1:172.21.15.90:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3604404106 0 0) 0x7f0084001670 con 0x7f00900cafb0 2023-06-09T04:42:25.101 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.091+0000 7f008d59a700 1 -- 172.21.15.90:0/3824587146 >> v1:172.21.15.90:6789/0 conn(0x7f00900cafb0 legacy=0x7f0090069c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:25.101 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.091+0000 7f008d59a700 1 --2- 172.21.15.90:0/3824587146 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0078003be0 0x7f0078003fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:25.102 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.091+0000 7f008d59a700 1 --2- 172.21.15.90:0/3824587146 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f009015deb0 0x7f0078004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:25.102 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.091+0000 7f008d59a700 1 --2- 172.21.15.90:0/3824587146 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0078004db0 0x7f0078005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:25.102 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.091+0000 7f008d59a700 1 -- 172.21.15.90:0/3824587146 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f007800bae0 con 0x7f0078004db0 2023-06-09T04:42:25.102 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.091+0000 7f008d59a700 1 -- 172.21.15.90:0/3824587146 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f007800bc20 con 0x7f0078003be0 2023-06-09T04:42:25.103 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.091+0000 7f008d59a700 1 -- 172.21.15.90:0/3824587146 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f007800bd90 con 0x7f009015deb0 2023-06-09T04:42:25.103 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.095+0000 7f008e59c700 1 --2- 172.21.15.90:0/3824587146 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0078003be0 0x7f0078003fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:25.103 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.095+0000 7f008dd9b700 1 --2- 172.21.15.90:0/3824587146 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f009015deb0 0x7f0078004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:25.103 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.095+0000 7f008ed9d700 1 --2- 172.21.15.90:0/3824587146 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0078004db0 0x7f0078005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:25.104 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.095+0000 7f008ed9d700 1 -- 172.21.15.90:0/3824587146 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f009015deb0 msgr2=0x7f0078004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:25.104 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.095+0000 7f008ed9d700 1 --2- 172.21.15.90:0/3824587146 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f009015deb0 0x7f0078004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:25.104 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.095+0000 7f008ed9d700 1 -- 172.21.15.90:0/3824587146 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0078003be0 msgr2=0x7f0078003fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:25.104 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.095+0000 7f008ed9d700 1 --2- 172.21.15.90:0/3824587146 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0078003be0 0x7f0078003fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:25.105 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.095+0000 7f008ed9d700 1 -- 172.21.15.90:0/3824587146 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00780035d0 con 0x7f0078004db0 2023-06-09T04:42:25.105 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.095+0000 7f008ed9d700 1 --2- 172.21.15.90:0/3824587146 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0078004db0 0x7f0078005220 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f009015e8c0 tx=0x7f00780058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54b7a505f689233b server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:25.105 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.095+0000 7f008d59a700 1 -- 172.21.15.90:0/3824587146 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f008800eb70 con 0x7f0078004db0 2023-06-09T04:42:25.105 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.095+0000 7f008d59a700 1 -- 172.21.15.90:0/3824587146 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f008800f040 con 0x7f0078004db0 2023-06-09T04:42:25.106 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.095+0000 7f008d59a700 1 -- 172.21.15.90:0/3824587146 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0088014480 con 0x7f0078004db0 2023-06-09T04:42:25.106 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.095+0000 7f008f59e700 1 -- 172.21.15.90:0/3824587146 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0078004db0 msgr2=0x7f0078005220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:25.106 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.095+0000 7f008f59e700 1 --2- 172.21.15.90:0/3824587146 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0078004db0 0x7f0078005220 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f009015e8c0 tx=0x7f00780058a0 comp rx=0 tx=0).stop 2023-06-09T04:42:25.106 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.095+0000 7f008ed9d700 1 -- 172.21.15.90:0/3824587146 reap_dead start 2023-06-09T04:42:25.107 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.095+0000 7f008f59e700 1 -- 172.21.15.90:0/3824587146 shutdown_connections 2023-06-09T04:42:25.107 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.095+0000 7f008f59e700 1 -- 172.21.15.90:0/3824587146 >> 172.21.15.90:0/3824587146 conn(0x7f009006c690 msgr2=0x7f00900aff00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:25.107 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.095+0000 7f008f59e700 1 -- 172.21.15.90:0/3824587146 shutdown_connections 2023-06-09T04:42:25.107 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.095+0000 7f008f59e700 1 -- 172.21.15.90:0/3824587146 wait complete. 2023-06-09T04:42:25.111 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.099+0000 7f008f59e700 1 Processor -- start 2023-06-09T04:42:25.111 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.099+0000 7f008f59e700 1 -- start start 2023-06-09T04:42:25.111 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.103+0000 7f008f59e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0078004db0 0x7f00901574e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:25.111 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.103+0000 7f008f59e700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f009014fca0 0x7f00900aeef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:25.111 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.103+0000 7f008f59e700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f00900af430 0x7f00901ed6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:25.111 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.103+0000 7f008f59e700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00900af8a0 con 0x7f009014fca0 2023-06-09T04:42:25.112 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.103+0000 7f008f59e700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0090152300 con 0x7f00900af430 2023-06-09T04:42:25.112 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.103+0000 7f008f59e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00901519d0 con 0x7f0078004db0 2023-06-09T04:42:25.112 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.103+0000 7f008dd9b700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f009014fca0 0x7f00900aeef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:25.112 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.103+0000 7f008dd9b700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f009014fca0 0x7f00900aeef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:54254/0 (socket says 172.21.15.90:54254) 2023-06-09T04:42:25.112 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.103+0000 7f008dd9b700 1 -- 172.21.15.90:0/440453075 learned_addr learned my addr 172.21.15.90:0/440453075 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:25.112 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.103+0000 7f008ed9d700 1 --2- 172.21.15.90:0/440453075 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f00900af430 0x7f00901ed6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:25.112 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.103+0000 7f008e59c700 1 --2- 172.21.15.90:0/440453075 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0078004db0 0x7f00901574e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:25.113 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.103+0000 7f008dd9b700 1 -- 172.21.15.90:0/440453075 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0078004db0 msgr2=0x7f00901574e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:25.113 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.103+0000 7f008dd9b700 1 --2- 172.21.15.90:0/440453075 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0078004db0 0x7f00901574e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:25.113 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.103+0000 7f008dd9b700 1 -- 172.21.15.90:0/440453075 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f00900af430 msgr2=0x7f00901ed6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:25.113 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.103+0000 7f008dd9b700 1 --2- 172.21.15.90:0/440453075 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f00900af430 0x7f00901ed6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:25.113 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.103+0000 7f008dd9b700 1 -- 172.21.15.90:0/440453075 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0090151cb0 con 0x7f009014fca0 2023-06-09T04:42:25.113 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.103+0000 7f008e59c700 1 --2- 172.21.15.90:0/440453075 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0078004db0 0x7f00901574e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:42:25.113 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.103+0000 7f008dd9b700 1 --2- 172.21.15.90:0/440453075 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f009014fca0 0x7f00900aeef0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f0084007290 tx=0x7f0084007650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:25.113 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.103+0000 7f007effd700 1 -- 172.21.15.90:0/440453075 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0084013050 con 0x7f009014fca0 2023-06-09T04:42:25.114 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.103+0000 7f007effd700 1 -- 172.21.15.90:0/440453075 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0084014040 con 0x7f009014fca0 2023-06-09T04:42:25.114 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.103+0000 7f008f59e700 1 -- 172.21.15.90:0/440453075 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0090151f90 con 0x7f009014fca0 2023-06-09T04:42:25.114 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.103+0000 7f007effd700 1 -- 172.21.15.90:0/440453075 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f008400eda0 con 0x7f009014fca0 2023-06-09T04:42:25.114 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.103+0000 7f008f59e700 1 -- 172.21.15.90:0/440453075 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0090150110 con 0x7f009014fca0 2023-06-09T04:42:25.114 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.103+0000 7f008f59e700 1 -- 172.21.15.90:0/440453075 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f009006b370 con 0x7f009014fca0 2023-06-09T04:42:25.114 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.107+0000 7f007effd700 1 -- 172.21.15.90:0/440453075 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f008400c450 con 0x7f009014fca0 2023-06-09T04:42:25.114 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.107+0000 7f007effd700 1 --2- 172.21.15.90:0/440453075 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f00700662f0 0x7f00700687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:25.115 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.107+0000 7f007effd700 1 -- 172.21.15.90:0/440453075 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0084087b50 con 0x7f009014fca0 2023-06-09T04:42:25.115 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.107+0000 7f008e59c700 1 --2- 172.21.15.90:0/440453075 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f00700662f0 0x7f00700687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:25.115 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.111+0000 7f008e59c700 1 --2- 172.21.15.90:0/440453075 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f00700662f0 0x7f00700687a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f0080007fd0 tx=0x7f0080009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:25.115 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.111+0000 7f007effd700 1 -- 172.21.15.90:0/440453075 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0084054fc0 con 0x7f009014fca0 2023-06-09T04:42:25.282 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.279+0000 7f008f59e700 1 -- 172.21.15.90:0/440453075 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f009004e380 con 0x7f009014fca0 2023-06-09T04:42:25.285 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.283+0000 7f007effd700 1 -- 172.21.15.90:0/440453075 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18279 (secure 0 0 0) 0x7f008401e090 con 0x7f009014fca0 2023-06-09T04:42:25.286 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:42:25.286 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":24,"fsid":"700369c0-a111-43b4-9415-844ad1742b70","created":"2023-06-09T04:41:28.180311+0000","modified":"2023-06-09T04:41:55.389425+0000","last_up_change":"2023-06-09T04:41:40.746475+0000","last_in_change":"2023-06-09T04:41:31.262765+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-09T04:41:42.402564+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-09T04:41:47.607323+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-09T04:41:52.543474+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-09T04:41:53.382940+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"46a4a7c5-babd-4ef3-9830-51487cff5eb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":2780271267},{"type":"v1","addr":"172.21.15.90:6809","nonce":2780271267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2780271267},{"type":"v1","addr":"172.21.15.90:6811","nonce":2780271267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2780271267},{"type":"v1","addr":"172.21.15.90:6815","nonce":2780271267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2780271267},{"type":"v1","addr":"172.21.15.90:6813","nonce":2780271267}]},"public_addr":"172.21.15.90:6809/2780271267","cluster_addr":"172.21.15.90:6811/2780271267","heartbeat_back_addr":"172.21.15.90:6815/2780271267","heartbeat_front_addr":"172.21.15.90:6813/2780271267","state":["exists","up"]},{"osd":1,"uuid":"1543988f-c498-494a-a6f9-fac8413db6ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":3064028136},{"type":"v1","addr":"172.21.15.90:6801","nonce":3064028136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":3064028136},{"type":"v1","addr":"172.21.15.90:6803","nonce":3064028136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":3064028136},{"type":"v1","addr":"172.21.15.90:6807","nonce":3064028136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":3064028136},{"type":"v1","addr":"172.21.15.90:6805","nonce":3064028136}]},"public_addr":"172.21.15.90:6801/3064028136","cluster_addr":"172.21.15.90:6803/3064028136","heartbeat_back_addr":"172.21.15.90:6807/3064028136","heartbeat_front_addr":"172.21.15.90:6805/3064028136","state":["exists","up"]},{"osd":2,"uuid":"79669dd6-ffc8-4197-b9f7-b3b372b2b9b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":3713146326},{"type":"v1","addr":"172.21.15.90:6825","nonce":3713146326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":3713146326},{"type":"v1","addr":"172.21.15.90:6827","nonce":3713146326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":3713146326},{"type":"v1","addr":"172.21.15.90:6831","nonce":3713146326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":3713146326},{"type":"v1","addr":"172.21.15.90:6829","nonce":3713146326}]},"public_addr":"172.21.15.90:6825/3713146326","cluster_addr":"172.21.15.90:6827/3713146326","heartbeat_back_addr":"172.21.15.90:6831/3713146326","heartbeat_front_addr":"172.21.15.90:6829/3713146326","state":["exists","up"]},{"osd":3,"uuid":"4062ab6f-ce40-450a-aa17-b10098766c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":3499839122},{"type":"v1","addr":"172.21.15.90:6817","nonce":3499839122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":3499839122},{"type":"v1","addr":"172.21.15.90:6819","nonce":3499839122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":3499839122},{"type":"v1","addr":"172.21.15.90:6823","nonce":3499839122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":3499839122},{"type":"v1","addr":"172.21.15.90:6821","nonce":3499839122}]},"public_addr":"172.21.15.90:6817/3499839122","cluster_addr":"172.21.15.90:6819/3499839122","heartbeat_back_addr":"172.21.15.90:6823/3499839122","heartbeat_front_addr":"172.21.15.90:6821/3499839122","state":["exists","up"]},{"osd":4,"uuid":"a10820e4-b348-4d92-9796-3b01484ace1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6817","nonce":1138565854},{"type":"v1","addr":"172.21.15.174:6819","nonce":1138565854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6821","nonce":1138565854},{"type":"v1","addr":"172.21.15.174:6823","nonce":1138565854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":1138565854},{"type":"v1","addr":"172.21.15.174:6831","nonce":1138565854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":1138565854},{"type":"v1","addr":"172.21.15.174:6829","nonce":1138565854}]},"public_addr":"172.21.15.174:6819/1138565854","cluster_addr":"172.21.15.174:6823/1138565854","heartbeat_back_addr":"172.21.15.174:6831/1138565854","heartbeat_front_addr":"172.21.15.174:6829/1138565854","state":["exists","up"]},{"osd":5,"uuid":"b4da1c32-be05-420b-9346-90d91aa70569","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":1707702879},{"type":"v1","addr":"172.21.15.174:6818","nonce":1707702879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":1707702879},{"type":"v1","addr":"172.21.15.174:6822","nonce":1707702879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6827","nonce":1707702879},{"type":"v1","addr":"172.21.15.174:6828","nonce":1707702879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":1707702879},{"type":"v1","addr":"172.21.15.174:6825","nonce":1707702879}]},"public_addr":"172.21.15.174:6818/1707702879","cluster_addr":"172.21.15.174:6822/1707702879","heartbeat_back_addr":"172.21.15.174:6828/1707702879","heartbeat_front_addr":"172.21.15.174:6825/1707702879","state":["exists","up"]},{"osd":6,"uuid":"d1b98041-d243-4355-bd0a-e22cf9875b32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":864450534},{"type":"v1","addr":"172.21.15.174:6801","nonce":864450534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":864450534},{"type":"v1","addr":"172.21.15.174:6803","nonce":864450534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":864450534},{"type":"v1","addr":"172.21.15.174:6807","nonce":864450534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":864450534},{"type":"v1","addr":"172.21.15.174:6805","nonce":864450534}]},"public_addr":"172.21.15.174:6801/864450534","cluster_addr":"172.21.15.174:6803/864450534","heartbeat_back_addr":"172.21.15.174:6807/864450534","heartbeat_front_addr":"172.21.15.174:6805/864450534","state":["exists","up"]},{"osd":7,"uuid":"5a207936-f89f-416b-b79b-34ec96f77c8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":2527640659},{"type":"v1","addr":"172.21.15.174:6809","nonce":2527640659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":2527640659},{"type":"v1","addr":"172.21.15.174:6811","nonce":2527640659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":2527640659},{"type":"v1","addr":"172.21.15.174:6815","nonce":2527640659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":2527640659},{"type":"v1","addr":"172.21.15.174:6813","nonce":2527640659}]},"public_addr":"172.21.15.174:6809/2527640659","cluster_addr":"172.21.15.174:6811/2527640659","heartbeat_back_addr":"172.21.15.174:6815/2527640659","heartbeat_front_addr":"172.21.15.174:6813/2527640659","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:36.972152+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:36.984561+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:36.998817+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:37.054944+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:37.085014+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:37.115125+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:36.854608+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:36.971685+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:42:25.288 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.287+0000 7f008f59e700 1 -- 172.21.15.90:0/440453075 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f00700662f0 msgr2=0x7f00700687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:25.288 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.287+0000 7f008f59e700 1 --2- 172.21.15.90:0/440453075 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f00700662f0 0x7f00700687a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f0080007fd0 tx=0x7f0080009040 comp rx=0 tx=0).stop 2023-06-09T04:42:25.288 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.287+0000 7f008f59e700 1 -- 172.21.15.90:0/440453075 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f009014fca0 msgr2=0x7f00900aeef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:25.288 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.287+0000 7f008f59e700 1 --2- 172.21.15.90:0/440453075 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f009014fca0 0x7f00900aeef0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f0084007290 tx=0x7f0084007650 comp rx=0 tx=0).stop 2023-06-09T04:42:25.288 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.287+0000 7f008f59e700 1 -- 172.21.15.90:0/440453075 shutdown_connections 2023-06-09T04:42:25.289 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.287+0000 7f008f59e700 1 --2- 172.21.15.90:0/440453075 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f00700662f0 0x7f00700687a0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:25.289 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.287+0000 7f008f59e700 1 --2- 172.21.15.90:0/440453075 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f00900af430 0x7f00901ed6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:25.289 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.287+0000 7f008f59e700 1 --2- 172.21.15.90:0/440453075 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f009014fca0 0x7f00900aeef0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:25.289 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.287+0000 7f008f59e700 1 --2- 172.21.15.90:0/440453075 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0078004db0 0x7f00901574e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:25.290 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.287+0000 7f008f59e700 1 -- 172.21.15.90:0/440453075 >> 172.21.15.90:0/440453075 conn(0x7f009006c690 msgr2=0x7f00900b2ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:25.290 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.287+0000 7f008f59e700 1 -- 172.21.15.90:0/440453075 shutdown_connections 2023-06-09T04:42:25.290 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.287+0000 7f008f59e700 1 -- 172.21.15.90:0/440453075 wait complete. 2023-06-09T04:42:25.310 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-09T04:41:42.402564+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-09T04:41:47.607323+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-09T04:41:52.543474+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-09T04:41:53.382940+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-09T04:42:25.311 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-09T04:42:25.489 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.487+0000 7f82a88d8700 1 Processor -- start 2023-06-09T04:42:25.489 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.487+0000 7f82a88d8700 1 -- start start 2023-06-09T04:42:25.492 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.491+0000 7f82a88d8700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f82a415f430 0x7f82a40cca40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:25.492 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.491+0000 7f82a88d8700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f82a406c4e0 0x7f82a406f600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:25.493 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.491+0000 7f82a88d8700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82a406cf30 con 0x7f82a4160580 2023-06-09T04:42:25.493 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.491+0000 7f82a88d8700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82a406d210 con 0x7f82a415f430 2023-06-09T04:42:25.493 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.491+0000 7f82a88d8700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82a415faa0 con 0x7f82a406c4e0 2023-06-09T04:42:25.494 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.491+0000 7f82a37fe700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f82a415f430 0x7f82a40cca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:25.494 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.491+0000 7f82a37fe700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f82a415f430 0x7f82a40cca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:54256/0 (socket says 172.21.15.90:54256) 2023-06-09T04:42:25.494 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.491+0000 7f82a37fe700 1 -- 172.21.15.90:0/3839619851 learned_addr learned my addr 172.21.15.90:0/3839619851 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:25.494 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.491+0000 7f82a2ffd700 1 --2- 172.21.15.90:0/3839619851 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f82a406c4e0 0x7f82a406f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:25.495 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.491+0000 7f82a37fe700 1 -- 172.21.15.90:0/3839619851 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f82a406c4e0 msgr2=0x7f82a406f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:25.495 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.491+0000 7f82a37fe700 1 --2- 172.21.15.90:0/3839619851 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f82a406c4e0 0x7f82a406f600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:25.495 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.491+0000 7f82a37fe700 1 -- 172.21.15.90:0/3839619851 >> v1:172.21.15.90:6789/0 conn(0x7f82a4160580 legacy=0x7f82a40cab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:25.495 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.491+0000 7f82a37fe700 1 -- 172.21.15.90:0/3839619851 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82a415fd80 con 0x7f82a415f430 2023-06-09T04:42:25.495 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.491+0000 7f82a27fc700 1 -- 172.21.15.90:0/3839619851 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2506448319 0 0) 0x7f82a406cf30 con 0x7f82a4160580 2023-06-09T04:42:25.495 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.491+0000 7f82a2ffd700 1 --2- 172.21.15.90:0/3839619851 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f82a406c4e0 0x7f82a406f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:42:25.496 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.491+0000 7f82a37fe700 1 --2- 172.21.15.90:0/3839619851 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f82a415f430 0x7f82a40cca40 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f8294009910 tx=0x7f8294009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8aec6cf22419adff server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:25.496 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.491+0000 7f82a27fc700 1 -- 172.21.15.90:0/3839619851 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f829400ba60 con 0x7f82a415f430 2023-06-09T04:42:25.496 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.495+0000 7f82a27fc700 1 -- 172.21.15.90:0/3839619851 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f829400bbc0 con 0x7f82a415f430 2023-06-09T04:42:25.496 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.495+0000 7f82a27fc700 1 -- 172.21.15.90:0/3839619851 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8294009e60 con 0x7f82a415f430 2023-06-09T04:42:25.497 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.495+0000 7f82a88d8700 1 -- 172.21.15.90:0/3839619851 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f82a415f430 msgr2=0x7f82a40cca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:25.497 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.495+0000 7f82a88d8700 1 --2- 172.21.15.90:0/3839619851 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f82a415f430 0x7f82a40cca40 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f8294009910 tx=0x7f8294009c20 comp rx=0 tx=0).stop 2023-06-09T04:42:25.497 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.495+0000 7f82a88d8700 1 -- 172.21.15.90:0/3839619851 shutdown_connections 2023-06-09T04:42:25.497 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.495+0000 7f82a88d8700 1 --2- 172.21.15.90:0/3839619851 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f82a406c4e0 0x7f82a406f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:25.497 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.495+0000 7f82a88d8700 1 --2- 172.21.15.90:0/3839619851 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f82a415f430 0x7f82a40cca40 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:25.497 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.495+0000 7f82a88d8700 1 -- 172.21.15.90:0/3839619851 >> 172.21.15.90:0/3839619851 conn(0x7f82a40b2c60 msgr2=0x7f82a40d0520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:25.498 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.495+0000 7f82a88d8700 1 -- 172.21.15.90:0/3839619851 shutdown_connections 2023-06-09T04:42:25.498 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.495+0000 7f82a88d8700 1 -- 172.21.15.90:0/3839619851 wait complete. 2023-06-09T04:42:25.500 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.499+0000 7f82a88d8700 1 Processor -- start 2023-06-09T04:42:25.500 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.499+0000 7f82a88d8700 1 -- start start 2023-06-09T04:42:25.502 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.499+0000 7f82a88d8700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f82a406c4e0 0x7f82a40c69d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:25.502 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.499+0000 7f82a88d8700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f82a415f430 0x7f82a40c9aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:25.502 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.499+0000 7f82a88d8700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f82a4160580 0x7f82a40b5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:25.502 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.499+0000 7f82a88d8700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82a40c6f10 con 0x7f82a406c4e0 2023-06-09T04:42:25.502 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.499+0000 7f82a88d8700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82a40c9fe0 con 0x7f82a4160580 2023-06-09T04:42:25.502 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.499+0000 7f82a88d8700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82a414df30 con 0x7f82a415f430 2023-06-09T04:42:25.503 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.499+0000 7f82a37fe700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f82a406c4e0 0x7f82a40c69d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:25.503 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.499+0000 7f82a37fe700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f82a406c4e0 0x7f82a40c69d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:54266/0 (socket says 172.21.15.90:54266) 2023-06-09T04:42:25.504 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.499+0000 7f82a37fe700 1 -- 172.21.15.90:0/2860583982 learned_addr learned my addr 172.21.15.90:0/2860583982 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:25.504 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.499+0000 7f82a2ffd700 1 --2- 172.21.15.90:0/2860583982 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f82a415f430 0x7f82a40c9aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:25.504 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.499+0000 7f82a3fff700 1 --2- 172.21.15.90:0/2860583982 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f82a4160580 0x7f82a40b5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:25.504 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.503+0000 7f82a37fe700 1 -- 172.21.15.90:0/2860583982 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f82a415f430 msgr2=0x7f82a40c9aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:25.504 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.503+0000 7f82a37fe700 1 --2- 172.21.15.90:0/2860583982 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f82a415f430 0x7f82a40c9aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:25.504 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.503+0000 7f82a37fe700 1 -- 172.21.15.90:0/2860583982 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f82a4160580 msgr2=0x7f82a40b5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:25.504 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.503+0000 7f82a37fe700 1 --2- 172.21.15.90:0/2860583982 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f82a4160580 0x7f82a40b5cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:25.505 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.503+0000 7f82a37fe700 1 -- 172.21.15.90:0/2860583982 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8294009570 con 0x7f82a406c4e0 2023-06-09T04:42:25.505 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.503+0000 7f82a37fe700 1 --2- 172.21.15.90:0/2860583982 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f82a406c4e0 0x7f82a40c69d0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f8294009c60 tx=0x7f8294004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:25.505 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.503+0000 7f828bfff700 1 -- 172.21.15.90:0/2860583982 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82940036c0 con 0x7f82a406c4e0 2023-06-09T04:42:25.505 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.503+0000 7f828bfff700 1 -- 172.21.15.90:0/2860583982 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f829401f070 con 0x7f82a406c4e0 2023-06-09T04:42:25.506 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.503+0000 7f828bfff700 1 -- 172.21.15.90:0/2860583982 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8294003a60 con 0x7f82a406c4e0 2023-06-09T04:42:25.506 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.503+0000 7f82a88d8700 1 -- 172.21.15.90:0/2860583982 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82a40c8a00 con 0x7f82a406c4e0 2023-06-09T04:42:25.506 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.503+0000 7f82a88d8700 1 -- 172.21.15.90:0/2860583982 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82a40c8fc0 con 0x7f82a406c4e0 2023-06-09T04:42:25.506 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.503+0000 7f82a88d8700 1 -- 172.21.15.90:0/2860583982 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82a4067380 con 0x7f82a406c4e0 2023-06-09T04:42:25.507 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.507+0000 7f828bfff700 1 -- 172.21.15.90:0/2860583982 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8294003bc0 con 0x7f82a406c4e0 2023-06-09T04:42:25.508 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.507+0000 7f828bfff700 1 --2- 172.21.15.90:0/2860583982 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f82900662f0 0x7f82900687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:25.509 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.507+0000 7f828bfff700 1 -- 172.21.15.90:0/2860583982 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8294021070 con 0x7f82a406c4e0 2023-06-09T04:42:25.509 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.507+0000 7f82a2ffd700 1 --2- 172.21.15.90:0/2860583982 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f82900662f0 0x7f82900687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:25.510 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.507+0000 7f82a2ffd700 1 --2- 172.21.15.90:0/2860583982 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f82900662f0 0x7f82900687a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f82a40b09e0 tx=0x7f8298008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:25.514 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.511+0000 7f828bfff700 1 -- 172.21.15.90:0/2860583982 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8294052790 con 0x7f82a406c4e0 2023-06-09T04:42:25.686 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.683+0000 7f82a88d8700 1 -- 172.21.15.90:0/2860583982 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f82a404e380 con 0x7f82a406c4e0 2023-06-09T04:42:25.687 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.687+0000 7f828bfff700 1 -- 172.21.15.90:0/2860583982 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8294055db0 con 0x7f82a406c4e0 2023-06-09T04:42:25.687 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 1 2023-06-09T04:42:25.690 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.687+0000 7f82a88d8700 1 -- 172.21.15.90:0/2860583982 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f82900662f0 msgr2=0x7f82900687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:25.690 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.687+0000 7f82a88d8700 1 --2- 172.21.15.90:0/2860583982 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f82900662f0 0x7f82900687a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f82a40b09e0 tx=0x7f8298008040 comp rx=0 tx=0).stop 2023-06-09T04:42:25.690 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.687+0000 7f82a88d8700 1 -- 172.21.15.90:0/2860583982 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f82a406c4e0 msgr2=0x7f82a40c69d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:25.691 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.687+0000 7f82a88d8700 1 --2- 172.21.15.90:0/2860583982 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f82a406c4e0 0x7f82a40c69d0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f8294009c60 tx=0x7f8294004770 comp rx=0 tx=0).stop 2023-06-09T04:42:25.691 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.687+0000 7f82a88d8700 1 -- 172.21.15.90:0/2860583982 shutdown_connections 2023-06-09T04:42:25.691 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.687+0000 7f82a88d8700 1 --2- 172.21.15.90:0/2860583982 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f82900662f0 0x7f82900687a0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:25.691 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.687+0000 7f82a88d8700 1 --2- 172.21.15.90:0/2860583982 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f82a4160580 0x7f82a40b5cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:25.691 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.687+0000 7f82a88d8700 1 --2- 172.21.15.90:0/2860583982 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f82a415f430 0x7f82a40c9aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:25.691 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.687+0000 7f82a88d8700 1 --2- 172.21.15.90:0/2860583982 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f82a406c4e0 0x7f82a40c69d0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:25.691 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.687+0000 7f82a88d8700 1 -- 172.21.15.90:0/2860583982 >> 172.21.15.90:0/2860583982 conn(0x7f82a40b2c60 msgr2=0x7f82a406e560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:25.692 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.687+0000 7f82a88d8700 1 -- 172.21.15.90:0/2860583982 shutdown_connections 2023-06-09T04:42:25.692 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.691+0000 7f82a88d8700 1 -- 172.21.15.90:0/2860583982 wait complete. 2023-06-09T04:42:25.713 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-09T04:42:25.893 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.891+0000 7f53dbc6f700 1 Processor -- start 2023-06-09T04:42:25.894 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.891+0000 7f53dbc6f700 1 -- start start 2023-06-09T04:42:25.896 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.895+0000 7f53dbc6f700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f53d40cb3a0 0x7f53d40cdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:25.896 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.895+0000 7f53dbc6f700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f53d40c3350 0x7f53d40c3780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:25.896 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.895+0000 7f53dbc6f700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f53d4071020 0x7f53d4071440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:25.896 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.895+0000 7f53dbc6f700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53d4071980 con 0x7f53d40cb3a0 2023-06-09T04:42:25.897 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.895+0000 7f53dbc6f700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53d4070b90 con 0x7f53d4071020 2023-06-09T04:42:25.897 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.895+0000 7f53dbc6f700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53d40705b0 con 0x7f53d40c3350 2023-06-09T04:42:25.898 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.895+0000 7f53d9a0b700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f53d40cb3a0 0x7f53d40cdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:25.898 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.895+0000 7f53d9a0b700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f53d40cb3a0 0x7f53d40cdcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:52850/0 (socket says 172.21.15.90:52850) 2023-06-09T04:42:25.898 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.895+0000 7f53d9a0b700 1 -- 172.21.15.90:0/2944282366 learned_addr learned my addr 172.21.15.90:0/2944282366 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:25.898 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.895+0000 7f53d920a700 1 --2- 172.21.15.90:0/2944282366 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f53d40c3350 0x7f53d40c3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:25.898 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.895+0000 7f53da20c700 1 --2- 172.21.15.90:0/2944282366 >> v2:172.21.15.174:3300/0 conn(0x7f53d4071020 0x7f53d4071440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:25.899 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.895+0000 7f53d9a0b700 1 -- 172.21.15.90:0/2944282366 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f53d40c3350 msgr2=0x7f53d40c3780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:25.899 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.895+0000 7f53d9a0b700 1 --2- 172.21.15.90:0/2944282366 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f53d40c3350 0x7f53d40c3780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:25.899 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.895+0000 7f53d9a0b700 1 -- 172.21.15.90:0/2944282366 >> v2:172.21.15.174:3300/0 conn(0x7f53d4071020 msgr2=0x7f53d4071440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:25.899 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.895+0000 7f53d9a0b700 1 --2- 172.21.15.90:0/2944282366 >> v2:172.21.15.174:3300/0 conn(0x7f53d4071020 0x7f53d4071440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:25.899 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.895+0000 7f53d9a0b700 1 -- 172.21.15.90:0/2944282366 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53d40ce230 con 0x7f53d40cb3a0 2023-06-09T04:42:25.899 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.895+0000 7f53d9a0b700 1 --2- 172.21.15.90:0/2944282366 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f53d40cb3a0 0x7f53d40cdcf0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f53d40cdac0 tx=0x7f53d0009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d45657218fc2ce server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:25.900 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.895+0000 7f53d8a09700 1 -- 172.21.15.90:0/2944282366 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53d0011830 con 0x7f53d40cb3a0 2023-06-09T04:42:25.900 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.895+0000 7f53d8a09700 1 -- 172.21.15.90:0/2944282366 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53d0011990 con 0x7f53d40cb3a0 2023-06-09T04:42:25.900 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.895+0000 7f53d8a09700 1 -- 172.21.15.90:0/2944282366 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53d0011d20 con 0x7f53d40cb3a0 2023-06-09T04:42:25.901 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.899+0000 7f53dbc6f700 1 -- 172.21.15.90:0/2944282366 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f53d40cb3a0 msgr2=0x7f53d40cdcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:25.901 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.899+0000 7f53dbc6f700 1 --2- 172.21.15.90:0/2944282366 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f53d40cb3a0 0x7f53d40cdcf0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f53d40cdac0 tx=0x7f53d0009bf0 comp rx=0 tx=0).stop 2023-06-09T04:42:25.901 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.899+0000 7f53dbc6f700 1 -- 172.21.15.90:0/2944282366 shutdown_connections 2023-06-09T04:42:25.901 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.899+0000 7f53dbc6f700 1 --2- 172.21.15.90:0/2944282366 >> v2:172.21.15.174:3300/0 conn(0x7f53d4071020 0x7f53d4071440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:25.901 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.899+0000 7f53dbc6f700 1 --2- 172.21.15.90:0/2944282366 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f53d40c3350 0x7f53d40c3780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:25.901 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.899+0000 7f53dbc6f700 1 --2- 172.21.15.90:0/2944282366 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f53d40cb3a0 0x7f53d40cdcf0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:25.901 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.899+0000 7f53dbc6f700 1 -- 172.21.15.90:0/2944282366 >> 172.21.15.90:0/2944282366 conn(0x7f53d40b00e0 msgr2=0x7f53d40b04b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:25.902 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.899+0000 7f53dbc6f700 1 -- 172.21.15.90:0/2944282366 shutdown_connections 2023-06-09T04:42:25.902 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.899+0000 7f53dbc6f700 1 -- 172.21.15.90:0/2944282366 wait complete. 2023-06-09T04:42:25.902 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.899+0000 7f53dbc6f700 1 Processor -- start 2023-06-09T04:42:25.903 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.903+0000 7f53dbc6f700 1 -- start start 2023-06-09T04:42:25.904 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.903+0000 7f53dbc6f700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f53d4071020 0x7f53d40c81c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:25.904 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.903+0000 7f53dbc6f700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f53d40c3350 0x7f53d415d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:25.904 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.903+0000 7f53dbc6f700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f53d40cb3a0 0x7f53d415dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:25.905 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.903+0000 7f53dbc6f700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53d40c5e00 con 0x7f53d40cb3a0 2023-06-09T04:42:25.905 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.903+0000 7f53dbc6f700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53d415e290 con 0x7f53d40c3350 2023-06-09T04:42:25.905 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.903+0000 7f53dbc6f700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53d41f6c80 con 0x7f53d4071020 2023-06-09T04:42:25.906 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.903+0000 7f53da20c700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f53d40cb3a0 0x7f53d415dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:25.906 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.903+0000 7f53da20c700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f53d40cb3a0 0x7f53d415dd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:52852/0 (socket says 172.21.15.90:52852) 2023-06-09T04:42:25.906 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.903+0000 7f53da20c700 1 -- 172.21.15.90:0/2077718222 learned_addr learned my addr 172.21.15.90:0/2077718222 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:25.906 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.903+0000 7f53d9a0b700 1 --2- 172.21.15.90:0/2077718222 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f53d4071020 0x7f53d40c81c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:25.906 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.903+0000 7f53d920a700 1 --2- 172.21.15.90:0/2077718222 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f53d40c3350 0x7f53d415d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:25.906 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.903+0000 7f53da20c700 1 -- 172.21.15.90:0/2077718222 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f53d4071020 msgr2=0x7f53d40c81c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:25.907 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.903+0000 7f53da20c700 1 --2- 172.21.15.90:0/2077718222 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f53d4071020 0x7f53d40c81c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:25.907 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.903+0000 7f53da20c700 1 -- 172.21.15.90:0/2077718222 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f53d40c3350 msgr2=0x7f53d415d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:25.907 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.903+0000 7f53da20c700 1 --2- 172.21.15.90:0/2077718222 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f53d40c3350 0x7f53d415d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:25.907 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.903+0000 7f53da20c700 1 -- 172.21.15.90:0/2077718222 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53d0009570 con 0x7f53d40cb3a0 2023-06-09T04:42:25.907 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.903+0000 7f53da20c700 1 --2- 172.21.15.90:0/2077718222 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f53d40cb3a0 0x7f53d415dd50 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f53cc00ef30 tx=0x7f53cc00b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:25.908 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.903+0000 7f53ca7fc700 1 -- 172.21.15.90:0/2077718222 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53cc010040 con 0x7f53d40cb3a0 2023-06-09T04:42:25.908 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.903+0000 7f53ca7fc700 1 -- 172.21.15.90:0/2077718222 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53cc00bd30 con 0x7f53d40cb3a0 2023-06-09T04:42:25.908 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.903+0000 7f53ca7fc700 1 -- 172.21.15.90:0/2077718222 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53cc00bea0 con 0x7f53d40cb3a0 2023-06-09T04:42:25.909 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.903+0000 7f53dbc6f700 1 -- 172.21.15.90:0/2077718222 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53d40b3e10 con 0x7f53d40cb3a0 2023-06-09T04:42:25.909 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.903+0000 7f53dbc6f700 1 -- 172.21.15.90:0/2077718222 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53d40c5a20 con 0x7f53d40cb3a0 2023-06-09T04:42:25.909 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.907+0000 7f53dbc6f700 1 -- 172.21.15.90:0/2077718222 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53d40c50f0 con 0x7f53d40cb3a0 2023-06-09T04:42:25.910 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.907+0000 7f53ca7fc700 1 -- 172.21.15.90:0/2077718222 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f53cc014640 con 0x7f53d40cb3a0 2023-06-09T04:42:25.913 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.911+0000 7f53ca7fc700 1 --2- 172.21.15.90:0/2077718222 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f53b80662f0 0x7f53b80687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:25.913 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.911+0000 7f53ca7fc700 1 -- 172.21.15.90:0/2077718222 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f53cc0843a0 con 0x7f53d40cb3a0 2023-06-09T04:42:25.914 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.911+0000 7f53d9a0b700 1 --2- 172.21.15.90:0/2077718222 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f53b80662f0 0x7f53b80687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:25.915 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.915+0000 7f53d9a0b700 1 --2- 172.21.15.90:0/2077718222 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f53b80662f0 0x7f53b80687a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f53d0000c00 tx=0x7f53d0008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:25.920 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:25.919+0000 7f53ca7fc700 1 -- 172.21.15.90:0/2077718222 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f53cc051810 con 0x7f53d40cb3a0 2023-06-09T04:42:26.094 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.091+0000 7f53dbc6f700 1 -- 172.21.15.90:0/2077718222 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f53d404db30 con 0x7f53d40cb3a0 2023-06-09T04:42:26.095 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.095+0000 7f53ca7fc700 1 -- 172.21.15.90:0/2077718222 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7f53cc054e30 con 0x7f53d40cb3a0 2023-06-09T04:42:26.095 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 8 2023-06-09T04:42:26.097 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.095+0000 7f53dbc6f700 1 -- 172.21.15.90:0/2077718222 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f53b80662f0 msgr2=0x7f53b80687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:26.097 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.095+0000 7f53dbc6f700 1 --2- 172.21.15.90:0/2077718222 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f53b80662f0 0x7f53b80687a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f53d0000c00 tx=0x7f53d0008030 comp rx=0 tx=0).stop 2023-06-09T04:42:26.098 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.095+0000 7f53dbc6f700 1 -- 172.21.15.90:0/2077718222 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f53d40cb3a0 msgr2=0x7f53d415dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:26.098 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.095+0000 7f53dbc6f700 1 --2- 172.21.15.90:0/2077718222 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f53d40cb3a0 0x7f53d415dd50 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f53cc00ef30 tx=0x7f53cc00b390 comp rx=0 tx=0).stop 2023-06-09T04:42:26.098 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.095+0000 7f53dbc6f700 1 -- 172.21.15.90:0/2077718222 shutdown_connections 2023-06-09T04:42:26.098 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.095+0000 7f53dbc6f700 1 --2- 172.21.15.90:0/2077718222 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f53b80662f0 0x7f53b80687a0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:26.098 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.095+0000 7f53dbc6f700 1 --2- 172.21.15.90:0/2077718222 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f53d40cb3a0 0x7f53d415dd50 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:26.099 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.095+0000 7f53dbc6f700 1 --2- 172.21.15.90:0/2077718222 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f53d40c3350 0x7f53d415d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:26.099 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.095+0000 7f53dbc6f700 1 --2- 172.21.15.90:0/2077718222 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f53d4071020 0x7f53d40c81c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:26.099 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.095+0000 7f53dbc6f700 1 -- 172.21.15.90:0/2077718222 >> 172.21.15.90:0/2077718222 conn(0x7f53d40b00e0 msgr2=0x7f53d4162b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:26.099 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.095+0000 7f53dbc6f700 1 -- 172.21.15.90:0/2077718222 shutdown_connections 2023-06-09T04:42:26.099 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.095+0000 7f53dbc6f700 1 -- 172.21.15.90:0/2077718222 wait complete. 2023-06-09T04:42:26.119 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-09T04:42:26.298 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.295+0000 7fda10dca700 1 Processor -- start 2023-06-09T04:42:26.299 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.295+0000 7fda10dca700 1 -- start start 2023-06-09T04:42:26.300 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.299+0000 7fda10dca700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fda0c0b18d0 0x7fda0c160920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:26.301 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.299+0000 7fda10dca700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fda0c0d2400 0x7fda0c0d28a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:26.301 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.299+0000 7fda10dca700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda0c15c6b0 con 0x7fda0c0b1ca0 2023-06-09T04:42:26.301 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.299+0000 7fda10dca700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda0c0d2de0 con 0x7fda0c0b18d0 2023-06-09T04:42:26.301 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.299+0000 7fda10dca700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda0c0cf6a0 con 0x7fda0c0d2400 2023-06-09T04:42:26.303 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.299+0000 7fda0affd700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7fda0c0b1ca0 0x7fda0c0cee90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:54894/0 (socket says 172.21.15.90:54894) 2023-06-09T04:42:26.304 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.299+0000 7fda0affd700 1 -- 172.21.15.90:0/317301328 learned_addr learned my addr 172.21.15.90:0/317301328 (peer_addr_for_me v1:172.21.15.90:0/0) 2023-06-09T04:42:26.304 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.299+0000 7fda0b7fe700 1 --2- 172.21.15.90:0/317301328 >> v2:172.21.15.90:3300/0 conn(0x7fda0c0b18d0 0x7fda0c160920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:26.304 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.299+0000 7fda0bfff700 1 --2- 172.21.15.90:0/317301328 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fda0c0d2400 0x7fda0c0d28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:26.305 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.299+0000 7fda0a7fc700 1 -- 172.21.15.90:0/317301328 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3490081117 0 0) 0x7fda0c15c6b0 con 0x7fda0c0b1ca0 2023-06-09T04:42:26.305 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.299+0000 7fda0a7fc700 1 -- 172.21.15.90:0/317301328 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd9f40035d0 con 0x7fda0c0b1ca0 2023-06-09T04:42:26.305 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.299+0000 7fda0b7fe700 1 -- 172.21.15.90:0/317301328 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fda0c0d2400 msgr2=0x7fda0c0d28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:26.306 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.299+0000 7fda0b7fe700 1 --2- 172.21.15.90:0/317301328 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fda0c0d2400 0x7fda0c0d28a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:26.306 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.299+0000 7fda0b7fe700 1 -- 172.21.15.90:0/317301328 >> v1:172.21.15.90:6789/0 conn(0x7fda0c0b1ca0 legacy=0x7fda0c0cee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:26.306 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.299+0000 7fda0b7fe700 1 -- 172.21.15.90:0/317301328 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda0c0cf980 con 0x7fda0c0b18d0 2023-06-09T04:42:26.306 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.303+0000 7fda0b7fe700 1 --2- 172.21.15.90:0/317301328 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fda0c0b18d0 0x7fda0c160920 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fd9fc009840 tx=0x7fd9fc009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a9d676d1d6dffa4 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:26.306 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.303+0000 7fda0a7fc700 1 -- 172.21.15.90:0/317301328 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9fc011830 con 0x7fda0c0b18d0 2023-06-09T04:42:26.307 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.303+0000 7fda0a7fc700 1 -- 172.21.15.90:0/317301328 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9fc011990 con 0x7fda0c0b18d0 2023-06-09T04:42:26.307 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.303+0000 7fda0a7fc700 1 -- 172.21.15.90:0/317301328 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9fc011d00 con 0x7fda0c0b18d0 2023-06-09T04:42:26.308 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.303+0000 7fda10dca700 1 -- 172.21.15.90:0/317301328 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fda0c0b18d0 msgr2=0x7fda0c160920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:26.308 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.303+0000 7fda10dca700 1 --2- 172.21.15.90:0/317301328 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fda0c0b18d0 0x7fda0c160920 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fd9fc009840 tx=0x7fd9fc009b50 comp rx=0 tx=0).stop 2023-06-09T04:42:26.308 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.303+0000 7fda10dca700 1 -- 172.21.15.90:0/317301328 shutdown_connections 2023-06-09T04:42:26.308 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.303+0000 7fda10dca700 1 --2- 172.21.15.90:0/317301328 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fda0c0d2400 0x7fda0c0d28a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:26.308 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.303+0000 7fda10dca700 1 --2- 172.21.15.90:0/317301328 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fda0c0b18d0 0x7fda0c160920 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:26.308 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.303+0000 7fda10dca700 1 -- 172.21.15.90:0/317301328 >> 172.21.15.90:0/317301328 conn(0x7fda0c09b9b0 msgr2=0x7fda0c0b55d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:26.309 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.303+0000 7fda10dca700 1 -- 172.21.15.90:0/317301328 shutdown_connections 2023-06-09T04:42:26.309 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.303+0000 7fda10dca700 1 -- 172.21.15.90:0/317301328 wait complete. 2023-06-09T04:42:26.309 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.307+0000 7fda10dca700 1 Processor -- start 2023-06-09T04:42:26.309 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.307+0000 7fda10dca700 1 -- start start 2023-06-09T04:42:26.310 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.307+0000 7fda10dca700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fda0c0b18d0 0x7fda0c1f2190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:26.310 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.307+0000 7fda10dca700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fda0c0b1ca0 0x7fda0c0b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:26.310 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.307+0000 7fda10dca700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fda0c0d2400 0x7fda0c0c9750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:26.310 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.307+0000 7fda10dca700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda0c0c61b0 con 0x7fda0c0b1ca0 2023-06-09T04:42:26.310 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.307+0000 7fda10dca700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda0c0b41e0 con 0x7fda0c0b18d0 2023-06-09T04:42:26.310 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.307+0000 7fda10dca700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda0c0b2ff0 con 0x7fda0c0d2400 2023-06-09T04:42:26.312 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.307+0000 7fda0affd700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fda0c0b1ca0 0x7fda0c0b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:26.312 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.307+0000 7fda0b7fe700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fda0c0b18d0 0x7fda0c1f2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:26.312 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.307+0000 7fda0affd700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fda0c0b1ca0 0x7fda0c0b20e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:52874/0 (socket says 172.21.15.90:52874) 2023-06-09T04:42:26.312 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.307+0000 7fda0b7fe700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fda0c0b18d0 0x7fda0c1f2190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.90:41428/0 (socket says 172.21.15.90:41428) 2023-06-09T04:42:26.313 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.307+0000 7fda0affd700 1 -- 172.21.15.90:0/903546444 learned_addr learned my addr 172.21.15.90:0/903546444 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:26.313 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.307+0000 7fda0bfff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fda0c0d2400 0x7fda0c0c9750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:26.313 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.311+0000 7fda0affd700 1 -- 172.21.15.90:0/903546444 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fda0c0d2400 msgr2=0x7fda0c0c9750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:26.313 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.311+0000 7fda0affd700 1 --2- 172.21.15.90:0/903546444 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fda0c0d2400 0x7fda0c0c9750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:26.313 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.311+0000 7fda0affd700 1 -- 172.21.15.90:0/903546444 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fda0c0b18d0 msgr2=0x7fda0c1f2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:26.313 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.311+0000 7fda0affd700 1 --2- 172.21.15.90:0/903546444 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fda0c0b18d0 0x7fda0c1f2190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:26.313 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.311+0000 7fda0affd700 1 -- 172.21.15.90:0/903546444 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9fc009450 con 0x7fda0c0b1ca0 2023-06-09T04:42:26.314 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.311+0000 7fda0affd700 1 --2- 172.21.15.90:0/903546444 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fda0c0b1ca0 0x7fda0c0b20e0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fda00005930 tx=0x7fda0000c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:26.314 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.311+0000 7fd9f3fff700 1 -- 172.21.15.90:0/903546444 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda00005d90 con 0x7fda0c0b1ca0 2023-06-09T04:42:26.314 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.311+0000 7fd9f3fff700 1 -- 172.21.15.90:0/903546444 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda000070d0 con 0x7fda0c0b1ca0 2023-06-09T04:42:26.314 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.311+0000 7fda10dca700 1 -- 172.21.15.90:0/903546444 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda0c0b2a30 con 0x7fda0c0b1ca0 2023-06-09T04:42:26.314 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.311+0000 7fd9f3fff700 1 -- 172.21.15.90:0/903546444 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda00007480 con 0x7fda0c0b1ca0 2023-06-09T04:42:26.314 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.311+0000 7fda10dca700 1 -- 172.21.15.90:0/903546444 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda0c0b3e70 con 0x7fda0c0b1ca0 2023-06-09T04:42:26.315 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.311+0000 7fda10dca700 1 -- 172.21.15.90:0/903546444 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda0c0b4000 con 0x7fda0c0b1ca0 2023-06-09T04:42:26.315 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.311+0000 7fd9f3fff700 1 -- 172.21.15.90:0/903546444 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fda000075e0 con 0x7fda0c0b1ca0 2023-06-09T04:42:26.316 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.315+0000 7fd9f3fff700 1 --2- 172.21.15.90:0/903546444 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fd9f8066320 0x7fd9f80687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:26.316 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.315+0000 7fd9f3fff700 1 -- 172.21.15.90:0/903546444 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fda00083100 con 0x7fda0c0b1ca0 2023-06-09T04:42:26.317 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.315+0000 7fda0b7fe700 1 --2- 172.21.15.90:0/903546444 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fd9f8066320 0x7fd9f80687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:26.318 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.315+0000 7fda0b7fe700 1 --2- 172.21.15.90:0/903546444 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fd9f8066320 0x7fd9f80687d0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fd9fc009b90 tx=0x7fd9fc008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:26.321 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.319+0000 7fd9f3fff700 1 -- 172.21.15.90:0/903546444 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fda00050580 con 0x7fda0c0b1ca0 2023-06-09T04:42:26.503 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.503+0000 7fda10dca700 1 -- 172.21.15.90:0/903546444 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fda0c04e380 con 0x7fda0c0b1ca0 2023-06-09T04:42:26.504 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.503+0000 7fd9f3fff700 1 -- 172.21.15.90:0/903546444 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7fda00053ba0 con 0x7fda0c0b1ca0 2023-06-09T04:42:26.504 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 32 2023-06-09T04:42:26.509 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.507+0000 7fda10dca700 1 -- 172.21.15.90:0/903546444 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fd9f8066320 msgr2=0x7fd9f80687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:26.509 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.507+0000 7fda10dca700 1 --2- 172.21.15.90:0/903546444 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fd9f8066320 0x7fd9f80687d0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fd9fc009b90 tx=0x7fd9fc008030 comp rx=0 tx=0).stop 2023-06-09T04:42:26.509 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.507+0000 7fda10dca700 1 -- 172.21.15.90:0/903546444 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fda0c0b1ca0 msgr2=0x7fda0c0b20e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:26.509 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.507+0000 7fda10dca700 1 --2- 172.21.15.90:0/903546444 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fda0c0b1ca0 0x7fda0c0b20e0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fda00005930 tx=0x7fda0000c9e0 comp rx=0 tx=0).stop 2023-06-09T04:42:26.509 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.507+0000 7fda10dca700 1 -- 172.21.15.90:0/903546444 shutdown_connections 2023-06-09T04:42:26.510 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.507+0000 7fda10dca700 1 --2- 172.21.15.90:0/903546444 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fd9f8066320 0x7fd9f80687d0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:26.510 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.507+0000 7fda10dca700 1 --2- 172.21.15.90:0/903546444 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fda0c0d2400 0x7fda0c0c9750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:26.510 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.507+0000 7fda10dca700 1 --2- 172.21.15.90:0/903546444 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fda0c0b1ca0 0x7fda0c0b20e0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:26.510 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.507+0000 7fda10dca700 1 --2- 172.21.15.90:0/903546444 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fda0c0b18d0 0x7fda0c1f2190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:26.510 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.507+0000 7fda10dca700 1 -- 172.21.15.90:0/903546444 >> 172.21.15.90:0/903546444 conn(0x7fda0c09b9b0 msgr2=0x7fda0c0b7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:26.511 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.507+0000 7fda10dca700 1 -- 172.21.15.90:0/903546444 shutdown_connections 2023-06-09T04:42:26.511 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.507+0000 7fda10dca700 1 -- 172.21.15.90:0/903546444 wait complete. 2023-06-09T04:42:26.529 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-09T04:42:26.708 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.707+0000 7f29914ee700 1 Processor -- start 2023-06-09T04:42:26.708 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.707+0000 7f29914ee700 1 -- start start 2023-06-09T04:42:26.711 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.711+0000 7f29914ee700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f298c158d00 0x7f298c06a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:26.711 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.711+0000 7f29914ee700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f298c0cad00 0x7f298c0cb180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:26.711 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.711+0000 7f29914ee700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f298c0ca050 con 0x7f298c0cc460 2023-06-09T04:42:26.712 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.711+0000 7f29914ee700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f298c0cb6c0 con 0x7f298c0cad00 2023-06-09T04:42:26.712 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.711+0000 7f29914ee700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f298c1590d0 con 0x7f298c158d00 2023-06-09T04:42:26.712 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.711+0000 7f298b7fe700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f298c0cad00 0x7f298c0cb180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:26.712 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.711+0000 7f298b7fe700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f298c0cad00 0x7f298c0cb180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:52880/0 (socket says 172.21.15.90:52880) 2023-06-09T04:42:26.712 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.711+0000 7f298b7fe700 1 -- 172.21.15.90:0/3310569908 learned_addr learned my addr 172.21.15.90:0/3310569908 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:26.713 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.711+0000 7f298b7fe700 1 -- 172.21.15.90:0/3310569908 >> v2:172.21.15.174:3300/0 conn(0x7f298c158d00 msgr2=0x7f298c06a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:26.713 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.711+0000 7f298b7fe700 1 --2- 172.21.15.90:0/3310569908 >> v2:172.21.15.174:3300/0 conn(0x7f298c158d00 0x7f298c06a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:26.713 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.711+0000 7f298b7fe700 1 -- 172.21.15.90:0/3310569908 >> v1:172.21.15.90:6789/0 conn(0x7f298c0cc460 legacy=0x7f298c0ca4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:26.713 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.711+0000 7f298b7fe700 1 -- 172.21.15.90:0/3310569908 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f298c0c91c0 con 0x7f298c0cad00 2023-06-09T04:42:26.714 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.711+0000 7f298b7fe700 1 --2- 172.21.15.90:0/3310569908 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f298c0cad00 0x7f298c0cb180 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f298c06f010 tx=0x7f298400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=737c6fb18f21dc83 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:26.714 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.711+0000 7f2989ffb700 1 -- 172.21.15.90:0/3310569908 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f298400e070 con 0x7f298c0cad00 2023-06-09T04:42:26.714 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.711+0000 7f2989ffb700 1 -- 172.21.15.90:0/3310569908 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f298400b9c0 con 0x7f298c0cad00 2023-06-09T04:42:26.714 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.711+0000 7f2989ffb700 1 -- 172.21.15.90:0/3310569908 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f298400bd70 con 0x7f298c0cad00 2023-06-09T04:42:26.715 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.711+0000 7f29914ee700 1 -- 172.21.15.90:0/3310569908 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f298c0cad00 msgr2=0x7f298c0cb180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:26.715 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.711+0000 7f29914ee700 1 --2- 172.21.15.90:0/3310569908 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f298c0cad00 0x7f298c0cb180 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f298c06f010 tx=0x7f298400b330 comp rx=0 tx=0).stop 2023-06-09T04:42:26.715 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.711+0000 7f29914ee700 1 -- 172.21.15.90:0/3310569908 shutdown_connections 2023-06-09T04:42:26.715 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.711+0000 7f29914ee700 1 --2- 172.21.15.90:0/3310569908 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f298c0cad00 0x7f298c0cb180 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:26.715 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.711+0000 7f29914ee700 1 --2- 172.21.15.90:0/3310569908 >> v2:172.21.15.174:3300/0 conn(0x7f298c158d00 0x7f298c06a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:26.715 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.711+0000 7f29914ee700 1 -- 172.21.15.90:0/3310569908 >> 172.21.15.90:0/3310569908 conn(0x7f298c0aff00 msgr2=0x7f298c0b0300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:26.716 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.711+0000 7f29914ee700 1 -- 172.21.15.90:0/3310569908 shutdown_connections 2023-06-09T04:42:26.716 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.711+0000 7f29914ee700 1 -- 172.21.15.90:0/3310569908 wait complete. 2023-06-09T04:42:26.718 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.715+0000 7f29914ee700 1 Processor -- start 2023-06-09T04:42:26.718 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.715+0000 7f29914ee700 1 -- start start 2023-06-09T04:42:26.720 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.719+0000 7f29914ee700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f298c0cad00 0x7f298c0c8030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:26.721 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.719+0000 7f29914ee700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f298c0cc460 0x7f298c140550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:26.721 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.719+0000 7f29914ee700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f298c158d00 0x7f298c13fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:26.721 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.719+0000 7f29914ee700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f298c14f3d0 con 0x7f298c158d00 2023-06-09T04:42:26.721 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.719+0000 7f29914ee700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f298c1524c0 con 0x7f298c0cc460 2023-06-09T04:42:26.721 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.719+0000 7f29914ee700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f298c152780 con 0x7f298c0cad00 2023-06-09T04:42:26.723 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.719+0000 7f298b7fe700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f298c158d00 0x7f298c13fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:26.723 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.719+0000 7f298b7fe700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f298c158d00 0x7f298c13fc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:52888/0 (socket says 172.21.15.90:52888) 2023-06-09T04:42:26.723 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.719+0000 7f298b7fe700 1 -- 172.21.15.90:0/3017315455 learned_addr learned my addr 172.21.15.90:0/3017315455 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:26.723 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.719+0000 7f298a7fc700 1 --2- 172.21.15.90:0/3017315455 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f298c0cc460 0x7f298c140550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:26.723 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.719+0000 7f298affd700 1 --2- 172.21.15.90:0/3017315455 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f298c0cad00 0x7f298c0c8030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:26.723 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.719+0000 7f298b7fe700 1 -- 172.21.15.90:0/3017315455 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f298c0cad00 msgr2=0x7f298c0c8030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:26.723 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.719+0000 7f298b7fe700 1 --2- 172.21.15.90:0/3017315455 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f298c0cad00 0x7f298c0c8030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:26.724 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.719+0000 7f298b7fe700 1 -- 172.21.15.90:0/3017315455 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f298c0cc460 msgr2=0x7f298c140550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:26.724 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.719+0000 7f298b7fe700 1 --2- 172.21.15.90:0/3017315455 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f298c0cc460 0x7f298c140550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:26.724 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.719+0000 7f298b7fe700 1 -- 172.21.15.90:0/3017315455 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2984009b30 con 0x7f298c158d00 2023-06-09T04:42:26.724 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.719+0000 7f298a7fc700 1 --2- 172.21.15.90:0/3017315455 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f298c0cc460 0x7f298c140550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:42:26.724 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.719+0000 7f298affd700 1 --2- 172.21.15.90:0/3017315455 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f298c0cad00 0x7f298c0c8030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:42:26.724 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.719+0000 7f298b7fe700 1 --2- 172.21.15.90:0/3017315455 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f298c158d00 0x7f298c13fc00 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f298c06f4e0 tx=0x7f2984004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:26.724 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.719+0000 7f29737fe700 1 -- 172.21.15.90:0/3017315455 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29840099b0 con 0x7f298c158d00 2023-06-09T04:42:26.725 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.719+0000 7f29737fe700 1 -- 172.21.15.90:0/3017315455 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29840092e0 con 0x7f298c158d00 2023-06-09T04:42:26.725 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.719+0000 7f29914ee700 1 -- 172.21.15.90:0/3017315455 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f298c152a60 con 0x7f298c158d00 2023-06-09T04:42:26.725 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.719+0000 7f29737fe700 1 -- 172.21.15.90:0/3017315455 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f298401b630 con 0x7f298c158d00 2023-06-09T04:42:26.725 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.723+0000 7f29914ee700 1 -- 172.21.15.90:0/3017315455 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f298c153020 con 0x7f298c158d00 2023-06-09T04:42:26.725 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.723+0000 7f29914ee700 1 -- 172.21.15.90:0/3017315455 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f298c153240 con 0x7f298c158d00 2023-06-09T04:42:26.726 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.723+0000 7f29737fe700 1 -- 172.21.15.90:0/3017315455 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f298401b790 con 0x7f298c158d00 2023-06-09T04:42:26.727 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.727+0000 7f29737fe700 1 --2- 172.21.15.90:0/3017315455 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f29780662f0 0x7f29780687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:26.728 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.727+0000 7f29737fe700 1 -- 172.21.15.90:0/3017315455 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2984085410 con 0x7f298c158d00 2023-06-09T04:42:26.728 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.727+0000 7f298affd700 1 --2- 172.21.15.90:0/3017315455 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f29780662f0 0x7f29780687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:26.729 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.727+0000 7f298affd700 1 --2- 172.21.15.90:0/3017315455 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f29780662f0 0x7f29780687a0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f297c007920 tx=0x7f297c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:26.733 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.731+0000 7f29737fe700 1 -- 172.21.15.90:0/3017315455 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2984052920 con 0x7f298c158d00 2023-06-09T04:42:26.903 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.903+0000 7f29914ee700 1 -- 172.21.15.90:0/3017315455 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f298c0c99d0 con 0x7f298c158d00 2023-06-09T04:42:26.904 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.903+0000 7f29737fe700 1 -- 172.21.15.90:0/3017315455 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2984055f40 con 0x7f298c158d00 2023-06-09T04:42:26.904 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 64 2023-06-09T04:42:26.907 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.907+0000 7f29914ee700 1 -- 172.21.15.90:0/3017315455 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f29780662f0 msgr2=0x7f29780687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:26.907 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.907+0000 7f29914ee700 1 --2- 172.21.15.90:0/3017315455 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f29780662f0 0x7f29780687a0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f297c007920 tx=0x7f297c008040 comp rx=0 tx=0).stop 2023-06-09T04:42:26.907 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.907+0000 7f29914ee700 1 -- 172.21.15.90:0/3017315455 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f298c158d00 msgr2=0x7f298c13fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:26.908 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.907+0000 7f29914ee700 1 --2- 172.21.15.90:0/3017315455 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f298c158d00 0x7f298c13fc00 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f298c06f4e0 tx=0x7f2984004af0 comp rx=0 tx=0).stop 2023-06-09T04:42:26.908 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.907+0000 7f29914ee700 1 -- 172.21.15.90:0/3017315455 shutdown_connections 2023-06-09T04:42:26.908 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.907+0000 7f29914ee700 1 --2- 172.21.15.90:0/3017315455 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f29780662f0 0x7f29780687a0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:26.909 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.907+0000 7f29914ee700 1 --2- 172.21.15.90:0/3017315455 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f298c158d00 0x7f298c13fc00 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:26.909 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.907+0000 7f29914ee700 1 --2- 172.21.15.90:0/3017315455 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f298c0cc460 0x7f298c140550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:26.909 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.907+0000 7f29914ee700 1 --2- 172.21.15.90:0/3017315455 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f298c0cad00 0x7f298c0c8030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:26.909 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.907+0000 7f29914ee700 1 -- 172.21.15.90:0/3017315455 >> 172.21.15.90:0/3017315455 conn(0x7f298c0aff00 msgr2=0x7f298c069820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:26.909 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.907+0000 7f29914ee700 1 -- 172.21.15.90:0/3017315455 shutdown_connections 2023-06-09T04:42:26.909 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:26.907+0000 7f29914ee700 1 -- 172.21.15.90:0/3017315455 wait complete. 2023-06-09T04:42:26.926 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T04:42:27.087 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.087+0000 7fee6a2e4700 1 Processor -- start 2023-06-09T04:42:27.088 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.087+0000 7fee6a2e4700 1 -- start start 2023-06-09T04:42:27.089 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.087+0000 7fee6a2e4700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fee640cc0f0 0x7fee640cd750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:27.089 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.087+0000 7fee6a2e4700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fee640cdc90 0x7fee640ab890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:27.089 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.087+0000 7fee6a2e4700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee640cc6b0 con 0x7fee6415bf60 2023-06-09T04:42:27.089 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.087+0000 7fee6a2e4700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee640cc990 con 0x7fee640cdc90 2023-06-09T04:42:27.089 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.087+0000 7fee6a2e4700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee640ccc70 con 0x7fee640cc0f0 2023-06-09T04:42:27.090 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.087+0000 7fee69ae3700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fee640cdc90 0x7fee640ab890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:27.090 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.087+0000 7fee69ae3700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fee640cdc90 0x7fee640ab890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:52892/0 (socket says 172.21.15.90:52892) 2023-06-09T04:42:27.091 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.087+0000 7fee69ae3700 1 -- 172.21.15.90:0/308260246 learned_addr learned my addr 172.21.15.90:0/308260246 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:27.091 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.087+0000 7fee68ae1700 1 --2- 172.21.15.90:0/308260246 >> v2:172.21.15.174:3300/0 conn(0x7fee640cc0f0 0x7fee640cd750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:27.091 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.087+0000 7fee69ae3700 1 -- 172.21.15.90:0/308260246 >> v2:172.21.15.174:3300/0 conn(0x7fee640cc0f0 msgr2=0x7fee640cd750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:27.091 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.087+0000 7fee69ae3700 1 --2- 172.21.15.90:0/308260246 >> v2:172.21.15.174:3300/0 conn(0x7fee640cc0f0 0x7fee640cd750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:27.091 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.087+0000 7fee69ae3700 1 -- 172.21.15.90:0/308260246 >> v1:172.21.15.174:6789/0 conn(0x7fee6415bf60 legacy=0x7fee6406f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:27.091 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.087+0000 7fee69ae3700 1 -- 172.21.15.90:0/308260246 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee640ccf50 con 0x7fee640cdc90 2023-06-09T04:42:27.091 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.087+0000 7fee68ae1700 1 --2- 172.21.15.90:0/308260246 >> v2:172.21.15.174:3300/0 conn(0x7fee640cc0f0 0x7fee640cd750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:42:27.092 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.087+0000 7fee69ae3700 1 --2- 172.21.15.90:0/308260246 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fee640cdc90 0x7fee640ab890 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fee6406f650 tx=0x7fee5c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15ecb146f522ebaa server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:27.093 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.091+0000 7fee5bfff700 1 -- 172.21.15.90:0/308260246 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee5c00e070 con 0x7fee640cdc90 2023-06-09T04:42:27.093 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.091+0000 7fee5bfff700 1 -- 172.21.15.90:0/308260246 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee5c00b9c0 con 0x7fee640cdc90 2023-06-09T04:42:27.093 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.091+0000 7fee5bfff700 1 -- 172.21.15.90:0/308260246 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee5c00bd70 con 0x7fee640cdc90 2023-06-09T04:42:27.093 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.091+0000 7fee6a2e4700 1 -- 172.21.15.90:0/308260246 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fee640cdc90 msgr2=0x7fee640ab890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:27.093 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.091+0000 7fee6a2e4700 1 --2- 172.21.15.90:0/308260246 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fee640cdc90 0x7fee640ab890 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fee6406f650 tx=0x7fee5c00b330 comp rx=0 tx=0).stop 2023-06-09T04:42:27.093 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.091+0000 7fee6a2e4700 1 -- 172.21.15.90:0/308260246 shutdown_connections 2023-06-09T04:42:27.093 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.091+0000 7fee6a2e4700 1 --2- 172.21.15.90:0/308260246 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fee640cdc90 0x7fee640ab890 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:27.094 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.091+0000 7fee6a2e4700 1 --2- 172.21.15.90:0/308260246 >> v2:172.21.15.174:3300/0 conn(0x7fee640cc0f0 0x7fee640cd750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:27.094 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.091+0000 7fee6a2e4700 1 -- 172.21.15.90:0/308260246 >> 172.21.15.90:0/308260246 conn(0x7fee6406c690 msgr2=0x7fee640aff00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:27.094 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.091+0000 7fee6a2e4700 1 -- 172.21.15.90:0/308260246 shutdown_connections 2023-06-09T04:42:27.094 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.091+0000 7fee6a2e4700 1 -- 172.21.15.90:0/308260246 wait complete. 2023-06-09T04:42:27.096 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.095+0000 7fee6a2e4700 1 Processor -- start 2023-06-09T04:42:27.096 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.095+0000 7fee6a2e4700 1 -- start start 2023-06-09T04:42:27.098 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.095+0000 7fee6a2e4700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fee640cc0f0 0x7fee640b1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:27.098 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.095+0000 7fee6a2e4700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fee640cdc90 0x7fee6414e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:27.099 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.095+0000 7fee6a2e4700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fee6415bf60 0x7fee6414e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:27.099 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.095+0000 7fee6a2e4700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee640b23c0 con 0x7fee640cdc90 2023-06-09T04:42:27.099 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.095+0000 7fee6a2e4700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee64154530 con 0x7fee640cc0f0 2023-06-09T04:42:27.099 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.095+0000 7fee6a2e4700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee64153c00 con 0x7fee6415bf60 2023-06-09T04:42:27.100 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.099+0000 7fee68ae1700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fee640cdc90 0x7fee6414e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:27.100 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.099+0000 7fee68ae1700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fee640cdc90 0x7fee6414e090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:52908/0 (socket says 172.21.15.90:52908) 2023-06-09T04:42:27.100 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.099+0000 7fee68ae1700 1 -- 172.21.15.90:0/4171910009 learned_addr learned my addr 172.21.15.90:0/4171910009 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:27.100 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.099+0000 7fee692e2700 1 --2- 172.21.15.90:0/4171910009 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fee640cc0f0 0x7fee640b1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:27.101 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.099+0000 7fee69ae3700 1 --2- 172.21.15.90:0/4171910009 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fee6415bf60 0x7fee6414e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:27.101 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.099+0000 7fee68ae1700 1 -- 172.21.15.90:0/4171910009 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fee6415bf60 msgr2=0x7fee6414e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:27.101 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.099+0000 7fee68ae1700 1 --2- 172.21.15.90:0/4171910009 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fee6415bf60 0x7fee6414e5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:27.101 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.099+0000 7fee68ae1700 1 -- 172.21.15.90:0/4171910009 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fee640cc0f0 msgr2=0x7fee640b1b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:27.101 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.099+0000 7fee68ae1700 1 --2- 172.21.15.90:0/4171910009 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fee640cc0f0 0x7fee640b1b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:27.101 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.099+0000 7fee68ae1700 1 -- 172.21.15.90:0/4171910009 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee5c009b30 con 0x7fee640cdc90 2023-06-09T04:42:27.101 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.099+0000 7fee68ae1700 1 --2- 172.21.15.90:0/4171910009 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fee640cdc90 0x7fee6414e090 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fee5400e760 tx=0x7fee5400eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:27.102 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.099+0000 7fee59ffb700 1 -- 172.21.15.90:0/4171910009 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee54004230 con 0x7fee640cdc90 2023-06-09T04:42:27.102 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.099+0000 7fee59ffb700 1 -- 172.21.15.90:0/4171910009 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee540043b0 con 0x7fee640cdc90 2023-06-09T04:42:27.103 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.099+0000 7fee6a2e4700 1 -- 172.21.15.90:0/4171910009 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee64153ee0 con 0x7fee640cdc90 2023-06-09T04:42:27.103 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.099+0000 7fee59ffb700 1 -- 172.21.15.90:0/4171910009 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee540036c0 con 0x7fee640cdc90 2023-06-09T04:42:27.103 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.099+0000 7fee6a2e4700 1 -- 172.21.15.90:0/4171910009 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee640b20b0 con 0x7fee640cdc90 2023-06-09T04:42:27.103 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.099+0000 7fee6a2e4700 1 -- 172.21.15.90:0/4171910009 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee641546c0 con 0x7fee640cdc90 2023-06-09T04:42:27.104 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.103+0000 7fee59ffb700 1 -- 172.21.15.90:0/4171910009 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fee54003820 con 0x7fee640cdc90 2023-06-09T04:42:27.106 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.103+0000 7fee59ffb700 1 --2- 172.21.15.90:0/4171910009 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fee480662f0 0x7fee480687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:27.106 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.103+0000 7fee59ffb700 1 -- 172.21.15.90:0/4171910009 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fee54083800 con 0x7fee640cdc90 2023-06-09T04:42:27.106 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.103+0000 7fee692e2700 1 --2- 172.21.15.90:0/4171910009 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fee480662f0 0x7fee480687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:27.108 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.107+0000 7fee692e2700 1 --2- 172.21.15.90:0/4171910009 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fee480662f0 0x7fee480687a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fee60000f60 tx=0x7fee60009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:27.110 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.107+0000 7fee59ffb700 1 -- 172.21.15.90:0/4171910009 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fee54054700 con 0x7fee640cdc90 2023-06-09T04:42:27.282 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.279+0000 7fee6a2e4700 1 -- 172.21.15.90:0/4171910009 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fee6404e380 con 0x7fee640cdc90 2023-06-09T04:42:27.285 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.283+0000 7fee59ffb700 1 -- 172.21.15.90:0/4171910009 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18279 (secure 0 0 0) 0x7fee540094e0 con 0x7fee640cdc90 2023-06-09T04:42:27.286 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:42:27.286 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":24,"fsid":"700369c0-a111-43b4-9415-844ad1742b70","created":"2023-06-09T04:41:28.180311+0000","modified":"2023-06-09T04:41:55.389425+0000","last_up_change":"2023-06-09T04:41:40.746475+0000","last_in_change":"2023-06-09T04:41:31.262765+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-09T04:41:42.402564+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-09T04:41:47.607323+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-09T04:41:52.543474+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-09T04:41:53.382940+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"46a4a7c5-babd-4ef3-9830-51487cff5eb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":2780271267},{"type":"v1","addr":"172.21.15.90:6809","nonce":2780271267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2780271267},{"type":"v1","addr":"172.21.15.90:6811","nonce":2780271267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2780271267},{"type":"v1","addr":"172.21.15.90:6815","nonce":2780271267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2780271267},{"type":"v1","addr":"172.21.15.90:6813","nonce":2780271267}]},"public_addr":"172.21.15.90:6809/2780271267","cluster_addr":"172.21.15.90:6811/2780271267","heartbeat_back_addr":"172.21.15.90:6815/2780271267","heartbeat_front_addr":"172.21.15.90:6813/2780271267","state":["exists","up"]},{"osd":1,"uuid":"1543988f-c498-494a-a6f9-fac8413db6ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":3064028136},{"type":"v1","addr":"172.21.15.90:6801","nonce":3064028136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":3064028136},{"type":"v1","addr":"172.21.15.90:6803","nonce":3064028136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":3064028136},{"type":"v1","addr":"172.21.15.90:6807","nonce":3064028136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":3064028136},{"type":"v1","addr":"172.21.15.90:6805","nonce":3064028136}]},"public_addr":"172.21.15.90:6801/3064028136","cluster_addr":"172.21.15.90:6803/3064028136","heartbeat_back_addr":"172.21.15.90:6807/3064028136","heartbeat_front_addr":"172.21.15.90:6805/3064028136","state":["exists","up"]},{"osd":2,"uuid":"79669dd6-ffc8-4197-b9f7-b3b372b2b9b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":3713146326},{"type":"v1","addr":"172.21.15.90:6825","nonce":3713146326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":3713146326},{"type":"v1","addr":"172.21.15.90:6827","nonce":3713146326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":3713146326},{"type":"v1","addr":"172.21.15.90:6831","nonce":3713146326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":3713146326},{"type":"v1","addr":"172.21.15.90:6829","nonce":3713146326}]},"public_addr":"172.21.15.90:6825/3713146326","cluster_addr":"172.21.15.90:6827/3713146326","heartbeat_back_addr":"172.21.15.90:6831/3713146326","heartbeat_front_addr":"172.21.15.90:6829/3713146326","state":["exists","up"]},{"osd":3,"uuid":"4062ab6f-ce40-450a-aa17-b10098766c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":3499839122},{"type":"v1","addr":"172.21.15.90:6817","nonce":3499839122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":3499839122},{"type":"v1","addr":"172.21.15.90:6819","nonce":3499839122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":3499839122},{"type":"v1","addr":"172.21.15.90:6823","nonce":3499839122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":3499839122},{"type":"v1","addr":"172.21.15.90:6821","nonce":3499839122}]},"public_addr":"172.21.15.90:6817/3499839122","cluster_addr":"172.21.15.90:6819/3499839122","heartbeat_back_addr":"172.21.15.90:6823/3499839122","heartbeat_front_addr":"172.21.15.90:6821/3499839122","state":["exists","up"]},{"osd":4,"uuid":"a10820e4-b348-4d92-9796-3b01484ace1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6817","nonce":1138565854},{"type":"v1","addr":"172.21.15.174:6819","nonce":1138565854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6821","nonce":1138565854},{"type":"v1","addr":"172.21.15.174:6823","nonce":1138565854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":1138565854},{"type":"v1","addr":"172.21.15.174:6831","nonce":1138565854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":1138565854},{"type":"v1","addr":"172.21.15.174:6829","nonce":1138565854}]},"public_addr":"172.21.15.174:6819/1138565854","cluster_addr":"172.21.15.174:6823/1138565854","heartbeat_back_addr":"172.21.15.174:6831/1138565854","heartbeat_front_addr":"172.21.15.174:6829/1138565854","state":["exists","up"]},{"osd":5,"uuid":"b4da1c32-be05-420b-9346-90d91aa70569","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":1707702879},{"type":"v1","addr":"172.21.15.174:6818","nonce":1707702879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":1707702879},{"type":"v1","addr":"172.21.15.174:6822","nonce":1707702879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6827","nonce":1707702879},{"type":"v1","addr":"172.21.15.174:6828","nonce":1707702879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":1707702879},{"type":"v1","addr":"172.21.15.174:6825","nonce":1707702879}]},"public_addr":"172.21.15.174:6818/1707702879","cluster_addr":"172.21.15.174:6822/1707702879","heartbeat_back_addr":"172.21.15.174:6828/1707702879","heartbeat_front_addr":"172.21.15.174:6825/1707702879","state":["exists","up"]},{"osd":6,"uuid":"d1b98041-d243-4355-bd0a-e22cf9875b32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":864450534},{"type":"v1","addr":"172.21.15.174:6801","nonce":864450534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":864450534},{"type":"v1","addr":"172.21.15.174:6803","nonce":864450534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":864450534},{"type":"v1","addr":"172.21.15.174:6807","nonce":864450534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":864450534},{"type":"v1","addr":"172.21.15.174:6805","nonce":864450534}]},"public_addr":"172.21.15.174:6801/864450534","cluster_addr":"172.21.15.174:6803/864450534","heartbeat_back_addr":"172.21.15.174:6807/864450534","heartbeat_front_addr":"172.21.15.174:6805/864450534","state":["exists","up"]},{"osd":7,"uuid":"5a207936-f89f-416b-b79b-34ec96f77c8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":2527640659},{"type":"v1","addr":"172.21.15.174:6809","nonce":2527640659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":2527640659},{"type":"v1","addr":"172.21.15.174:6811","nonce":2527640659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":2527640659},{"type":"v1","addr":"172.21.15.174:6815","nonce":2527640659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":2527640659},{"type":"v1","addr":"172.21.15.174:6813","nonce":2527640659}]},"public_addr":"172.21.15.174:6809/2527640659","cluster_addr":"172.21.15.174:6811/2527640659","heartbeat_back_addr":"172.21.15.174:6815/2527640659","heartbeat_front_addr":"172.21.15.174:6813/2527640659","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:36.972152+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:36.984561+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:36.998817+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:37.054944+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:37.085014+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:37.115125+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:36.854608+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:36.971685+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:42:27.288 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.287+0000 7fee6a2e4700 1 -- 172.21.15.90:0/4171910009 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fee480662f0 msgr2=0x7fee480687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:27.289 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.287+0000 7fee6a2e4700 1 --2- 172.21.15.90:0/4171910009 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fee480662f0 0x7fee480687a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fee60000f60 tx=0x7fee60009040 comp rx=0 tx=0).stop 2023-06-09T04:42:27.289 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.287+0000 7fee6a2e4700 1 -- 172.21.15.90:0/4171910009 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fee640cdc90 msgr2=0x7fee6414e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:27.289 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.287+0000 7fee6a2e4700 1 --2- 172.21.15.90:0/4171910009 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fee640cdc90 0x7fee6414e090 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fee5400e760 tx=0x7fee5400eb20 comp rx=0 tx=0).stop 2023-06-09T04:42:27.289 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.287+0000 7fee6a2e4700 1 -- 172.21.15.90:0/4171910009 shutdown_connections 2023-06-09T04:42:27.289 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.287+0000 7fee6a2e4700 1 --2- 172.21.15.90:0/4171910009 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fee480662f0 0x7fee480687a0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:27.289 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.287+0000 7fee6a2e4700 1 --2- 172.21.15.90:0/4171910009 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fee6415bf60 0x7fee6414e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:27.290 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.287+0000 7fee6a2e4700 1 --2- 172.21.15.90:0/4171910009 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fee640cdc90 0x7fee6414e090 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:27.290 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.287+0000 7fee6a2e4700 1 --2- 172.21.15.90:0/4171910009 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fee640cc0f0 0x7fee640b1b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:27.290 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.287+0000 7fee6a2e4700 1 -- 172.21.15.90:0/4171910009 >> 172.21.15.90:0/4171910009 conn(0x7fee6406c690 msgr2=0x7fee64069820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:27.290 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.287+0000 7fee6a2e4700 1 -- 172.21.15.90:0/4171910009 shutdown_connections 2023-06-09T04:42:27.290 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.287+0000 7fee6a2e4700 1 -- 172.21.15.90:0/4171910009 wait complete. 2023-06-09T04:42:27.308 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-09T04:41:42.402564+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-09T04:41:47.607323+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-09T04:41:52.543474+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-09T04:41:53.382940+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-09T04:42:27.308 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-09T04:42:27.483 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.479+0000 7f6e6e6ca700 1 Processor -- start 2023-06-09T04:42:27.483 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.483+0000 7f6e6e6ca700 1 -- start start 2023-06-09T04:42:27.485 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.483+0000 7f6e6e6ca700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f6e68159ed0 0x7f6e680718d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:27.486 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.483+0000 7f6e6e6ca700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e680ccf60 con 0x7f6e680cc790 2023-06-09T04:42:27.486 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.483+0000 7f6e6e6ca700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e680c91a0 con 0x7f6e6806a230 2023-06-09T04:42:27.486 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.483+0000 7f6e6e6ca700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e68071e10 con 0x7f6e68159ed0 2023-06-09T04:42:27.486 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.483+0000 7f6e67fff700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f6e68159ed0 0x7f6e680718d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:27.487 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.483+0000 7f6e67fff700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f6e68159ed0 0x7f6e680718d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:52922/0 (socket says 172.21.15.90:52922) 2023-06-09T04:42:27.487 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.483+0000 7f6e67fff700 1 -- 172.21.15.90:0/2426137631 learned_addr learned my addr 172.21.15.90:0/2426137631 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:27.487 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.487+0000 7f6e67fff700 1 -- 172.21.15.90:0/2426137631 >> v1:172.21.15.174:6789/0 conn(0x7f6e6806a230 legacy=0x7f6e680cc080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:27.487 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.487+0000 7f6e67fff700 1 -- 172.21.15.90:0/2426137631 >> v1:172.21.15.90:6789/0 conn(0x7f6e680cc790 legacy=0x7f6e680ca5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:27.487 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.487+0000 7f6e67fff700 1 -- 172.21.15.90:0/2426137631 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e6815a2a0 con 0x7f6e68159ed0 2023-06-09T04:42:27.488 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.487+0000 7f6e67fff700 1 --2- 172.21.15.90:0/2426137631 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6e68159ed0 0x7f6e680718d0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f6e58009e50 tx=0x7f6e5800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15d771670f4ed4d4 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:27.488 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.487+0000 7f6e677fe700 1 -- 172.21.15.90:0/2426137631 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e5800e070 con 0x7f6e68159ed0 2023-06-09T04:42:27.488 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.487+0000 7f6e677fe700 1 -- 172.21.15.90:0/2426137631 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e5800b9c0 con 0x7f6e68159ed0 2023-06-09T04:42:27.488 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.487+0000 7f6e677fe700 1 -- 172.21.15.90:0/2426137631 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e5800bd70 con 0x7f6e68159ed0 2023-06-09T04:42:27.489 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.487+0000 7f6e6e6ca700 1 -- 172.21.15.90:0/2426137631 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6e68159ed0 msgr2=0x7f6e680718d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:27.489 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.487+0000 7f6e6e6ca700 1 --2- 172.21.15.90:0/2426137631 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6e68159ed0 0x7f6e680718d0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f6e58009e50 tx=0x7f6e5800b330 comp rx=0 tx=0).stop 2023-06-09T04:42:27.489 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.487+0000 7f6e6e6ca700 1 -- 172.21.15.90:0/2426137631 shutdown_connections 2023-06-09T04:42:27.490 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.487+0000 7f6e6e6ca700 1 --2- 172.21.15.90:0/2426137631 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6e68159ed0 0x7f6e680718d0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:27.490 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.487+0000 7f6e6e6ca700 1 -- 172.21.15.90:0/2426137631 >> 172.21.15.90:0/2426137631 conn(0x7f6e680b00e0 msgr2=0x7f6e680b04b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:27.490 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.487+0000 7f6e6e6ca700 1 -- 172.21.15.90:0/2426137631 shutdown_connections 2023-06-09T04:42:27.490 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.487+0000 7f6e6e6ca700 1 -- 172.21.15.90:0/2426137631 wait complete. 2023-06-09T04:42:27.490 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.487+0000 7f6e6e6ca700 1 Processor -- start 2023-06-09T04:42:27.491 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.491+0000 7f6e6e6ca700 1 -- start start 2023-06-09T04:42:27.492 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.491+0000 7f6e6e6ca700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6e6806a230 0x7f6e680b3ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:27.492 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.491+0000 7f6e6e6ca700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6e680cc790 0x7f6e68148e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:27.492 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.491+0000 7f6e6e6ca700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6e68159ed0 0x7f6e681507e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:27.492 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.491+0000 7f6e6e6ca700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e680b43e0 con 0x7f6e680cc790 2023-06-09T04:42:27.493 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.491+0000 7f6e6e6ca700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e680b2e00 con 0x7f6e68159ed0 2023-06-09T04:42:27.493 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.491+0000 7f6e6e6ca700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e680b30e0 con 0x7f6e6806a230 2023-06-09T04:42:27.493 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.491+0000 7f6e5f7fe700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6e680cc790 0x7f6e68148e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:27.494 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.491+0000 7f6e67fff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6e6806a230 0x7f6e680b3ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:27.494 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.491+0000 7f6e5f7fe700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6e680cc790 0x7f6e68148e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:52932/0 (socket says 172.21.15.90:52932) 2023-06-09T04:42:27.494 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.491+0000 7f6e5f7fe700 1 -- 172.21.15.90:0/1398598327 learned_addr learned my addr 172.21.15.90:0/1398598327 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:27.494 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.491+0000 7f6e6cc67700 1 --2- 172.21.15.90:0/1398598327 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6e68159ed0 0x7f6e681507e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:27.494 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.491+0000 7f6e5f7fe700 1 -- 172.21.15.90:0/1398598327 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6e6806a230 msgr2=0x7f6e680b3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:27.494 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.491+0000 7f6e5f7fe700 1 --2- 172.21.15.90:0/1398598327 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6e6806a230 0x7f6e680b3ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:27.494 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.491+0000 7f6e5f7fe700 1 -- 172.21.15.90:0/1398598327 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6e68159ed0 msgr2=0x7f6e681507e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:27.495 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.491+0000 7f6e5f7fe700 1 --2- 172.21.15.90:0/1398598327 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6e68159ed0 0x7f6e681507e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:27.495 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.491+0000 7f6e5f7fe700 1 -- 172.21.15.90:0/1398598327 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e58009b30 con 0x7f6e680cc790 2023-06-09T04:42:27.495 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.491+0000 7f6e5f7fe700 1 --2- 172.21.15.90:0/1398598327 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6e680cc790 0x7f6e68148e50 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f6e5000c4d0 tx=0x7f6e5000c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:27.496 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.491+0000 7f6e657fa700 1 -- 172.21.15.90:0/1398598327 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e500052d0 con 0x7f6e680cc790 2023-06-09T04:42:27.496 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.491+0000 7f6e657fa700 1 -- 172.21.15.90:0/1398598327 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e50005430 con 0x7f6e680cc790 2023-06-09T04:42:27.496 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.491+0000 7f6e6e6ca700 1 -- 172.21.15.90:0/1398598327 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e680b33c0 con 0x7f6e680cc790 2023-06-09T04:42:27.496 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.491+0000 7f6e657fa700 1 -- 172.21.15.90:0/1398598327 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e500055a0 con 0x7f6e680cc790 2023-06-09T04:42:27.496 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.491+0000 7f6e6e6ca700 1 -- 172.21.15.90:0/1398598327 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e680b3980 con 0x7f6e680cc790 2023-06-09T04:42:27.496 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.495+0000 7f6e6e6ca700 1 -- 172.21.15.90:0/1398598327 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e6804db30 con 0x7f6e680cc790 2023-06-09T04:42:27.497 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.495+0000 7f6e657fa700 1 -- 172.21.15.90:0/1398598327 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6e500038c0 con 0x7f6e680cc790 2023-06-09T04:42:27.499 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.499+0000 7f6e657fa700 1 --2- 172.21.15.90:0/1398598327 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f6e480662f0 0x7f6e480687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:27.499 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.499+0000 7f6e657fa700 1 -- 172.21.15.90:0/1398598327 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6e50083080 con 0x7f6e680cc790 2023-06-09T04:42:27.500 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.499+0000 7f6e67fff700 1 --2- 172.21.15.90:0/1398598327 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f6e480662f0 0x7f6e480687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:27.501 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.499+0000 7f6e67fff700 1 --2- 172.21.15.90:0/1398598327 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f6e480662f0 0x7f6e480687a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f6e5800b370 tx=0x7f6e58009000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:27.504 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.503+0000 7f6e657fa700 1 -- 172.21.15.90:0/1398598327 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6e500b3700 con 0x7f6e680cc790 2023-06-09T04:42:27.676 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.675+0000 7f6e6e6ca700 1 -- 172.21.15.90:0/1398598327 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6e680afec0 con 0x7f6e680cc790 2023-06-09T04:42:27.676 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.675+0000 7f6e657fa700 1 -- 172.21.15.90:0/1398598327 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6e500170a0 con 0x7f6e680cc790 2023-06-09T04:42:27.677 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 1 2023-06-09T04:42:27.679 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.679+0000 7f6e6e6ca700 1 -- 172.21.15.90:0/1398598327 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f6e480662f0 msgr2=0x7f6e480687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:27.679 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.679+0000 7f6e6e6ca700 1 --2- 172.21.15.90:0/1398598327 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f6e480662f0 0x7f6e480687a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f6e5800b370 tx=0x7f6e58009000 comp rx=0 tx=0).stop 2023-06-09T04:42:27.680 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.679+0000 7f6e6e6ca700 1 -- 172.21.15.90:0/1398598327 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6e680cc790 msgr2=0x7f6e68148e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:27.680 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.679+0000 7f6e6e6ca700 1 --2- 172.21.15.90:0/1398598327 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6e680cc790 0x7f6e68148e50 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f6e5000c4d0 tx=0x7f6e5000c7e0 comp rx=0 tx=0).stop 2023-06-09T04:42:27.680 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.679+0000 7f6e6e6ca700 1 -- 172.21.15.90:0/1398598327 shutdown_connections 2023-06-09T04:42:27.681 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.679+0000 7f6e6e6ca700 1 --2- 172.21.15.90:0/1398598327 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f6e480662f0 0x7f6e480687a0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:27.681 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.679+0000 7f6e6e6ca700 1 --2- 172.21.15.90:0/1398598327 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6e68159ed0 0x7f6e681507e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:27.681 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.679+0000 7f6e6e6ca700 1 --2- 172.21.15.90:0/1398598327 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6e680cc790 0x7f6e68148e50 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:27.681 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.679+0000 7f6e6e6ca700 1 --2- 172.21.15.90:0/1398598327 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6e6806a230 0x7f6e680b3ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:27.681 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.679+0000 7f6e6e6ca700 1 -- 172.21.15.90:0/1398598327 >> 172.21.15.90:0/1398598327 conn(0x7f6e680b00e0 msgr2=0x7f6e68071350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:27.681 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.679+0000 7f6e6e6ca700 1 -- 172.21.15.90:0/1398598327 shutdown_connections 2023-06-09T04:42:27.681 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.679+0000 7f6e6e6ca700 1 -- 172.21.15.90:0/1398598327 wait complete. 2023-06-09T04:42:27.700 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-09T04:42:27.877 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.875+0000 7f417df64700 1 Processor -- start 2023-06-09T04:42:27.878 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.875+0000 7f417df64700 1 -- start start 2023-06-09T04:42:27.880 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.879+0000 7f417df64700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f417815a3b0 0x7f417806a230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:27.881 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.879+0000 7f417df64700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f41780cd5a0 0x7f41780cda00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:27.881 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.879+0000 7f417df64700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41780c8c90 con 0x7f41780cb3d0 2023-06-09T04:42:27.881 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.879+0000 7f417df64700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f417815d9a0 con 0x7f417815a3b0 2023-06-09T04:42:27.881 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.879+0000 7f417df64700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f417815a990 con 0x7f41780cd5a0 2023-06-09T04:42:27.881 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.879+0000 7f4177fff700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f417815a3b0 0x7f417806a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:27.881 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.879+0000 7f4177fff700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f417815a3b0 0x7f417806a230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:52940/0 (socket says 172.21.15.90:52940) 2023-06-09T04:42:27.881 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.879+0000 7f4177fff700 1 -- 172.21.15.90:0/1003209217 learned_addr learned my addr 172.21.15.90:0/1003209217 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:27.882 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.879+0000 7f4177fff700 1 -- 172.21.15.90:0/1003209217 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f41780cd5a0 msgr2=0x7f41780cda00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:27.882 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.879+0000 7f4177fff700 1 --2- 172.21.15.90:0/1003209217 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f41780cd5a0 0x7f41780cda00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:27.883 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.879+0000 7f4177fff700 1 -- 172.21.15.90:0/1003209217 >> v1:172.21.15.90:6789/0 conn(0x7f41780cb3d0 legacy=0x7f41780ca2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:27.883 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.879+0000 7f4177fff700 1 -- 172.21.15.90:0/1003209217 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41780cdf40 con 0x7f417815a3b0 2023-06-09T04:42:27.883 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.879+0000 7f4177fff700 1 --2- 172.21.15.90:0/1003209217 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f417815a3b0 0x7f417806a230 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f4164009910 tx=0x7f4164009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77702634e9f9ed14 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:27.883 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.879+0000 7f41777fe700 1 -- 172.21.15.90:0/1003209217 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4164004230 con 0x7f417815a3b0 2023-06-09T04:42:27.883 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.879+0000 7f41777fe700 1 -- 172.21.15.90:0/1003209217 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4164004390 con 0x7f417815a3b0 2023-06-09T04:42:27.883 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.879+0000 7f41777fe700 1 -- 172.21.15.90:0/1003209217 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4164009e60 con 0x7f417815a3b0 2023-06-09T04:42:27.884 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.883+0000 7f417df64700 1 -- 172.21.15.90:0/1003209217 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f417815a3b0 msgr2=0x7f417806a230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:27.884 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.883+0000 7f417df64700 1 --2- 172.21.15.90:0/1003209217 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f417815a3b0 0x7f417806a230 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f4164009910 tx=0x7f4164009c20 comp rx=0 tx=0).stop 2023-06-09T04:42:27.884 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.883+0000 7f417df64700 1 -- 172.21.15.90:0/1003209217 shutdown_connections 2023-06-09T04:42:27.885 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.883+0000 7f417df64700 1 --2- 172.21.15.90:0/1003209217 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f41780cd5a0 0x7f41780cda00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:27.885 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.883+0000 7f417df64700 1 --2- 172.21.15.90:0/1003209217 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f417815a3b0 0x7f417806a230 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:27.885 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.883+0000 7f417df64700 1 -- 172.21.15.90:0/1003209217 >> 172.21.15.90:0/1003209217 conn(0x7f41780aff00 msgr2=0x7f41780b0300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:27.885 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.883+0000 7f417df64700 1 -- 172.21.15.90:0/1003209217 shutdown_connections 2023-06-09T04:42:27.885 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.883+0000 7f417df64700 1 -- 172.21.15.90:0/1003209217 wait complete. 2023-06-09T04:42:27.887 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.887+0000 7f417df64700 1 Processor -- start 2023-06-09T04:42:27.888 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.887+0000 7f417df64700 1 -- start start 2023-06-09T04:42:27.889 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.887+0000 7f417df64700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f41780cb3d0 0x7f4178151070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:27.889 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.887+0000 7f417df64700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f41780cd5a0 0x7f4178149ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:27.890 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.887+0000 7f417df64700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f417815a3b0 0x7f417806f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:27.890 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.887+0000 7f417df64700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4178070e10 con 0x7f417815a3b0 2023-06-09T04:42:27.890 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.887+0000 7f417df64700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f417814a530 con 0x7f41780cd5a0 2023-06-09T04:42:27.890 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.887+0000 7f417df64700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f417806ff30 con 0x7f41780cb3d0 2023-06-09T04:42:27.891 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.887+0000 7f417d763700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f417815a3b0 0x7f417806f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:27.891 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.887+0000 7f417d763700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f417815a3b0 0x7f417806f9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:52948/0 (socket says 172.21.15.90:52948) 2023-06-09T04:42:27.891 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.887+0000 7f417d763700 1 -- 172.21.15.90:0/2853261595 learned_addr learned my addr 172.21.15.90:0/2853261595 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:27.891 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.887+0000 7f417cf62700 1 --2- 172.21.15.90:0/2853261595 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f41780cb3d0 0x7f4178151070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:27.891 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.887+0000 7f4177fff700 1 --2- 172.21.15.90:0/2853261595 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f41780cd5a0 0x7f4178149ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:27.892 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.891+0000 7f417d763700 1 -- 172.21.15.90:0/2853261595 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f41780cb3d0 msgr2=0x7f4178151070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:27.892 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.891+0000 7f417d763700 1 --2- 172.21.15.90:0/2853261595 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f41780cb3d0 0x7f4178151070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:27.892 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.891+0000 7f417d763700 1 -- 172.21.15.90:0/2853261595 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f41780cd5a0 msgr2=0x7f4178149ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:27.893 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.891+0000 7f417d763700 1 --2- 172.21.15.90:0/2853261595 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f41780cd5a0 0x7f4178149ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:27.893 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.891+0000 7f417d763700 1 -- 172.21.15.90:0/2853261595 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4164009570 con 0x7f417815a3b0 2023-06-09T04:42:27.893 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.891+0000 7f417d763700 1 --2- 172.21.15.90:0/2853261595 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f417815a3b0 0x7f417806f9f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f417000b9a0 tx=0x7f417000bcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:27.893 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.891+0000 7f41757fa700 1 -- 172.21.15.90:0/2853261595 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f417000d850 con 0x7f417815a3b0 2023-06-09T04:42:27.893 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.891+0000 7f41757fa700 1 -- 172.21.15.90:0/2853261595 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f417000d9d0 con 0x7f417815a3b0 2023-06-09T04:42:27.893 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.891+0000 7f417df64700 1 -- 172.21.15.90:0/2853261595 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f417806a770 con 0x7f417815a3b0 2023-06-09T04:42:27.893 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.891+0000 7f41757fa700 1 -- 172.21.15.90:0/2853261595 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f417000dd80 con 0x7f417815a3b0 2023-06-09T04:42:27.894 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.891+0000 7f417df64700 1 -- 172.21.15.90:0/2853261595 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41780704e0 con 0x7f417815a3b0 2023-06-09T04:42:27.895 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.895+0000 7f417df64700 1 -- 172.21.15.90:0/2853261595 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4178070fc0 con 0x7f417815a3b0 2023-06-09T04:42:27.897 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.895+0000 7f41757fa700 1 -- 172.21.15.90:0/2853261595 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f417000e420 con 0x7f417815a3b0 2023-06-09T04:42:27.898 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.895+0000 7f41757fa700 1 --2- 172.21.15.90:0/2853261595 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f415c0662f0 0x7f415c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:27.899 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.899+0000 7f41757fa700 1 -- 172.21.15.90:0/2853261595 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4170083e10 con 0x7f417815a3b0 2023-06-09T04:42:27.899 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.899+0000 7f417cf62700 1 --2- 172.21.15.90:0/2853261595 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f415c0662f0 0x7f415c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:27.900 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.899+0000 7f417cf62700 1 --2- 172.21.15.90:0/2853261595 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f415c0662f0 0x7f415c0687a0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f41780c8530 tx=0x7f416c007ea0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:27.905 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:27.903+0000 7f41757fa700 1 -- 172.21.15.90:0/2853261595 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4178070fc0 con 0x7f417815a3b0 2023-06-09T04:42:28.076 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:28.075+0000 7f417df64700 1 -- 172.21.15.90:0/2853261595 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f4178070fc0 con 0x7f417815a3b0 2023-06-09T04:42:28.077 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:28.075+0000 7f41757fa700 1 -- 172.21.15.90:0/2853261595 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7f4178070fc0 con 0x7f417815a3b0 2023-06-09T04:42:28.077 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 8 2023-06-09T04:42:28.081 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:28.079+0000 7f417df64700 1 -- 172.21.15.90:0/2853261595 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f415c0662f0 msgr2=0x7f415c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:28.082 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:28.079+0000 7f417df64700 1 --2- 172.21.15.90:0/2853261595 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f415c0662f0 0x7f415c0687a0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f41780c8530 tx=0x7f416c007ea0 comp rx=0 tx=0).stop 2023-06-09T04:42:28.082 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:28.079+0000 7f417df64700 1 -- 172.21.15.90:0/2853261595 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f417815a3b0 msgr2=0x7f417806f9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:28.082 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:28.079+0000 7f417df64700 1 --2- 172.21.15.90:0/2853261595 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f417815a3b0 0x7f417806f9f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f417000b9a0 tx=0x7f417000bcb0 comp rx=0 tx=0).stop 2023-06-09T04:42:28.082 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:28.079+0000 7f417df64700 1 -- 172.21.15.90:0/2853261595 shutdown_connections 2023-06-09T04:42:28.082 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:28.079+0000 7f417df64700 1 --2- 172.21.15.90:0/2853261595 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f415c0662f0 0x7f415c0687a0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:28.082 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:28.079+0000 7f417df64700 1 --2- 172.21.15.90:0/2853261595 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f417815a3b0 0x7f417806f9f0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:28.082 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:28.079+0000 7f417df64700 1 --2- 172.21.15.90:0/2853261595 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f41780cd5a0 0x7f4178149ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:28.083 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:28.079+0000 7f417df64700 1 --2- 172.21.15.90:0/2853261595 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f41780cb3d0 0x7f4178151070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:28.083 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:28.079+0000 7f417df64700 1 -- 172.21.15.90:0/2853261595 >> 172.21.15.90:0/2853261595 conn(0x7f41780aff00 msgr2=0x7f417815c390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:28.083 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:28.079+0000 7f417df64700 1 -- 172.21.15.90:0/2853261595 shutdown_connections 2023-06-09T04:42:28.083 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:28.079+0000 7f417df64700 1 -- 172.21.15.90:0/2853261595 wait complete. 2023-06-09T04:42:28.104 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-09T04:42:28.279 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:28.279+0000 7f71ceabf700 1 Processor -- start 2023-06-09T04:42:28.280 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:28.279+0000 7f71ceabf700 1 -- start start 2023-06-09T04:42:28.282 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:28.279+0000 7f71ceabf700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f71c80b18d0 0x7f71c8160920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:28.283 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:28.279+0000 7f71ceabf700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f71c80d2400 0x7f71c80d28a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:28.283 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:28.279+0000 7f71ceabf700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71c815c6b0 con 0x7f71c80b1ca0 2023-06-09T04:42:28.283 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:28.283+0000 7f71ceabf700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71c80d2de0 con 0x7f71c80d2400 2023-06-09T04:42:28.284 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:28.283+0000 7f71ceabf700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71c80cf6a0 con 0x7f71c80b18d0 2023-06-09T04:42:28.284 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:28.283+0000 7f71cd2bc700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f71c80b1ca0 0x7f71c80cee90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:54926/0 (socket says 172.21.15.90:54926) 2023-06-09T04:42:28.284 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:28.283+0000 7f71cd2bc700 1 -- 172.21.15.90:0/2195996539 learned_addr learned my addr 172.21.15.90:0/2195996539 (peer_addr_for_me v1:172.21.15.90:0/0) 2023-06-09T04:42:28.284 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:28.283+0000 7f71cdabd700 1 --2- 172.21.15.90:0/2195996539 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f71c80b18d0 0x7f71c8160920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:28.284 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:28.283+0000 7f71ce2be700 1 --2- 172.21.15.90:0/2195996539 >> v2:172.21.15.174:3300/0 conn(0x7f71c80d2400 0x7f71c80d28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:28.285 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:28.283+0000 7f71ccabb700 1 -- 172.21.15.90:0/2195996539 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2094537158 0 0) 0x7f71c815c6b0 con 0x7f71c80b1ca0 2023-06-09T04:42:28.285 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:28.283+0000 7f71ccabb700 1 -- 172.21.15.90:0/2195996539 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f71b40035d0 con 0x7f71c80b1ca0 2023-06-09T04:42:28.285 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:28.283+0000 7f71ce2be700 1 -- 172.21.15.90:0/2195996539 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f71c80b18d0 msgr2=0x7f71c8160920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:28.285 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:28.283+0000 7f71ce2be700 1 --2- 172.21.15.90:0/2195996539 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f71c80b18d0 0x7f71c8160920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:28.286 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:28.283+0000 7f71ce2be700 1 -- 172.21.15.90:0/2195996539 >> v1:172.21.15.90:6789/0 conn(0x7f71c80b1ca0 legacy=0x7f71c80cee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:28.286 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:28.283+0000 7f71ce2be700 1 -- 172.21.15.90:0/2195996539 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71c80cf980 con 0x7f71c80d2400 2023-06-09T04:42:28.286 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:28.283+0000 7f71cdabd700 1 --2- 172.21.15.90:0/2195996539 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f71c80b18d0 0x7f71c8160920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:42:28.286 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:28.283+0000 7f71ce2be700 1 --2- 172.21.15.90:0/2195996539 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71c80d2400 0x7f71c80d28a0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f71c0009d90 tx=0x7f71c000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cebebef0dedbe939 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:28.287 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:28.283+0000 7f71ccabb700 1 -- 172.21.15.90:0/2195996539 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71c000e070 con 0x7f71c80d2400 2023-06-09T04:42:28.287 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:28.283+0000 7f71ccabb700 1 -- 172.21.15.90:0/2195996539 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71c000bb20 con 0x7f71c80d2400 2023-06-09T04:42:28.287 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:28.283+0000 7f71ccabb700 1 -- 172.21.15.90:0/2195996539 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71c0012430 con 0x7f71c80d2400 2023-06-09T04:42:28.287 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:28.283+0000 7f71ceabf700 1 -- 172.21.15.90:0/2195996539 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71c80d2400 msgr2=0x7f71c80d28a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:28.287 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:28.283+0000 7f71ceabf700 1 --2- 172.21.15.90:0/2195996539 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71c80d2400 0x7f71c80d28a0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f71c0009d90 tx=0x7f71c000b330 comp rx=0 tx=0).stop 2023-06-09T04:42:28.288 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:28.283+0000 7f71ceabf700 1 -- 172.21.15.90:0/2195996539 shutdown_connections 2023-06-09T04:42:28.288 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:28.283+0000 7f71ceabf700 1 --2- 172.21.15.90:0/2195996539 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71c80d2400 0x7f71c80d28a0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:28.288 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:28.283+0000 7f71ceabf700 1 --2- 172.21.15.90:0/2195996539 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f71c80b18d0 0x7f71c8160920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:28.288 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:28.283+0000 7f71ceabf700 1 -- 172.21.15.90:0/2195996539 >> 172.21.15.90:0/2195996539 conn(0x7f71c809b9b0 msgr2=0x7f71c80b55d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:28.288 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:28.287+0000 7f71ceabf700 1 -- 172.21.15.90:0/2195996539 shutdown_connections 2023-06-09T04:42:28.288 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:28.287+0000 7f71ceabf700 1 -- 172.21.15.90:0/2195996539 wait complete. 2023-06-09T04:42:28.290 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:28.287+0000 7f71ceabf700 1 Processor -- start 2023-06-09T04:42:28.291 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:28.291+0000 7f71ceabf700 1 -- start start 2023-06-09T04:42:28.292 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:28.291+0000 7f71ceabf700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71c80b18d0 0x7f71c81f1b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:28.292 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:28.291+0000 7f71ceabf700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f71c80b1ca0 0x7f71c8159140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:28.293 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:28.291+0000 7f71ceabf700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f71c80d2400 0x7f71c81f22b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:28.293 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:28.291+0000 7f71ceabf700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71c81f20a0 con 0x7f71c80d2400 2023-06-09T04:42:28.293 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:28.291+0000 7f71ceabf700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71c80c9750 con 0x7f71c80b18d0 2023-06-09T04:42:28.293 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:28.291+0000 7f71ceabf700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71c80ca5b0 con 0x7f71c80b1ca0 2023-06-09T04:42:28.294 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:28.291+0000 7f71ce2be700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f71c80d2400 0x7f71c81f22b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:28.294 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:28.291+0000 7f71ce2be700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f71c80d2400 0x7f71c81f22b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:52950/0 (socket says 172.21.15.90:52950) 2023-06-09T04:42:28.294 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:28.291+0000 7f71ce2be700 1 -- 172.21.15.90:0/2409568045 learned_addr learned my addr 172.21.15.90:0/2409568045 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:28.294 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:28.291+0000 7f71cd2bc700 1 --2- 172.21.15.90:0/2409568045 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f71c80b1ca0 0x7f71c8159140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:28.294 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:28.291+0000 7f71cdabd700 1 --2- 172.21.15.90:0/2409568045 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71c80b18d0 0x7f71c81f1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:28.294 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:28.291+0000 7f71cd2bc700 1 -- 172.21.15.90:0/2409568045 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71c80b18d0 msgr2=0x7f71c81f1b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:28.295 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:28.291+0000 7f71cd2bc700 1 --2- 172.21.15.90:0/2409568045 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71c80b18d0 0x7f71c81f1b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:28.295 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:28.291+0000 7f71cd2bc700 1 -- 172.21.15.90:0/2409568045 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f71c80d2400 msgr2=0x7f71c81f22b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:28.295 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:28.291+0000 7f71cd2bc700 1 --2- 172.21.15.90:0/2409568045 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f71c80d2400 0x7f71c81f22b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:28.295 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:28.291+0000 7f71cd2bc700 1 -- 172.21.15.90:0/2409568045 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71c4009450 con 0x7f71c80b1ca0 2023-06-09T04:42:28.295 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:28.291+0000 7f71ce2be700 1 --2- 172.21.15.90:0/2409568045 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f71c80d2400 0x7f71c81f22b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:42:28.295 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:28.291+0000 7f71cd2bc700 1 --2- 172.21.15.90:0/2409568045 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f71c80b1ca0 0x7f71c8159140 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f71b800c4d0 tx=0x7f71b800c7e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:28.296 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:28.291+0000 7f71be7fc700 1 -- 172.21.15.90:0/2409568045 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71b8005d90 con 0x7f71c80b1ca0 2023-06-09T04:42:28.296 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:28.291+0000 7f71be7fc700 1 -- 172.21.15.90:0/2409568045 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71b80070d0 con 0x7f71c80b1ca0 2023-06-09T04:42:28.296 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:28.291+0000 7f71ceabf700 1 -- 172.21.15.90:0/2409568045 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71c0009a70 con 0x7f71c80b1ca0 2023-06-09T04:42:28.296 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:28.291+0000 7f71be7fc700 1 -- 172.21.15.90:0/2409568045 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71b8007440 con 0x7f71c80b1ca0 2023-06-09T04:42:28.297 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:28.291+0000 7f71ceabf700 1 -- 172.21.15.90:0/2409568045 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71c80c99a0 con 0x7f71c80b1ca0 2023-06-09T04:42:28.297 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:28.295+0000 7f71ceabf700 1 -- 172.21.15.90:0/2409568045 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71c804e380 con 0x7f71c80b1ca0 2023-06-09T04:42:28.297 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:28.295+0000 7f71be7fc700 1 -- 172.21.15.90:0/2409568045 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f71b80075a0 con 0x7f71c80b1ca0 2023-06-09T04:42:28.299 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:28.299+0000 7f71be7fc700 1 --2- 172.21.15.90:0/2409568045 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f71ac0662f0 0x7f71ac0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:28.299 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:28.299+0000 7f71be7fc700 1 -- 172.21.15.90:0/2409568045 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f71b80831a0 con 0x7f71c80b1ca0 2023-06-09T04:42:28.300 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:28.299+0000 7f71cdabd700 1 --2- 172.21.15.90:0/2409568045 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f71ac0662f0 0x7f71ac0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:28.301 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:28.299+0000 7f71cdabd700 1 --2- 172.21.15.90:0/2409568045 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f71ac0662f0 0x7f71ac0687a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f71c80a0660 tx=0x7f71c40091c0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:28.307 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:28.307+0000 7f71be7fc700 1 -- 172.21.15.90:0/2409568045 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f71b8050690 con 0x7f71c80b1ca0 2023-06-09T04:42:28.478 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:28.475+0000 7f71ceabf700 1 -- 172.21.15.90:0/2409568045 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f71c80cf360 con 0x7f71c80b1ca0 2023-06-09T04:42:28.479 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:28.479+0000 7f71be7fc700 1 -- 172.21.15.90:0/2409568045 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f71b8053cb0 con 0x7f71c80b1ca0 2023-06-09T04:42:28.480 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 32 2023-06-09T04:42:28.484 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:28.483+0000 7f71ceabf700 1 -- 172.21.15.90:0/2409568045 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f71ac0662f0 msgr2=0x7f71ac0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:28.484 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:28.483+0000 7f71ceabf700 1 --2- 172.21.15.90:0/2409568045 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f71ac0662f0 0x7f71ac0687a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f71c80a0660 tx=0x7f71c40091c0 comp rx=0 tx=0).stop 2023-06-09T04:42:28.484 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:28.483+0000 7f71ceabf700 1 -- 172.21.15.90:0/2409568045 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f71c80b1ca0 msgr2=0x7f71c8159140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:28.484 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:28.483+0000 7f71ceabf700 1 --2- 172.21.15.90:0/2409568045 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f71c80b1ca0 0x7f71c8159140 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f71b800c4d0 tx=0x7f71b800c7e0 comp rx=0 tx=0).stop 2023-06-09T04:42:28.485 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:28.483+0000 7f71ceabf700 1 -- 172.21.15.90:0/2409568045 shutdown_connections 2023-06-09T04:42:28.485 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:28.483+0000 7f71ceabf700 1 --2- 172.21.15.90:0/2409568045 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f71ac0662f0 0x7f71ac0687a0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:28.485 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:28.483+0000 7f71ceabf700 1 --2- 172.21.15.90:0/2409568045 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f71c80d2400 0x7f71c81f22b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:28.485 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:28.483+0000 7f71ceabf700 1 --2- 172.21.15.90:0/2409568045 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f71c80b1ca0 0x7f71c8159140 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:28.485 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:28.483+0000 7f71ceabf700 1 --2- 172.21.15.90:0/2409568045 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71c80b18d0 0x7f71c81f1b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:28.485 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:28.483+0000 7f71ceabf700 1 -- 172.21.15.90:0/2409568045 >> 172.21.15.90:0/2409568045 conn(0x7f71c809b9b0 msgr2=0x7f71c815bac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:28.485 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:28.483+0000 7f71ceabf700 1 -- 172.21.15.90:0/2409568045 shutdown_connections 2023-06-09T04:42:28.486 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:28.483+0000 7f71ceabf700 1 -- 172.21.15.90:0/2409568045 wait complete. 2023-06-09T04:42:28.504 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-09T04:42:28.684 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:28.683+0000 7f1054816700 1 Processor -- start 2023-06-09T04:42:28.685 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:28.683+0000 7f1054816700 1 -- start start 2023-06-09T04:42:28.686 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:28.683+0000 7f1054816700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f105015bf60 0x7f10500cda20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:28.687 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:28.687+0000 7f1054816700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f105015c330 con 0x7f10500cb370 2023-06-09T04:42:28.687 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:28.687+0000 7f1054816700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f105006f960 con 0x7f1050160450 2023-06-09T04:42:28.687 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:28.687+0000 7f1054816700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10500c51f0 con 0x7f105015bf60 2023-06-09T04:42:28.688 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:28.687+0000 7f104ffff700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f10500cb370 0x7f1050069820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:54940/0 (socket says 172.21.15.90:54940) 2023-06-09T04:42:28.688 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:28.687+0000 7f104ffff700 1 -- 172.21.15.90:0/3472733919 learned_addr learned my addr 172.21.15.90:0/3472733919 (peer_addr_for_me v1:172.21.15.90:0/0) 2023-06-09T04:42:28.688 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:28.687+0000 7f104f7fe700 1 --2- 172.21.15.90:0/3472733919 >> v2:172.21.15.174:3300/0 conn(0x7f105015bf60 0x7f10500cda20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:28.689 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:28.687+0000 7f104e7fc700 1 -- 172.21.15.90:0/3472733919 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2252499781 0 0) 0x7f105015c330 con 0x7f10500cb370 2023-06-09T04:42:28.689 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:28.687+0000 7f104e7fc700 1 -- 172.21.15.90:0/3472733919 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f10380035d0 con 0x7f10500cb370 2023-06-09T04:42:28.689 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:28.687+0000 7f104f7fe700 1 -- 172.21.15.90:0/3472733919 >> v1:172.21.15.174:6789/0 conn(0x7f1050160450 legacy=0x7f10500cac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:28.689 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:28.687+0000 7f104e7fc700 1 -- 172.21.15.90:0/3472733919 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3842236031 0 0) 0x7f105006f960 con 0x7f1050160450 2023-06-09T04:42:28.689 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:28.687+0000 7f104f7fe700 1 -- 172.21.15.90:0/3472733919 >> v1:172.21.15.90:6789/0 conn(0x7f10500cb370 legacy=0x7f1050069820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:28.690 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:28.687+0000 7f104f7fe700 1 -- 172.21.15.90:0/3472733919 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10500cc520 con 0x7f105015bf60 2023-06-09T04:42:28.690 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:28.687+0000 7f104f7fe700 1 --2- 172.21.15.90:0/3472733919 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f105015bf60 0x7f10500cda20 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f1040009850 tx=0x7f1040009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a08e9b4262ae58f5 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:28.690 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:28.687+0000 7f104e7fc700 1 -- 172.21.15.90:0/3472733919 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1040011830 con 0x7f105015bf60 2023-06-09T04:42:28.691 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:28.687+0000 7f104e7fc700 1 -- 172.21.15.90:0/3472733919 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1040011990 con 0x7f105015bf60 2023-06-09T04:42:28.691 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:28.687+0000 7f104e7fc700 1 -- 172.21.15.90:0/3472733919 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1040011d40 con 0x7f105015bf60 2023-06-09T04:42:28.691 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:28.691+0000 7f1054816700 1 -- 172.21.15.90:0/3472733919 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f105015bf60 msgr2=0x7f10500cda20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:28.691 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:28.691+0000 7f1054816700 1 --2- 172.21.15.90:0/3472733919 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f105015bf60 0x7f10500cda20 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f1040009850 tx=0x7f1040009b60 comp rx=0 tx=0).stop 2023-06-09T04:42:28.692 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:28.691+0000 7f1054816700 1 -- 172.21.15.90:0/3472733919 shutdown_connections 2023-06-09T04:42:28.692 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:28.691+0000 7f1054816700 1 --2- 172.21.15.90:0/3472733919 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f105015bf60 0x7f10500cda20 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:28.692 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:28.691+0000 7f1054816700 1 -- 172.21.15.90:0/3472733919 >> 172.21.15.90:0/3472733919 conn(0x7f10500aff00 msgr2=0x7f10500b0300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:28.692 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:28.691+0000 7f1054816700 1 -- 172.21.15.90:0/3472733919 shutdown_connections 2023-06-09T04:42:28.692 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:28.691+0000 7f1054816700 1 -- 172.21.15.90:0/3472733919 wait complete. 2023-06-09T04:42:28.695 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:28.691+0000 7f1054816700 1 Processor -- start 2023-06-09T04:42:28.695 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:28.695+0000 7f1054816700 1 -- start start 2023-06-09T04:42:28.696 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:28.695+0000 7f1054816700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f10500cb370 0x7f10500a8980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:28.697 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:28.695+0000 7f1054816700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f105015bf60 0x7f1050159270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:28.697 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:28.695+0000 7f104effd700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f105015bf60 0x7f1050159270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:28.698 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:28.695+0000 7f104effd700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f105015bf60 0x7f1050159270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:52954/0 (socket says 172.21.15.90:52954) 2023-06-09T04:42:28.698 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:28.695+0000 7f1054816700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1050160450 0x7f105015dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:28.698 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:28.695+0000 7f1054816700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10500adf10 con 0x7f105015bf60 2023-06-09T04:42:28.698 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:28.695+0000 7f104effd700 1 -- 172.21.15.90:0/397587091 learned_addr learned my addr 172.21.15.90:0/397587091 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:28.698 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:28.695+0000 7f1054816700 1 -- 172.21.15.90:0/397587091 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10500ae1f0 con 0x7f10500cb370 2023-06-09T04:42:28.698 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:28.695+0000 7f1054816700 1 -- 172.21.15.90:0/397587091 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10500ae4d0 con 0x7f1050160450 2023-06-09T04:42:28.698 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:28.695+0000 7f104f7fe700 1 --2- 172.21.15.90:0/397587091 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f10500cb370 0x7f10500a8980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:28.699 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:28.695+0000 7f104effd700 1 -- 172.21.15.90:0/397587091 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1050160450 msgr2=0x7f105015dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:28.699 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:28.695+0000 7f104effd700 1 --2- 172.21.15.90:0/397587091 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1050160450 0x7f105015dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:28.699 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:28.695+0000 7f104effd700 1 -- 172.21.15.90:0/397587091 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f10500cb370 msgr2=0x7f10500a8980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:28.700 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:28.695+0000 7f104effd700 1 --2- 172.21.15.90:0/397587091 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f10500cb370 0x7f10500a8980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:28.700 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:28.695+0000 7f104effd700 1 -- 172.21.15.90:0/397587091 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10400094b0 con 0x7f105015bf60 2023-06-09T04:42:28.700 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:28.695+0000 7f104effd700 1 --2- 172.21.15.90:0/397587091 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f105015bf60 0x7f1050159270 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f104400c520 tx=0x7f104400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:28.700 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:28.695+0000 7f1037fff700 1 -- 172.21.15.90:0/397587091 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10440054e0 con 0x7f105015bf60 2023-06-09T04:42:28.700 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:28.695+0000 7f1037fff700 1 -- 172.21.15.90:0/397587091 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10440036a0 con 0x7f105015bf60 2023-06-09T04:42:28.700 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:28.695+0000 7f1054816700 1 -- 172.21.15.90:0/397587091 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10500ae7b0 con 0x7f105015bf60 2023-06-09T04:42:28.700 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:28.695+0000 7f1037fff700 1 -- 172.21.15.90:0/397587091 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1044003a50 con 0x7f105015bf60 2023-06-09T04:42:28.701 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:28.699+0000 7f1054816700 1 -- 172.21.15.90:0/397587091 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10501597b0 con 0x7f105015bf60 2023-06-09T04:42:28.701 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:28.699+0000 7f1054816700 1 -- 172.21.15.90:0/397587091 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10500ae9a0 con 0x7f105015bf60 2023-06-09T04:42:28.701 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:28.699+0000 7f1037fff700 1 -- 172.21.15.90:0/397587091 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f1044003bb0 con 0x7f105015bf60 2023-06-09T04:42:28.703 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:28.703+0000 7f1037fff700 1 --2- 172.21.15.90:0/397587091 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f103c0662f0 0x7f103c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:28.704 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:28.703+0000 7f1037fff700 1 -- 172.21.15.90:0/397587091 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f10440832b0 con 0x7f105015bf60 2023-06-09T04:42:28.704 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:28.703+0000 7f104f7fe700 1 --2- 172.21.15.90:0/397587091 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f103c0662f0 0x7f103c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:28.706 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:28.703+0000 7f104f7fe700 1 --2- 172.21.15.90:0/397587091 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f103c0662f0 0x7f103c0687a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f10400090b0 tx=0x7f1040008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:28.710 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:28.707+0000 7f1037fff700 1 -- 172.21.15.90:0/397587091 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1044050720 con 0x7f105015bf60 2023-06-09T04:42:28.882 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:28.879+0000 7f1054816700 1 -- 172.21.15.90:0/397587091 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f10500ae050 con 0x7f105015bf60 2023-06-09T04:42:28.883 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:28.883+0000 7f1037fff700 1 -- 172.21.15.90:0/397587091 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f10500ae050 con 0x7f105015bf60 2023-06-09T04:42:28.884 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 64 2023-06-09T04:42:28.886 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:28.883+0000 7f1054816700 1 -- 172.21.15.90:0/397587091 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f103c0662f0 msgr2=0x7f103c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:28.886 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:28.883+0000 7f1054816700 1 --2- 172.21.15.90:0/397587091 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f103c0662f0 0x7f103c0687a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f10400090b0 tx=0x7f1040008030 comp rx=0 tx=0).stop 2023-06-09T04:42:28.886 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:28.883+0000 7f1054816700 1 -- 172.21.15.90:0/397587091 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f105015bf60 msgr2=0x7f1050159270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:28.886 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:28.883+0000 7f1054816700 1 --2- 172.21.15.90:0/397587091 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f105015bf60 0x7f1050159270 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f104400c520 tx=0x7f104400c8e0 comp rx=0 tx=0).stop 2023-06-09T04:42:28.886 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:28.883+0000 7f1054816700 1 -- 172.21.15.90:0/397587091 shutdown_connections 2023-06-09T04:42:28.886 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:28.883+0000 7f1054816700 1 --2- 172.21.15.90:0/397587091 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f103c0662f0 0x7f103c0687a0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:28.887 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:28.883+0000 7f1054816700 1 --2- 172.21.15.90:0/397587091 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1050160450 0x7f105015dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:28.887 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:28.883+0000 7f1054816700 1 --2- 172.21.15.90:0/397587091 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f105015bf60 0x7f1050159270 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:28.887 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:28.883+0000 7f1054816700 1 --2- 172.21.15.90:0/397587091 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f10500cb370 0x7f10500a8980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:28.887 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:28.883+0000 7f1054816700 1 -- 172.21.15.90:0/397587091 >> 172.21.15.90:0/397587091 conn(0x7f10500aff00 msgr2=0x7f10500acdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:28.887 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:28.883+0000 7f1054816700 1 -- 172.21.15.90:0/397587091 shutdown_connections 2023-06-09T04:42:28.888 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:28.883+0000 7f1054816700 1 -- 172.21.15.90:0/397587091 wait complete. 2023-06-09T04:42:28.915 INFO:tasks.cephfs_test_runner:Starting test: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2023-06-09T04:42:28.916 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic' 2023-06-09T04:42:29.092 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:29.091+0000 7f3894e5a700 1 Processor -- start 2023-06-09T04:42:29.092 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:29.091+0000 7f3894e5a700 1 -- start start 2023-06-09T04:42:29.094 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:29.091+0000 7f3894e5a700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f38900b1ca0 0x7f3890160920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:29.095 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:29.091+0000 7f3894e5a700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f38900d2400 0x7f38900d28a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:29.095 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:29.091+0000 7f3894e5a700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f389015c6b0 con 0x7f38900b18d0 2023-06-09T04:42:29.095 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:29.091+0000 7f3894e5a700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38900d2de0 con 0x7f38900b1ca0 2023-06-09T04:42:29.095 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:29.091+0000 7f3894e5a700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38900cf6a0 con 0x7f38900d2400 2023-06-09T04:42:29.096 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:29.095+0000 7f388f7fe700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f38900b18d0 0x7f38900cee90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:54952/0 (socket says 172.21.15.90:54952) 2023-06-09T04:42:29.096 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:29.095+0000 7f388f7fe700 1 -- 172.21.15.90:0/2697692827 learned_addr learned my addr 172.21.15.90:0/2697692827 (peer_addr_for_me v1:172.21.15.90:0/0) 2023-06-09T04:42:29.096 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:29.095+0000 7f388effd700 1 --2- 172.21.15.90:0/2697692827 >> v2:172.21.15.174:3300/0 conn(0x7f38900b1ca0 0x7f3890160920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:29.096 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:29.095+0000 7f388ffff700 1 --2- 172.21.15.90:0/2697692827 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f38900d2400 0x7f38900d28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:29.097 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:29.095+0000 7f388e7fc700 1 -- 172.21.15.90:0/2697692827 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4049725782 0 0) 0x7f389015c6b0 con 0x7f38900b18d0 2023-06-09T04:42:29.097 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:29.095+0000 7f388e7fc700 1 -- 172.21.15.90:0/2697692827 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f38780035d0 con 0x7f38900b18d0 2023-06-09T04:42:29.097 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:29.095+0000 7f388effd700 1 -- 172.21.15.90:0/2697692827 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f38900d2400 msgr2=0x7f38900d28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:29.097 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:29.095+0000 7f388effd700 1 --2- 172.21.15.90:0/2697692827 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f38900d2400 0x7f38900d28a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:29.097 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:29.095+0000 7f388effd700 1 -- 172.21.15.90:0/2697692827 >> v1:172.21.15.90:6789/0 conn(0x7f38900b18d0 legacy=0x7f38900cee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:29.097 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:29.095+0000 7f388e7fc700 1 -- 172.21.15.90:0/2697692827 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 686685612 0 0) 0x7f38780035d0 con 0x7f38900b18d0 2023-06-09T04:42:29.097 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:29.095+0000 7f388effd700 1 -- 172.21.15.90:0/2697692827 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38900cf980 con 0x7f38900b1ca0 2023-06-09T04:42:29.098 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:29.095+0000 7f388ffff700 1 --2- 172.21.15.90:0/2697692827 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f38900d2400 0x7f38900d28a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:42:29.098 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:29.095+0000 7f388effd700 1 --2- 172.21.15.90:0/2697692827 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f38900b1ca0 0x7f3890160920 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f3884009850 tx=0x7f3884009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5f7fea810ffb767e server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:29.099 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:29.095+0000 7f388e7fc700 1 -- 172.21.15.90:0/2697692827 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38800054c0 con 0x7f38900b1ca0 2023-06-09T04:42:29.099 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:29.095+0000 7f388e7fc700 1 -- 172.21.15.90:0/2697692827 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3884004030 con 0x7f38900b1ca0 2023-06-09T04:42:29.099 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:29.095+0000 7f388e7fc700 1 -- 172.21.15.90:0/2697692827 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38840043e0 con 0x7f38900b1ca0 2023-06-09T04:42:29.099 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:29.095+0000 7f3894e5a700 1 -- 172.21.15.90:0/2697692827 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f38900b1ca0 msgr2=0x7f3890160920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:29.099 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:29.095+0000 7f3894e5a700 1 --2- 172.21.15.90:0/2697692827 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f38900b1ca0 0x7f3890160920 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f3884009850 tx=0x7f3884009b60 comp rx=0 tx=0).stop 2023-06-09T04:42:29.099 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:29.095+0000 7f3894e5a700 1 -- 172.21.15.90:0/2697692827 shutdown_connections 2023-06-09T04:42:29.099 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:29.095+0000 7f3894e5a700 1 --2- 172.21.15.90:0/2697692827 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f38900d2400 0x7f38900d28a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:29.100 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:29.095+0000 7f3894e5a700 1 --2- 172.21.15.90:0/2697692827 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f38900b1ca0 0x7f3890160920 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:29.100 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:29.095+0000 7f3894e5a700 1 -- 172.21.15.90:0/2697692827 >> 172.21.15.90:0/2697692827 conn(0x7f389009b9b0 msgr2=0x7f38900b55d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:29.100 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:29.095+0000 7f3894e5a700 1 -- 172.21.15.90:0/2697692827 shutdown_connections 2023-06-09T04:42:29.100 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:29.095+0000 7f3894e5a700 1 -- 172.21.15.90:0/2697692827 wait complete. 2023-06-09T04:42:29.100 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:29.099+0000 7f3894e5a700 1 Processor -- start 2023-06-09T04:42:29.101 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:29.099+0000 7f3894e5a700 1 -- start start 2023-06-09T04:42:29.102 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:29.099+0000 7f3894e5a700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f38900b18d0 0x7f38901424a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:29.102 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:29.099+0000 7f3894e5a700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f38900b1ca0 0x7f38900c9750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:29.102 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:29.099+0000 7f3894e5a700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f38900d2400 0x7f38900c9c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:29.102 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:29.099+0000 7f3894e5a700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38900b4a30 con 0x7f38900d2400 2023-06-09T04:42:29.102 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:29.099+0000 7f3894e5a700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38900b3e20 con 0x7f38900b18d0 2023-06-09T04:42:29.102 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:29.099+0000 7f3894e5a700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38900b4100 con 0x7f38900b1ca0 2023-06-09T04:42:29.103 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:29.099+0000 7f388ffff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f38900d2400 0x7f38900c9c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:29.104 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:29.099+0000 7f388ffff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f38900d2400 0x7f38900c9c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:52966/0 (socket says 172.21.15.90:52966) 2023-06-09T04:42:29.104 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:29.099+0000 7f388ffff700 1 -- 172.21.15.90:0/895299867 learned_addr learned my addr 172.21.15.90:0/895299867 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:29.104 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:29.099+0000 7f388f7fe700 1 --2- 172.21.15.90:0/895299867 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f38900b18d0 0x7f38901424a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:29.104 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:29.099+0000 7f388effd700 1 --2- 172.21.15.90:0/895299867 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f38900b1ca0 0x7f38900c9750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:29.104 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:29.103+0000 7f388ffff700 1 -- 172.21.15.90:0/895299867 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f38900b1ca0 msgr2=0x7f38900c9750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:29.104 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:29.103+0000 7f388ffff700 1 --2- 172.21.15.90:0/895299867 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f38900b1ca0 0x7f38900c9750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:29.104 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:29.103+0000 7f388ffff700 1 -- 172.21.15.90:0/895299867 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f38900b18d0 msgr2=0x7f38901424a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:29.104 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:29.103+0000 7f388ffff700 1 --2- 172.21.15.90:0/895299867 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f38900b18d0 0x7f38901424a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:29.105 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:29.103+0000 7f388ffff700 1 -- 172.21.15.90:0/895299867 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38880094b0 con 0x7f38900d2400 2023-06-09T04:42:29.105 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:29.103+0000 7f388f7fe700 1 --2- 172.21.15.90:0/895299867 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f38900b18d0 0x7f38901424a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:42:29.105 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:29.103+0000 7f388ffff700 1 --2- 172.21.15.90:0/895299867 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f38900d2400 0x7f38900c9c90 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f388800e930 tx=0x7f388800ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:29.105 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:29.103+0000 7f3877fff700 1 -- 172.21.15.90:0/895299867 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3888009710 con 0x7f38900d2400 2023-06-09T04:42:29.106 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:29.103+0000 7f3877fff700 1 -- 172.21.15.90:0/895299867 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f388800ee80 con 0x7f38900d2400 2023-06-09T04:42:29.106 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:29.103+0000 7f3894e5a700 1 -- 172.21.15.90:0/895299867 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38840094b0 con 0x7f38900d2400 2023-06-09T04:42:29.106 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:29.103+0000 7f3877fff700 1 -- 172.21.15.90:0/895299867 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3888004240 con 0x7f38900d2400 2023-06-09T04:42:29.106 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:29.103+0000 7f3894e5a700 1 -- 172.21.15.90:0/895299867 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38900b46c0 con 0x7f38900d2400 2023-06-09T04:42:29.106 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:29.103+0000 7f3894e5a700 1 -- 172.21.15.90:0/895299867 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38900b4b70 con 0x7f38900d2400 2023-06-09T04:42:29.107 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:29.107+0000 7f3877fff700 1 -- 172.21.15.90:0/895299867 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f38880043e0 con 0x7f38900d2400 2023-06-09T04:42:29.108 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:29.107+0000 7f3877fff700 1 --2- 172.21.15.90:0/895299867 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f387c0662f0 0x7f387c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:29.109 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:29.107+0000 7f3877fff700 1 -- 172.21.15.90:0/895299867 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3888083d90 con 0x7f38900d2400 2023-06-09T04:42:29.109 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:29.107+0000 7f388f7fe700 1 --2- 172.21.15.90:0/895299867 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f387c0662f0 0x7f387c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:29.110 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:29.107+0000 7f388f7fe700 1 --2- 172.21.15.90:0/895299867 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f387c0662f0 0x7f387c0687a0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f3880005030 tx=0x7f3880009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:29.114 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:29.111+0000 7f3877fff700 1 -- 172.21.15.90:0/895299867 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f38900b4b70 con 0x7f38900d2400 2023-06-09T04:42:29.358 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:29.355+0000 7f3894e5a700 1 -- 172.21.15.90:0/895299867 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]} v 0) v1 -- 0x7f38900b4b70 con 0x7f38900d2400 2023-06-09T04:42:30.090 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:30.087+0000 7f3877fff700 1 -- 172.21.15.90:0/895299867 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]}]=0 v56) v1 ==== 147+0+0 (secure 0 0 0) 0x7f38900b4b70 con 0x7f38900d2400 2023-06-09T04:42:30.094 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:30.091+0000 7f3894e5a700 1 -- 172.21.15.90:0/895299867 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f387c0662f0 msgr2=0x7f387c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:30.094 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:30.091+0000 7f3894e5a700 1 --2- 172.21.15.90:0/895299867 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f387c0662f0 0x7f387c0687a0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f3880005030 tx=0x7f3880009040 comp rx=0 tx=0).stop 2023-06-09T04:42:30.094 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:30.091+0000 7f3894e5a700 1 -- 172.21.15.90:0/895299867 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f38900d2400 msgr2=0x7f38900c9c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:30.095 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:30.091+0000 7f3894e5a700 1 --2- 172.21.15.90:0/895299867 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f38900d2400 0x7f38900c9c90 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f388800e930 tx=0x7f388800ec40 comp rx=0 tx=0).stop 2023-06-09T04:42:30.095 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:30.091+0000 7f3894e5a700 1 -- 172.21.15.90:0/895299867 shutdown_connections 2023-06-09T04:42:30.095 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:30.091+0000 7f3894e5a700 1 --2- 172.21.15.90:0/895299867 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f387c0662f0 0x7f387c0687a0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:30.095 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:30.091+0000 7f3894e5a700 1 --2- 172.21.15.90:0/895299867 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f38900d2400 0x7f38900c9c90 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:30.096 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:30.091+0000 7f3894e5a700 1 --2- 172.21.15.90:0/895299867 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f38900b1ca0 0x7f38900c9750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:30.096 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:30.091+0000 7f3894e5a700 1 --2- 172.21.15.90:0/895299867 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f38900b18d0 0x7f38901424a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:30.096 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:30.091+0000 7f3894e5a700 1 -- 172.21.15.90:0/895299867 >> 172.21.15.90:0/895299867 conn(0x7f389009b9b0 msgr2=0x7f38900b0df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:30.096 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:30.095+0000 7f3894e5a700 1 -- 172.21.15.90:0/895299867 shutdown_connections 2023-06-09T04:42:30.096 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:30.095+0000 7f3894e5a700 1 -- 172.21.15.90:0/895299867 wait complete. 2023-06-09T04:42:30.119 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-06-09T04:42:30.300 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:30.299+0000 7f0eb6c7d700 1 Processor -- start 2023-06-09T04:42:30.301 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:30.299+0000 7f0eb6c7d700 1 -- start start 2023-06-09T04:42:30.304 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:30.303+0000 7f0eb6c7d700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0eb00b18d0 0x7f0eb0160920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:30.304 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:30.303+0000 7f0eb6c7d700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f0eb00b1ca0 0x7f0eb00cee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:30.304 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:30.303+0000 7f0eb6c7d700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0eb015c6b0 con 0x7f0eb00d2400 2023-06-09T04:42:30.305 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:30.303+0000 7f0eb6c7d700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0eb00cf3d0 con 0x7f0eb00b1ca0 2023-06-09T04:42:30.305 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:30.303+0000 7f0eb6c7d700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0eb00cf6a0 con 0x7f0eb00b18d0 2023-06-09T04:42:30.305 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:30.303+0000 7f0eb5c7b700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0eb00b18d0 0x7f0eb0160920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:30.305 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:30.303+0000 7f0eb547a700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f0eb00b1ca0 0x7f0eb00cee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:30.306 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:30.303+0000 7f0eb5c7b700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0eb00b18d0 0x7f0eb0160920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.90:39270/0 (socket says 172.21.15.90:39270) 2023-06-09T04:42:30.306 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:30.303+0000 7f0eb5c7b700 1 -- 172.21.15.90:0/3633164908 learned_addr learned my addr 172.21.15.90:0/3633164908 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:30.306 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:30.303+0000 7f0eb5c7b700 1 -- 172.21.15.90:0/3633164908 >> v2:172.21.15.174:3300/0 conn(0x7f0eb00b1ca0 msgr2=0x7f0eb00cee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:30.307 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:30.303+0000 7f0eb5c7b700 1 --2- 172.21.15.90:0/3633164908 >> v2:172.21.15.174:3300/0 conn(0x7f0eb00b1ca0 0x7f0eb00cee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:30.307 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:30.303+0000 7f0eb5c7b700 1 -- 172.21.15.90:0/3633164908 >> v1:172.21.15.174:6789/0 conn(0x7f0eb00d2400 legacy=0x7f0eb00d28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:30.307 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:30.303+0000 7f0eb5c7b700 1 -- 172.21.15.90:0/3633164908 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0eb00cf980 con 0x7f0eb00b18d0 2023-06-09T04:42:30.307 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:30.303+0000 7f0eb5c7b700 1 --2- 172.21.15.90:0/3633164908 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0eb00b18d0 0x7f0eb0160920 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0eac009940 tx=0x7f0eac009c50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fdba52a43029e773 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:30.308 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:30.307+0000 7f0eb4c79700 1 -- 172.21.15.90:0/3633164908 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eac005e50 con 0x7f0eb00b18d0 2023-06-09T04:42:30.308 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:30.307+0000 7f0eb4c79700 1 -- 172.21.15.90:0/3633164908 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0eac006030 con 0x7f0eb00b18d0 2023-06-09T04:42:30.308 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:30.307+0000 7f0eb4c79700 1 -- 172.21.15.90:0/3633164908 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eac0063c0 con 0x7f0eb00b18d0 2023-06-09T04:42:30.308 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:30.307+0000 7f0eb6c7d700 1 -- 172.21.15.90:0/3633164908 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0eb00b18d0 msgr2=0x7f0eb0160920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:30.308 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:30.307+0000 7f0eb6c7d700 1 --2- 172.21.15.90:0/3633164908 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0eb00b18d0 0x7f0eb0160920 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0eac009940 tx=0x7f0eac009c50 comp rx=0 tx=0).stop 2023-06-09T04:42:30.309 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:30.307+0000 7f0eb6c7d700 1 -- 172.21.15.90:0/3633164908 shutdown_connections 2023-06-09T04:42:30.309 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:30.307+0000 7f0eb6c7d700 1 --2- 172.21.15.90:0/3633164908 >> v2:172.21.15.174:3300/0 conn(0x7f0eb00b1ca0 0x7f0eb00cee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:30.309 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:30.307+0000 7f0eb6c7d700 1 --2- 172.21.15.90:0/3633164908 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0eb00b18d0 0x7f0eb0160920 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:30.309 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:30.307+0000 7f0eb6c7d700 1 -- 172.21.15.90:0/3633164908 >> 172.21.15.90:0/3633164908 conn(0x7f0eb009b9b0 msgr2=0x7f0eb00b55d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:30.309 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:30.307+0000 7f0eb6c7d700 1 -- 172.21.15.90:0/3633164908 shutdown_connections 2023-06-09T04:42:30.310 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:30.307+0000 7f0eb6c7d700 1 -- 172.21.15.90:0/3633164908 wait complete. 2023-06-09T04:42:30.310 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:30.307+0000 7f0eb6c7d700 1 Processor -- start 2023-06-09T04:42:30.311 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:30.311+0000 7f0eb6c7d700 1 -- start start 2023-06-09T04:42:30.313 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:30.311+0000 7f0eb6c7d700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0eb00b18d0 0x7f0eb00cc1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:30.313 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:30.311+0000 7f0eb6c7d700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0eb00b1ca0 0x7f0eb006bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:30.313 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:30.311+0000 7f0eb6c7d700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0eb00d2400 0x7f0eb0153a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:30.314 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:30.311+0000 7f0eb6c7d700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eb006c1d0 con 0x7f0eb00b1ca0 2023-06-09T04:42:30.314 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:30.311+0000 7f0eb6c7d700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eb00c9880 con 0x7f0eb00b18d0 2023-06-09T04:42:30.314 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:30.311+0000 7f0eb6c7d700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0eb006c3c0 con 0x7f0eb00d2400 2023-06-09T04:42:30.315 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:30.311+0000 7f0eb547a700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0eb00b1ca0 0x7f0eb006bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:30.315 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:30.311+0000 7f0eb547a700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0eb00b1ca0 0x7f0eb006bc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:52978/0 (socket says 172.21.15.90:52978) 2023-06-09T04:42:30.315 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:30.311+0000 7f0eb547a700 1 -- 172.21.15.90:0/1878204163 learned_addr learned my addr 172.21.15.90:0/1878204163 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:30.315 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:30.311+0000 7f0eb5c7b700 1 --2- 172.21.15.90:0/1878204163 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0eb00b18d0 0x7f0eb00cc1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:30.315 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:30.311+0000 7f0eb647c700 1 --2- 172.21.15.90:0/1878204163 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0eb00d2400 0x7f0eb0153a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:30.315 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:30.311+0000 7f0eb547a700 1 -- 172.21.15.90:0/1878204163 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0eb00d2400 msgr2=0x7f0eb0153a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:30.315 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:30.311+0000 7f0eb547a700 1 --2- 172.21.15.90:0/1878204163 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0eb00d2400 0x7f0eb0153a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:30.316 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:30.311+0000 7f0eb547a700 1 -- 172.21.15.90:0/1878204163 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0eb00b18d0 msgr2=0x7f0eb00cc1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:30.316 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:30.311+0000 7f0eb547a700 1 --2- 172.21.15.90:0/1878204163 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0eb00b18d0 0x7f0eb00cc1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:30.316 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:30.311+0000 7f0eb547a700 1 -- 172.21.15.90:0/1878204163 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0eac009520 con 0x7f0eb00b1ca0 2023-06-09T04:42:30.317 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:30.315+0000 7f0eb547a700 1 --2- 172.21.15.90:0/1878204163 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0eb00b1ca0 0x7f0eb006bc90 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f0ea000e9a0 tx=0x7f0ea000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:30.317 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:30.315+0000 7f0ea67fc700 1 -- 172.21.15.90:0/1878204163 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ea0009720 con 0x7f0eb00b1ca0 2023-06-09T04:42:30.317 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:30.315+0000 7f0ea67fc700 1 -- 172.21.15.90:0/1878204163 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ea000c690 con 0x7f0eb00b1ca0 2023-06-09T04:42:30.317 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:30.315+0000 7f0ea67fc700 1 -- 172.21.15.90:0/1878204163 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ea000ca40 con 0x7f0eb00b1ca0 2023-06-09T04:42:30.317 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:30.315+0000 7f0eb6c7d700 1 -- 172.21.15.90:0/1878204163 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0eb006c6a0 con 0x7f0eb00b1ca0 2023-06-09T04:42:30.317 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:30.315+0000 7f0eb6c7d700 1 -- 172.21.15.90:0/1878204163 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0eb006cc60 con 0x7f0eb00b1ca0 2023-06-09T04:42:30.318 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:30.315+0000 7f0eb6c7d700 1 -- 172.21.15.90:0/1878204163 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0eb00c99f0 con 0x7f0eb00b1ca0 2023-06-09T04:42:30.318 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:30.315+0000 7f0ea67fc700 1 -- 172.21.15.90:0/1878204163 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0ea000cba0 con 0x7f0eb00b1ca0 2023-06-09T04:42:30.320 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:30.319+0000 7f0ea67fc700 1 --2- 172.21.15.90:0/1878204163 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f0e940662f0 0x7f0e940687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:30.320 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:30.319+0000 7f0ea67fc700 1 -- 172.21.15.90:0/1878204163 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0ea0083cf0 con 0x7f0eb00b1ca0 2023-06-09T04:42:30.321 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:30.319+0000 7f0eb5c7b700 1 --2- 172.21.15.90:0/1878204163 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f0e940662f0 0x7f0e940687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:30.322 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:30.319+0000 7f0eb5c7b700 1 --2- 172.21.15.90:0/1878204163 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f0e940662f0 0x7f0e940687a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f0eac000c00 tx=0x7f0eac008070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:30.325 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:30.323+0000 7f0ea67fc700 1 -- 172.21.15.90:0/1878204163 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0eb00c99f0 con 0x7f0eb00b1ca0 2023-06-09T04:42:30.494 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:30.491+0000 7f0eb6c7d700 1 -- 172.21.15.90:0/1878204163 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f0eb00c99f0 con 0x7f0eb00b1ca0 2023-06-09T04:42:30.503 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:30.503+0000 7f0ea67fc700 1 -- 172.21.15.90:0/1878204163 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f0eb00c99f0 con 0x7f0eb00b1ca0 2023-06-09T04:42:30.507 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:30.503+0000 7f0eb6c7d700 1 -- 172.21.15.90:0/1878204163 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f0e940662f0 msgr2=0x7f0e940687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:30.507 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:30.503+0000 7f0eb6c7d700 1 --2- 172.21.15.90:0/1878204163 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f0e940662f0 0x7f0e940687a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f0eac000c00 tx=0x7f0eac008070 comp rx=0 tx=0).stop 2023-06-09T04:42:30.507 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:30.503+0000 7f0eb6c7d700 1 -- 172.21.15.90:0/1878204163 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0eb00b1ca0 msgr2=0x7f0eb006bc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:30.507 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:30.503+0000 7f0eb6c7d700 1 --2- 172.21.15.90:0/1878204163 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0eb00b1ca0 0x7f0eb006bc90 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f0ea000e9a0 tx=0x7f0ea000ecb0 comp rx=0 tx=0).stop 2023-06-09T04:42:30.507 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:30.503+0000 7f0eb6c7d700 1 -- 172.21.15.90:0/1878204163 shutdown_connections 2023-06-09T04:42:30.507 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:30.503+0000 7f0eb6c7d700 1 --2- 172.21.15.90:0/1878204163 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f0e940662f0 0x7f0e940687a0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:30.508 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:30.503+0000 7f0eb6c7d700 1 --2- 172.21.15.90:0/1878204163 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0eb00d2400 0x7f0eb0153a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:30.508 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:30.503+0000 7f0eb6c7d700 1 --2- 172.21.15.90:0/1878204163 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0eb00b1ca0 0x7f0eb006bc90 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:30.508 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:30.503+0000 7f0eb6c7d700 1 --2- 172.21.15.90:0/1878204163 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0eb00b18d0 0x7f0eb00cc1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:30.508 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:30.503+0000 7f0eb6c7d700 1 -- 172.21.15.90:0/1878204163 >> 172.21.15.90:0/1878204163 conn(0x7f0eb009b9b0 msgr2=0x7f0eb015a6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:30.508 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:30.507+0000 7f0eb6c7d700 1 -- 172.21.15.90:0/1878204163 shutdown_connections 2023-06-09T04:42:30.508 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:30.507+0000 7f0eb6c7d700 1 -- 172.21.15.90:0/1878204163 wait complete. 2023-06-09T04:42:30.528 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-06-09T04:42:30.528 DEBUG:teuthology.orchestra.run.smithi090:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-06-09T04:42:30.571 DEBUG:teuthology.orchestra.run.smithi174:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-06-09T04:42:30.615 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-06-09T04:42:30.616 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2023-06-09T04:42:30.616 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-09T04:42:30.635 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2023-06-09T04:42:30.635 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-09T04:42:30.695 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2023-06-09T04:42:30.695 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-09T04:42:30.755 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T04:42:30.974 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:30.971+0000 7f4c3acd8700 1 Processor -- start 2023-06-09T04:42:30.975 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:30.975+0000 7f4c3acd8700 1 -- start start 2023-06-09T04:42:30.978 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:30.975+0000 7f4c3acd8700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f4c34069f30 0x7f4c34163ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:30.979 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:30.975+0000 7f4c3acd8700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c3406aa30 con 0x7f4c34070280 2023-06-09T04:42:30.979 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:30.975+0000 7f4c3acd8700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c3406a470 con 0x7f4c340b0610 2023-06-09T04:42:30.979 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:30.975+0000 7f4c3acd8700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c3406a750 con 0x7f4c34069f30 2023-06-09T04:42:30.979 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:30.975+0000 7f4c394d5700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f4c34070280 0x7f4c34069820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:54958/0 (socket says 172.21.15.90:54958) 2023-06-09T04:42:30.980 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:30.975+0000 7f4c394d5700 1 -- 172.21.15.90:0/4245603262 learned_addr learned my addr 172.21.15.90:0/4245603262 (peer_addr_for_me v1:172.21.15.90:0/0) 2023-06-09T04:42:30.981 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:30.979+0000 7f4c3a4d7700 1 --2- 172.21.15.90:0/4245603262 >> v2:172.21.15.90:3300/0 conn(0x7f4c34069f30 0x7f4c34163ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:30.982 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:30.979+0000 7f4c38cd4700 1 -- 172.21.15.90:0/4245603262 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 318181847 0 0) 0x7f4c3406aa30 con 0x7f4c34070280 2023-06-09T04:42:30.982 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:30.979+0000 7f4c38cd4700 1 -- 172.21.15.90:0/4245603262 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4c200035d0 con 0x7f4c34070280 2023-06-09T04:42:30.982 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:30.979+0000 7f4c38cd4700 1 -- 172.21.15.90:0/4245603262 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2928773355 0 0) 0x7f4c3406a470 con 0x7f4c340b0610 2023-06-09T04:42:30.982 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:30.979+0000 7f4c3a4d7700 1 -- 172.21.15.90:0/4245603262 >> v1:172.21.15.174:6789/0 conn(0x7f4c340b0610 legacy=0x7f4c3406fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:30.983 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:30.979+0000 7f4c3a4d7700 1 -- 172.21.15.90:0/4245603262 >> v1:172.21.15.90:6789/0 conn(0x7f4c34070280 legacy=0x7f4c34069820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:30.983 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:30.979+0000 7f4c3a4d7700 1 -- 172.21.15.90:0/4245603262 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c34159ba0 con 0x7f4c34069f30 2023-06-09T04:42:30.983 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:30.979+0000 7f4c3a4d7700 1 --2- 172.21.15.90:0/4245603262 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4c34069f30 0x7f4c34163ef0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f4c2c009d90 tx=0x7f4c2c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbf01b72b1769636 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:30.983 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:30.979+0000 7f4c38cd4700 1 -- 172.21.15.90:0/4245603262 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c2c00e070 con 0x7f4c34069f30 2023-06-09T04:42:30.984 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:30.979+0000 7f4c38cd4700 1 -- 172.21.15.90:0/4245603262 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c2c00bb20 con 0x7f4c34069f30 2023-06-09T04:42:30.984 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:30.979+0000 7f4c38cd4700 1 -- 172.21.15.90:0/4245603262 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c2c00be90 con 0x7f4c34069f30 2023-06-09T04:42:30.986 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:30.979+0000 7f4c3acd8700 1 -- 172.21.15.90:0/4245603262 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4c34069f30 msgr2=0x7f4c34163ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:30.986 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:30.979+0000 7f4c3acd8700 1 --2- 172.21.15.90:0/4245603262 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4c34069f30 0x7f4c34163ef0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f4c2c009d90 tx=0x7f4c2c00b330 comp rx=0 tx=0).stop 2023-06-09T04:42:30.986 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:30.979+0000 7f4c3acd8700 1 -- 172.21.15.90:0/4245603262 shutdown_connections 2023-06-09T04:42:30.986 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:30.979+0000 7f4c3acd8700 1 --2- 172.21.15.90:0/4245603262 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4c34069f30 0x7f4c34163ef0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:30.987 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:30.979+0000 7f4c3acd8700 1 -- 172.21.15.90:0/4245603262 >> 172.21.15.90:0/4245603262 conn(0x7f4c3406c690 msgr2=0x7f4c340aff00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:30.987 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:30.979+0000 7f4c3acd8700 1 -- 172.21.15.90:0/4245603262 shutdown_connections 2023-06-09T04:42:30.987 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:30.979+0000 7f4c3acd8700 1 -- 172.21.15.90:0/4245603262 wait complete. 2023-06-09T04:42:30.987 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:30.983+0000 7f4c3acd8700 1 Processor -- start 2023-06-09T04:42:30.988 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:30.983+0000 7f4c3acd8700 1 -- start start 2023-06-09T04:42:30.988 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:30.983+0000 7f4c3acd8700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4c34069f30 0x7f4c340ad380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:30.988 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:30.983+0000 7f4c3acd8700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4c34070280 0x7f4c34158000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:30.988 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:30.983+0000 7f4c3acd8700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4c340b0610 0x7f4c34150700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:30.989 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:30.983+0000 7f4c3acd8700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c340abef0 con 0x7f4c34069f30 2023-06-09T04:42:30.989 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:30.983+0000 7f4c3acd8700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c34150c40 con 0x7f4c340b0610 2023-06-09T04:42:30.989 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:30.983+0000 7f4c3acd8700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c340ad9b0 con 0x7f4c34070280 2023-06-09T04:42:30.991 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:30.983+0000 7f4c39cd6700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4c34069f30 0x7f4c340ad380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:30.991 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:30.983+0000 7f4c39cd6700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4c34069f30 0x7f4c340ad380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:52994/0 (socket says 172.21.15.90:52994) 2023-06-09T04:42:30.992 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:30.983+0000 7f4c39cd6700 1 -- 172.21.15.90:0/1397907694 learned_addr learned my addr 172.21.15.90:0/1397907694 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:30.992 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:30.983+0000 7f4c3a4d7700 1 --2- 172.21.15.90:0/1397907694 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4c340b0610 0x7f4c34150700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:30.992 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:30.983+0000 7f4c394d5700 1 --2- 172.21.15.90:0/1397907694 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4c34070280 0x7f4c34158000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:30.993 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:30.983+0000 7f4c39cd6700 1 -- 172.21.15.90:0/1397907694 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4c34070280 msgr2=0x7f4c34158000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:30.993 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:30.987+0000 7f4c39cd6700 1 --2- 172.21.15.90:0/1397907694 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4c34070280 0x7f4c34158000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:30.993 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:30.987+0000 7f4c39cd6700 1 -- 172.21.15.90:0/1397907694 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4c340b0610 msgr2=0x7f4c34150700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:30.993 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:30.987+0000 7f4c39cd6700 1 --2- 172.21.15.90:0/1397907694 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4c340b0610 0x7f4c34150700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:30.993 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:30.987+0000 7f4c39cd6700 1 -- 172.21.15.90:0/1397907694 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c2c009a70 con 0x7f4c34069f30 2023-06-09T04:42:30.994 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:30.987+0000 7f4c3a4d7700 1 --2- 172.21.15.90:0/1397907694 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4c340b0610 0x7f4c34150700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:42:30.994 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:30.987+0000 7f4c39cd6700 1 --2- 172.21.15.90:0/1397907694 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4c34069f30 0x7f4c340ad380 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f4c3000c520 tx=0x7f4c3000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:30.994 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:30.987+0000 7f4c2a7fc700 1 -- 172.21.15.90:0/1397907694 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c300054e0 con 0x7f4c34069f30 2023-06-09T04:42:30.994 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:30.987+0000 7f4c2a7fc700 1 -- 172.21.15.90:0/1397907694 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c300036a0 con 0x7f4c34069f30 2023-06-09T04:42:30.995 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:30.987+0000 7f4c3acd8700 1 -- 172.21.15.90:0/1397907694 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c340ab930 con 0x7f4c34069f30 2023-06-09T04:42:30.995 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:30.987+0000 7f4c2a7fc700 1 -- 172.21.15.90:0/1397907694 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c30003a50 con 0x7f4c34069f30 2023-06-09T04:42:30.995 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:30.987+0000 7f4c3acd8700 1 -- 172.21.15.90:0/1397907694 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c341f4a60 con 0x7f4c34069f30 2023-06-09T04:42:30.995 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:30.987+0000 7f4c3acd8700 1 -- 172.21.15.90:0/1397907694 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c341f48c0 con 0x7f4c34069f30 2023-06-09T04:42:30.996 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:30.991+0000 7f4c2a7fc700 1 -- 172.21.15.90:0/1397907694 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4c30003bb0 con 0x7f4c34069f30 2023-06-09T04:42:30.997 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:30.991+0000 7f4c2a7fc700 1 --2- 172.21.15.90:0/1397907694 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f4c180662f0 0x7f4c180687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:30.997 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:30.991+0000 7f4c2a7fc700 1 -- 172.21.15.90:0/1397907694 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4c30083230 con 0x7f4c34069f30 2023-06-09T04:42:30.997 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:30.991+0000 7f4c394d5700 1 --2- 172.21.15.90:0/1397907694 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f4c180662f0 0x7f4c180687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:30.998 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:30.991+0000 7f4c394d5700 1 --2- 172.21.15.90:0/1397907694 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f4c180662f0 0x7f4c180687a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f4c341f4820 tx=0x7f4c24009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:30.999 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:30.999+0000 7f4c2a7fc700 1 -- 172.21.15.90:0/1397907694 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4c341f48c0 con 0x7f4c34069f30 2023-06-09T04:42:31.170 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:31.167+0000 7f4c3acd8700 1 -- 172.21.15.90:0/1397907694 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4c341f48c0 con 0x7f4c34069f30 2023-06-09T04:42:31.171 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:31.171+0000 7f4c2a7fc700 1 -- 172.21.15.90:0/1397907694 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18279 (secure 0 0 0) 0x7f4c341f48c0 con 0x7f4c34069f30 2023-06-09T04:42:31.172 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:42:31.172 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":24,"fsid":"700369c0-a111-43b4-9415-844ad1742b70","created":"2023-06-09T04:41:28.180311+0000","modified":"2023-06-09T04:41:55.389425+0000","last_up_change":"2023-06-09T04:41:40.746475+0000","last_in_change":"2023-06-09T04:41:31.262765+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-09T04:41:42.402564+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-09T04:41:47.607323+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-09T04:41:52.543474+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-09T04:41:53.382940+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"46a4a7c5-babd-4ef3-9830-51487cff5eb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":2780271267},{"type":"v1","addr":"172.21.15.90:6809","nonce":2780271267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2780271267},{"type":"v1","addr":"172.21.15.90:6811","nonce":2780271267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2780271267},{"type":"v1","addr":"172.21.15.90:6815","nonce":2780271267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2780271267},{"type":"v1","addr":"172.21.15.90:6813","nonce":2780271267}]},"public_addr":"172.21.15.90:6809/2780271267","cluster_addr":"172.21.15.90:6811/2780271267","heartbeat_back_addr":"172.21.15.90:6815/2780271267","heartbeat_front_addr":"172.21.15.90:6813/2780271267","state":["exists","up"]},{"osd":1,"uuid":"1543988f-c498-494a-a6f9-fac8413db6ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":3064028136},{"type":"v1","addr":"172.21.15.90:6801","nonce":3064028136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":3064028136},{"type":"v1","addr":"172.21.15.90:6803","nonce":3064028136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":3064028136},{"type":"v1","addr":"172.21.15.90:6807","nonce":3064028136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":3064028136},{"type":"v1","addr":"172.21.15.90:6805","nonce":3064028136}]},"public_addr":"172.21.15.90:6801/3064028136","cluster_addr":"172.21.15.90:6803/3064028136","heartbeat_back_addr":"172.21.15.90:6807/3064028136","heartbeat_front_addr":"172.21.15.90:6805/3064028136","state":["exists","up"]},{"osd":2,"uuid":"79669dd6-ffc8-4197-b9f7-b3b372b2b9b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":3713146326},{"type":"v1","addr":"172.21.15.90:6825","nonce":3713146326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":3713146326},{"type":"v1","addr":"172.21.15.90:6827","nonce":3713146326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":3713146326},{"type":"v1","addr":"172.21.15.90:6831","nonce":3713146326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":3713146326},{"type":"v1","addr":"172.21.15.90:6829","nonce":3713146326}]},"public_addr":"172.21.15.90:6825/3713146326","cluster_addr":"172.21.15.90:6827/3713146326","heartbeat_back_addr":"172.21.15.90:6831/3713146326","heartbeat_front_addr":"172.21.15.90:6829/3713146326","state":["exists","up"]},{"osd":3,"uuid":"4062ab6f-ce40-450a-aa17-b10098766c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":3499839122},{"type":"v1","addr":"172.21.15.90:6817","nonce":3499839122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":3499839122},{"type":"v1","addr":"172.21.15.90:6819","nonce":3499839122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":3499839122},{"type":"v1","addr":"172.21.15.90:6823","nonce":3499839122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":3499839122},{"type":"v1","addr":"172.21.15.90:6821","nonce":3499839122}]},"public_addr":"172.21.15.90:6817/3499839122","cluster_addr":"172.21.15.90:6819/3499839122","heartbeat_back_addr":"172.21.15.90:6823/3499839122","heartbeat_front_addr":"172.21.15.90:6821/3499839122","state":["exists","up"]},{"osd":4,"uuid":"a10820e4-b348-4d92-9796-3b01484ace1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6817","nonce":1138565854},{"type":"v1","addr":"172.21.15.174:6819","nonce":1138565854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6821","nonce":1138565854},{"type":"v1","addr":"172.21.15.174:6823","nonce":1138565854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":1138565854},{"type":"v1","addr":"172.21.15.174:6831","nonce":1138565854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":1138565854},{"type":"v1","addr":"172.21.15.174:6829","nonce":1138565854}]},"public_addr":"172.21.15.174:6819/1138565854","cluster_addr":"172.21.15.174:6823/1138565854","heartbeat_back_addr":"172.21.15.174:6831/1138565854","heartbeat_front_addr":"172.21.15.174:6829/1138565854","state":["exists","up"]},{"osd":5,"uuid":"b4da1c32-be05-420b-9346-90d91aa70569","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":1707702879},{"type":"v1","addr":"172.21.15.174:6818","nonce":1707702879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":1707702879},{"type":"v1","addr":"172.21.15.174:6822","nonce":1707702879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6827","nonce":1707702879},{"type":"v1","addr":"172.21.15.174:6828","nonce":1707702879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":1707702879},{"type":"v1","addr":"172.21.15.174:6825","nonce":1707702879}]},"public_addr":"172.21.15.174:6818/1707702879","cluster_addr":"172.21.15.174:6822/1707702879","heartbeat_back_addr":"172.21.15.174:6828/1707702879","heartbeat_front_addr":"172.21.15.174:6825/1707702879","state":["exists","up"]},{"osd":6,"uuid":"d1b98041-d243-4355-bd0a-e22cf9875b32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":864450534},{"type":"v1","addr":"172.21.15.174:6801","nonce":864450534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":864450534},{"type":"v1","addr":"172.21.15.174:6803","nonce":864450534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":864450534},{"type":"v1","addr":"172.21.15.174:6807","nonce":864450534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":864450534},{"type":"v1","addr":"172.21.15.174:6805","nonce":864450534}]},"public_addr":"172.21.15.174:6801/864450534","cluster_addr":"172.21.15.174:6803/864450534","heartbeat_back_addr":"172.21.15.174:6807/864450534","heartbeat_front_addr":"172.21.15.174:6805/864450534","state":["exists","up"]},{"osd":7,"uuid":"5a207936-f89f-416b-b79b-34ec96f77c8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":2527640659},{"type":"v1","addr":"172.21.15.174:6809","nonce":2527640659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":2527640659},{"type":"v1","addr":"172.21.15.174:6811","nonce":2527640659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":2527640659},{"type":"v1","addr":"172.21.15.174:6815","nonce":2527640659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":2527640659},{"type":"v1","addr":"172.21.15.174:6813","nonce":2527640659}]},"public_addr":"172.21.15.174:6809/2527640659","cluster_addr":"172.21.15.174:6811/2527640659","heartbeat_back_addr":"172.21.15.174:6815/2527640659","heartbeat_front_addr":"172.21.15.174:6813/2527640659","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:36.972152+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:36.984561+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:36.998817+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:37.054944+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:37.085014+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:37.115125+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:36.854608+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:36.971685+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:42:31.174 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:31.171+0000 7f4c3acd8700 1 -- 172.21.15.90:0/1397907694 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f4c180662f0 msgr2=0x7f4c180687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:31.174 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:31.171+0000 7f4c3acd8700 1 --2- 172.21.15.90:0/1397907694 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f4c180662f0 0x7f4c180687a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f4c341f4820 tx=0x7f4c24009040 comp rx=0 tx=0).stop 2023-06-09T04:42:31.174 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:31.171+0000 7f4c3acd8700 1 -- 172.21.15.90:0/1397907694 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4c34069f30 msgr2=0x7f4c340ad380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:31.174 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:31.171+0000 7f4c3acd8700 1 --2- 172.21.15.90:0/1397907694 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4c34069f30 0x7f4c340ad380 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f4c3000c520 tx=0x7f4c3000c8e0 comp rx=0 tx=0).stop 2023-06-09T04:42:31.174 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:31.171+0000 7f4c3acd8700 1 -- 172.21.15.90:0/1397907694 shutdown_connections 2023-06-09T04:42:31.174 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:31.171+0000 7f4c3acd8700 1 --2- 172.21.15.90:0/1397907694 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f4c180662f0 0x7f4c180687a0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:31.175 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:31.171+0000 7f4c3acd8700 1 --2- 172.21.15.90:0/1397907694 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4c340b0610 0x7f4c34150700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:31.175 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:31.171+0000 7f4c3acd8700 1 --2- 172.21.15.90:0/1397907694 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4c34070280 0x7f4c34158000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:31.175 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:31.171+0000 7f4c3acd8700 1 --2- 172.21.15.90:0/1397907694 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4c34069f30 0x7f4c340ad380 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:31.175 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:31.171+0000 7f4c3acd8700 1 -- 172.21.15.90:0/1397907694 >> 172.21.15.90:0/1397907694 conn(0x7f4c3406c690 msgr2=0x7f4c3415a3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:31.176 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:31.171+0000 7f4c3acd8700 1 -- 172.21.15.90:0/1397907694 shutdown_connections 2023-06-09T04:42:31.176 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:31.171+0000 7f4c3acd8700 1 -- 172.21.15.90:0/1397907694 wait complete. 2023-06-09T04:42:31.196 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-09T04:41:42.402564+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-09T04:41:47.607323+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-09T04:41:52.543474+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-09T04:41:53.382940+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-09T04:42:31.197 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-09T04:42:31.367 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:31.367+0000 7fc1397d9700 1 Processor -- start 2023-06-09T04:42:31.368 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:31.367+0000 7fc1397d9700 1 -- start start 2023-06-09T04:42:31.370 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:31.367+0000 7fc1397d9700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc13406a230 0x7fc1340cc080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:31.370 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:31.367+0000 7fc1397d9700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fc1340cc5c0 0x7fc1340ca5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:31.370 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:31.367+0000 7fc1397d9700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1340ccf60 con 0x7fc134159ed0 2023-06-09T04:42:31.370 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:31.367+0000 7fc1397d9700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1340cca40 con 0x7fc1340cc5c0 2023-06-09T04:42:31.370 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:31.367+0000 7fc1397d9700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1340c91a0 con 0x7fc13406a230 2023-06-09T04:42:31.371 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:31.367+0000 7fc1337fe700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fc1340cc5c0 0x7fc1340ca5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:31.371 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:31.367+0000 7fc1337fe700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fc1340cc5c0 0x7fc1340ca5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:53008/0 (socket says 172.21.15.90:53008) 2023-06-09T04:42:31.371 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:31.367+0000 7fc1337fe700 1 -- 172.21.15.90:0/450704421 learned_addr learned my addr 172.21.15.90:0/450704421 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:31.372 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:31.367+0000 7fc132ffd700 1 --1- 172.21.15.90:0/450704421 >> v1:172.21.15.90:6789/0 conn(0x7fc134159ed0 0x7fc1340718d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:54974/0 (socket says 172.21.15.90:54974) 2023-06-09T04:42:31.372 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:31.367+0000 7fc1327fc700 1 --2- 172.21.15.90:0/450704421 >> v2:172.21.15.174:3300/0 conn(0x7fc13406a230 0x7fc1340cc080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:31.372 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:31.371+0000 7fc1337fe700 1 -- 172.21.15.90:0/450704421 >> v2:172.21.15.174:3300/0 conn(0x7fc13406a230 msgr2=0x7fc1340cc080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:31.372 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:31.371+0000 7fc1337fe700 1 --2- 172.21.15.90:0/450704421 >> v2:172.21.15.174:3300/0 conn(0x7fc13406a230 0x7fc1340cc080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:31.372 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:31.371+0000 7fc1337fe700 1 -- 172.21.15.90:0/450704421 >> v1:172.21.15.90:6789/0 conn(0x7fc134159ed0 legacy=0x7fc1340718d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:31.372 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:31.371+0000 7fc1337fe700 1 -- 172.21.15.90:0/450704421 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc13415a2a0 con 0x7fc1340cc5c0 2023-06-09T04:42:31.373 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:31.371+0000 7fc1337fe700 1 --2- 172.21.15.90:0/450704421 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc1340cc5c0 0x7fc1340ca5f0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fc134066b40 tx=0x7fc12c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b49d0dc89394e1 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:31.373 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:31.371+0000 7fc131ffb700 1 -- 172.21.15.90:0/450704421 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc12c00e070 con 0x7fc1340cc5c0 2023-06-09T04:42:31.373 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:31.371+0000 7fc131ffb700 1 -- 172.21.15.90:0/450704421 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc12c00b910 con 0x7fc1340cc5c0 2023-06-09T04:42:31.373 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:31.371+0000 7fc131ffb700 1 -- 172.21.15.90:0/450704421 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc12c00bcc0 con 0x7fc1340cc5c0 2023-06-09T04:42:31.374 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:31.371+0000 7fc1397d9700 1 -- 172.21.15.90:0/450704421 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc1340cc5c0 msgr2=0x7fc1340ca5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:31.374 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:31.371+0000 7fc1397d9700 1 --2- 172.21.15.90:0/450704421 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc1340cc5c0 0x7fc1340ca5f0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fc134066b40 tx=0x7fc12c00b330 comp rx=0 tx=0).stop 2023-06-09T04:42:31.374 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:31.371+0000 7fc1397d9700 1 -- 172.21.15.90:0/450704421 shutdown_connections 2023-06-09T04:42:31.374 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:31.371+0000 7fc1397d9700 1 --2- 172.21.15.90:0/450704421 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc1340cc5c0 0x7fc1340ca5f0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:31.375 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:31.371+0000 7fc1397d9700 1 --2- 172.21.15.90:0/450704421 >> v2:172.21.15.174:3300/0 conn(0x7fc13406a230 0x7fc1340cc080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:31.375 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:31.371+0000 7fc1397d9700 1 -- 172.21.15.90:0/450704421 >> 172.21.15.90:0/450704421 conn(0x7fc1340b00e0 msgr2=0x7fc1340b04b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:31.375 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:31.371+0000 7fc1397d9700 1 -- 172.21.15.90:0/450704421 shutdown_connections 2023-06-09T04:42:31.375 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:31.371+0000 7fc1397d9700 1 -- 172.21.15.90:0/450704421 wait complete. 2023-06-09T04:42:31.378 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:31.375+0000 7fc1397d9700 1 Processor -- start 2023-06-09T04:42:31.378 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:31.375+0000 7fc1397d9700 1 -- start start 2023-06-09T04:42:31.380 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:31.379+0000 7fc1397d9700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc13406a230 0x7fc1340cd430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:31.380 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:31.379+0000 7fc1397d9700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc1340cc5c0 0x7fc1340cb4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:31.380 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:31.379+0000 7fc1397d9700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc134159ed0 0x7fc1340b1e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:31.380 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:31.379+0000 7fc1397d9700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1340b2370 con 0x7fc1340cc5c0 2023-06-09T04:42:31.380 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:31.379+0000 7fc1397d9700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1340b13e0 con 0x7fc13406a230 2023-06-09T04:42:31.381 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:31.379+0000 7fc1397d9700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1340ce8a0 con 0x7fc134159ed0 2023-06-09T04:42:31.382 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:31.379+0000 7fc1327fc700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc1340cc5c0 0x7fc1340cb4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:31.382 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:31.379+0000 7fc1327fc700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc1340cc5c0 0x7fc1340cb4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:53010/0 (socket says 172.21.15.90:53010) 2023-06-09T04:42:31.382 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:31.379+0000 7fc1327fc700 1 -- 172.21.15.90:0/3577614114 learned_addr learned my addr 172.21.15.90:0/3577614114 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:31.382 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:31.379+0000 7fc1337fe700 1 --2- 172.21.15.90:0/3577614114 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc134159ed0 0x7fc1340b1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:31.382 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:31.379+0000 7fc1327fc700 1 -- 172.21.15.90:0/3577614114 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc134159ed0 msgr2=0x7fc1340b1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:31.382 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:31.379+0000 7fc132ffd700 1 --2- 172.21.15.90:0/3577614114 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc13406a230 0x7fc1340cd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:31.383 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:31.379+0000 7fc1327fc700 1 --2- 172.21.15.90:0/3577614114 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc134159ed0 0x7fc1340b1e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:31.383 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:31.379+0000 7fc1327fc700 1 -- 172.21.15.90:0/3577614114 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc13406a230 msgr2=0x7fc1340cd430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:31.383 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:31.379+0000 7fc1327fc700 1 --2- 172.21.15.90:0/3577614114 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc13406a230 0x7fc1340cd430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:31.383 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:31.379+0000 7fc1327fc700 1 -- 172.21.15.90:0/3577614114 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc12c009b30 con 0x7fc1340cc5c0 2023-06-09T04:42:31.383 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:31.379+0000 7fc1337fe700 1 --2- 172.21.15.90:0/3577614114 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc134159ed0 0x7fc1340b1e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:42:31.383 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:31.379+0000 7fc132ffd700 1 --2- 172.21.15.90:0/3577614114 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc13406a230 0x7fc1340cd430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:42:31.383 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:31.379+0000 7fc1327fc700 1 --2- 172.21.15.90:0/3577614114 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc1340cc5c0 0x7fc1340cb4d0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fc12800e9a0 tx=0x7fc12800ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:31.384 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:31.379+0000 7fc11b7fe700 1 -- 172.21.15.90:0/3577614114 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc128009720 con 0x7fc1340cc5c0 2023-06-09T04:42:31.384 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:31.379+0000 7fc11b7fe700 1 -- 172.21.15.90:0/3577614114 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc12800c850 con 0x7fc1340cc5c0 2023-06-09T04:42:31.384 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:31.379+0000 7fc1397d9700 1 -- 172.21.15.90:0/3577614114 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1340ceb60 con 0x7fc1340cc5c0 2023-06-09T04:42:31.384 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:31.379+0000 7fc11b7fe700 1 -- 172.21.15.90:0/3577614114 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc12800cc00 con 0x7fc1340cc5c0 2023-06-09T04:42:31.384 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:31.379+0000 7fc1397d9700 1 -- 172.21.15.90:0/3577614114 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1340b1910 con 0x7fc1340cc5c0 2023-06-09T04:42:31.385 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:31.383+0000 7fc1397d9700 1 -- 172.21.15.90:0/3577614114 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc13404db30 con 0x7fc1340cc5c0 2023-06-09T04:42:31.385 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:31.383+0000 7fc11b7fe700 1 -- 172.21.15.90:0/3577614114 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc128013470 con 0x7fc1340cc5c0 2023-06-09T04:42:31.385 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:31.383+0000 7fc11b7fe700 1 --2- 172.21.15.90:0/3577614114 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fc1200662f0 0x7fc1200687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:31.385 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:31.383+0000 7fc11b7fe700 1 -- 172.21.15.90:0/3577614114 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc128083e60 con 0x7fc1340cc5c0 2023-06-09T04:42:31.386 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:31.383+0000 7fc132ffd700 1 --2- 172.21.15.90:0/3577614114 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fc1200662f0 0x7fc1200687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:31.388 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:31.387+0000 7fc132ffd700 1 --2- 172.21.15.90:0/3577614114 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fc1200662f0 0x7fc1200687a0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fc124000f60 tx=0x7fc124009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:31.393 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:31.391+0000 7fc11b7fe700 1 -- 172.21.15.90:0/3577614114 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc128054ce0 con 0x7fc1340cc5c0 2023-06-09T04:42:31.563 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:31.559+0000 7fc1397d9700 1 -- 172.21.15.90:0/3577614114 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc1340c8540 con 0x7fc1340cc5c0 2023-06-09T04:42:31.563 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:31.563+0000 7fc11b7fe700 1 -- 172.21.15.90:0/3577614114 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc128054870 con 0x7fc1340cc5c0 2023-06-09T04:42:31.564 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 1 2023-06-09T04:42:31.566 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:31.563+0000 7fc1397d9700 1 -- 172.21.15.90:0/3577614114 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fc1200662f0 msgr2=0x7fc1200687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:31.566 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:31.563+0000 7fc1397d9700 1 --2- 172.21.15.90:0/3577614114 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fc1200662f0 0x7fc1200687a0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fc124000f60 tx=0x7fc124009040 comp rx=0 tx=0).stop 2023-06-09T04:42:31.566 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:31.563+0000 7fc1397d9700 1 -- 172.21.15.90:0/3577614114 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc1340cc5c0 msgr2=0x7fc1340cb4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:31.567 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:31.563+0000 7fc1397d9700 1 --2- 172.21.15.90:0/3577614114 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc1340cc5c0 0x7fc1340cb4d0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fc12800e9a0 tx=0x7fc12800ed60 comp rx=0 tx=0).stop 2023-06-09T04:42:31.567 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:31.563+0000 7fc1397d9700 1 -- 172.21.15.90:0/3577614114 shutdown_connections 2023-06-09T04:42:31.567 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:31.563+0000 7fc1397d9700 1 --2- 172.21.15.90:0/3577614114 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fc1200662f0 0x7fc1200687a0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:31.567 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:31.563+0000 7fc1397d9700 1 --2- 172.21.15.90:0/3577614114 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc134159ed0 0x7fc1340b1e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:31.567 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:31.563+0000 7fc1397d9700 1 --2- 172.21.15.90:0/3577614114 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc1340cc5c0 0x7fc1340cb4d0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:31.567 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:31.563+0000 7fc1397d9700 1 --2- 172.21.15.90:0/3577614114 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc13406a230 0x7fc1340cd430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:31.567 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:31.563+0000 7fc1397d9700 1 -- 172.21.15.90:0/3577614114 >> 172.21.15.90:0/3577614114 conn(0x7fc1340b00e0 msgr2=0x7fc1340718b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:31.568 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:31.563+0000 7fc1397d9700 1 -- 172.21.15.90:0/3577614114 shutdown_connections 2023-06-09T04:42:31.568 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:31.563+0000 7fc1397d9700 1 -- 172.21.15.90:0/3577614114 wait complete. 2023-06-09T04:42:31.588 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-09T04:42:31.763 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:31.763+0000 7f4ddea69700 1 Processor -- start 2023-06-09T04:42:31.764 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:31.763+0000 7f4ddea69700 1 -- start start 2023-06-09T04:42:31.767 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:31.767+0000 7f4ddea69700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f4dd8159ed0 0x7f4dd80718d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:31.767 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:31.767+0000 7f4ddea69700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4dd80ccf60 con 0x7f4dd80cc790 2023-06-09T04:42:31.767 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:31.767+0000 7f4ddea69700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4dd80c91a0 con 0x7f4dd806a230 2023-06-09T04:42:31.767 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:31.767+0000 7f4ddea69700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4dd8071e10 con 0x7f4dd8159ed0 2023-06-09T04:42:31.768 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:31.767+0000 7f4ddc805700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f4dd8159ed0 0x7f4dd80718d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:31.768 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:31.767+0000 7f4ddd006700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f4dd80cc790 0x7f4dd80ca5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:54986/0 (socket says 172.21.15.90:54986) 2023-06-09T04:42:31.768 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:31.767+0000 7f4ddd006700 1 -- 172.21.15.90:0/3661300696 learned_addr learned my addr 172.21.15.90:0/3661300696 (peer_addr_for_me v1:172.21.15.90:0/0) 2023-06-09T04:42:31.769 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:31.767+0000 7f4dd77fe700 1 -- 172.21.15.90:0/3661300696 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2233552660 0 0) 0x7f4dd0001490 con 0x7f4dd80cc790 2023-06-09T04:42:31.769 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:31.767+0000 7f4dd77fe700 1 -- 172.21.15.90:0/3661300696 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4dc80035d0 con 0x7f4dd80cc790 2023-06-09T04:42:31.770 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:31.767+0000 7f4ddc805700 1 -- 172.21.15.90:0/3661300696 >> v1:172.21.15.174:6789/0 conn(0x7f4dd806a230 legacy=0x7f4dd80cc080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:31.770 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:31.767+0000 7f4dd77fe700 1 -- 172.21.15.90:0/3661300696 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2567410027 0 0) 0x7f4dd80c91a0 con 0x7f4dd806a230 2023-06-09T04:42:31.770 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:31.767+0000 7f4ddc805700 1 -- 172.21.15.90:0/3661300696 >> v1:172.21.15.90:6789/0 conn(0x7f4dd80cc790 legacy=0x7f4dd80ca5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:31.770 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:31.767+0000 7f4ddc805700 1 -- 172.21.15.90:0/3661300696 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dd815a2a0 con 0x7f4dd8159ed0 2023-06-09T04:42:31.770 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:31.767+0000 7f4ddc805700 1 --2- 172.21.15.90:0/3661300696 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4dd8159ed0 0x7f4dd80718d0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f4dcc009850 tx=0x7f4dcc009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c63524b07d28973 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:31.770 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:31.767+0000 7f4dd77fe700 1 -- 172.21.15.90:0/3661300696 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dcc011830 con 0x7f4dd8159ed0 2023-06-09T04:42:31.770 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:31.767+0000 7f4dd77fe700 1 -- 172.21.15.90:0/3661300696 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dcc011990 con 0x7f4dd8159ed0 2023-06-09T04:42:31.771 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:31.767+0000 7f4dd77fe700 1 -- 172.21.15.90:0/3661300696 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dcc011d40 con 0x7f4dd8159ed0 2023-06-09T04:42:31.771 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:31.767+0000 7f4ddea69700 1 -- 172.21.15.90:0/3661300696 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4dd8159ed0 msgr2=0x7f4dd80718d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:31.771 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:31.767+0000 7f4ddea69700 1 --2- 172.21.15.90:0/3661300696 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4dd8159ed0 0x7f4dd80718d0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f4dcc009850 tx=0x7f4dcc009b60 comp rx=0 tx=0).stop 2023-06-09T04:42:31.772 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:31.767+0000 7f4ddea69700 1 -- 172.21.15.90:0/3661300696 shutdown_connections 2023-06-09T04:42:31.772 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:31.767+0000 7f4ddea69700 1 --2- 172.21.15.90:0/3661300696 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4dd8159ed0 0x7f4dd80718d0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:31.772 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:31.767+0000 7f4ddea69700 1 -- 172.21.15.90:0/3661300696 >> 172.21.15.90:0/3661300696 conn(0x7f4dd80b00e0 msgr2=0x7f4dd80b04b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:31.772 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:31.767+0000 7f4ddea69700 1 -- 172.21.15.90:0/3661300696 shutdown_connections 2023-06-09T04:42:31.772 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:31.767+0000 7f4ddea69700 1 -- 172.21.15.90:0/3661300696 wait complete. 2023-06-09T04:42:31.773 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:31.771+0000 7f4ddea69700 1 Processor -- start 2023-06-09T04:42:31.773 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:31.771+0000 7f4ddea69700 1 -- start start 2023-06-09T04:42:31.774 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:31.771+0000 7f4ddea69700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4dd806a230 0x7f4dd8152730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:31.774 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:31.771+0000 7f4ddea69700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4dd80cc790 0x7f4dd81f2ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:31.774 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:31.771+0000 7f4ddea69700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4dd8159ed0 0x7f4dd81f3010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:31.774 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:31.771+0000 7f4ddea69700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dd815c050 con 0x7f4dd80cc790 2023-06-09T04:42:31.774 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:31.771+0000 7f4ddea69700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dd815c470 con 0x7f4dd8159ed0 2023-06-09T04:42:31.775 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:31.771+0000 7f4ddea69700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dd815b3d0 con 0x7f4dd806a230 2023-06-09T04:42:31.776 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:31.771+0000 7f4dd7fff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4dd80cc790 0x7f4dd81f2ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:31.776 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:31.771+0000 7f4dd7fff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4dd80cc790 0x7f4dd81f2ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:53038/0 (socket says 172.21.15.90:53038) 2023-06-09T04:42:31.776 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:31.771+0000 7f4dd7fff700 1 -- 172.21.15.90:0/19621188 learned_addr learned my addr 172.21.15.90:0/19621188 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:31.776 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:31.771+0000 7f4ddd006700 1 --2- 172.21.15.90:0/19621188 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4dd8159ed0 0x7f4dd81f3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:31.777 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:31.771+0000 7f4ddc805700 1 --2- 172.21.15.90:0/19621188 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4dd806a230 0x7f4dd8152730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:31.777 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:31.775+0000 7f4dd7fff700 1 -- 172.21.15.90:0/19621188 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4dd806a230 msgr2=0x7f4dd8152730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:31.777 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:31.775+0000 7f4dd7fff700 1 --2- 172.21.15.90:0/19621188 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4dd806a230 0x7f4dd8152730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:31.777 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:31.775+0000 7f4dd7fff700 1 -- 172.21.15.90:0/19621188 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4dd8159ed0 msgr2=0x7f4dd81f3010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:31.777 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:31.775+0000 7f4dd7fff700 1 --2- 172.21.15.90:0/19621188 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4dd8159ed0 0x7f4dd81f3010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:31.777 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:31.775+0000 7f4dd7fff700 1 -- 172.21.15.90:0/19621188 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dcc0094b0 con 0x7f4dd80cc790 2023-06-09T04:42:31.777 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:31.775+0000 7f4dd7fff700 1 --2- 172.21.15.90:0/19621188 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4dd80cc790 0x7f4dd81f2ad0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f4dc400c540 tx=0x7f4dc400c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:31.777 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:31.775+0000 7f4dd57fa700 1 -- 172.21.15.90:0/19621188 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dc40054e0 con 0x7f4dd80cc790 2023-06-09T04:42:31.778 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:31.775+0000 7f4dd57fa700 1 -- 172.21.15.90:0/19621188 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dc40036a0 con 0x7f4dd80cc790 2023-06-09T04:42:31.778 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:31.775+0000 7f4dd57fa700 1 -- 172.21.15.90:0/19621188 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dc4003a50 con 0x7f4dd80cc790 2023-06-09T04:42:31.778 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:31.775+0000 7f4ddea69700 1 -- 172.21.15.90:0/19621188 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4dd815b6b0 con 0x7f4dd80cc790 2023-06-09T04:42:31.778 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:31.775+0000 7f4ddea69700 1 -- 172.21.15.90:0/19621188 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dd815bc70 con 0x7f4dd80cc790 2023-06-09T04:42:31.778 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:31.775+0000 7f4ddea69700 1 -- 172.21.15.90:0/19621188 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4dd815c190 con 0x7f4dd80cc790 2023-06-09T04:42:31.779 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:31.775+0000 7f4dd57fa700 1 -- 172.21.15.90:0/19621188 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4dc4003bb0 con 0x7f4dd80cc790 2023-06-09T04:42:31.780 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:31.779+0000 7f4dd57fa700 1 --2- 172.21.15.90:0/19621188 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f4dbc0662f0 0x7f4dbc0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:31.780 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:31.779+0000 7f4dd57fa700 1 -- 172.21.15.90:0/19621188 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4dc4083230 con 0x7f4dd80cc790 2023-06-09T04:42:31.780 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:31.779+0000 7f4ddc805700 1 --2- 172.21.15.90:0/19621188 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f4dbc0662f0 0x7f4dbc0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:31.781 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:31.779+0000 7f4ddc805700 1 --2- 172.21.15.90:0/19621188 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f4dbc0662f0 0x7f4dbc0687a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f4dcc0090b0 tx=0x7f4dcc01c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:31.784 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:31.783+0000 7f4dd57fa700 1 -- 172.21.15.90:0/19621188 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4dc40506b0 con 0x7f4dd80cc790 2023-06-09T04:42:31.951 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:31.947+0000 7f4ddea69700 1 -- 172.21.15.90:0/19621188 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f4dd804db30 con 0x7f4dd80cc790 2023-06-09T04:42:31.952 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:31.951+0000 7f4dd57fa700 1 -- 172.21.15.90:0/19621188 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7f4dc4003e60 con 0x7f4dd80cc790 2023-06-09T04:42:31.952 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 8 2023-06-09T04:42:31.954 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:31.951+0000 7f4ddea69700 1 -- 172.21.15.90:0/19621188 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f4dbc0662f0 msgr2=0x7f4dbc0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:31.954 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:31.951+0000 7f4ddea69700 1 --2- 172.21.15.90:0/19621188 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f4dbc0662f0 0x7f4dbc0687a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f4dcc0090b0 tx=0x7f4dcc01c040 comp rx=0 tx=0).stop 2023-06-09T04:42:31.955 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:31.951+0000 7f4ddea69700 1 -- 172.21.15.90:0/19621188 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4dd80cc790 msgr2=0x7f4dd81f2ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:31.955 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:31.951+0000 7f4ddea69700 1 --2- 172.21.15.90:0/19621188 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4dd80cc790 0x7f4dd81f2ad0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f4dc400c540 tx=0x7f4dc400c900 comp rx=0 tx=0).stop 2023-06-09T04:42:31.955 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:31.955+0000 7f4ddea69700 1 -- 172.21.15.90:0/19621188 shutdown_connections 2023-06-09T04:42:31.955 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:31.955+0000 7f4ddea69700 1 --2- 172.21.15.90:0/19621188 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f4dbc0662f0 0x7f4dbc0687a0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:31.956 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:31.955+0000 7f4ddea69700 1 --2- 172.21.15.90:0/19621188 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4dd8159ed0 0x7f4dd81f3010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:31.956 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:31.955+0000 7f4ddea69700 1 --2- 172.21.15.90:0/19621188 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4dd80cc790 0x7f4dd81f2ad0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:31.956 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:31.955+0000 7f4ddea69700 1 --2- 172.21.15.90:0/19621188 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4dd806a230 0x7f4dd8152730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:31.956 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:31.955+0000 7f4ddea69700 1 -- 172.21.15.90:0/19621188 >> 172.21.15.90:0/19621188 conn(0x7f4dd80b00e0 msgr2=0x7f4dd8159070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:31.956 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:31.955+0000 7f4ddea69700 1 -- 172.21.15.90:0/19621188 shutdown_connections 2023-06-09T04:42:31.956 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:31.955+0000 7f4ddea69700 1 -- 172.21.15.90:0/19621188 wait complete. 2023-06-09T04:42:31.977 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-09T04:42:32.146 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.143+0000 7f7f78e89700 1 Processor -- start 2023-06-09T04:42:32.147 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.143+0000 7f7f78e89700 1 -- start start 2023-06-09T04:42:32.148 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.147+0000 7f7f78e89700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f7f7406a230 0x7f7f740cc080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:32.149 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.147+0000 7f7f78e89700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7f740cc5c0 0x7f7f740ca5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:32.149 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.147+0000 7f7f78e89700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f740ccf60 con 0x7f7f74159ed0 2023-06-09T04:42:32.149 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.147+0000 7f7f78e89700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f740cca40 con 0x7f7f7406a230 2023-06-09T04:42:32.149 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.147+0000 7f7f78e89700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f740c91a0 con 0x7f7f740cc5c0 2023-06-09T04:42:32.150 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.147+0000 7f7f7259c700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f7f74159ed0 0x7f7f740718d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:54992/0 (socket says 172.21.15.90:54992) 2023-06-09T04:42:32.150 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.147+0000 7f7f7259c700 1 -- 172.21.15.90:0/633541124 learned_addr learned my addr 172.21.15.90:0/633541124 (peer_addr_for_me v1:172.21.15.90:0/0) 2023-06-09T04:42:32.150 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.147+0000 7f7f69d9b700 1 --2- 172.21.15.90:0/633541124 >> v2:172.21.15.174:3300/0 conn(0x7f7f7406a230 0x7f7f740cc080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:32.150 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.147+0000 7f7f72d9d700 1 --2- 172.21.15.90:0/633541124 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7f740cc5c0 0x7f7f740ca5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:32.150 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.147+0000 7f7f71d9b700 1 -- 172.21.15.90:0/633541124 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2775557905 0 0) 0x7f7f64001110 con 0x7f7f74159ed0 2023-06-09T04:42:32.151 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.147+0000 7f7f71d9b700 1 -- 172.21.15.90:0/633541124 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f600035d0 con 0x7f7f74159ed0 2023-06-09T04:42:32.151 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.147+0000 7f7f71d9b700 1 -- 172.21.15.90:0/633541124 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1692093163 0 0) 0x7f7f600035d0 con 0x7f7f74159ed0 2023-06-09T04:42:32.152 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.147+0000 7f7f71d9b700 1 -- 172.21.15.90:0/633541124 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7f740cc5c0 msgr2=0x7f7f740ca5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:32.152 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.147+0000 7f7f71d9b700 1 --2- 172.21.15.90:0/633541124 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7f740cc5c0 0x7f7f740ca5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:32.152 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.147+0000 7f7f71d9b700 1 -- 172.21.15.90:0/633541124 >> v2:172.21.15.174:3300/0 conn(0x7f7f7406a230 msgr2=0x7f7f740cc080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:32.152 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.147+0000 7f7f71d9b700 1 --2- 172.21.15.90:0/633541124 >> v2:172.21.15.174:3300/0 conn(0x7f7f7406a230 0x7f7f740cc080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:32.153 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.147+0000 7f7f71d9b700 1 -- 172.21.15.90:0/633541124 --> v1:172.21.15.90:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f7415a2a0 con 0x7f7f74159ed0 2023-06-09T04:42:32.153 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.147+0000 7f7f71d9b700 1 -- 172.21.15.90:0/633541124 <== mon.0 v1:172.21.15.90:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3604404106 0 0) 0x7f7f64001800 con 0x7f7f74159ed0 2023-06-09T04:42:32.153 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.147+0000 7f7f71d9b700 1 -- 172.21.15.90:0/633541124 >> v1:172.21.15.90:6789/0 conn(0x7f7f74159ed0 legacy=0x7f7f740718d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:32.154 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.147+0000 7f7f71d9b700 1 --2- 172.21.15.90:0/633541124 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7f60003a20 0x7f7f60003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:32.154 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.147+0000 7f7f71d9b700 1 --2- 172.21.15.90:0/633541124 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7f740cc5c0 0x7f7f60004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:32.154 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.147+0000 7f7f71d9b700 1 --2- 172.21.15.90:0/633541124 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7f60004db0 0x7f7f60005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:32.154 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.147+0000 7f7f71d9b700 1 -- 172.21.15.90:0/633541124 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f740cca40 con 0x7f7f60004db0 2023-06-09T04:42:32.155 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.147+0000 7f7f71d9b700 1 -- 172.21.15.90:0/633541124 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f740c91a0 con 0x7f7f60003a20 2023-06-09T04:42:32.155 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.147+0000 7f7f71d9b700 1 -- 172.21.15.90:0/633541124 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f6000ba30 con 0x7f7f740cc5c0 2023-06-09T04:42:32.155 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.151+0000 7f7f72d9d700 1 --2- 172.21.15.90:0/633541124 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7f60004db0 0x7f7f60005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:32.155 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.151+0000 7f7f69d9b700 1 --2- 172.21.15.90:0/633541124 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7f740cc5c0 0x7f7f60004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:32.156 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.151+0000 7f7f7259c700 1 --2- 172.21.15.90:0/633541124 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7f60003a20 0x7f7f60003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:32.158 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.151+0000 7f7f69d9b700 1 -- 172.21.15.90:0/633541124 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7f60003a20 msgr2=0x7f7f60003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:32.158 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.151+0000 7f7f69d9b700 1 --2- 172.21.15.90:0/633541124 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7f60003a20 0x7f7f60003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:32.159 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.151+0000 7f7f69d9b700 1 -- 172.21.15.90:0/633541124 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7f60004db0 msgr2=0x7f7f60005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:32.159 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.151+0000 7f7f69d9b700 1 --2- 172.21.15.90:0/633541124 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7f60004db0 0x7f7f60005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:32.159 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.151+0000 7f7f69d9b700 1 -- 172.21.15.90:0/633541124 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f600035d0 con 0x7f7f740cc5c0 2023-06-09T04:42:32.160 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.151+0000 7f7f7259c700 1 --2- 172.21.15.90:0/633541124 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7f60003a20 0x7f7f60003e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:42:32.160 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.151+0000 7f7f72d9d700 1 --2- 172.21.15.90:0/633541124 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7f60004db0 0x7f7f60005220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:42:32.160 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.151+0000 7f7f69d9b700 1 --2- 172.21.15.90:0/633541124 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7f740cc5c0 0x7f7f60004870 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7f5c009b40 tx=0x7f7f600058a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=18773cbd168ca061 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:32.160 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.151+0000 7f7f71d9b700 1 -- 172.21.15.90:0/633541124 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f5c00e6c0 con 0x7f7f740cc5c0 2023-06-09T04:42:32.160 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.151+0000 7f7f71d9b700 1 -- 172.21.15.90:0/633541124 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f5c00e820 con 0x7f7f740cc5c0 2023-06-09T04:42:32.161 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.151+0000 7f7f71d9b700 1 -- 172.21.15.90:0/633541124 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f5c00eb90 con 0x7f7f740cc5c0 2023-06-09T04:42:32.161 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.151+0000 7f7f78e89700 1 -- 172.21.15.90:0/633541124 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7f740cc5c0 msgr2=0x7f7f60004870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:32.161 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.151+0000 7f7f78e89700 1 --2- 172.21.15.90:0/633541124 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7f740cc5c0 0x7f7f60004870 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7f5c009b40 tx=0x7f7f600058a0 comp rx=0 tx=0).stop 2023-06-09T04:42:32.161 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.151+0000 7f7f72d9d700 1 -- 172.21.15.90:0/633541124 reap_dead start 2023-06-09T04:42:32.162 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.151+0000 7f7f78e89700 1 -- 172.21.15.90:0/633541124 shutdown_connections 2023-06-09T04:42:32.162 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.151+0000 7f7f78e89700 1 -- 172.21.15.90:0/633541124 >> 172.21.15.90:0/633541124 conn(0x7f7f740b00e0 msgr2=0x7f7f740b04b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:32.162 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.151+0000 7f7f78e89700 1 -- 172.21.15.90:0/633541124 shutdown_connections 2023-06-09T04:42:32.162 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.151+0000 7f7f78e89700 1 -- 172.21.15.90:0/633541124 wait complete. 2023-06-09T04:42:32.163 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.155+0000 7f7f78e89700 1 Processor -- start 2023-06-09T04:42:32.163 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.155+0000 7f7f78e89700 1 -- start start 2023-06-09T04:42:32.164 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.155+0000 7f7f78e89700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7f740cc5c0 0x7f7f741f59b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:32.164 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.155+0000 7f7f78e89700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7f74157040 0x7f7f741578a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:32.165 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.159+0000 7f7f78e89700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7f74157de0 0x7f7f741f19d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:32.165 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.159+0000 7f7f78e89700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f74158250 con 0x7f7f74157040 2023-06-09T04:42:32.165 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.159+0000 7f7f78e89700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f740a7b40 con 0x7f7f74157de0 2023-06-09T04:42:32.165 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.159+0000 7f7f78e89700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f740a7860 con 0x7f7f740cc5c0 2023-06-09T04:42:32.165 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.159+0000 7f7f69d9b700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7f74157040 0x7f7f741578a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:32.165 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.159+0000 7f7f69d9b700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7f74157040 0x7f7f741578a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:53060/0 (socket says 172.21.15.90:53060) 2023-06-09T04:42:32.165 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.159+0000 7f7f69d9b700 1 -- 172.21.15.90:0/2841927458 learned_addr learned my addr 172.21.15.90:0/2841927458 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:32.166 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.159+0000 7f7f7259c700 1 --2- 172.21.15.90:0/2841927458 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7f740cc5c0 0x7f7f741f59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:32.166 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.159+0000 7f7f72d9d700 1 --2- 172.21.15.90:0/2841927458 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7f74157de0 0x7f7f741f19d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:32.166 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.159+0000 7f7f69d9b700 1 -- 172.21.15.90:0/2841927458 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7f740cc5c0 msgr2=0x7f7f741f59b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:32.166 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.159+0000 7f7f69d9b700 1 --2- 172.21.15.90:0/2841927458 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7f740cc5c0 0x7f7f741f59b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:32.166 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.159+0000 7f7f69d9b700 1 -- 172.21.15.90:0/2841927458 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7f74157de0 msgr2=0x7f7f741f19d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:32.166 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.159+0000 7f7f69d9b700 1 --2- 172.21.15.90:0/2841927458 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7f74157de0 0x7f7f741f19d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:32.166 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.159+0000 7f7f69d9b700 1 -- 172.21.15.90:0/2841927458 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f741f2c10 con 0x7f7f74157040 2023-06-09T04:42:32.166 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.159+0000 7f7f69d9b700 1 --2- 172.21.15.90:0/2841927458 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7f74157040 0x7f7f741578a0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f7f5c00e4b0 tx=0x7f7f5c0047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:32.167 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.159+0000 7f7f6b7fe700 1 -- 172.21.15.90:0/2841927458 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f5c00e6c0 con 0x7f7f74157040 2023-06-09T04:42:32.167 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.159+0000 7f7f6b7fe700 1 -- 172.21.15.90:0/2841927458 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f5c004480 con 0x7f7f74157040 2023-06-09T04:42:32.167 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.159+0000 7f7f6b7fe700 1 -- 172.21.15.90:0/2841927458 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f5c013b20 con 0x7f7f74157040 2023-06-09T04:42:32.167 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.159+0000 7f7f78e89700 1 -- 172.21.15.90:0/2841927458 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f741f2ef0 con 0x7f7f74157040 2023-06-09T04:42:32.167 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.159+0000 7f7f78e89700 1 -- 172.21.15.90:0/2841927458 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f740b40f0 con 0x7f7f74157040 2023-06-09T04:42:32.167 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.159+0000 7f7f78e89700 1 -- 172.21.15.90:0/2841927458 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f7404db30 con 0x7f7f74157040 2023-06-09T04:42:32.167 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.163+0000 7f7f6b7fe700 1 -- 172.21.15.90:0/2841927458 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7f5c013c80 con 0x7f7f74157040 2023-06-09T04:42:32.168 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.163+0000 7f7f6b7fe700 1 --2- 172.21.15.90:0/2841927458 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f7f54066320 0x7f7f540687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:32.168 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.163+0000 7f7f6b7fe700 1 -- 172.21.15.90:0/2841927458 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7f5c0851c0 con 0x7f7f74157040 2023-06-09T04:42:32.168 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.163+0000 7f7f7259c700 1 --2- 172.21.15.90:0/2841927458 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f7f54066320 0x7f7f540687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:32.168 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.167+0000 7f7f7259c700 1 --2- 172.21.15.90:0/2841927458 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f7f54066320 0x7f7f540687d0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f7f64000c00 tx=0x7f7f64007040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:32.172 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.171+0000 7f7f6b7fe700 1 -- 172.21.15.90:0/2841927458 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7f5c052630 con 0x7f7f74157040 2023-06-09T04:42:32.346 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.343+0000 7f7f78e89700 1 -- 172.21.15.90:0/2841927458 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7f7406aa50 con 0x7f7f74157040 2023-06-09T04:42:32.347 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.343+0000 7f7f6b7fe700 1 -- 172.21.15.90:0/2841927458 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7f5c055c50 con 0x7f7f74157040 2023-06-09T04:42:32.347 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 32 2023-06-09T04:42:32.349 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.347+0000 7f7f78e89700 1 -- 172.21.15.90:0/2841927458 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f7f54066320 msgr2=0x7f7f540687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:32.349 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.347+0000 7f7f78e89700 1 --2- 172.21.15.90:0/2841927458 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f7f54066320 0x7f7f540687d0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f7f64000c00 tx=0x7f7f64007040 comp rx=0 tx=0).stop 2023-06-09T04:42:32.350 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.347+0000 7f7f78e89700 1 -- 172.21.15.90:0/2841927458 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7f74157040 msgr2=0x7f7f741578a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:32.350 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.347+0000 7f7f78e89700 1 --2- 172.21.15.90:0/2841927458 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7f74157040 0x7f7f741578a0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f7f5c00e4b0 tx=0x7f7f5c0047e0 comp rx=0 tx=0).stop 2023-06-09T04:42:32.350 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.347+0000 7f7f78e89700 1 -- 172.21.15.90:0/2841927458 shutdown_connections 2023-06-09T04:42:32.350 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.347+0000 7f7f78e89700 1 --2- 172.21.15.90:0/2841927458 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f7f54066320 0x7f7f540687d0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:32.351 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.347+0000 7f7f78e89700 1 --2- 172.21.15.90:0/2841927458 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7f74157de0 0x7f7f741f19d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:32.351 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.347+0000 7f7f78e89700 1 --2- 172.21.15.90:0/2841927458 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7f74157040 0x7f7f741578a0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:32.351 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.347+0000 7f7f78e89700 1 --2- 172.21.15.90:0/2841927458 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7f740cc5c0 0x7f7f741f59b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:32.351 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.347+0000 7f7f78e89700 1 -- 172.21.15.90:0/2841927458 >> 172.21.15.90:0/2841927458 conn(0x7f7f740b00e0 msgr2=0x7f7f740aea20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:32.351 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.347+0000 7f7f78e89700 1 -- 172.21.15.90:0/2841927458 shutdown_connections 2023-06-09T04:42:32.351 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.347+0000 7f7f78e89700 1 -- 172.21.15.90:0/2841927458 wait complete. 2023-06-09T04:42:32.370 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-09T04:42:32.548 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.547+0000 7f7c9a9ef700 1 Processor -- start 2023-06-09T04:42:32.549 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.547+0000 7f7c9a9ef700 1 -- start start 2023-06-09T04:42:32.551 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.547+0000 7f7c9a9ef700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f7c9415de00 0x7f7c941612e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:32.551 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.551+0000 7f7c9a9ef700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f7c940cda20 0x7f7c940c4640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:32.551 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.551+0000 7f7c9a9ef700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c940cc230 con 0x7f7c940c3170 2023-06-09T04:42:32.551 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.551+0000 7f7c9a9ef700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c940cde90 con 0x7f7c940cda20 2023-06-09T04:42:32.551 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.551+0000 7f7c9a9ef700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c9406ab90 con 0x7f7c9415de00 2023-06-09T04:42:32.552 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.551+0000 7f7c991ec700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f7c940cda20 0x7f7c940c4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:32.552 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.551+0000 7f7c991ec700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f7c940cda20 0x7f7c940c4640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:53066/0 (socket says 172.21.15.90:53066) 2023-06-09T04:42:32.553 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.551+0000 7f7c991ec700 1 -- 172.21.15.90:0/2321980902 learned_addr learned my addr 172.21.15.90:0/2321980902 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:32.553 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.551+0000 7f7c999ed700 1 --2- 172.21.15.90:0/2321980902 >> v2:172.21.15.174:3300/0 conn(0x7f7c9415de00 0x7f7c941612e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:32.553 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.551+0000 7f7c991ec700 1 -- 172.21.15.90:0/2321980902 >> v2:172.21.15.174:3300/0 conn(0x7f7c9415de00 msgr2=0x7f7c941612e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:32.553 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.551+0000 7f7c991ec700 1 --2- 172.21.15.90:0/2321980902 >> v2:172.21.15.174:3300/0 conn(0x7f7c9415de00 0x7f7c941612e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:32.554 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.551+0000 7f7c991ec700 1 -- 172.21.15.90:0/2321980902 >> v1:172.21.15.174:6789/0 conn(0x7f7c940c3170 legacy=0x7f7c94069820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:32.554 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.551+0000 7f7c991ec700 1 -- 172.21.15.90:0/2321980902 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c9415e1d0 con 0x7f7c940cda20 2023-06-09T04:42:32.554 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.551+0000 7f7c999ed700 1 --2- 172.21.15.90:0/2321980902 >> v2:172.21.15.174:3300/0 conn(0x7f7c9415de00 0x7f7c941612e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:42:32.554 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.551+0000 7f7c991ec700 1 --2- 172.21.15.90:0/2321980902 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7c940cda20 0x7f7c940c4640 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f7c9406efd0 tx=0x7f7c84009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5e030900bab257f server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:32.554 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.551+0000 7f7c989eb700 1 -- 172.21.15.90:0/2321980902 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c8400b8a0 con 0x7f7c940cda20 2023-06-09T04:42:32.555 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.551+0000 7f7c989eb700 1 -- 172.21.15.90:0/2321980902 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c8400ba00 con 0x7f7c940cda20 2023-06-09T04:42:32.555 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.551+0000 7f7c989eb700 1 -- 172.21.15.90:0/2321980902 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c8400bd90 con 0x7f7c940cda20 2023-06-09T04:42:32.555 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.551+0000 7f7c9a9ef700 1 -- 172.21.15.90:0/2321980902 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7c940cda20 msgr2=0x7f7c940c4640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:32.556 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.551+0000 7f7c9a9ef700 1 --2- 172.21.15.90:0/2321980902 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7c940cda20 0x7f7c940c4640 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f7c9406efd0 tx=0x7f7c84009bf0 comp rx=0 tx=0).stop 2023-06-09T04:42:32.556 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.551+0000 7f7c9a9ef700 1 -- 172.21.15.90:0/2321980902 shutdown_connections 2023-06-09T04:42:32.556 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.551+0000 7f7c9a9ef700 1 --2- 172.21.15.90:0/2321980902 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7c940cda20 0x7f7c940c4640 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:32.556 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.551+0000 7f7c9a9ef700 1 --2- 172.21.15.90:0/2321980902 >> v2:172.21.15.174:3300/0 conn(0x7f7c9415de00 0x7f7c941612e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:32.556 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.551+0000 7f7c9a9ef700 1 -- 172.21.15.90:0/2321980902 >> 172.21.15.90:0/2321980902 conn(0x7f7c940aff00 msgr2=0x7f7c940b0300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:32.556 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.555+0000 7f7c9a9ef700 1 -- 172.21.15.90:0/2321980902 shutdown_connections 2023-06-09T04:42:32.556 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.555+0000 7f7c9a9ef700 1 -- 172.21.15.90:0/2321980902 wait complete. 2023-06-09T04:42:32.557 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.555+0000 7f7c9a9ef700 1 Processor -- start 2023-06-09T04:42:32.557 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.555+0000 7f7c9a9ef700 1 -- start start 2023-06-09T04:42:32.558 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.555+0000 7f7c9a9ef700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7c940c3170 0x7f7c9415ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:32.559 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.555+0000 7f7c9a9ef700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7c940cda20 0x7f7c940cb1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:32.559 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.555+0000 7f7c9a9ef700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7c9415de00 0x7f7c94157fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:32.559 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.555+0000 7f7c9a9ef700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c94164450 con 0x7f7c940c3170 2023-06-09T04:42:32.559 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.555+0000 7f7c9a9ef700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c941633b0 con 0x7f7c9415de00 2023-06-09T04:42:32.559 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.555+0000 7f7c9a9ef700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c94163690 con 0x7f7c940cda20 2023-06-09T04:42:32.560 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.559+0000 7f7c999ed700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7c940c3170 0x7f7c9415ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:32.560 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.559+0000 7f7c999ed700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7c940c3170 0x7f7c9415ced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:53082/0 (socket says 172.21.15.90:53082) 2023-06-09T04:42:32.560 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.559+0000 7f7c999ed700 1 -- 172.21.15.90:0/1054088638 learned_addr learned my addr 172.21.15.90:0/1054088638 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:32.561 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.559+0000 7f7c991ec700 1 --2- 172.21.15.90:0/1054088638 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7c940cda20 0x7f7c940cb1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:32.561 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.559+0000 7f7c9a1ee700 1 --2- 172.21.15.90:0/1054088638 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7c9415de00 0x7f7c94157fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:32.561 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.559+0000 7f7c999ed700 1 -- 172.21.15.90:0/1054088638 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7c940cda20 msgr2=0x7f7c940cb1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:32.561 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.559+0000 7f7c999ed700 1 --2- 172.21.15.90:0/1054088638 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7c940cda20 0x7f7c940cb1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:32.561 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.559+0000 7f7c999ed700 1 -- 172.21.15.90:0/1054088638 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7c9415de00 msgr2=0x7f7c94157fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:32.561 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.559+0000 7f7c999ed700 1 --2- 172.21.15.90:0/1054088638 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7c9415de00 0x7f7c94157fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:32.561 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.559+0000 7f7c999ed700 1 -- 172.21.15.90:0/1054088638 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c84009570 con 0x7f7c940c3170 2023-06-09T04:42:32.561 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.559+0000 7f7c991ec700 1 --2- 172.21.15.90:0/1054088638 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7c940cda20 0x7f7c940cb1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:42:32.562 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.559+0000 7f7c999ed700 1 --2- 172.21.15.90:0/1054088638 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7c940c3170 0x7f7c9415ced0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f7c9000e810 tx=0x7f7c9000ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:32.562 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.559+0000 7f7c8a7fc700 1 -- 172.21.15.90:0/1054088638 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c90013610 con 0x7f7c940c3170 2023-06-09T04:42:32.562 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.559+0000 7f7c8a7fc700 1 -- 172.21.15.90:0/1054088638 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c90013770 con 0x7f7c940c3170 2023-06-09T04:42:32.563 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.559+0000 7f7c9a9ef700 1 -- 172.21.15.90:0/1054088638 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c94163970 con 0x7f7c940c3170 2023-06-09T04:42:32.563 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.559+0000 7f7c8a7fc700 1 -- 172.21.15.90:0/1054088638 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c90013b00 con 0x7f7c940c3170 2023-06-09T04:42:32.563 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.559+0000 7f7c9a9ef700 1 -- 172.21.15.90:0/1054088638 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c94163f30 con 0x7f7c940c3170 2023-06-09T04:42:32.563 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.559+0000 7f7c9a9ef700 1 -- 172.21.15.90:0/1054088638 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c940cbe80 con 0x7f7c940c3170 2023-06-09T04:42:32.564 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.563+0000 7f7c8a7fc700 1 -- 172.21.15.90:0/1054088638 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7c90013c60 con 0x7f7c940c3170 2023-06-09T04:42:32.565 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.563+0000 7f7c8a7fc700 1 --2- 172.21.15.90:0/1054088638 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f7c780662f0 0x7f7c780687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:32.566 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.563+0000 7f7c8a7fc700 1 -- 172.21.15.90:0/1054088638 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7c90083990 con 0x7f7c940c3170 2023-06-09T04:42:32.566 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.563+0000 7f7c991ec700 1 --2- 172.21.15.90:0/1054088638 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f7c780662f0 0x7f7c780687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:32.567 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.567+0000 7f7c991ec700 1 --2- 172.21.15.90:0/1054088638 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f7c780662f0 0x7f7c780687a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f7c84000c00 tx=0x7f7c84008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:32.572 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.571+0000 7f7c8a7fc700 1 -- 172.21.15.90:0/1054088638 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7c90050e20 con 0x7f7c940c3170 2023-06-09T04:42:32.744 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.743+0000 7f7c9a9ef700 1 -- 172.21.15.90:0/1054088638 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7c9404e380 con 0x7f7c940c3170 2023-06-09T04:42:32.745 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.743+0000 7f7c8a7fc700 1 -- 172.21.15.90:0/1054088638 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7c90054440 con 0x7f7c940c3170 2023-06-09T04:42:32.745 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 64 2023-06-09T04:42:32.747 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.747+0000 7f7c9a9ef700 1 -- 172.21.15.90:0/1054088638 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f7c780662f0 msgr2=0x7f7c780687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:32.748 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.747+0000 7f7c9a9ef700 1 --2- 172.21.15.90:0/1054088638 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f7c780662f0 0x7f7c780687a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f7c84000c00 tx=0x7f7c84008030 comp rx=0 tx=0).stop 2023-06-09T04:42:32.748 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.747+0000 7f7c9a9ef700 1 -- 172.21.15.90:0/1054088638 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7c940c3170 msgr2=0x7f7c9415ced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:32.748 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.747+0000 7f7c9a9ef700 1 --2- 172.21.15.90:0/1054088638 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7c940c3170 0x7f7c9415ced0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f7c9000e810 tx=0x7f7c9000ebd0 comp rx=0 tx=0).stop 2023-06-09T04:42:32.748 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.747+0000 7f7c9a9ef700 1 -- 172.21.15.90:0/1054088638 shutdown_connections 2023-06-09T04:42:32.749 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.747+0000 7f7c9a9ef700 1 --2- 172.21.15.90:0/1054088638 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f7c780662f0 0x7f7c780687a0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:32.749 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.747+0000 7f7c9a9ef700 1 --2- 172.21.15.90:0/1054088638 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7c9415de00 0x7f7c94157fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:32.749 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.747+0000 7f7c9a9ef700 1 --2- 172.21.15.90:0/1054088638 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7c940cda20 0x7f7c940cb1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:32.749 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.747+0000 7f7c9a9ef700 1 --2- 172.21.15.90:0/1054088638 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7c940c3170 0x7f7c9415ced0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:32.749 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.747+0000 7f7c9a9ef700 1 -- 172.21.15.90:0/1054088638 >> 172.21.15.90:0/1054088638 conn(0x7f7c940aff00 msgr2=0x7f7c94070270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:32.749 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.747+0000 7f7c9a9ef700 1 -- 172.21.15.90:0/1054088638 shutdown_connections 2023-06-09T04:42:32.749 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.747+0000 7f7c9a9ef700 1 -- 172.21.15.90:0/1054088638 wait complete. 2023-06-09T04:42:32.765 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-06-09T04:42:32.942 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.939+0000 7f9d15946700 1 Processor -- start 2023-06-09T04:42:32.942 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.939+0000 7f9d15946700 1 -- start start 2023-06-09T04:42:32.944 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.943+0000 7f9d15946700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9d100c8b40 0x7f9d100ca7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:32.945 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.943+0000 7f9d15946700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d100cae10 con 0x7f9d1015e120 2023-06-09T04:42:32.945 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.943+0000 7f9d15946700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d100cb0f0 con 0x7f9d10154370 2023-06-09T04:42:32.945 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.943+0000 7f9d15946700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d100c8f60 con 0x7f9d100c8b40 2023-06-09T04:42:32.945 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.943+0000 7f9d07fff700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f9d1015e120 0x7f9d100b3340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:54998/0 (socket says 172.21.15.90:54998) 2023-06-09T04:42:32.945 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.943+0000 7f9d07fff700 1 -- 172.21.15.90:0/3036354582 learned_addr learned my addr 172.21.15.90:0/3036354582 (peer_addr_for_me v1:172.21.15.90:0/0) 2023-06-09T04:42:32.946 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.943+0000 7f9d0f7fe700 1 --2- 172.21.15.90:0/3036354582 >> v2:172.21.15.174:3300/0 conn(0x7f9d100c8b40 0x7f9d100ca7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:32.947 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.943+0000 7f9d0e7fc700 1 -- 172.21.15.90:0/3036354582 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4194640530 0 0) 0x7f9d100cae10 con 0x7f9d1015e120 2023-06-09T04:42:32.947 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.943+0000 7f9d0e7fc700 1 -- 172.21.15.90:0/3036354582 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9cfc0035d0 con 0x7f9d1015e120 2023-06-09T04:42:32.947 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.943+0000 7f9d0e7fc700 1 -- 172.21.15.90:0/3036354582 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2114591309 0 0) 0x7f9d100cb0f0 con 0x7f9d10154370 2023-06-09T04:42:32.947 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.943+0000 7f9d0e7fc700 1 -- 172.21.15.90:0/3036354582 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d100cae10 con 0x7f9d10154370 2023-06-09T04:42:32.947 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.943+0000 7f9d0e7fc700 1 -- 172.21.15.90:0/3036354582 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 642133547 0 0) 0x7f9cfc0035d0 con 0x7f9d1015e120 2023-06-09T04:42:32.947 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.943+0000 7f9d0e7fc700 1 -- 172.21.15.90:0/3036354582 >> v2:172.21.15.174:3300/0 conn(0x7f9d100c8b40 msgr2=0x7f9d100ca7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:32.948 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.943+0000 7f9d0e7fc700 1 --2- 172.21.15.90:0/3036354582 >> v2:172.21.15.174:3300/0 conn(0x7f9d100c8b40 0x7f9d100ca7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:32.948 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.943+0000 7f9d0e7fc700 1 -- 172.21.15.90:0/3036354582 >> v1:172.21.15.174:6789/0 conn(0x7f9d10154370 legacy=0x7f9d1015da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:32.948 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.943+0000 7f9d0e7fc700 1 -- 172.21.15.90:0/3036354582 --> v1:172.21.15.90:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d100cb3d0 con 0x7f9d1015e120 2023-06-09T04:42:32.948 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.943+0000 7f9d0e7fc700 1 -- 172.21.15.90:0/3036354582 <== mon.0 v1:172.21.15.90:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3604404106 0 0) 0x7f9cf8001670 con 0x7f9d1015e120 2023-06-09T04:42:32.948 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.943+0000 7f9d0e7fc700 1 -- 172.21.15.90:0/3036354582 >> v1:172.21.15.90:6789/0 conn(0x7f9d1015e120 legacy=0x7f9d100b3340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:32.948 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.943+0000 7f9d0e7fc700 1 --2- 172.21.15.90:0/3036354582 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9cfc003bb0 0x7f9cfc003fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:32.948 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.943+0000 7f9d0e7fc700 1 --2- 172.21.15.90:0/3036354582 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9cfc004870 0x7f9cfc004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:32.949 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.943+0000 7f9d0e7fc700 1 --2- 172.21.15.90:0/3036354582 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9cfc005220 0x7f9cfc00ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:32.949 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.943+0000 7f9d0e7fc700 1 -- 172.21.15.90:0/3036354582 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d100c8f60 con 0x7f9cfc005220 2023-06-09T04:42:32.949 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.943+0000 7f9d0e7fc700 1 -- 172.21.15.90:0/3036354582 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cfc00c130 con 0x7f9cfc004870 2023-06-09T04:42:32.949 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.943+0000 7f9d0e7fc700 1 -- 172.21.15.90:0/3036354582 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cfc00c2f0 con 0x7f9cfc003bb0 2023-06-09T04:42:32.952 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.947+0000 7f9d0f7fe700 1 --2- 172.21.15.90:0/3036354582 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9cfc005220 0x7f9cfc00ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:32.952 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.947+0000 7f9d07fff700 1 --2- 172.21.15.90:0/3036354582 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9cfc004870 0x7f9cfc004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:32.952 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.947+0000 7f9d0effd700 1 --2- 172.21.15.90:0/3036354582 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9cfc003bb0 0x7f9cfc003fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:32.953 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.947+0000 7f9d07fff700 1 -- 172.21.15.90:0/3036354582 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9cfc003bb0 msgr2=0x7f9cfc003fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:32.953 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.947+0000 7f9d07fff700 1 --2- 172.21.15.90:0/3036354582 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9cfc003bb0 0x7f9cfc003fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:32.953 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.947+0000 7f9d07fff700 1 -- 172.21.15.90:0/3036354582 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9cfc005220 msgr2=0x7f9cfc00ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:32.953 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.947+0000 7f9d07fff700 1 --2- 172.21.15.90:0/3036354582 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9cfc005220 0x7f9cfc00ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:32.954 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.947+0000 7f9d07fff700 1 -- 172.21.15.90:0/3036354582 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cfc0035d0 con 0x7f9cfc004870 2023-06-09T04:42:32.954 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.947+0000 7f9d0f7fe700 1 -- 172.21.15.90:0/3036354582 reap_dead start 2023-06-09T04:42:32.954 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.947+0000 7f9d07fff700 1 --2- 172.21.15.90:0/3036354582 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9cfc004870 0x7f9cfc004ce0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f9cf8001eb0 tx=0x7f9cfc0058a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a689f94dbe7770eb server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:32.955 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.947+0000 7f9d0e7fc700 1 -- 172.21.15.90:0/3036354582 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cf800cd40 con 0x7f9cfc004870 2023-06-09T04:42:32.955 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.947+0000 7f9d0e7fc700 1 -- 172.21.15.90:0/3036354582 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cf8005980 con 0x7f9cfc004870 2023-06-09T04:42:32.955 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.947+0000 7f9d0e7fc700 1 -- 172.21.15.90:0/3036354582 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cf8005d30 con 0x7f9cfc004870 2023-06-09T04:42:32.956 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.947+0000 7f9d15946700 1 -- 172.21.15.90:0/3036354582 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9cfc004870 msgr2=0x7f9cfc004ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:32.956 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.947+0000 7f9d15946700 1 --2- 172.21.15.90:0/3036354582 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9cfc004870 0x7f9cfc004ce0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f9cf8001eb0 tx=0x7f9cfc0058a0 comp rx=0 tx=0).stop 2023-06-09T04:42:32.956 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.947+0000 7f9d15946700 1 -- 172.21.15.90:0/3036354582 shutdown_connections 2023-06-09T04:42:32.957 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.947+0000 7f9d15946700 1 --2- 172.21.15.90:0/3036354582 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9cfc004870 0x7f9cfc004ce0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:32.957 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.947+0000 7f9d15946700 1 -- 172.21.15.90:0/3036354582 >> 172.21.15.90:0/3036354582 conn(0x7f9d1006c810 msgr2=0x7f9d100b0000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:32.957 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.947+0000 7f9d15946700 1 -- 172.21.15.90:0/3036354582 shutdown_connections 2023-06-09T04:42:32.957 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.947+0000 7f9d15946700 1 -- 172.21.15.90:0/3036354582 wait complete. 2023-06-09T04:42:32.960 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.951+0000 7f9d15946700 1 Processor -- start 2023-06-09T04:42:32.961 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.955+0000 7f9d15946700 1 -- start start 2023-06-09T04:42:32.961 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.955+0000 7f9d15946700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9cfc004870 0x7f9d10153a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:32.961 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.955+0000 7f9d15946700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9d100adb20 0x7f9d100adf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:32.961 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.955+0000 7f9d15946700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9d100cc300 0x7f9d100cc770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:32.961 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.955+0000 7f9d15946700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d10153f90 con 0x7f9d100cc300 2023-06-09T04:42:32.961 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.955+0000 7f9d15946700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d100ae4d0 con 0x7f9d100adb20 2023-06-09T04:42:32.961 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.955+0000 7f9d15946700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d100ce0d0 con 0x7f9cfc004870 2023-06-09T04:42:32.962 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.955+0000 7f9d0f7fe700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9d100cc300 0x7f9d100cc770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:32.962 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.955+0000 7f9d0f7fe700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9d100cc300 0x7f9d100cc770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:53094/0 (socket says 172.21.15.90:53094) 2023-06-09T04:42:32.962 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.955+0000 7f9d0f7fe700 1 -- 172.21.15.90:0/3547644986 learned_addr learned my addr 172.21.15.90:0/3547644986 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:32.962 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.955+0000 7f9d0effd700 1 --2- 172.21.15.90:0/3547644986 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9cfc004870 0x7f9d10153a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:32.962 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.955+0000 7f9d07fff700 1 --2- 172.21.15.90:0/3547644986 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9d100adb20 0x7f9d100adf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:32.962 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.955+0000 7f9d0f7fe700 1 -- 172.21.15.90:0/3547644986 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9cfc004870 msgr2=0x7f9d10153a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:32.962 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.955+0000 7f9d0f7fe700 1 --2- 172.21.15.90:0/3547644986 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9cfc004870 0x7f9d10153a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:32.962 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.955+0000 7f9d0f7fe700 1 -- 172.21.15.90:0/3547644986 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9d100adb20 msgr2=0x7f9d100adf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:32.963 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.955+0000 7f9d0f7fe700 1 --2- 172.21.15.90:0/3547644986 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9d100adb20 0x7f9d100adf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:32.963 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.955+0000 7f9d0f7fe700 1 -- 172.21.15.90:0/3547644986 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d101548c0 con 0x7f9d100cc300 2023-06-09T04:42:32.963 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.955+0000 7f9d0effd700 1 --2- 172.21.15.90:0/3547644986 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9cfc004870 0x7f9d10153a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:42:32.963 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.955+0000 7f9d0f7fe700 1 --2- 172.21.15.90:0/3547644986 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9d100cc300 0x7f9d100cc770 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f9d100b42f0 tx=0x7f9d08011f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:32.963 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.955+0000 7f9d0cff9700 1 -- 172.21.15.90:0/3547644986 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d0800e040 con 0x7f9d100cc300 2023-06-09T04:42:32.963 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.955+0000 7f9d0cff9700 1 -- 172.21.15.90:0/3547644986 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d0800f040 con 0x7f9d100cc300 2023-06-09T04:42:32.963 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.959+0000 7f9d15946700 1 -- 172.21.15.90:0/3547644986 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d100cd030 con 0x7f9d100cc300 2023-06-09T04:42:32.964 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.959+0000 7f9d0cff9700 1 -- 172.21.15.90:0/3547644986 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d0800fd50 con 0x7f9d100cc300 2023-06-09T04:42:32.964 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.959+0000 7f9d15946700 1 -- 172.21.15.90:0/3547644986 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d100cd5f0 con 0x7f9d100cc300 2023-06-09T04:42:32.964 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.959+0000 7f9d15946700 1 -- 172.21.15.90:0/3547644986 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d1004db30 con 0x7f9d100cc300 2023-06-09T04:42:32.965 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.959+0000 7f9d0cff9700 1 -- 172.21.15.90:0/3547644986 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9d08022460 con 0x7f9d100cc300 2023-06-09T04:42:32.965 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.963+0000 7f9d0cff9700 1 --2- 172.21.15.90:0/3547644986 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f9cf00662f0 0x7f9cf00687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:32.965 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.963+0000 7f9d0cff9700 1 -- 172.21.15.90:0/3547644986 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9d080842f0 con 0x7f9d100cc300 2023-06-09T04:42:32.965 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.963+0000 7f9d0effd700 1 --2- 172.21.15.90:0/3547644986 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f9cf00662f0 0x7f9cf00687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:32.966 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.963+0000 7f9d0effd700 1 --2- 172.21.15.90:0/3547644986 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f9cf00662f0 0x7f9cf00687a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f9d00000c00 tx=0x7f9d00009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:32.968 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:32.967+0000 7f9d0cff9700 1 -- 172.21.15.90:0/3547644986 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9d08051770 con 0x7f9d100cc300 2023-06-09T04:42:33.156 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:33.155+0000 7f9d15946700 1 -- 172.21.15.90:0/3547644986 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f9d100c9720 con 0x7f9d100cc300 2023-06-09T04:42:33.156 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:33.155+0000 7f9d0cff9700 1 -- 172.21.15.90:0/3547644986 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) v1 ==== 80+0+0 (secure 0 0 0) 0x7f9d08054d90 con 0x7f9d100cc300 2023-06-09T04:42:33.159 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:33.159+0000 7f9d15946700 1 -- 172.21.15.90:0/3547644986 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f9cf00662f0 msgr2=0x7f9cf00687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:33.160 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:33.159+0000 7f9d15946700 1 --2- 172.21.15.90:0/3547644986 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f9cf00662f0 0x7f9cf00687a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f9d00000c00 tx=0x7f9d00009040 comp rx=0 tx=0).stop 2023-06-09T04:42:33.160 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:33.159+0000 7f9d15946700 1 -- 172.21.15.90:0/3547644986 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9d100cc300 msgr2=0x7f9d100cc770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:33.160 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:33.159+0000 7f9d15946700 1 --2- 172.21.15.90:0/3547644986 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9d100cc300 0x7f9d100cc770 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f9d100b42f0 tx=0x7f9d08011f80 comp rx=0 tx=0).stop 2023-06-09T04:42:33.161 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:33.159+0000 7f9d15946700 1 -- 172.21.15.90:0/3547644986 shutdown_connections 2023-06-09T04:42:33.161 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:33.159+0000 7f9d15946700 1 --2- 172.21.15.90:0/3547644986 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f9cf00662f0 0x7f9cf00687a0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:33.161 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:33.159+0000 7f9d15946700 1 --2- 172.21.15.90:0/3547644986 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9d100cc300 0x7f9d100cc770 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:33.161 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:33.159+0000 7f9d15946700 1 --2- 172.21.15.90:0/3547644986 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9d100adb20 0x7f9d100adf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:33.161 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:33.159+0000 7f9d15946700 1 --2- 172.21.15.90:0/3547644986 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9cfc004870 0x7f9d10153a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:33.161 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:33.159+0000 7f9d15946700 1 -- 172.21.15.90:0/3547644986 >> 172.21.15.90:0/3547644986 conn(0x7f9d1006c810 msgr2=0x7f9d1015b550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:33.161 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:33.159+0000 7f9d15946700 1 -- 172.21.15.90:0/3547644986 shutdown_connections 2023-06-09T04:42:33.161 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:33.159+0000 7f9d15946700 1 -- 172.21.15.90:0/3547644986 wait complete. 2023-06-09T04:42:33.162 INFO:teuthology.orchestra.run.smithi090.stderr:listed 0 entries 2023-06-09T04:42:33.180 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-06-09T04:42:33.180 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:42:33.181 DEBUG:teuthology.orchestra.run.smithi090:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-06-09T04:42:33.257 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi090.front.sepia.ceph.com 2023-06-09T04:42:33.257 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:42:33.257 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-06-09T04:42:33.286 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2023-06-09T04:42:33.286 DEBUG:teuthology.orchestra.run.smithi174:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-09T04:42:33.306 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2023-06-09T04:42:33.306 DEBUG:teuthology.orchestra.run.smithi174:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-09T04:42:33.370 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2023-06-09T04:42:33.371 DEBUG:teuthology.orchestra.run.smithi174:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-09T04:42:33.430 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T04:42:33.611 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:33.611+0000 7f2f39da7700 1 Processor -- start 2023-06-09T04:42:33.612 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:33.611+0000 7f2f39da7700 1 -- start start 2023-06-09T04:42:33.613 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:33.611+0000 7f2f39da7700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f2f3415e120 0x7f2f340c8b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:33.613 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:33.611+0000 7f2f39da7700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2f340ca7a0 0x7f2f340ad920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:33.614 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:33.611+0000 7f2f39da7700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f340cabc0 con 0x7f2f34154370 2023-06-09T04:42:33.614 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:33.611+0000 7f2f39da7700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f340cae10 con 0x7f2f3415e120 2023-06-09T04:42:33.614 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:33.611+0000 7f2f39da7700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f340cb0f0 con 0x7f2f340ca7a0 2023-06-09T04:42:33.615 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:33.611+0000 7f2f337fe700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f2f34154370 0x7f2f3415da10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:55004/0 (socket says 172.21.15.90:55004) 2023-06-09T04:42:33.615 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:33.611+0000 7f2f337fe700 1 -- 172.21.15.90:0/3112087595 learned_addr learned my addr 172.21.15.90:0/3112087595 (peer_addr_for_me v1:172.21.15.90:0/0) 2023-06-09T04:42:33.615 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:33.611+0000 7f2f32ffd700 1 --2- 172.21.15.90:0/3112087595 >> v2:172.21.15.174:3300/0 conn(0x7f2f3415e120 0x7f2f340c8b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:33.615 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:33.611+0000 7f2f33fff700 1 --2- 172.21.15.90:0/3112087595 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2f340ca7a0 0x7f2f340ad920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:33.615 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:33.611+0000 7f2f327fc700 1 -- 172.21.15.90:0/3112087595 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2252205966 0 0) 0x7f2f340cabc0 con 0x7f2f34154370 2023-06-09T04:42:33.615 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:33.611+0000 7f2f327fc700 1 -- 172.21.15.90:0/3112087595 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f1c0035d0 con 0x7f2f34154370 2023-06-09T04:42:33.617 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:33.615+0000 7f2f327fc700 1 -- 172.21.15.90:0/3112087595 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3301105862 0 0) 0x7f2f1c0035d0 con 0x7f2f34154370 2023-06-09T04:42:33.617 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:33.615+0000 7f2f327fc700 1 -- 172.21.15.90:0/3112087595 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2f340ca7a0 msgr2=0x7f2f340ad920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:33.617 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:33.615+0000 7f2f327fc700 1 --2- 172.21.15.90:0/3112087595 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2f340ca7a0 0x7f2f340ad920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:33.617 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:33.615+0000 7f2f327fc700 1 -- 172.21.15.90:0/3112087595 >> v2:172.21.15.174:3300/0 conn(0x7f2f3415e120 msgr2=0x7f2f340c8b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:33.617 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:33.615+0000 7f2f327fc700 1 --2- 172.21.15.90:0/3112087595 >> v2:172.21.15.174:3300/0 conn(0x7f2f3415e120 0x7f2f340c8b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:33.618 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:33.615+0000 7f2f327fc700 1 -- 172.21.15.90:0/3112087595 --> v1:172.21.15.90:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f340cb3d0 con 0x7f2f34154370 2023-06-09T04:42:33.618 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:33.615+0000 7f2f327fc700 1 -- 172.21.15.90:0/3112087595 <== mon.0 v1:172.21.15.90:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3604404106 0 0) 0x7f2f24001670 con 0x7f2f34154370 2023-06-09T04:42:33.618 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:33.615+0000 7f2f32ffd700 1 --2- 172.21.15.90:0/3112087595 >> v2:172.21.15.174:3300/0 conn(0x7f2f3415e120 0x7f2f340c8b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:42:33.618 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:33.615+0000 7f2f327fc700 1 -- 172.21.15.90:0/3112087595 >> v1:172.21.15.90:6789/0 conn(0x7f2f34154370 legacy=0x7f2f3415da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:33.618 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:33.615+0000 7f2f327fc700 1 --2- 172.21.15.90:0/3112087595 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2f340ca7a0 0x7f2f1c003a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:33.618 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:33.615+0000 7f2f327fc700 1 --2- 172.21.15.90:0/3112087595 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2f1c003ff0 0x7f2f1c004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:33.618 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:33.615+0000 7f2f327fc700 1 --2- 172.21.15.90:0/3112087595 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2f1c004db0 0x7f2f1c005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:33.619 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:33.615+0000 7f2f327fc700 1 -- 172.21.15.90:0/3112087595 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f340cae10 con 0x7f2f1c003ff0 2023-06-09T04:42:33.619 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:33.615+0000 7f2f327fc700 1 -- 172.21.15.90:0/3112087595 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f340cb0f0 con 0x7f2f1c004db0 2023-06-09T04:42:33.619 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:33.615+0000 7f2f327fc700 1 -- 172.21.15.90:0/3112087595 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f1c00ba30 con 0x7f2f340ca7a0 2023-06-09T04:42:33.619 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:33.615+0000 7f2f32ffd700 1 --2- 172.21.15.90:0/3112087595 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2f1c003ff0 0x7f2f1c004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:33.619 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:33.615+0000 7f2f337fe700 1 --2- 172.21.15.90:0/3112087595 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2f340ca7a0 0x7f2f1c003a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:33.619 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:33.615+0000 7f2f33fff700 1 --2- 172.21.15.90:0/3112087595 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2f1c004db0 0x7f2f1c005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:33.619 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:33.615+0000 7f2f32ffd700 1 -- 172.21.15.90:0/3112087595 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2f340ca7a0 msgr2=0x7f2f1c003a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:33.619 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:33.615+0000 7f2f32ffd700 1 --2- 172.21.15.90:0/3112087595 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2f340ca7a0 0x7f2f1c003a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:33.620 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:33.615+0000 7f2f32ffd700 1 -- 172.21.15.90:0/3112087595 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2f1c004db0 msgr2=0x7f2f1c005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:33.620 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:33.615+0000 7f2f32ffd700 1 --2- 172.21.15.90:0/3112087595 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2f1c004db0 0x7f2f1c005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:33.620 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:33.615+0000 7f2f32ffd700 1 -- 172.21.15.90:0/3112087595 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f1c0035d0 con 0x7f2f1c003ff0 2023-06-09T04:42:33.620 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:33.615+0000 7f2f32ffd700 1 --2- 172.21.15.90:0/3112087595 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2f1c003ff0 0x7f2f1c004870 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f2f280098d0 tx=0x7f2f1c0058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abbe04a4e150840d server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:33.621 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:33.615+0000 7f2f327fc700 1 -- 172.21.15.90:0/3112087595 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f28009e60 con 0x7f2f1c003ff0 2023-06-09T04:42:33.621 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:33.615+0000 7f2f327fc700 1 -- 172.21.15.90:0/3112087595 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f2800e9a0 con 0x7f2f1c003ff0 2023-06-09T04:42:33.621 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:33.615+0000 7f2f327fc700 1 -- 172.21.15.90:0/3112087595 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f2800ed10 con 0x7f2f1c003ff0 2023-06-09T04:42:33.621 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:33.615+0000 7f2f39da7700 1 -- 172.21.15.90:0/3112087595 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2f1c003ff0 msgr2=0x7f2f1c004870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:33.621 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:33.615+0000 7f2f39da7700 1 --2- 172.21.15.90:0/3112087595 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2f1c003ff0 0x7f2f1c004870 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f2f280098d0 tx=0x7f2f1c0058a0 comp rx=0 tx=0).stop 2023-06-09T04:42:33.622 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:33.615+0000 7f2f33fff700 1 -- 172.21.15.90:0/3112087595 reap_dead start 2023-06-09T04:42:33.622 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:33.615+0000 7f2f39da7700 1 -- 172.21.15.90:0/3112087595 shutdown_connections 2023-06-09T04:42:33.622 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:33.615+0000 7f2f39da7700 1 -- 172.21.15.90:0/3112087595 >> 172.21.15.90:0/3112087595 conn(0x7f2f3406c810 msgr2=0x7f2f340b0000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:33.622 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:33.615+0000 7f2f39da7700 1 -- 172.21.15.90:0/3112087595 shutdown_connections 2023-06-09T04:42:33.622 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:33.615+0000 7f2f39da7700 1 -- 172.21.15.90:0/3112087595 wait complete. 2023-06-09T04:42:33.623 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:33.619+0000 7f2f39da7700 1 Processor -- start 2023-06-09T04:42:33.623 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:33.619+0000 7f2f39da7700 1 -- start start 2023-06-09T04:42:33.623 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:33.623+0000 7f2f39da7700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2f1c003ff0 0x7f2f341edcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:33.623 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:33.623+0000 7f2f39da7700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2f34158840 0x7f2f34158cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:33.624 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:33.623+0000 7f2f39da7700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2f340add00 0x7f2f340ae170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:33.624 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:33.623+0000 7f2f39da7700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f341591f0 con 0x7f2f1c003ff0 2023-06-09T04:42:33.624 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:33.623+0000 7f2f39da7700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f340aeb70 con 0x7f2f34158840 2023-06-09T04:42:33.624 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:33.623+0000 7f2f39da7700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f340aee50 con 0x7f2f340add00 2023-06-09T04:42:33.625 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:33.623+0000 7f2f337fe700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2f1c003ff0 0x7f2f341edcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:33.625 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:33.623+0000 7f2f337fe700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2f1c003ff0 0x7f2f341edcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:53108/0 (socket says 172.21.15.90:53108) 2023-06-09T04:42:33.626 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:33.623+0000 7f2f337fe700 1 -- 172.21.15.90:0/3403893108 learned_addr learned my addr 172.21.15.90:0/3403893108 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:33.626 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:33.623+0000 7f2f33fff700 1 --2- 172.21.15.90:0/3403893108 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2f340add00 0x7f2f340ae170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:33.626 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:33.623+0000 7f2f32ffd700 1 --2- 172.21.15.90:0/3403893108 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2f34158840 0x7f2f34158cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:33.626 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:33.623+0000 7f2f337fe700 1 -- 172.21.15.90:0/3403893108 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2f340add00 msgr2=0x7f2f340ae170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:33.626 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:33.623+0000 7f2f337fe700 1 --2- 172.21.15.90:0/3403893108 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2f340add00 0x7f2f340ae170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:33.626 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:33.623+0000 7f2f337fe700 1 -- 172.21.15.90:0/3403893108 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2f34158840 msgr2=0x7f2f34158cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:33.626 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:33.623+0000 7f2f337fe700 1 --2- 172.21.15.90:0/3403893108 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2f34158840 0x7f2f34158cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:33.626 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:33.623+0000 7f2f337fe700 1 -- 172.21.15.90:0/3403893108 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f341548c0 con 0x7f2f1c003ff0 2023-06-09T04:42:33.627 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:33.623+0000 7f2f337fe700 1 --2- 172.21.15.90:0/3403893108 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2f1c003ff0 0x7f2f341edcc0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f2f24007340 tx=0x7f2f24007650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:33.627 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:33.623+0000 7f2f1bfff700 1 -- 172.21.15.90:0/3403893108 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f2400f6c0 con 0x7f2f1c003ff0 2023-06-09T04:42:33.627 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:33.623+0000 7f2f1bfff700 1 -- 172.21.15.90:0/3403893108 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f2400f840 con 0x7f2f1c003ff0 2023-06-09T04:42:33.627 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:33.623+0000 7f2f39da7700 1 -- 172.21.15.90:0/3403893108 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f340af130 con 0x7f2f1c003ff0 2023-06-09T04:42:33.628 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:33.623+0000 7f2f1bfff700 1 -- 172.21.15.90:0/3403893108 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f2400fbf0 con 0x7f2f1c003ff0 2023-06-09T04:42:33.629 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:33.623+0000 7f2f39da7700 1 -- 172.21.15.90:0/3403893108 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f340af6f0 con 0x7f2f1c003ff0 2023-06-09T04:42:33.629 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:33.627+0000 7f2f39da7700 1 -- 172.21.15.90:0/3403893108 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f3404db30 con 0x7f2f1c003ff0 2023-06-09T04:42:33.629 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:33.627+0000 7f2f1bfff700 1 -- 172.21.15.90:0/3403893108 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2f2400fd50 con 0x7f2f1c003ff0 2023-06-09T04:42:33.630 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:33.627+0000 7f2f1bfff700 1 --2- 172.21.15.90:0/3403893108 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f2f200662f0 0x7f2f200687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:33.630 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:33.627+0000 7f2f1bfff700 1 -- 172.21.15.90:0/3403893108 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2f24083ea0 con 0x7f2f1c003ff0 2023-06-09T04:42:33.631 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:33.631+0000 7f2f32ffd700 1 --2- 172.21.15.90:0/3403893108 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f2f200662f0 0x7f2f200687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:33.632 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:33.631+0000 7f2f32ffd700 1 --2- 172.21.15.90:0/3403893108 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f2f200662f0 0x7f2f200687a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f2f2801e040 tx=0x7f2f28017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:33.634 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:33.631+0000 7f2f1bfff700 1 -- 172.21.15.90:0/3403893108 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2f24051200 con 0x7f2f1c003ff0 2023-06-09T04:42:33.805 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:33.803+0000 7f2f39da7700 1 -- 172.21.15.90:0/3403893108 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2f3406fe80 con 0x7f2f1c003ff0 2023-06-09T04:42:33.808 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:33.807+0000 7f2f1bfff700 1 -- 172.21.15.90:0/3403893108 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18279 (secure 0 0 0) 0x7f2f24054820 con 0x7f2f1c003ff0 2023-06-09T04:42:33.809 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:42:33.809 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":24,"fsid":"700369c0-a111-43b4-9415-844ad1742b70","created":"2023-06-09T04:41:28.180311+0000","modified":"2023-06-09T04:41:55.389425+0000","last_up_change":"2023-06-09T04:41:40.746475+0000","last_in_change":"2023-06-09T04:41:31.262765+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-09T04:41:42.402564+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-09T04:41:47.607323+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-09T04:41:52.543474+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-09T04:41:53.382940+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"46a4a7c5-babd-4ef3-9830-51487cff5eb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":2780271267},{"type":"v1","addr":"172.21.15.90:6809","nonce":2780271267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2780271267},{"type":"v1","addr":"172.21.15.90:6811","nonce":2780271267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2780271267},{"type":"v1","addr":"172.21.15.90:6815","nonce":2780271267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2780271267},{"type":"v1","addr":"172.21.15.90:6813","nonce":2780271267}]},"public_addr":"172.21.15.90:6809/2780271267","cluster_addr":"172.21.15.90:6811/2780271267","heartbeat_back_addr":"172.21.15.90:6815/2780271267","heartbeat_front_addr":"172.21.15.90:6813/2780271267","state":["exists","up"]},{"osd":1,"uuid":"1543988f-c498-494a-a6f9-fac8413db6ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":3064028136},{"type":"v1","addr":"172.21.15.90:6801","nonce":3064028136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":3064028136},{"type":"v1","addr":"172.21.15.90:6803","nonce":3064028136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":3064028136},{"type":"v1","addr":"172.21.15.90:6807","nonce":3064028136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":3064028136},{"type":"v1","addr":"172.21.15.90:6805","nonce":3064028136}]},"public_addr":"172.21.15.90:6801/3064028136","cluster_addr":"172.21.15.90:6803/3064028136","heartbeat_back_addr":"172.21.15.90:6807/3064028136","heartbeat_front_addr":"172.21.15.90:6805/3064028136","state":["exists","up"]},{"osd":2,"uuid":"79669dd6-ffc8-4197-b9f7-b3b372b2b9b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":3713146326},{"type":"v1","addr":"172.21.15.90:6825","nonce":3713146326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":3713146326},{"type":"v1","addr":"172.21.15.90:6827","nonce":3713146326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":3713146326},{"type":"v1","addr":"172.21.15.90:6831","nonce":3713146326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":3713146326},{"type":"v1","addr":"172.21.15.90:6829","nonce":3713146326}]},"public_addr":"172.21.15.90:6825/3713146326","cluster_addr":"172.21.15.90:6827/3713146326","heartbeat_back_addr":"172.21.15.90:6831/3713146326","heartbeat_front_addr":"172.21.15.90:6829/3713146326","state":["exists","up"]},{"osd":3,"uuid":"4062ab6f-ce40-450a-aa17-b10098766c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":3499839122},{"type":"v1","addr":"172.21.15.90:6817","nonce":3499839122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":3499839122},{"type":"v1","addr":"172.21.15.90:6819","nonce":3499839122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":3499839122},{"type":"v1","addr":"172.21.15.90:6823","nonce":3499839122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":3499839122},{"type":"v1","addr":"172.21.15.90:6821","nonce":3499839122}]},"public_addr":"172.21.15.90:6817/3499839122","cluster_addr":"172.21.15.90:6819/3499839122","heartbeat_back_addr":"172.21.15.90:6823/3499839122","heartbeat_front_addr":"172.21.15.90:6821/3499839122","state":["exists","up"]},{"osd":4,"uuid":"a10820e4-b348-4d92-9796-3b01484ace1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6817","nonce":1138565854},{"type":"v1","addr":"172.21.15.174:6819","nonce":1138565854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6821","nonce":1138565854},{"type":"v1","addr":"172.21.15.174:6823","nonce":1138565854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":1138565854},{"type":"v1","addr":"172.21.15.174:6831","nonce":1138565854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":1138565854},{"type":"v1","addr":"172.21.15.174:6829","nonce":1138565854}]},"public_addr":"172.21.15.174:6819/1138565854","cluster_addr":"172.21.15.174:6823/1138565854","heartbeat_back_addr":"172.21.15.174:6831/1138565854","heartbeat_front_addr":"172.21.15.174:6829/1138565854","state":["exists","up"]},{"osd":5,"uuid":"b4da1c32-be05-420b-9346-90d91aa70569","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":1707702879},{"type":"v1","addr":"172.21.15.174:6818","nonce":1707702879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":1707702879},{"type":"v1","addr":"172.21.15.174:6822","nonce":1707702879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6827","nonce":1707702879},{"type":"v1","addr":"172.21.15.174:6828","nonce":1707702879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":1707702879},{"type":"v1","addr":"172.21.15.174:6825","nonce":1707702879}]},"public_addr":"172.21.15.174:6818/1707702879","cluster_addr":"172.21.15.174:6822/1707702879","heartbeat_back_addr":"172.21.15.174:6828/1707702879","heartbeat_front_addr":"172.21.15.174:6825/1707702879","state":["exists","up"]},{"osd":6,"uuid":"d1b98041-d243-4355-bd0a-e22cf9875b32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":864450534},{"type":"v1","addr":"172.21.15.174:6801","nonce":864450534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":864450534},{"type":"v1","addr":"172.21.15.174:6803","nonce":864450534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":864450534},{"type":"v1","addr":"172.21.15.174:6807","nonce":864450534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":864450534},{"type":"v1","addr":"172.21.15.174:6805","nonce":864450534}]},"public_addr":"172.21.15.174:6801/864450534","cluster_addr":"172.21.15.174:6803/864450534","heartbeat_back_addr":"172.21.15.174:6807/864450534","heartbeat_front_addr":"172.21.15.174:6805/864450534","state":["exists","up"]},{"osd":7,"uuid":"5a207936-f89f-416b-b79b-34ec96f77c8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":2527640659},{"type":"v1","addr":"172.21.15.174:6809","nonce":2527640659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":2527640659},{"type":"v1","addr":"172.21.15.174:6811","nonce":2527640659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":2527640659},{"type":"v1","addr":"172.21.15.174:6815","nonce":2527640659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":2527640659},{"type":"v1","addr":"172.21.15.174:6813","nonce":2527640659}]},"public_addr":"172.21.15.174:6809/2527640659","cluster_addr":"172.21.15.174:6811/2527640659","heartbeat_back_addr":"172.21.15.174:6815/2527640659","heartbeat_front_addr":"172.21.15.174:6813/2527640659","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:36.972152+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:36.984561+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:36.998817+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:37.054944+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:37.085014+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:37.115125+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:36.854608+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:36.971685+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:42:33.810 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:33.807+0000 7f2f39da7700 1 -- 172.21.15.90:0/3403893108 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f2f200662f0 msgr2=0x7f2f200687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:33.811 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:33.807+0000 7f2f39da7700 1 --2- 172.21.15.90:0/3403893108 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f2f200662f0 0x7f2f200687a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f2f2801e040 tx=0x7f2f28017000 comp rx=0 tx=0).stop 2023-06-09T04:42:33.811 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:33.807+0000 7f2f39da7700 1 -- 172.21.15.90:0/3403893108 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2f1c003ff0 msgr2=0x7f2f341edcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:33.811 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:33.807+0000 7f2f39da7700 1 --2- 172.21.15.90:0/3403893108 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2f1c003ff0 0x7f2f341edcc0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f2f24007340 tx=0x7f2f24007650 comp rx=0 tx=0).stop 2023-06-09T04:42:33.811 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:33.807+0000 7f2f39da7700 1 -- 172.21.15.90:0/3403893108 shutdown_connections 2023-06-09T04:42:33.811 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:33.807+0000 7f2f39da7700 1 --2- 172.21.15.90:0/3403893108 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f2f200662f0 0x7f2f200687a0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:33.811 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:33.807+0000 7f2f39da7700 1 --2- 172.21.15.90:0/3403893108 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2f340add00 0x7f2f340ae170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:33.811 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:33.807+0000 7f2f39da7700 1 --2- 172.21.15.90:0/3403893108 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2f34158840 0x7f2f34158cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:33.812 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:33.807+0000 7f2f39da7700 1 --2- 172.21.15.90:0/3403893108 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2f1c003ff0 0x7f2f341edcc0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:33.812 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:33.807+0000 7f2f39da7700 1 -- 172.21.15.90:0/3403893108 >> 172.21.15.90:0/3403893108 conn(0x7f2f3406c810 msgr2=0x7f2f340affe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:33.812 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:33.811+0000 7f2f39da7700 1 -- 172.21.15.90:0/3403893108 shutdown_connections 2023-06-09T04:42:33.813 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:33.811+0000 7f2f39da7700 1 -- 172.21.15.90:0/3403893108 wait complete. 2023-06-09T04:42:33.834 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-09T04:41:42.402564+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-09T04:41:47.607323+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-09T04:41:52.543474+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-09T04:41:53.382940+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-09T04:42:33.834 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-09T04:42:34.015 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.011+0000 7fbf7a7c1700 1 Processor -- start 2023-06-09T04:42:34.015 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.011+0000 7fbf7a7c1700 1 -- start start 2023-06-09T04:42:34.016 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.015+0000 7fbf7a7c1700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fbf74159ed0 0x7fbf740718d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:34.017 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.015+0000 7fbf7a7c1700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fbf7406a230 0x7fbf740cc080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:34.017 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.015+0000 7fbf7a7c1700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf740ccf60 con 0x7fbf740cc5c0 2023-06-09T04:42:34.017 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.015+0000 7fbf7a7c1700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf740cca40 con 0x7fbf74159ed0 2023-06-09T04:42:34.017 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.015+0000 7fbf7a7c1700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf740c91a0 con 0x7fbf7406a230 2023-06-09T04:42:34.018 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.015+0000 7fbf73fff700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fbf74159ed0 0x7fbf740718d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:34.018 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.015+0000 7fbf73fff700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fbf74159ed0 0x7fbf740718d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:53114/0 (socket says 172.21.15.90:53114) 2023-06-09T04:42:34.018 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.015+0000 7fbf73fff700 1 -- 172.21.15.90:0/373423522 learned_addr learned my addr 172.21.15.90:0/373423522 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:34.018 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.015+0000 7fbf6b7fe700 1 --2- 172.21.15.90:0/373423522 >> v2:172.21.15.174:3300/0 conn(0x7fbf7406a230 0x7fbf740cc080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:34.018 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.015+0000 7fbf73fff700 1 -- 172.21.15.90:0/373423522 >> v2:172.21.15.174:3300/0 conn(0x7fbf7406a230 msgr2=0x7fbf740cc080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:34.019 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.015+0000 7fbf73fff700 1 --2- 172.21.15.90:0/373423522 >> v2:172.21.15.174:3300/0 conn(0x7fbf7406a230 0x7fbf740cc080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:34.019 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.015+0000 7fbf73fff700 1 -- 172.21.15.90:0/373423522 >> v1:172.21.15.90:6789/0 conn(0x7fbf740cc5c0 legacy=0x7fbf7415da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:34.019 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.015+0000 7fbf73fff700 1 -- 172.21.15.90:0/373423522 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf74071e10 con 0x7fbf74159ed0 2023-06-09T04:42:34.019 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.015+0000 7fbf73fff700 1 --2- 172.21.15.90:0/373423522 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbf74159ed0 0x7fbf740718d0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fbf74066b40 tx=0x7fbf64009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e4b8a3889929736 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:34.020 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.019+0000 7fbf737fe700 1 -- 172.21.15.90:0/373423522 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf64011830 con 0x7fbf74159ed0 2023-06-09T04:42:34.020 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.019+0000 7fbf737fe700 1 -- 172.21.15.90:0/373423522 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf64011990 con 0x7fbf74159ed0 2023-06-09T04:42:34.020 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.019+0000 7fbf737fe700 1 -- 172.21.15.90:0/373423522 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf64011d20 con 0x7fbf74159ed0 2023-06-09T04:42:34.020 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.019+0000 7fbf7a7c1700 1 -- 172.21.15.90:0/373423522 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbf74159ed0 msgr2=0x7fbf740718d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:34.020 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.019+0000 7fbf7a7c1700 1 --2- 172.21.15.90:0/373423522 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbf74159ed0 0x7fbf740718d0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fbf74066b40 tx=0x7fbf64009bf0 comp rx=0 tx=0).stop 2023-06-09T04:42:34.021 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.019+0000 7fbf7a7c1700 1 -- 172.21.15.90:0/373423522 shutdown_connections 2023-06-09T04:42:34.021 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.019+0000 7fbf7a7c1700 1 --2- 172.21.15.90:0/373423522 >> v2:172.21.15.174:3300/0 conn(0x7fbf7406a230 0x7fbf740cc080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:34.021 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.019+0000 7fbf7a7c1700 1 --2- 172.21.15.90:0/373423522 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbf74159ed0 0x7fbf740718d0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:34.021 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.019+0000 7fbf7a7c1700 1 -- 172.21.15.90:0/373423522 >> 172.21.15.90:0/373423522 conn(0x7fbf740b00e0 msgr2=0x7fbf740b04b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:34.022 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.019+0000 7fbf7a7c1700 1 -- 172.21.15.90:0/373423522 shutdown_connections 2023-06-09T04:42:34.022 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.019+0000 7fbf7a7c1700 1 -- 172.21.15.90:0/373423522 wait complete. 2023-06-09T04:42:34.022 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.019+0000 7fbf7a7c1700 1 Processor -- start 2023-06-09T04:42:34.023 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.019+0000 7fbf7a7c1700 1 -- start start 2023-06-09T04:42:34.025 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.023+0000 7fbf7a7c1700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbf7406a230 0x7fbf740acbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:34.025 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.023+0000 7fbf7a7c1700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbf740cc5c0 0x7fbf740b3d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:34.025 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.023+0000 7fbf7a7c1700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbf74159ed0 0x7fbf740b1650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:34.025 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.023+0000 7fbf7a7c1700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf740ab890 con 0x7fbf7406a230 2023-06-09T04:42:34.025 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.023+0000 7fbf7a7c1700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf740abb30 con 0x7fbf740cc5c0 2023-06-09T04:42:34.025 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.023+0000 7fbf7a7c1700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf740abe10 con 0x7fbf74159ed0 2023-06-09T04:42:34.026 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.023+0000 7fbf73fff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbf7406a230 0x7fbf740acbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:34.026 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.023+0000 7fbf73fff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbf7406a230 0x7fbf740acbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:53118/0 (socket says 172.21.15.90:53118) 2023-06-09T04:42:34.026 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.023+0000 7fbf73fff700 1 -- 172.21.15.90:0/262813657 learned_addr learned my addr 172.21.15.90:0/262813657 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:34.026 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.023+0000 7fbf78d5e700 1 --2- 172.21.15.90:0/262813657 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbf74159ed0 0x7fbf740b1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:34.026 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.023+0000 7fbf6b7fe700 1 --2- 172.21.15.90:0/262813657 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbf740cc5c0 0x7fbf740b3d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:34.027 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.023+0000 7fbf73fff700 1 -- 172.21.15.90:0/262813657 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbf74159ed0 msgr2=0x7fbf740b1650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:34.027 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.023+0000 7fbf73fff700 1 --2- 172.21.15.90:0/262813657 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbf74159ed0 0x7fbf740b1650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:34.027 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.023+0000 7fbf73fff700 1 -- 172.21.15.90:0/262813657 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbf740cc5c0 msgr2=0x7fbf740b3d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:34.027 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.023+0000 7fbf73fff700 1 --2- 172.21.15.90:0/262813657 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbf740cc5c0 0x7fbf740b3d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:34.028 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.023+0000 7fbf73fff700 1 -- 172.21.15.90:0/262813657 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf64009570 con 0x7fbf7406a230 2023-06-09T04:42:34.028 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.023+0000 7fbf6b7fe700 1 --2- 172.21.15.90:0/262813657 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbf740cc5c0 0x7fbf740b3d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:42:34.028 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.023+0000 7fbf78d5e700 1 --2- 172.21.15.90:0/262813657 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbf74159ed0 0x7fbf740b1650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:42:34.028 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.023+0000 7fbf73fff700 1 --2- 172.21.15.90:0/262813657 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbf7406a230 0x7fbf740acbd0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fbf7406d060 tx=0x7fbf64004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:34.028 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.023+0000 7fbf717fa700 1 -- 172.21.15.90:0/262813657 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf64004550 con 0x7fbf7406a230 2023-06-09T04:42:34.028 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.023+0000 7fbf717fa700 1 -- 172.21.15.90:0/262813657 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf6401f070 con 0x7fbf7406a230 2023-06-09T04:42:34.028 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.023+0000 7fbf7a7c1700 1 -- 172.21.15.90:0/262813657 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf740ac0f0 con 0x7fbf7406a230 2023-06-09T04:42:34.029 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.023+0000 7fbf717fa700 1 -- 172.21.15.90:0/262813657 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf64003900 con 0x7fbf7406a230 2023-06-09T04:42:34.029 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.023+0000 7fbf7a7c1700 1 -- 172.21.15.90:0/262813657 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf740ac6b0 con 0x7fbf7406a230 2023-06-09T04:42:34.029 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.027+0000 7fbf7a7c1700 1 -- 172.21.15.90:0/262813657 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf7404db30 con 0x7fbf7406a230 2023-06-09T04:42:34.029 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.027+0000 7fbf717fa700 1 -- 172.21.15.90:0/262813657 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fbf64003a60 con 0x7fbf7406a230 2023-06-09T04:42:34.030 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.027+0000 7fbf717fa700 1 --2- 172.21.15.90:0/262813657 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fbf54066320 0x7fbf540687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:34.031 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.027+0000 7fbf717fa700 1 -- 172.21.15.90:0/262813657 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbf64021070 con 0x7fbf7406a230 2023-06-09T04:42:34.031 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.031+0000 7fbf6b7fe700 1 --2- 172.21.15.90:0/262813657 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fbf54066320 0x7fbf540687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:34.032 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.031+0000 7fbf6b7fe700 1 --2- 172.21.15.90:0/262813657 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fbf54066320 0x7fbf540687d0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fbf7406a660 tx=0x7fbf5c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:34.037 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.035+0000 7fbf717fa700 1 -- 172.21.15.90:0/262813657 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fbf64052670 con 0x7fbf7406a230 2023-06-09T04:42:34.207 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.203+0000 7fbf7a7c1700 1 -- 172.21.15.90:0/262813657 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbf740add10 con 0x7fbf7406a230 2023-06-09T04:42:34.207 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.207+0000 7fbf717fa700 1 -- 172.21.15.90:0/262813657 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbf64055c90 con 0x7fbf7406a230 2023-06-09T04:42:34.208 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 1 2023-06-09T04:42:34.211 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.211+0000 7fbf7a7c1700 1 -- 172.21.15.90:0/262813657 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fbf54066320 msgr2=0x7fbf540687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:34.211 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.211+0000 7fbf7a7c1700 1 --2- 172.21.15.90:0/262813657 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fbf54066320 0x7fbf540687d0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fbf7406a660 tx=0x7fbf5c008040 comp rx=0 tx=0).stop 2023-06-09T04:42:34.212 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.211+0000 7fbf7a7c1700 1 -- 172.21.15.90:0/262813657 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbf7406a230 msgr2=0x7fbf740acbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:34.212 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.211+0000 7fbf7a7c1700 1 --2- 172.21.15.90:0/262813657 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbf7406a230 0x7fbf740acbd0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fbf7406d060 tx=0x7fbf64004770 comp rx=0 tx=0).stop 2023-06-09T04:42:34.213 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.211+0000 7fbf7a7c1700 1 -- 172.21.15.90:0/262813657 shutdown_connections 2023-06-09T04:42:34.213 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.211+0000 7fbf7a7c1700 1 --2- 172.21.15.90:0/262813657 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fbf54066320 0x7fbf540687d0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:34.213 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.211+0000 7fbf7a7c1700 1 --2- 172.21.15.90:0/262813657 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbf74159ed0 0x7fbf740b1650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:34.213 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.211+0000 7fbf7a7c1700 1 --2- 172.21.15.90:0/262813657 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbf740cc5c0 0x7fbf740b3d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:34.213 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.211+0000 7fbf7a7c1700 1 --2- 172.21.15.90:0/262813657 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbf7406a230 0x7fbf740acbd0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:34.213 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.211+0000 7fbf7a7c1700 1 -- 172.21.15.90:0/262813657 >> 172.21.15.90:0/262813657 conn(0x7fbf740b00e0 msgr2=0x7fbf740ceae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:34.213 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.211+0000 7fbf7a7c1700 1 -- 172.21.15.90:0/262813657 shutdown_connections 2023-06-09T04:42:34.214 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.211+0000 7fbf7a7c1700 1 -- 172.21.15.90:0/262813657 wait complete. 2023-06-09T04:42:34.232 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-09T04:42:34.408 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.407+0000 7f0c7d901700 1 Processor -- start 2023-06-09T04:42:34.408 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.407+0000 7f0c7d901700 1 -- start start 2023-06-09T04:42:34.410 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.407+0000 7f0c7d901700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0c78089fb0 0x7f0c780cde60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:34.410 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.407+0000 7f0c7d901700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c780cd4b0 con 0x7f0c78159f80 2023-06-09T04:42:34.411 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.407+0000 7f0c7d901700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c780b5330 con 0x7f0c780b35e0 2023-06-09T04:42:34.411 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.407+0000 7f0c76ffd700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f0c78159f80 0x7f0c780b2ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:55022/0 (socket says 172.21.15.90:55022) 2023-06-09T04:42:34.411 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.407+0000 7f0c76ffd700 1 -- 172.21.15.90:0/3546194036 learned_addr learned my addr 172.21.15.90:0/3546194036 (peer_addr_for_me v1:172.21.15.90:0/0) 2023-06-09T04:42:34.411 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.407+0000 7f0c7d901700 1 -- 172.21.15.90:0/3546194036 --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c780b5610 con 0x7f0c78089fb0 2023-06-09T04:42:34.411 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.407+0000 7f0c767fc700 1 --2- 172.21.15.90:0/3546194036 >> v2:172.21.15.90:3300/0 conn(0x7f0c78089fb0 0x7f0c780cde60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:34.412 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.411+0000 7f0c75ffb700 1 -- 172.21.15.90:0/3546194036 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 171395097 0 0) 0x7f0c780cd4b0 con 0x7f0c78159f80 2023-06-09T04:42:34.412 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.411+0000 7f0c75ffb700 1 -- 172.21.15.90:0/3546194036 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c600035d0 con 0x7f0c78159f80 2023-06-09T04:42:34.412 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.411+0000 7f0c767fc700 1 -- 172.21.15.90:0/3546194036 >> v1:172.21.15.174:6789/0 conn(0x7f0c780b35e0 legacy=0x7f0c780ce3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:34.412 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.411+0000 7f0c767fc700 1 -- 172.21.15.90:0/3546194036 >> v1:172.21.15.90:6789/0 conn(0x7f0c78159f80 legacy=0x7f0c780b2ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:34.413 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.411+0000 7f0c767fc700 1 -- 172.21.15.90:0/3546194036 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c780b58f0 con 0x7f0c78089fb0 2023-06-09T04:42:34.413 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.411+0000 7f0c767fc700 1 --2- 172.21.15.90:0/3546194036 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0c78089fb0 0x7f0c780cde60 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f0c6c009850 tx=0x7f0c6c009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ec010174bc1608c server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:34.413 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.411+0000 7f0c75ffb700 1 -- 172.21.15.90:0/3546194036 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c6c011830 con 0x7f0c78089fb0 2023-06-09T04:42:34.414 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.411+0000 7f0c75ffb700 1 -- 172.21.15.90:0/3546194036 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c6c011990 con 0x7f0c78089fb0 2023-06-09T04:42:34.414 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.411+0000 7f0c75ffb700 1 -- 172.21.15.90:0/3546194036 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c6c011d40 con 0x7f0c78089fb0 2023-06-09T04:42:34.414 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.411+0000 7f0c7d901700 1 -- 172.21.15.90:0/3546194036 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0c78089fb0 msgr2=0x7f0c780cde60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:34.414 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.411+0000 7f0c7d901700 1 --2- 172.21.15.90:0/3546194036 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0c78089fb0 0x7f0c780cde60 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f0c6c009850 tx=0x7f0c6c009b60 comp rx=0 tx=0).stop 2023-06-09T04:42:34.414 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.411+0000 7f0c7d901700 1 -- 172.21.15.90:0/3546194036 shutdown_connections 2023-06-09T04:42:34.414 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.411+0000 7f0c7d901700 1 --2- 172.21.15.90:0/3546194036 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0c78089fb0 0x7f0c780cde60 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:34.415 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.411+0000 7f0c7d901700 1 -- 172.21.15.90:0/3546194036 >> 172.21.15.90:0/3546194036 conn(0x7f0c780cc7f0 msgr2=0x7f0c780ccbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:34.415 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.411+0000 7f0c7d901700 1 -- 172.21.15.90:0/3546194036 shutdown_connections 2023-06-09T04:42:34.415 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.411+0000 7f0c7d901700 1 -- 172.21.15.90:0/3546194036 wait complete. 2023-06-09T04:42:34.417 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.415+0000 7f0c7d901700 1 Processor -- start 2023-06-09T04:42:34.417 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.415+0000 7f0c7d901700 1 -- start start 2023-06-09T04:42:34.420 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.419+0000 7f0c7d901700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0c78089fb0 0x7f0c7814e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:34.420 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.419+0000 7f0c7d901700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0c780b35e0 0x7f0c780af680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:34.420 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.419+0000 7f0c7d901700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0c78159f80 0x7f0c780b1bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:34.420 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.419+0000 7f0c7d901700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c780b0800 con 0x7f0c78089fb0 2023-06-09T04:42:34.421 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.419+0000 7f0c7d901700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c7815ccc0 con 0x7f0c78159f80 2023-06-09T04:42:34.421 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.419+0000 7f0c7d901700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c780afff0 con 0x7f0c780b35e0 2023-06-09T04:42:34.421 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.419+0000 7f0c76ffd700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0c78089fb0 0x7f0c7814e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:34.421 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.419+0000 7f0c76ffd700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0c78089fb0 0x7f0c7814e070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:53140/0 (socket says 172.21.15.90:53140) 2023-06-09T04:42:34.421 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.419+0000 7f0c76ffd700 1 -- 172.21.15.90:0/4018090715 learned_addr learned my addr 172.21.15.90:0/4018090715 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:34.422 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.419+0000 7f0c77fff700 1 --2- 172.21.15.90:0/4018090715 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0c78159f80 0x7f0c780b1bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:34.423 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.419+0000 7f0c767fc700 1 --2- 172.21.15.90:0/4018090715 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0c780b35e0 0x7f0c780af680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:34.423 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.419+0000 7f0c76ffd700 1 -- 172.21.15.90:0/4018090715 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0c780b35e0 msgr2=0x7f0c780af680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:34.423 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.419+0000 7f0c76ffd700 1 --2- 172.21.15.90:0/4018090715 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0c780b35e0 0x7f0c780af680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:34.423 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.419+0000 7f0c76ffd700 1 -- 172.21.15.90:0/4018090715 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0c78159f80 msgr2=0x7f0c780b1bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:34.423 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.419+0000 7f0c76ffd700 1 --2- 172.21.15.90:0/4018090715 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0c78159f80 0x7f0c780b1bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:34.423 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.419+0000 7f0c76ffd700 1 -- 172.21.15.90:0/4018090715 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c6c0094b0 con 0x7f0c78089fb0 2023-06-09T04:42:34.423 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.419+0000 7f0c77fff700 1 --2- 172.21.15.90:0/4018090715 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0c78159f80 0x7f0c780b1bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:42:34.424 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.419+0000 7f0c767fc700 1 --2- 172.21.15.90:0/4018090715 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0c780b35e0 0x7f0c780af680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:42:34.424 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.419+0000 7f0c76ffd700 1 --2- 172.21.15.90:0/4018090715 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0c78089fb0 0x7f0c7814e070 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f0c6800c4d0 tx=0x7f0c6800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:34.424 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.419+0000 7f0c5ffff700 1 -- 172.21.15.90:0/4018090715 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c68005d90 con 0x7f0c78089fb0 2023-06-09T04:42:34.424 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.419+0000 7f0c5ffff700 1 -- 172.21.15.90:0/4018090715 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c680070d0 con 0x7f0c78089fb0 2023-06-09T04:42:34.424 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.419+0000 7f0c7d901700 1 -- 172.21.15.90:0/4018090715 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c780b0240 con 0x7f0c78089fb0 2023-06-09T04:42:34.424 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.419+0000 7f0c5ffff700 1 -- 172.21.15.90:0/4018090715 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c68007480 con 0x7f0c78089fb0 2023-06-09T04:42:34.424 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.419+0000 7f0c7d901700 1 -- 172.21.15.90:0/4018090715 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c7815ced0 con 0x7f0c78089fb0 2023-06-09T04:42:34.425 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.423+0000 7f0c7d901700 1 -- 172.21.15.90:0/4018090715 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c7804db30 con 0x7f0c78089fb0 2023-06-09T04:42:34.425 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.423+0000 7f0c5ffff700 1 -- 172.21.15.90:0/4018090715 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0c680075e0 con 0x7f0c78089fb0 2023-06-09T04:42:34.426 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.423+0000 7f0c5ffff700 1 --2- 172.21.15.90:0/4018090715 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f0c640662f0 0x7f0c640687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:34.426 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.423+0000 7f0c5ffff700 1 -- 172.21.15.90:0/4018090715 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0c680832a0 con 0x7f0c78089fb0 2023-06-09T04:42:34.427 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.427+0000 7f0c767fc700 1 --2- 172.21.15.90:0/4018090715 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f0c640662f0 0x7f0c640687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:34.428 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.427+0000 7f0c767fc700 1 --2- 172.21.15.90:0/4018090715 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f0c640662f0 0x7f0c640687a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f0c7808a380 tx=0x7f0c6c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:34.432 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.431+0000 7f0c5ffff700 1 -- 172.21.15.90:0/4018090715 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0c68050720 con 0x7f0c78089fb0 2023-06-09T04:42:34.605 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.603+0000 7f0c7d901700 1 -- 172.21.15.90:0/4018090715 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f0c780b3fb0 con 0x7f0c78089fb0 2023-06-09T04:42:34.606 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.603+0000 7f0c5ffff700 1 -- 172.21.15.90:0/4018090715 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7f0c68053d40 con 0x7f0c78089fb0 2023-06-09T04:42:34.606 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 8 2023-06-09T04:42:34.608 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.607+0000 7f0c7d901700 1 -- 172.21.15.90:0/4018090715 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f0c640662f0 msgr2=0x7f0c640687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:34.609 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.607+0000 7f0c7d901700 1 --2- 172.21.15.90:0/4018090715 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f0c640662f0 0x7f0c640687a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f0c7808a380 tx=0x7f0c6c008030 comp rx=0 tx=0).stop 2023-06-09T04:42:34.609 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.607+0000 7f0c7d901700 1 -- 172.21.15.90:0/4018090715 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0c78089fb0 msgr2=0x7f0c7814e070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:34.609 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.607+0000 7f0c7d901700 1 --2- 172.21.15.90:0/4018090715 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0c78089fb0 0x7f0c7814e070 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f0c6800c4d0 tx=0x7f0c6800c890 comp rx=0 tx=0).stop 2023-06-09T04:42:34.610 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.607+0000 7f0c7d901700 1 -- 172.21.15.90:0/4018090715 shutdown_connections 2023-06-09T04:42:34.610 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.607+0000 7f0c7d901700 1 --2- 172.21.15.90:0/4018090715 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f0c640662f0 0x7f0c640687a0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:34.610 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.607+0000 7f0c7d901700 1 --2- 172.21.15.90:0/4018090715 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0c78159f80 0x7f0c780b1bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:34.610 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.607+0000 7f0c7d901700 1 --2- 172.21.15.90:0/4018090715 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0c780b35e0 0x7f0c780af680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:34.610 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.607+0000 7f0c7d901700 1 --2- 172.21.15.90:0/4018090715 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0c78089fb0 0x7f0c7814e070 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:34.610 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.607+0000 7f0c7d901700 1 -- 172.21.15.90:0/4018090715 >> 172.21.15.90:0/4018090715 conn(0x7f0c780cc7f0 msgr2=0x7f0c780cf0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:34.610 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.607+0000 7f0c7d901700 1 -- 172.21.15.90:0/4018090715 shutdown_connections 2023-06-09T04:42:34.611 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.607+0000 7f0c7d901700 1 -- 172.21.15.90:0/4018090715 wait complete. 2023-06-09T04:42:34.630 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-09T04:42:34.812 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.811+0000 7f5b9eb02700 1 Processor -- start 2023-06-09T04:42:34.813 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.811+0000 7f5b9eb02700 1 -- start start 2023-06-09T04:42:34.815 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.815+0000 7f5b9eb02700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5b9815de00 0x7f5b981612e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:34.816 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.815+0000 7f5b9eb02700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f5b980c3170 0x7f5b980c35f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:34.816 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.815+0000 7f5b9eb02700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b980cc230 con 0x7f5b980cda20 2023-06-09T04:42:34.816 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.815+0000 7f5b9eb02700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b980cde90 con 0x7f5b9815de00 2023-06-09T04:42:34.816 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.815+0000 7f5b9eb02700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b9806ab90 con 0x7f5b980c3170 2023-06-09T04:42:34.817 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.815+0000 7f5b9db00700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5b9815de00 0x7f5b981612e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:34.817 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.815+0000 7f5b9e301700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f5b980c3170 0x7f5b980c35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:34.817 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.815+0000 7f5b9e301700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f5b980c3170 0x7f5b980c35f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.90:41722/0 (socket says 172.21.15.90:41722) 2023-06-09T04:42:34.817 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.815+0000 7f5b9e301700 1 -- 172.21.15.90:0/1314088404 learned_addr learned my addr 172.21.15.90:0/1314088404 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:34.818 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.815+0000 7f5b9db00700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5b9815de00 0x7f5b981612e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:53152/0 (socket says 172.21.15.90:53152) 2023-06-09T04:42:34.819 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.815+0000 7f5b9e301700 1 -- 172.21.15.90:0/1314088404 >> v2:172.21.15.90:3300/0 conn(0x7f5b9815de00 msgr2=0x7f5b981612e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:34.819 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.815+0000 7f5b9e301700 1 --2- 172.21.15.90:0/1314088404 >> v2:172.21.15.90:3300/0 conn(0x7f5b9815de00 0x7f5b981612e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:34.819 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.815+0000 7f5b9e301700 1 -- 172.21.15.90:0/1314088404 >> v1:172.21.15.174:6789/0 conn(0x7f5b980cda20 legacy=0x7f5b980c4640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:34.819 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.815+0000 7f5b9e301700 1 -- 172.21.15.90:0/1314088404 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b9815e1d0 con 0x7f5b980c3170 2023-06-09T04:42:34.819 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.815+0000 7f5b9e301700 1 --2- 172.21.15.90:0/1314088404 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5b980c3170 0x7f5b980c35f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f5b980c88d0 tx=0x7f5b9000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dadd018edbb21153 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:34.819 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.815+0000 7f5b9cafe700 1 -- 172.21.15.90:0/1314088404 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b9000e070 con 0x7f5b980c3170 2023-06-09T04:42:34.819 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.815+0000 7f5b9cafe700 1 -- 172.21.15.90:0/1314088404 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b9000b910 con 0x7f5b980c3170 2023-06-09T04:42:34.820 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.815+0000 7f5b9cafe700 1 -- 172.21.15.90:0/1314088404 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b9000bcc0 con 0x7f5b980c3170 2023-06-09T04:42:34.820 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.819+0000 7f5b9eb02700 1 -- 172.21.15.90:0/1314088404 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5b980c3170 msgr2=0x7f5b980c35f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:34.821 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.819+0000 7f5b9eb02700 1 --2- 172.21.15.90:0/1314088404 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5b980c3170 0x7f5b980c35f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f5b980c88d0 tx=0x7f5b9000b330 comp rx=0 tx=0).stop 2023-06-09T04:42:34.821 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.819+0000 7f5b9eb02700 1 -- 172.21.15.90:0/1314088404 shutdown_connections 2023-06-09T04:42:34.821 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.819+0000 7f5b9eb02700 1 --2- 172.21.15.90:0/1314088404 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5b980c3170 0x7f5b980c35f0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:34.821 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.819+0000 7f5b9eb02700 1 --2- 172.21.15.90:0/1314088404 >> v2:172.21.15.90:3300/0 conn(0x7f5b9815de00 0x7f5b981612e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:34.821 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.819+0000 7f5b9eb02700 1 -- 172.21.15.90:0/1314088404 >> 172.21.15.90:0/1314088404 conn(0x7f5b980aff00 msgr2=0x7f5b980b0300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:34.821 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.819+0000 7f5b9eb02700 1 -- 172.21.15.90:0/1314088404 shutdown_connections 2023-06-09T04:42:34.821 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.819+0000 7f5b9eb02700 1 -- 172.21.15.90:0/1314088404 wait complete. 2023-06-09T04:42:34.823 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.823+0000 7f5b9eb02700 1 Processor -- start 2023-06-09T04:42:34.824 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.823+0000 7f5b9eb02700 1 -- start start 2023-06-09T04:42:34.825 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.823+0000 7f5b9eb02700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5b980c3170 0x7f5b981f56a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:34.825 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.823+0000 7f5b9eb02700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5b980cda20 0x7f5b981f9cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:34.825 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.823+0000 7f5b9eb02700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5b9815de00 0x7f5b98157120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:34.825 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.823+0000 7f5b9eb02700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b9815d6b0 con 0x7f5b980c3170 2023-06-09T04:42:34.826 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.823+0000 7f5b9eb02700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b981f5be0 con 0x7f5b980cda20 2023-06-09T04:42:34.826 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.823+0000 7f5b9eb02700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b98162a10 con 0x7f5b9815de00 2023-06-09T04:42:34.827 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.823+0000 7f5b9db00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5b980c3170 0x7f5b981f56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:34.827 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.823+0000 7f5b9db00700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5b980c3170 0x7f5b981f56a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:53156/0 (socket says 172.21.15.90:53156) 2023-06-09T04:42:34.827 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.823+0000 7f5b9db00700 1 -- 172.21.15.90:0/3259543282 learned_addr learned my addr 172.21.15.90:0/3259543282 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:34.827 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.823+0000 7f5b9e301700 1 --2- 172.21.15.90:0/3259543282 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5b9815de00 0x7f5b98157120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:34.827 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.823+0000 7f5b9d2ff700 1 --2- 172.21.15.90:0/3259543282 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5b980cda20 0x7f5b981f9cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:34.828 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.823+0000 7f5b9db00700 1 -- 172.21.15.90:0/3259543282 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5b9815de00 msgr2=0x7f5b98157120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:34.828 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.823+0000 7f5b9db00700 1 --2- 172.21.15.90:0/3259543282 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5b9815de00 0x7f5b98157120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:34.828 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.823+0000 7f5b9db00700 1 -- 172.21.15.90:0/3259543282 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5b980cda20 msgr2=0x7f5b981f9cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:34.828 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.823+0000 7f5b9db00700 1 --2- 172.21.15.90:0/3259543282 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5b980cda20 0x7f5b981f9cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:34.828 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.823+0000 7f5b9db00700 1 -- 172.21.15.90:0/3259543282 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b90009b30 con 0x7f5b980c3170 2023-06-09T04:42:34.828 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.823+0000 7f5b9d2ff700 1 --2- 172.21.15.90:0/3259543282 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5b980cda20 0x7f5b981f9cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:42:34.828 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.823+0000 7f5b9e301700 1 --2- 172.21.15.90:0/3259543282 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5b9815de00 0x7f5b98157120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:42:34.829 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.823+0000 7f5b9db00700 1 --2- 172.21.15.90:0/3259543282 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5b980c3170 0x7f5b981f56a0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f5b9400e840 tx=0x7f5b9400ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:34.829 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.827+0000 7f5b8e7fc700 1 -- 172.21.15.90:0/3259543282 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b940095a0 con 0x7f5b980c3170 2023-06-09T04:42:34.829 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.827+0000 7f5b9eb02700 1 -- 172.21.15.90:0/3259543282 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b981fa200 con 0x7f5b980c3170 2023-06-09T04:42:34.829 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.827+0000 7f5b8e7fc700 1 -- 172.21.15.90:0/3259543282 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b9400c690 con 0x7f5b980c3170 2023-06-09T04:42:34.829 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.827+0000 7f5b8e7fc700 1 -- 172.21.15.90:0/3259543282 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b9400ca00 con 0x7f5b980c3170 2023-06-09T04:42:34.829 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.827+0000 7f5b9eb02700 1 -- 172.21.15.90:0/3259543282 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b981623c0 con 0x7f5b980c3170 2023-06-09T04:42:34.830 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.827+0000 7f5b9eb02700 1 -- 172.21.15.90:0/3259543282 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b9804e380 con 0x7f5b980c3170 2023-06-09T04:42:34.830 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.827+0000 7f5b8e7fc700 1 -- 172.21.15.90:0/3259543282 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5b9400cbe0 con 0x7f5b980c3170 2023-06-09T04:42:34.832 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.831+0000 7f5b8e7fc700 1 --2- 172.21.15.90:0/3259543282 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f5b7c0662f0 0x7f5b7c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:34.833 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.831+0000 7f5b8e7fc700 1 -- 172.21.15.90:0/3259543282 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5b94083d80 con 0x7f5b980c3170 2023-06-09T04:42:34.833 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.831+0000 7f5b9d2ff700 1 --2- 172.21.15.90:0/3259543282 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f5b7c0662f0 0x7f5b7c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:34.834 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.831+0000 7f5b9d2ff700 1 --2- 172.21.15.90:0/3259543282 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f5b7c0662f0 0x7f5b7c0687a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f5b98158350 tx=0x7f5b88009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:34.839 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:34.839+0000 7f5b8e7fc700 1 -- 172.21.15.90:0/3259543282 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5b94051160 con 0x7f5b980c3170 2023-06-09T04:42:35.006 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.003+0000 7f5b9eb02700 1 -- 172.21.15.90:0/3259543282 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5b980ccff0 con 0x7f5b980c3170 2023-06-09T04:42:35.007 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.007+0000 7f5b8e7fc700 1 -- 172.21.15.90:0/3259543282 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5b94017020 con 0x7f5b980c3170 2023-06-09T04:42:35.007 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 32 2023-06-09T04:42:35.009 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.007+0000 7f5b9eb02700 1 -- 172.21.15.90:0/3259543282 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f5b7c0662f0 msgr2=0x7f5b7c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:35.009 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.007+0000 7f5b9eb02700 1 --2- 172.21.15.90:0/3259543282 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f5b7c0662f0 0x7f5b7c0687a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f5b98158350 tx=0x7f5b88009040 comp rx=0 tx=0).stop 2023-06-09T04:42:35.009 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.007+0000 7f5b9eb02700 1 -- 172.21.15.90:0/3259543282 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5b980c3170 msgr2=0x7f5b981f56a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:35.010 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.007+0000 7f5b9eb02700 1 --2- 172.21.15.90:0/3259543282 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5b980c3170 0x7f5b981f56a0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f5b9400e840 tx=0x7f5b9400ec00 comp rx=0 tx=0).stop 2023-06-09T04:42:35.010 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.007+0000 7f5b9eb02700 1 -- 172.21.15.90:0/3259543282 shutdown_connections 2023-06-09T04:42:35.010 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.007+0000 7f5b9eb02700 1 --2- 172.21.15.90:0/3259543282 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f5b7c0662f0 0x7f5b7c0687a0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:35.010 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.007+0000 7f5b9eb02700 1 --2- 172.21.15.90:0/3259543282 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5b9815de00 0x7f5b98157120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:35.010 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.007+0000 7f5b9eb02700 1 --2- 172.21.15.90:0/3259543282 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5b980cda20 0x7f5b981f9cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:35.010 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.007+0000 7f5b9eb02700 1 --2- 172.21.15.90:0/3259543282 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5b980c3170 0x7f5b981f56a0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:35.010 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.007+0000 7f5b9eb02700 1 -- 172.21.15.90:0/3259543282 >> 172.21.15.90:0/3259543282 conn(0x7f5b980aff00 msgr2=0x7f5b980c3f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:35.011 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.007+0000 7f5b9eb02700 1 -- 172.21.15.90:0/3259543282 shutdown_connections 2023-06-09T04:42:35.011 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.007+0000 7f5b9eb02700 1 -- 172.21.15.90:0/3259543282 wait complete. 2023-06-09T04:42:35.029 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-09T04:42:35.220 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.219+0000 7f6451493700 1 Processor -- start 2023-06-09T04:42:35.220 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.219+0000 7f6451493700 1 -- start start 2023-06-09T04:42:35.222 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.219+0000 7f6451493700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f644c0b1ca0 0x7f644c160920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:35.222 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.219+0000 7f6451493700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f644c0d2400 0x7f644c0d28a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:35.222 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.219+0000 7f6451493700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f644c15c6b0 con 0x7f644c0b18d0 2023-06-09T04:42:35.222 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.219+0000 7f6451493700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f644c0d2de0 con 0x7f644c0b1ca0 2023-06-09T04:42:35.223 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.219+0000 7f6451493700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f644c0cf6a0 con 0x7f644c0d2400 2023-06-09T04:42:35.223 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.219+0000 7f644b7fe700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f644c0b1ca0 0x7f644c160920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:35.223 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.223+0000 7f644b7fe700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f644c0b1ca0 0x7f644c160920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:53166/0 (socket says 172.21.15.90:53166) 2023-06-09T04:42:35.223 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.223+0000 7f644b7fe700 1 -- 172.21.15.90:0/2857732773 learned_addr learned my addr 172.21.15.90:0/2857732773 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:35.224 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.223+0000 7f6450c92700 1 --2- 172.21.15.90:0/2857732773 >> v2:172.21.15.174:3300/0 conn(0x7f644c0d2400 0x7f644c0d28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:35.224 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.223+0000 7f644b7fe700 1 -- 172.21.15.90:0/2857732773 >> v2:172.21.15.174:3300/0 conn(0x7f644c0d2400 msgr2=0x7f644c0d28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:35.225 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.223+0000 7f644b7fe700 1 --2- 172.21.15.90:0/2857732773 >> v2:172.21.15.174:3300/0 conn(0x7f644c0d2400 0x7f644c0d28a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:35.225 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.223+0000 7f644b7fe700 1 -- 172.21.15.90:0/2857732773 >> v1:172.21.15.174:6789/0 conn(0x7f644c0b18d0 legacy=0x7f644c0cee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:35.225 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.223+0000 7f644b7fe700 1 -- 172.21.15.90:0/2857732773 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f644c0cf980 con 0x7f644c0b1ca0 2023-06-09T04:42:35.225 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.223+0000 7f644affd700 1 -- 172.21.15.90:0/2857732773 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1934322714 0 0) 0x7f644c15c6b0 con 0x7f644c0b18d0 2023-06-09T04:42:35.225 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.223+0000 7f644b7fe700 1 --2- 172.21.15.90:0/2857732773 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f644c0b1ca0 0x7f644c160920 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f644c071b60 tx=0x7f6440009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a60d683cdc501df server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:35.225 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.223+0000 7f644affd700 1 -- 172.21.15.90:0/2857732773 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6440011830 con 0x7f644c0b1ca0 2023-06-09T04:42:35.225 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.223+0000 7f644affd700 1 -- 172.21.15.90:0/2857732773 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6440011990 con 0x7f644c0b1ca0 2023-06-09T04:42:35.226 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.223+0000 7f644affd700 1 -- 172.21.15.90:0/2857732773 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6440011d20 con 0x7f644c0b1ca0 2023-06-09T04:42:35.226 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.223+0000 7f6451493700 1 -- 172.21.15.90:0/2857732773 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f644c0b1ca0 msgr2=0x7f644c160920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:35.227 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.223+0000 7f6451493700 1 --2- 172.21.15.90:0/2857732773 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f644c0b1ca0 0x7f644c160920 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f644c071b60 tx=0x7f6440009bf0 comp rx=0 tx=0).stop 2023-06-09T04:42:35.227 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.223+0000 7f6451493700 1 -- 172.21.15.90:0/2857732773 shutdown_connections 2023-06-09T04:42:35.227 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.223+0000 7f6451493700 1 --2- 172.21.15.90:0/2857732773 >> v2:172.21.15.174:3300/0 conn(0x7f644c0d2400 0x7f644c0d28a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:35.227 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.223+0000 7f6451493700 1 --2- 172.21.15.90:0/2857732773 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f644c0b1ca0 0x7f644c160920 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:35.227 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.223+0000 7f6451493700 1 -- 172.21.15.90:0/2857732773 >> 172.21.15.90:0/2857732773 conn(0x7f644c09b9b0 msgr2=0x7f644c0b55d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:35.227 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.223+0000 7f6451493700 1 -- 172.21.15.90:0/2857732773 shutdown_connections 2023-06-09T04:42:35.227 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.223+0000 7f6451493700 1 -- 172.21.15.90:0/2857732773 wait complete. 2023-06-09T04:42:35.230 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.227+0000 7f6451493700 1 Processor -- start 2023-06-09T04:42:35.230 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.227+0000 7f6451493700 1 -- start start 2023-06-09T04:42:35.233 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.231+0000 7f6451493700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f644c0b18d0 0x7f644c156270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:35.233 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.231+0000 7f6451493700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f644c0b1ca0 0x7f644c15f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:35.233 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.231+0000 7f6451493700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f644c0d2400 0x7f644c06b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:35.233 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.231+0000 7f6451493700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f644c069b90 con 0x7f644c0b18d0 2023-06-09T04:42:35.233 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.231+0000 7f6451493700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f644c15d7b0 con 0x7f644c0b1ca0 2023-06-09T04:42:35.233 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.231+0000 7f6451493700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f644c15da90 con 0x7f644c0d2400 2023-06-09T04:42:35.234 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.231+0000 7f644bfff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f644c0b18d0 0x7f644c156270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:35.235 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.231+0000 7f644bfff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f644c0b18d0 0x7f644c156270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:53168/0 (socket says 172.21.15.90:53168) 2023-06-09T04:42:35.235 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.231+0000 7f644bfff700 1 -- 172.21.15.90:0/2959902929 learned_addr learned my addr 172.21.15.90:0/2959902929 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:35.235 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.231+0000 7f644b7fe700 1 --2- 172.21.15.90:0/2959902929 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f644c0b1ca0 0x7f644c15f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:35.235 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.231+0000 7f6450c92700 1 --2- 172.21.15.90:0/2959902929 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f644c0d2400 0x7f644c06b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:35.235 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.231+0000 7f644bfff700 1 -- 172.21.15.90:0/2959902929 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f644c0d2400 msgr2=0x7f644c06b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:35.235 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.231+0000 7f644bfff700 1 --2- 172.21.15.90:0/2959902929 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f644c0d2400 0x7f644c06b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:35.235 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.231+0000 7f644bfff700 1 -- 172.21.15.90:0/2959902929 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f644c0b1ca0 msgr2=0x7f644c15f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:35.236 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.231+0000 7f644bfff700 1 --2- 172.21.15.90:0/2959902929 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f644c0b1ca0 0x7f644c15f000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:35.236 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.231+0000 7f644bfff700 1 -- 172.21.15.90:0/2959902929 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6440009570 con 0x7f644c0b18d0 2023-06-09T04:42:35.236 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.231+0000 7f644b7fe700 1 --2- 172.21.15.90:0/2959902929 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f644c0b1ca0 0x7f644c15f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:42:35.237 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.231+0000 7f644bfff700 1 --2- 172.21.15.90:0/2959902929 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f644c0b18d0 0x7f644c156270 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f643c00c750 tx=0x7f643c00cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:35.237 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.231+0000 7f6448ff9700 1 -- 172.21.15.90:0/2959902929 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f643c0054e0 con 0x7f644c0b18d0 2023-06-09T04:42:35.237 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.231+0000 7f6448ff9700 1 -- 172.21.15.90:0/2959902929 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f643c0036f0 con 0x7f644c0b18d0 2023-06-09T04:42:35.237 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.231+0000 7f6448ff9700 1 -- 172.21.15.90:0/2959902929 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f643c003aa0 con 0x7f644c0b18d0 2023-06-09T04:42:35.238 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.231+0000 7f6451493700 1 -- 172.21.15.90:0/2959902929 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f644c15dd70 con 0x7f644c0b18d0 2023-06-09T04:42:35.239 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.235+0000 7f6451493700 1 -- 172.21.15.90:0/2959902929 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f644c15e330 con 0x7f644c0b18d0 2023-06-09T04:42:35.239 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.235+0000 7f6451493700 1 -- 172.21.15.90:0/2959902929 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f644c15e4c0 con 0x7f644c0b18d0 2023-06-09T04:42:35.239 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.235+0000 7f6448ff9700 1 -- 172.21.15.90:0/2959902929 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f643c003c00 con 0x7f644c0b18d0 2023-06-09T04:42:35.240 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.235+0000 7f6448ff9700 1 --2- 172.21.15.90:0/2959902929 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f64380662f0 0x7f64380687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:35.240 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.235+0000 7f6448ff9700 1 -- 172.21.15.90:0/2959902929 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f643c083330 con 0x7f644c0b18d0 2023-06-09T04:42:35.241 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.239+0000 7f644b7fe700 1 --2- 172.21.15.90:0/2959902929 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f64380662f0 0x7f64380687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:35.241 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.239+0000 7f644b7fe700 1 --2- 172.21.15.90:0/2959902929 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f64380662f0 0x7f64380687a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f644c0b20b0 tx=0x7f6440008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:35.247 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.247+0000 7f6448ff9700 1 -- 172.21.15.90:0/2959902929 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f643c050770 con 0x7f644c0b18d0 2023-06-09T04:42:35.417 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.415+0000 7f6451493700 1 -- 172.21.15.90:0/2959902929 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f644c04e380 con 0x7f644c0b18d0 2023-06-09T04:42:35.418 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.415+0000 7f6448ff9700 1 -- 172.21.15.90:0/2959902929 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f643c053d90 con 0x7f644c0b18d0 2023-06-09T04:42:35.418 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 64 2023-06-09T04:42:35.420 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.419+0000 7f6451493700 1 -- 172.21.15.90:0/2959902929 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f64380662f0 msgr2=0x7f64380687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:35.420 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.419+0000 7f6451493700 1 --2- 172.21.15.90:0/2959902929 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f64380662f0 0x7f64380687a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f644c0b20b0 tx=0x7f6440008030 comp rx=0 tx=0).stop 2023-06-09T04:42:35.420 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.419+0000 7f6451493700 1 -- 172.21.15.90:0/2959902929 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f644c0b18d0 msgr2=0x7f644c156270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:35.421 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.419+0000 7f6451493700 1 --2- 172.21.15.90:0/2959902929 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f644c0b18d0 0x7f644c156270 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f643c00c750 tx=0x7f643c00cb10 comp rx=0 tx=0).stop 2023-06-09T04:42:35.421 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.419+0000 7f6451493700 1 -- 172.21.15.90:0/2959902929 shutdown_connections 2023-06-09T04:42:35.421 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.419+0000 7f6451493700 1 --2- 172.21.15.90:0/2959902929 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f64380662f0 0x7f64380687a0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:35.421 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.419+0000 7f6451493700 1 --2- 172.21.15.90:0/2959902929 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f644c0d2400 0x7f644c06b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:35.421 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.419+0000 7f6451493700 1 --2- 172.21.15.90:0/2959902929 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f644c0b1ca0 0x7f644c15f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:35.421 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.419+0000 7f6451493700 1 --2- 172.21.15.90:0/2959902929 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f644c0b18d0 0x7f644c156270 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:35.421 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.419+0000 7f6451493700 1 -- 172.21.15.90:0/2959902929 >> 172.21.15.90:0/2959902929 conn(0x7f644c09b9b0 msgr2=0x7f644c0ce9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:35.422 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.419+0000 7f6451493700 1 -- 172.21.15.90:0/2959902929 shutdown_connections 2023-06-09T04:42:35.422 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.419+0000 7f6451493700 1 -- 172.21.15.90:0/2959902929 wait complete. 2023-06-09T04:42:35.443 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-06-09T04:42:35.615 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.615+0000 7f29970ca700 1 Processor -- start 2023-06-09T04:42:35.615 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.615+0000 7f29970ca700 1 -- start start 2023-06-09T04:42:35.617 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.615+0000 7f29970ca700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f299015e120 0x7f29900c8b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:35.617 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.615+0000 7f29970ca700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f29900ca7a0 0x7f29900ad920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:35.617 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.615+0000 7f29970ca700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29900cae10 con 0x7f2990154370 2023-06-09T04:42:35.618 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.615+0000 7f29970ca700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29900cac00 con 0x7f29900ca7a0 2023-06-09T04:42:35.618 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.615+0000 7f29970ca700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29900cb0f0 con 0x7f299015e120 2023-06-09T04:42:35.618 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.615+0000 7f2994e66700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f2990154370 0x7f299015da10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:55028/0 (socket says 172.21.15.90:55028) 2023-06-09T04:42:35.619 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.615+0000 7f2994e66700 1 -- 172.21.15.90:0/579832896 learned_addr learned my addr 172.21.15.90:0/579832896 (peer_addr_for_me v1:172.21.15.90:0/0) 2023-06-09T04:42:35.619 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.615+0000 7f2995667700 1 --2- 172.21.15.90:0/579832896 >> v2:172.21.15.90:3300/0 conn(0x7f29900ca7a0 0x7f29900ad920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:35.619 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.615+0000 7f298ffff700 1 --2- 172.21.15.90:0/579832896 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f299015e120 0x7f29900c8b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:35.619 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.615+0000 7f298f7fe700 1 -- 172.21.15.90:0/579832896 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1415707630 0 0) 0x7f29900cae10 con 0x7f2990154370 2023-06-09T04:42:35.619 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.615+0000 7f298f7fe700 1 -- 172.21.15.90:0/579832896 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f29800035d0 con 0x7f2990154370 2023-06-09T04:42:35.619 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.615+0000 7f2995667700 1 -- 172.21.15.90:0/579832896 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f299015e120 msgr2=0x7f29900c8b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:35.620 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.615+0000 7f2995667700 1 --2- 172.21.15.90:0/579832896 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f299015e120 0x7f29900c8b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:35.620 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.615+0000 7f2995667700 1 -- 172.21.15.90:0/579832896 >> v1:172.21.15.90:6789/0 conn(0x7f2990154370 legacy=0x7f299015da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:35.620 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.615+0000 7f2995667700 1 -- 172.21.15.90:0/579832896 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29900cb3d0 con 0x7f29900ca7a0 2023-06-09T04:42:35.621 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.619+0000 7f2995667700 1 --2- 172.21.15.90:0/579832896 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f29900ca7a0 0x7f29900ad920 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f2988009d90 tx=0x7f298800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41aaf636776a1790 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:35.621 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.619+0000 7f298f7fe700 1 -- 172.21.15.90:0/579832896 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f298800e070 con 0x7f29900ca7a0 2023-06-09T04:42:35.621 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.619+0000 7f298f7fe700 1 -- 172.21.15.90:0/579832896 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f298800bb20 con 0x7f29900ca7a0 2023-06-09T04:42:35.621 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.619+0000 7f298f7fe700 1 -- 172.21.15.90:0/579832896 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2988012430 con 0x7f29900ca7a0 2023-06-09T04:42:35.621 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.619+0000 7f29970ca700 1 -- 172.21.15.90:0/579832896 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f29900ca7a0 msgr2=0x7f29900ad920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:35.621 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.619+0000 7f29970ca700 1 --2- 172.21.15.90:0/579832896 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f29900ca7a0 0x7f29900ad920 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f2988009d90 tx=0x7f298800b330 comp rx=0 tx=0).stop 2023-06-09T04:42:35.622 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.619+0000 7f29970ca700 1 -- 172.21.15.90:0/579832896 shutdown_connections 2023-06-09T04:42:35.622 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.619+0000 7f29970ca700 1 --2- 172.21.15.90:0/579832896 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f29900ca7a0 0x7f29900ad920 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:35.622 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.619+0000 7f29970ca700 1 --2- 172.21.15.90:0/579832896 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f299015e120 0x7f29900c8b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:35.622 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.619+0000 7f29970ca700 1 -- 172.21.15.90:0/579832896 >> 172.21.15.90:0/579832896 conn(0x7f299006c810 msgr2=0x7f29900b0000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:35.622 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.619+0000 7f29970ca700 1 -- 172.21.15.90:0/579832896 shutdown_connections 2023-06-09T04:42:35.622 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.619+0000 7f29970ca700 1 -- 172.21.15.90:0/579832896 wait complete. 2023-06-09T04:42:35.624 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.623+0000 7f29970ca700 1 Processor -- start 2023-06-09T04:42:35.624 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.623+0000 7f29970ca700 1 -- start start 2023-06-09T04:42:35.626 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.623+0000 7f29970ca700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f29900ca7a0 0x7f2990153840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:35.626 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.623+0000 7f29970ca700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2990154370 0x7f29900cc0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:35.626 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.623+0000 7f29970ca700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f299015e120 0x7f29900ad9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:35.626 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.623+0000 7f29970ca700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29900cd620 con 0x7f2990154370 2023-06-09T04:42:35.627 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.623+0000 7f29970ca700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2990153d80 con 0x7f29900ca7a0 2023-06-09T04:42:35.627 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.623+0000 7f29970ca700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29900cdab0 con 0x7f299015e120 2023-06-09T04:42:35.628 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.623+0000 7f298ffff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2990154370 0x7f29900cc0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:35.628 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.623+0000 7f298ffff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2990154370 0x7f29900cc0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:53198/0 (socket says 172.21.15.90:53198) 2023-06-09T04:42:35.628 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.623+0000 7f298ffff700 1 -- 172.21.15.90:0/2355968131 learned_addr learned my addr 172.21.15.90:0/2355968131 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:35.628 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.627+0000 7f2995667700 1 --2- 172.21.15.90:0/2355968131 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f299015e120 0x7f29900ad9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:35.629 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.627+0000 7f2994e66700 1 --2- 172.21.15.90:0/2355968131 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f29900ca7a0 0x7f2990153840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:35.629 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.627+0000 7f298ffff700 1 -- 172.21.15.90:0/2355968131 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f299015e120 msgr2=0x7f29900ad9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:35.629 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.627+0000 7f298ffff700 1 --2- 172.21.15.90:0/2355968131 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f299015e120 0x7f29900ad9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:35.629 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.627+0000 7f298ffff700 1 -- 172.21.15.90:0/2355968131 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f29900ca7a0 msgr2=0x7f2990153840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:35.629 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.627+0000 7f298ffff700 1 --2- 172.21.15.90:0/2355968131 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f29900ca7a0 0x7f2990153840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:35.629 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.627+0000 7f298ffff700 1 -- 172.21.15.90:0/2355968131 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2988009a70 con 0x7f2990154370 2023-06-09T04:42:35.629 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.627+0000 7f2995667700 1 --2- 172.21.15.90:0/2355968131 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f299015e120 0x7f29900ad9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:42:35.630 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.627+0000 7f2994e66700 1 --2- 172.21.15.90:0/2355968131 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f29900ca7a0 0x7f2990153840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:42:35.630 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.627+0000 7f298ffff700 1 --2- 172.21.15.90:0/2355968131 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2990154370 0x7f29900cc0c0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f297c00e790 tx=0x7f297c00eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:35.630 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.627+0000 7f298d7fa700 1 -- 172.21.15.90:0/2355968131 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f297c013610 con 0x7f2990154370 2023-06-09T04:42:35.630 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.627+0000 7f298d7fa700 1 -- 172.21.15.90:0/2355968131 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f297c013770 con 0x7f2990154370 2023-06-09T04:42:35.630 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.627+0000 7f298d7fa700 1 -- 172.21.15.90:0/2355968131 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f297c013b20 con 0x7f2990154370 2023-06-09T04:42:35.630 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.627+0000 7f29970ca700 1 -- 172.21.15.90:0/2355968131 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29901548c0 con 0x7f2990154370 2023-06-09T04:42:35.630 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.627+0000 7f29970ca700 1 -- 172.21.15.90:0/2355968131 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29900cccf0 con 0x7f2990154370 2023-06-09T04:42:35.631 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.627+0000 7f29970ca700 1 -- 172.21.15.90:0/2355968131 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29900cd7d0 con 0x7f2990154370 2023-06-09T04:42:35.631 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.631+0000 7f298d7fa700 1 -- 172.21.15.90:0/2355968131 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f297c013c80 con 0x7f2990154370 2023-06-09T04:42:35.632 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.631+0000 7f298d7fa700 1 --2- 172.21.15.90:0/2355968131 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f29740662f0 0x7f29740687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:35.633 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.631+0000 7f298d7fa700 1 -- 172.21.15.90:0/2355968131 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f297c083a50 con 0x7f2990154370 2023-06-09T04:42:35.633 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.631+0000 7f2994e66700 1 --2- 172.21.15.90:0/2355968131 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f29740662f0 0x7f29740687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:35.634 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.631+0000 7f2994e66700 1 --2- 172.21.15.90:0/2355968131 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f29740662f0 0x7f29740687a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f29840011e0 tx=0x7f2984009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:35.639 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.639+0000 7f298d7fa700 1 -- 172.21.15.90:0/2355968131 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f29900cd7d0 con 0x7f2990154370 2023-06-09T04:42:35.821 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.819+0000 7f29970ca700 1 -- 172.21.15.90:0/2355968131 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f29900cd7d0 con 0x7f2990154370 2023-06-09T04:42:35.821 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.819+0000 7f298d7fa700 1 -- 172.21.15.90:0/2355968131 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) v1 ==== 80+0+0 (secure 0 0 0) 0x7f29900cd7d0 con 0x7f2990154370 2023-06-09T04:42:35.825 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.823+0000 7f29970ca700 1 -- 172.21.15.90:0/2355968131 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f29740662f0 msgr2=0x7f29740687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:35.825 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.823+0000 7f29970ca700 1 --2- 172.21.15.90:0/2355968131 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f29740662f0 0x7f29740687a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f29840011e0 tx=0x7f2984009040 comp rx=0 tx=0).stop 2023-06-09T04:42:35.826 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.823+0000 7f29970ca700 1 -- 172.21.15.90:0/2355968131 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2990154370 msgr2=0x7f29900cc0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:35.826 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.823+0000 7f29970ca700 1 --2- 172.21.15.90:0/2355968131 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2990154370 0x7f29900cc0c0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f297c00e790 tx=0x7f297c00eb50 comp rx=0 tx=0).stop 2023-06-09T04:42:35.826 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.823+0000 7f29970ca700 1 -- 172.21.15.90:0/2355968131 shutdown_connections 2023-06-09T04:42:35.826 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.823+0000 7f29970ca700 1 --2- 172.21.15.90:0/2355968131 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f29740662f0 0x7f29740687a0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:35.827 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.823+0000 7f29970ca700 1 --2- 172.21.15.90:0/2355968131 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f299015e120 0x7f29900ad9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:35.827 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.823+0000 7f29970ca700 1 --2- 172.21.15.90:0/2355968131 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2990154370 0x7f29900cc0c0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:35.827 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.823+0000 7f29970ca700 1 --2- 172.21.15.90:0/2355968131 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f29900ca7a0 0x7f2990153840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:35.827 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.823+0000 7f29970ca700 1 -- 172.21.15.90:0/2355968131 >> 172.21.15.90:0/2355968131 conn(0x7f299006c810 msgr2=0x7f29900cebf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:35.827 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.823+0000 7f29970ca700 1 -- 172.21.15.90:0/2355968131 shutdown_connections 2023-06-09T04:42:35.827 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:35.823+0000 7f29970ca700 1 -- 172.21.15.90:0/2355968131 wait complete. 2023-06-09T04:42:35.829 INFO:teuthology.orchestra.run.smithi090.stderr:listed 0 entries 2023-06-09T04:42:35.848 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-06-09T04:42:35.848 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:42:35.849 DEBUG:teuthology.orchestra.run.smithi174:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2023-06-09T04:42:35.937 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi174.front.sepia.ceph.com 2023-06-09T04:42:35.938 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:42:35.938 DEBUG:teuthology.orchestra.run.smithi174:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-06-09T04:42:35.964 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2023-06-09T04:42:35.965 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-09T04:42:35.983 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2023-06-09T04:42:35.983 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-09T04:42:36.043 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2023-06-09T04:42:36.043 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-09T04:42:36.105 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T04:42:36.318 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:36.315+0000 7ff04759e700 1 Processor -- start 2023-06-09T04:42:36.319 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:36.315+0000 7ff04759e700 1 -- start start 2023-06-09T04:42:36.320 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:36.319+0000 7ff04759e700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7ff048154350 0x7ff0480cc0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:36.320 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:36.319+0000 7ff04759e700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ff0480cafb0 0x7ff04806acf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:36.321 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:36.319+0000 7ff04759e700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0480cd8a0 con 0x7ff04815d7a0 2023-06-09T04:42:36.321 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:36.319+0000 7ff04759e700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff048154720 con 0x7ff048154350 2023-06-09T04:42:36.321 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:36.319+0000 7ff04759e700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0480cb420 con 0x7ff0480cafb0 2023-06-09T04:42:36.321 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:36.319+0000 7ff045d9b700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ff0480cafb0 0x7ff04806acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:36.322 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:36.319+0000 7ff045d9b700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ff0480cafb0 0x7ff04806acf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.90:47410/0 (socket says 172.21.15.90:47410) 2023-06-09T04:42:36.322 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:36.319+0000 7ff045d9b700 1 -- 172.21.15.90:0/1611359816 learned_addr learned my addr 172.21.15.90:0/1611359816 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:36.322 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:36.319+0000 7ff04659c700 1 --2- 172.21.15.90:0/1611359816 >> v2:172.21.15.90:3300/0 conn(0x7ff048154350 0x7ff0480cc0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:36.322 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:36.319+0000 7ff04659c700 1 -- 172.21.15.90:0/1611359816 >> v2:172.21.15.174:3300/0 conn(0x7ff0480cafb0 msgr2=0x7ff04806acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:36.323 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:36.319+0000 7ff04659c700 1 --2- 172.21.15.90:0/1611359816 >> v2:172.21.15.174:3300/0 conn(0x7ff0480cafb0 0x7ff04806acf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:36.323 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:36.319+0000 7ff04659c700 1 -- 172.21.15.90:0/1611359816 >> v1:172.21.15.90:6789/0 conn(0x7ff04815d7a0 legacy=0x7ff048069c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:36.323 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:36.319+0000 7ff04659c700 1 -- 172.21.15.90:0/1611359816 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0480cdaf0 con 0x7ff048154350 2023-06-09T04:42:36.323 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:36.319+0000 7ff045d9b700 1 --2- 172.21.15.90:0/1611359816 >> v2:172.21.15.174:3300/0 conn(0x7ff0480cafb0 0x7ff04806acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:42:36.324 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:36.323+0000 7ff04659c700 1 --2- 172.21.15.90:0/1611359816 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff048154350 0x7ff0480cc0f0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7ff04806f210 tx=0x7ff03800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6778218c61e608d8 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:36.324 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:36.323+0000 7ff04559a700 1 -- 172.21.15.90:0/1611359816 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff03800e070 con 0x7ff048154350 2023-06-09T04:42:36.324 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:36.323+0000 7ff04559a700 1 -- 172.21.15.90:0/1611359816 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff03800bb20 con 0x7ff048154350 2023-06-09T04:42:36.324 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:36.323+0000 7ff04559a700 1 -- 172.21.15.90:0/1611359816 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff038012430 con 0x7ff048154350 2023-06-09T04:42:36.324 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:36.323+0000 7ff04759e700 1 -- 172.21.15.90:0/1611359816 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff048154350 msgr2=0x7ff0480cc0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:36.325 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:36.323+0000 7ff04759e700 1 --2- 172.21.15.90:0/1611359816 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff048154350 0x7ff0480cc0f0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7ff04806f210 tx=0x7ff03800b330 comp rx=0 tx=0).stop 2023-06-09T04:42:36.325 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:36.323+0000 7ff04759e700 1 -- 172.21.15.90:0/1611359816 shutdown_connections 2023-06-09T04:42:36.325 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:36.323+0000 7ff04759e700 1 --2- 172.21.15.90:0/1611359816 >> v2:172.21.15.174:3300/0 conn(0x7ff0480cafb0 0x7ff04806acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:36.326 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:36.323+0000 7ff04759e700 1 --2- 172.21.15.90:0/1611359816 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff048154350 0x7ff0480cc0f0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:36.326 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:36.323+0000 7ff04759e700 1 -- 172.21.15.90:0/1611359816 >> 172.21.15.90:0/1611359816 conn(0x7ff04806c690 msgr2=0x7ff0480aff00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:36.326 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:36.323+0000 7ff04759e700 1 -- 172.21.15.90:0/1611359816 shutdown_connections 2023-06-09T04:42:36.326 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:36.323+0000 7ff04759e700 1 -- 172.21.15.90:0/1611359816 wait complete. 2023-06-09T04:42:36.327 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:36.327+0000 7ff04759e700 1 Processor -- start 2023-06-09T04:42:36.327 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:36.327+0000 7ff04759e700 1 -- start start 2023-06-09T04:42:36.328 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:36.327+0000 7ff04759e700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff0480cafb0 0x7ff048141ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:36.329 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:36.327+0000 7ff04759e700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff048154350 0x7ff04813e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:36.329 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:36.327+0000 7ff04759e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff04815d7a0 0x7ff048158c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:36.329 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:36.327+0000 7ff04759e700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff04814f5f0 con 0x7ff048154350 2023-06-09T04:42:36.329 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:36.327+0000 7ff04759e700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff048142020 con 0x7ff0480cafb0 2023-06-09T04:42:36.329 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:36.327+0000 7ff04759e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff04814f840 con 0x7ff04815d7a0 2023-06-09T04:42:36.330 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:36.327+0000 7ff045d9b700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff048154350 0x7ff04813e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:36.330 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:36.327+0000 7ff045d9b700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff048154350 0x7ff04813e740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:52556/0 (socket says 172.21.15.90:52556) 2023-06-09T04:42:36.330 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:36.327+0000 7ff045d9b700 1 -- 172.21.15.90:0/3498574956 learned_addr learned my addr 172.21.15.90:0/3498574956 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:36.331 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:36.327+0000 7ff04659c700 1 --2- 172.21.15.90:0/3498574956 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff0480cafb0 0x7ff048141ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:36.331 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:36.327+0000 7ff046d9d700 1 --2- 172.21.15.90:0/3498574956 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff04815d7a0 0x7ff048158c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:36.331 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:36.327+0000 7ff045d9b700 1 -- 172.21.15.90:0/3498574956 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff04815d7a0 msgr2=0x7ff048158c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:36.331 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:36.327+0000 7ff045d9b700 1 --2- 172.21.15.90:0/3498574956 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff04815d7a0 0x7ff048158c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:36.331 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:36.327+0000 7ff045d9b700 1 -- 172.21.15.90:0/3498574956 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff0480cafb0 msgr2=0x7ff048141ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:36.331 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:36.327+0000 7ff045d9b700 1 --2- 172.21.15.90:0/3498574956 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff0480cafb0 0x7ff048141ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:36.331 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:36.327+0000 7ff045d9b700 1 -- 172.21.15.90:0/3498574956 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff03c009570 con 0x7ff048154350 2023-06-09T04:42:36.332 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:36.327+0000 7ff04659c700 1 --2- 172.21.15.90:0/3498574956 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff0480cafb0 0x7ff048141ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:42:36.332 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:36.327+0000 7ff045d9b700 1 --2- 172.21.15.90:0/3498574956 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff048154350 0x7ff04813e740 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7ff03c00ebe0 tx=0x7ff03c009e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:36.332 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:36.327+0000 7ff036ffd700 1 -- 172.21.15.90:0/3498574956 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff03c00c910 con 0x7ff048154350 2023-06-09T04:42:36.332 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:36.327+0000 7ff036ffd700 1 -- 172.21.15.90:0/3498574956 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff03c00ca70 con 0x7ff048154350 2023-06-09T04:42:36.333 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:36.327+0000 7ff04759e700 1 -- 172.21.15.90:0/3498574956 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff038009a70 con 0x7ff048154350 2023-06-09T04:42:36.333 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:36.327+0000 7ff036ffd700 1 -- 172.21.15.90:0/3498574956 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff03c00cde0 con 0x7ff048154350 2023-06-09T04:42:36.333 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:36.327+0000 7ff04759e700 1 -- 172.21.15.90:0/3498574956 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff04813f1c0 con 0x7ff048154350 2023-06-09T04:42:36.333 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:36.331+0000 7ff04759e700 1 -- 172.21.15.90:0/3498574956 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff04806b390 con 0x7ff048154350 2023-06-09T04:42:36.334 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:36.331+0000 7ff036ffd700 1 -- 172.21.15.90:0/3498574956 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff03c013470 con 0x7ff048154350 2023-06-09T04:42:36.336 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:36.335+0000 7ff036ffd700 1 --2- 172.21.15.90:0/3498574956 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7ff0280662f0 0x7ff0280687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:36.336 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:36.335+0000 7ff036ffd700 1 -- 172.21.15.90:0/3498574956 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7ff03c084300 con 0x7ff048154350 2023-06-09T04:42:36.337 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:36.335+0000 7ff04659c700 1 --2- 172.21.15.90:0/3498574956 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7ff0280662f0 0x7ff0280687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:36.338 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:36.335+0000 7ff04659c700 1 --2- 172.21.15.90:0/3498574956 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7ff0280662f0 0x7ff0280687a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ff038014040 tx=0x7ff038011000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:36.341 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:36.339+0000 7ff036ffd700 1 -- 172.21.15.90:0/3498574956 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff03c051730 con 0x7ff048154350 2023-06-09T04:42:36.510 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:36.507+0000 7ff04759e700 1 -- 172.21.15.90:0/3498574956 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff04804e380 con 0x7ff048154350 2023-06-09T04:42:36.513 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:36.511+0000 7ff036ffd700 1 -- 172.21.15.90:0/3498574956 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18375 (secure 0 0 0) 0x7ff03c054d50 con 0x7ff048154350 2023-06-09T04:42:36.514 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:42:36.514 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":26,"fsid":"700369c0-a111-43b4-9415-844ad1742b70","created":"2023-06-09T04:41:28.180311+0000","modified":"2023-06-09T04:42:36.122304+0000","last_up_change":"2023-06-09T04:41:40.746475+0000","last_in_change":"2023-06-09T04:41:31.262765+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-09T04:41:42.402564+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-09T04:41:47.607323+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-09T04:41:52.543474+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-09T04:41:53.382940+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"46a4a7c5-babd-4ef3-9830-51487cff5eb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":2780271267},{"type":"v1","addr":"172.21.15.90:6809","nonce":2780271267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2780271267},{"type":"v1","addr":"172.21.15.90:6811","nonce":2780271267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2780271267},{"type":"v1","addr":"172.21.15.90:6815","nonce":2780271267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2780271267},{"type":"v1","addr":"172.21.15.90:6813","nonce":2780271267}]},"public_addr":"172.21.15.90:6809/2780271267","cluster_addr":"172.21.15.90:6811/2780271267","heartbeat_back_addr":"172.21.15.90:6815/2780271267","heartbeat_front_addr":"172.21.15.90:6813/2780271267","state":["exists","up"]},{"osd":1,"uuid":"1543988f-c498-494a-a6f9-fac8413db6ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":3064028136},{"type":"v1","addr":"172.21.15.90:6801","nonce":3064028136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":3064028136},{"type":"v1","addr":"172.21.15.90:6803","nonce":3064028136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":3064028136},{"type":"v1","addr":"172.21.15.90:6807","nonce":3064028136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":3064028136},{"type":"v1","addr":"172.21.15.90:6805","nonce":3064028136}]},"public_addr":"172.21.15.90:6801/3064028136","cluster_addr":"172.21.15.90:6803/3064028136","heartbeat_back_addr":"172.21.15.90:6807/3064028136","heartbeat_front_addr":"172.21.15.90:6805/3064028136","state":["exists","up"]},{"osd":2,"uuid":"79669dd6-ffc8-4197-b9f7-b3b372b2b9b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":3713146326},{"type":"v1","addr":"172.21.15.90:6825","nonce":3713146326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":3713146326},{"type":"v1","addr":"172.21.15.90:6827","nonce":3713146326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":3713146326},{"type":"v1","addr":"172.21.15.90:6831","nonce":3713146326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":3713146326},{"type":"v1","addr":"172.21.15.90:6829","nonce":3713146326}]},"public_addr":"172.21.15.90:6825/3713146326","cluster_addr":"172.21.15.90:6827/3713146326","heartbeat_back_addr":"172.21.15.90:6831/3713146326","heartbeat_front_addr":"172.21.15.90:6829/3713146326","state":["exists","up"]},{"osd":3,"uuid":"4062ab6f-ce40-450a-aa17-b10098766c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":3499839122},{"type":"v1","addr":"172.21.15.90:6817","nonce":3499839122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":3499839122},{"type":"v1","addr":"172.21.15.90:6819","nonce":3499839122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":3499839122},{"type":"v1","addr":"172.21.15.90:6823","nonce":3499839122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":3499839122},{"type":"v1","addr":"172.21.15.90:6821","nonce":3499839122}]},"public_addr":"172.21.15.90:6817/3499839122","cluster_addr":"172.21.15.90:6819/3499839122","heartbeat_back_addr":"172.21.15.90:6823/3499839122","heartbeat_front_addr":"172.21.15.90:6821/3499839122","state":["exists","up"]},{"osd":4,"uuid":"a10820e4-b348-4d92-9796-3b01484ace1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6817","nonce":1138565854},{"type":"v1","addr":"172.21.15.174:6819","nonce":1138565854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6821","nonce":1138565854},{"type":"v1","addr":"172.21.15.174:6823","nonce":1138565854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":1138565854},{"type":"v1","addr":"172.21.15.174:6831","nonce":1138565854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":1138565854},{"type":"v1","addr":"172.21.15.174:6829","nonce":1138565854}]},"public_addr":"172.21.15.174:6819/1138565854","cluster_addr":"172.21.15.174:6823/1138565854","heartbeat_back_addr":"172.21.15.174:6831/1138565854","heartbeat_front_addr":"172.21.15.174:6829/1138565854","state":["exists","up"]},{"osd":5,"uuid":"b4da1c32-be05-420b-9346-90d91aa70569","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":1707702879},{"type":"v1","addr":"172.21.15.174:6818","nonce":1707702879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":1707702879},{"type":"v1","addr":"172.21.15.174:6822","nonce":1707702879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6827","nonce":1707702879},{"type":"v1","addr":"172.21.15.174:6828","nonce":1707702879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":1707702879},{"type":"v1","addr":"172.21.15.174:6825","nonce":1707702879}]},"public_addr":"172.21.15.174:6818/1707702879","cluster_addr":"172.21.15.174:6822/1707702879","heartbeat_back_addr":"172.21.15.174:6828/1707702879","heartbeat_front_addr":"172.21.15.174:6825/1707702879","state":["exists","up"]},{"osd":6,"uuid":"d1b98041-d243-4355-bd0a-e22cf9875b32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":864450534},{"type":"v1","addr":"172.21.15.174:6801","nonce":864450534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":864450534},{"type":"v1","addr":"172.21.15.174:6803","nonce":864450534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":864450534},{"type":"v1","addr":"172.21.15.174:6807","nonce":864450534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":864450534},{"type":"v1","addr":"172.21.15.174:6805","nonce":864450534}]},"public_addr":"172.21.15.174:6801/864450534","cluster_addr":"172.21.15.174:6803/864450534","heartbeat_back_addr":"172.21.15.174:6807/864450534","heartbeat_front_addr":"172.21.15.174:6805/864450534","state":["exists","up"]},{"osd":7,"uuid":"5a207936-f89f-416b-b79b-34ec96f77c8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":2527640659},{"type":"v1","addr":"172.21.15.174:6809","nonce":2527640659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":2527640659},{"type":"v1","addr":"172.21.15.174:6811","nonce":2527640659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":2527640659},{"type":"v1","addr":"172.21.15.174:6815","nonce":2527640659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":2527640659},{"type":"v1","addr":"172.21.15.174:6813","nonce":2527640659}]},"public_addr":"172.21.15.174:6809/2527640659","cluster_addr":"172.21.15.174:6811/2527640659","heartbeat_back_addr":"172.21.15.174:6815/2527640659","heartbeat_front_addr":"172.21.15.174:6813/2527640659","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:36.972152+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:36.984561+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:36.998817+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:37.054944+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:37.085014+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:37.115125+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:36.854608+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:36.971685+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.11","mappings":[{"from":3,"to":2}]},{"pgid":"4.3e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:42:36.516 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:36.515+0000 7ff04759e700 1 -- 172.21.15.90:0/3498574956 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7ff0280662f0 msgr2=0x7ff0280687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:36.516 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:36.515+0000 7ff04759e700 1 --2- 172.21.15.90:0/3498574956 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7ff0280662f0 0x7ff0280687a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ff038014040 tx=0x7ff038011000 comp rx=0 tx=0).stop 2023-06-09T04:42:36.516 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:36.515+0000 7ff04759e700 1 -- 172.21.15.90:0/3498574956 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff048154350 msgr2=0x7ff04813e740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:36.516 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:36.515+0000 7ff04759e700 1 --2- 172.21.15.90:0/3498574956 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff048154350 0x7ff04813e740 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7ff03c00ebe0 tx=0x7ff03c009e90 comp rx=0 tx=0).stop 2023-06-09T04:42:36.517 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:36.515+0000 7ff04759e700 1 -- 172.21.15.90:0/3498574956 shutdown_connections 2023-06-09T04:42:36.517 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:36.515+0000 7ff04759e700 1 --2- 172.21.15.90:0/3498574956 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7ff0280662f0 0x7ff0280687a0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:36.517 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:36.515+0000 7ff04759e700 1 --2- 172.21.15.90:0/3498574956 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff04815d7a0 0x7ff048158c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:36.517 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:36.515+0000 7ff04759e700 1 --2- 172.21.15.90:0/3498574956 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff048154350 0x7ff04813e740 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:36.517 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:36.515+0000 7ff04759e700 1 --2- 172.21.15.90:0/3498574956 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff0480cafb0 0x7ff048141ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:36.517 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:36.515+0000 7ff04759e700 1 -- 172.21.15.90:0/3498574956 >> 172.21.15.90:0/3498574956 conn(0x7ff04806c690 msgr2=0x7ff04815a020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:36.518 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:36.515+0000 7ff04759e700 1 -- 172.21.15.90:0/3498574956 shutdown_connections 2023-06-09T04:42:36.518 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:36.515+0000 7ff04759e700 1 -- 172.21.15.90:0/3498574956 wait complete. 2023-06-09T04:42:36.537 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-09T04:41:42.402564+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-09T04:41:47.607323+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-09T04:41:52.543474+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-09T04:41:53.382940+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-09T04:42:36.538 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-09T04:42:36.714 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:36.711+0000 7f137e977700 1 Processor -- start 2023-06-09T04:42:36.715 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:36.711+0000 7f137e977700 1 -- start start 2023-06-09T04:42:36.718 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:36.715+0000 7f137e977700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f13780cc460 0x7f13780ca4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:36.718 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:36.715+0000 7f137e977700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f13780cad00 0x7f13780cb1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:36.719 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:36.715+0000 7f137e977700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13780ca050 con 0x7f1378158d00 2023-06-09T04:42:36.719 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:36.715+0000 7f137e977700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13780cb6e0 con 0x7f13780cc460 2023-06-09T04:42:36.719 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:36.715+0000 7f137e977700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13781590d0 con 0x7f13780cad00 2023-06-09T04:42:36.719 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:36.715+0000 7f137d975700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f1378158d00 0x7f137806a930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:56566/0 (socket says 172.21.15.90:56566) 2023-06-09T04:42:36.720 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:36.715+0000 7f137d975700 1 -- 172.21.15.90:0/1451502951 learned_addr learned my addr 172.21.15.90:0/1451502951 (peer_addr_for_me v1:172.21.15.90:0/0) 2023-06-09T04:42:36.720 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:36.719+0000 7f137d174700 1 --2- 172.21.15.90:0/1451502951 >> v2:172.21.15.174:3300/0 conn(0x7f13780cc460 0x7f13780ca4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:36.720 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:36.719+0000 7f137e176700 1 --2- 172.21.15.90:0/1451502951 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f13780cad00 0x7f13780cb1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:36.721 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:36.719+0000 7f137c973700 1 -- 172.21.15.90:0/1451502951 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 187717819 0 0) 0x7f13780ca050 con 0x7f1378158d00 2023-06-09T04:42:36.721 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:36.719+0000 7f137c973700 1 -- 172.21.15.90:0/1451502951 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f13640035d0 con 0x7f1378158d00 2023-06-09T04:42:36.721 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:36.719+0000 7f137d174700 1 -- 172.21.15.90:0/1451502951 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f13780cad00 msgr2=0x7f13780cb1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:36.721 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:36.719+0000 7f137d174700 1 --2- 172.21.15.90:0/1451502951 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f13780cad00 0x7f13780cb1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:36.722 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:36.719+0000 7f137d174700 1 -- 172.21.15.90:0/1451502951 >> v1:172.21.15.90:6789/0 conn(0x7f1378158d00 legacy=0x7f137806a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:36.722 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:36.719+0000 7f137d174700 1 -- 172.21.15.90:0/1451502951 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13780c91c0 con 0x7f13780cc460 2023-06-09T04:42:36.722 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:36.719+0000 7f137d174700 1 --2- 172.21.15.90:0/1451502951 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f13780cc460 0x7f13780ca4e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f1368009850 tx=0x7f1368009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5a6fc94958522f1c server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:36.722 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:36.719+0000 7f137c973700 1 -- 172.21.15.90:0/1451502951 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1368011830 con 0x7f13780cc460 2023-06-09T04:42:36.722 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:36.719+0000 7f137c973700 1 -- 172.21.15.90:0/1451502951 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1368011990 con 0x7f13780cc460 2023-06-09T04:42:36.722 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:36.719+0000 7f137c973700 1 -- 172.21.15.90:0/1451502951 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1368011d40 con 0x7f13780cc460 2023-06-09T04:42:36.723 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:36.719+0000 7f137e977700 1 -- 172.21.15.90:0/1451502951 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f13780cc460 msgr2=0x7f13780ca4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:36.723 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:36.719+0000 7f137e977700 1 --2- 172.21.15.90:0/1451502951 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f13780cc460 0x7f13780ca4e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f1368009850 tx=0x7f1368009b60 comp rx=0 tx=0).stop 2023-06-09T04:42:36.723 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:36.719+0000 7f137e977700 1 -- 172.21.15.90:0/1451502951 shutdown_connections 2023-06-09T04:42:36.723 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:36.719+0000 7f137e977700 1 --2- 172.21.15.90:0/1451502951 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f13780cad00 0x7f13780cb1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:36.724 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:36.719+0000 7f137e977700 1 --2- 172.21.15.90:0/1451502951 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f13780cc460 0x7f13780ca4e0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:36.724 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:36.719+0000 7f137e977700 1 -- 172.21.15.90:0/1451502951 >> 172.21.15.90:0/1451502951 conn(0x7f13780aff00 msgr2=0x7f13780b0300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:36.724 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:36.723+0000 7f137e977700 1 -- 172.21.15.90:0/1451502951 shutdown_connections 2023-06-09T04:42:36.724 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:36.723+0000 7f137e977700 1 -- 172.21.15.90:0/1451502951 wait complete. 2023-06-09T04:42:36.725 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:36.723+0000 7f137e977700 1 Processor -- start 2023-06-09T04:42:36.725 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:36.723+0000 7f137e977700 1 -- start start 2023-06-09T04:42:36.727 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:36.723+0000 7f137e977700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f13780cad00 0x7f13780c7a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:36.727 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:36.727+0000 7f137e977700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f13780cc460 0x7f13780b1200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:36.727 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:36.727+0000 7f137e977700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1378158d00 0x7f13780b1740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:36.727 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:36.727+0000 7f137e977700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1378155150 con 0x7f1378158d00 2023-06-09T04:42:36.728 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:36.727+0000 7f137e977700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f137814f760 con 0x7f13780cad00 2023-06-09T04:42:36.728 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:36.727+0000 7f137e977700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1378155360 con 0x7f13780cc460 2023-06-09T04:42:36.728 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:36.727+0000 7f137e176700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1378158d00 0x7f13780b1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:36.728 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:36.727+0000 7f137e176700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1378158d00 0x7f13780b1740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:52568/0 (socket says 172.21.15.90:52568) 2023-06-09T04:42:36.728 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:36.727+0000 7f137e176700 1 -- 172.21.15.90:0/3582344763 learned_addr learned my addr 172.21.15.90:0/3582344763 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:36.729 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:36.727+0000 7f137d174700 1 --2- 172.21.15.90:0/3582344763 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f13780cc460 0x7f13780b1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:36.730 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:36.727+0000 7f137d975700 1 --2- 172.21.15.90:0/3582344763 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f13780cad00 0x7f13780c7a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:36.730 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:36.727+0000 7f137e176700 1 -- 172.21.15.90:0/3582344763 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f13780cc460 msgr2=0x7f13780b1200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:36.730 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:36.727+0000 7f137e176700 1 --2- 172.21.15.90:0/3582344763 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f13780cc460 0x7f13780b1200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:36.730 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:36.727+0000 7f137e176700 1 -- 172.21.15.90:0/3582344763 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f13780cad00 msgr2=0x7f13780c7a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:36.730 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:36.727+0000 7f137e176700 1 --2- 172.21.15.90:0/3582344763 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f13780cad00 0x7f13780c7a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:36.730 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:36.727+0000 7f137e176700 1 -- 172.21.15.90:0/3582344763 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13680094b0 con 0x7f1378158d00 2023-06-09T04:42:36.730 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:36.727+0000 7f137e176700 1 --2- 172.21.15.90:0/3582344763 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1378158d00 0x7f13780b1740 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f137000efc0 tx=0x7f137000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:36.731 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:36.727+0000 7f136e7fc700 1 -- 172.21.15.90:0/3582344763 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f137000cd40 con 0x7f1378158d00 2023-06-09T04:42:36.731 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:36.727+0000 7f136e7fc700 1 -- 172.21.15.90:0/3582344763 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f137000f040 con 0x7f1378158d00 2023-06-09T04:42:36.731 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:36.727+0000 7f137e977700 1 -- 172.21.15.90:0/3582344763 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1378155640 con 0x7f1378158d00 2023-06-09T04:42:36.731 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:36.727+0000 7f136e7fc700 1 -- 172.21.15.90:0/3582344763 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13700146c0 con 0x7f1378158d00 2023-06-09T04:42:36.731 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:36.727+0000 7f137e977700 1 -- 172.21.15.90:0/3582344763 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1378155c00 con 0x7f1378158d00 2023-06-09T04:42:36.732 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:36.727+0000 7f137e977700 1 -- 172.21.15.90:0/3582344763 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f137804e380 con 0x7f1378158d00 2023-06-09T04:42:36.732 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:36.731+0000 7f136e7fc700 1 -- 172.21.15.90:0/3582344763 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f1370014820 con 0x7f1378158d00 2023-06-09T04:42:36.732 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:36.731+0000 7f136e7fc700 1 --2- 172.21.15.90:0/3582344763 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f135c0662f0 0x7f135c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:36.733 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:36.731+0000 7f136e7fc700 1 -- 172.21.15.90:0/3582344763 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f13700846b0 con 0x7f1378158d00 2023-06-09T04:42:36.733 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:36.731+0000 7f137d975700 1 --2- 172.21.15.90:0/3582344763 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f135c0662f0 0x7f135c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:36.734 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:36.731+0000 7f137d975700 1 --2- 172.21.15.90:0/3582344763 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f135c0662f0 0x7f135c0687a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f13740011e0 tx=0x7f1374009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:36.738 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:36.735+0000 7f136e7fc700 1 -- 172.21.15.90:0/3582344763 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1370055580 con 0x7f1378158d00 2023-06-09T04:42:36.908 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:36.907+0000 7f137e977700 1 -- 172.21.15.90:0/3582344763 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f13780adb50 con 0x7f1378158d00 2023-06-09T04:42:36.909 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:36.907+0000 7f136e7fc700 1 -- 172.21.15.90:0/3582344763 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1370082e60 con 0x7f1378158d00 2023-06-09T04:42:36.909 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 1 2023-06-09T04:42:36.912 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:36.911+0000 7f137e977700 1 -- 172.21.15.90:0/3582344763 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f135c0662f0 msgr2=0x7f135c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:36.912 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:36.911+0000 7f137e977700 1 --2- 172.21.15.90:0/3582344763 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f135c0662f0 0x7f135c0687a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f13740011e0 tx=0x7f1374009040 comp rx=0 tx=0).stop 2023-06-09T04:42:36.912 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:36.911+0000 7f137e977700 1 -- 172.21.15.90:0/3582344763 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1378158d00 msgr2=0x7f13780b1740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:36.912 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:36.911+0000 7f137e977700 1 --2- 172.21.15.90:0/3582344763 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1378158d00 0x7f13780b1740 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f137000efc0 tx=0x7f137000c3a0 comp rx=0 tx=0).stop 2023-06-09T04:42:36.913 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:36.911+0000 7f137e977700 1 -- 172.21.15.90:0/3582344763 shutdown_connections 2023-06-09T04:42:36.913 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:36.911+0000 7f137e977700 1 --2- 172.21.15.90:0/3582344763 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f135c0662f0 0x7f135c0687a0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:36.913 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:36.911+0000 7f137e977700 1 --2- 172.21.15.90:0/3582344763 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1378158d00 0x7f13780b1740 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:36.913 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:36.911+0000 7f137e977700 1 --2- 172.21.15.90:0/3582344763 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f13780cc460 0x7f13780b1200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:36.914 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:36.911+0000 7f137e977700 1 --2- 172.21.15.90:0/3582344763 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f13780cad00 0x7f13780c7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:36.914 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:36.911+0000 7f137e977700 1 -- 172.21.15.90:0/3582344763 >> 172.21.15.90:0/3582344763 conn(0x7f13780aff00 msgr2=0x7f13780c8600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:36.914 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:36.911+0000 7f137e977700 1 -- 172.21.15.90:0/3582344763 shutdown_connections 2023-06-09T04:42:36.914 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:36.911+0000 7f137e977700 1 -- 172.21.15.90:0/3582344763 wait complete. 2023-06-09T04:42:36.933 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-09T04:42:37.105 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.103+0000 7f89fb59e700 1 Processor -- start 2023-06-09T04:42:37.105 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.103+0000 7f89fb59e700 1 -- start start 2023-06-09T04:42:37.107 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.107+0000 7f89fb59e700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f89fc0d2310 0x7f89fc0b1930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:37.108 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.107+0000 7f89fb59e700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89fc0b84f0 con 0x7f89fc0cd190 2023-06-09T04:42:37.108 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.107+0000 7f89fb59e700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89fc15c3d0 con 0x7f89fc0cf910 2023-06-09T04:42:37.108 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.107+0000 7f89fb59e700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89fc0cff40 con 0x7f89fc0d2310 2023-06-09T04:42:37.108 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.107+0000 7f89fad9d700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f89fc0cd190 0x7f89fc0cd5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:56570/0 (socket says 172.21.15.90:56570) 2023-06-09T04:42:37.109 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.107+0000 7f89fad9d700 1 -- 172.21.15.90:0/4110784065 learned_addr learned my addr 172.21.15.90:0/4110784065 (peer_addr_for_me v1:172.21.15.90:0/0) 2023-06-09T04:42:37.109 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.107+0000 7f89fa59c700 1 --2- 172.21.15.90:0/4110784065 >> v2:172.21.15.174:3300/0 conn(0x7f89fc0d2310 0x7f89fc0b1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:37.110 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.107+0000 7f89f959a700 1 -- 172.21.15.90:0/4110784065 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 94559559 0 0) 0x7f89fc0b84f0 con 0x7f89fc0cd190 2023-06-09T04:42:37.110 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.107+0000 7f89f959a700 1 -- 172.21.15.90:0/4110784065 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f89e40035d0 con 0x7f89fc0cd190 2023-06-09T04:42:37.110 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.107+0000 7f89f959a700 1 -- 172.21.15.90:0/4110784065 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2736207952 0 0) 0x7f89e40035d0 con 0x7f89fc0cd190 2023-06-09T04:42:37.110 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.107+0000 7f89f959a700 1 -- 172.21.15.90:0/4110784065 >> v2:172.21.15.174:3300/0 conn(0x7f89fc0d2310 msgr2=0x7f89fc0b1930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:37.110 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.107+0000 7f89f959a700 1 --2- 172.21.15.90:0/4110784065 >> v2:172.21.15.174:3300/0 conn(0x7f89fc0d2310 0x7f89fc0b1930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:37.110 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.107+0000 7f89f959a700 1 -- 172.21.15.90:0/4110784065 >> v1:172.21.15.174:6789/0 conn(0x7f89fc0cf910 legacy=0x7f89fc0d26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:37.110 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.107+0000 7f89f959a700 1 -- 172.21.15.90:0/4110784065 --> v1:172.21.15.90:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89fc0b7730 con 0x7f89fc0cd190 2023-06-09T04:42:37.111 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.107+0000 7f89f959a700 1 -- 172.21.15.90:0/4110784065 <== mon.0 v1:172.21.15.90:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3604404106 0 0) 0x7f89f40019f0 con 0x7f89fc0cd190 2023-06-09T04:42:37.111 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.107+0000 7f89f959a700 1 -- 172.21.15.90:0/4110784065 >> v1:172.21.15.90:6789/0 conn(0x7f89fc0cd190 legacy=0x7f89fc0cd5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:37.112 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.107+0000 7f89f959a700 1 --2- 172.21.15.90:0/4110784065 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f89e4003a20 0x7f89e4003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:37.112 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.107+0000 7f89f959a700 1 --2- 172.21.15.90:0/4110784065 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f89e4004410 0x7f89e40048d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:37.112 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.107+0000 7f89f959a700 1 --2- 172.21.15.90:0/4110784065 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f89e40050d0 0x7f89e400ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:37.112 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.107+0000 7f89f959a700 1 -- 172.21.15.90:0/4110784065 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89fc0cff40 con 0x7f89e4004410 2023-06-09T04:42:37.113 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.107+0000 7f89f959a700 1 -- 172.21.15.90:0/4110784065 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89e400c020 con 0x7f89e40050d0 2023-06-09T04:42:37.113 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.107+0000 7f89f959a700 1 -- 172.21.15.90:0/4110784065 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89e400c1e0 con 0x7f89e4003a20 2023-06-09T04:42:37.113 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.107+0000 7f89f9d9b700 1 --2- 172.21.15.90:0/4110784065 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f89e4004410 0x7f89e40048d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:37.113 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.107+0000 7f89fa59c700 1 --2- 172.21.15.90:0/4110784065 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f89e4003a20 0x7f89e4003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:37.113 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.107+0000 7f89fad9d700 1 --2- 172.21.15.90:0/4110784065 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f89e40050d0 0x7f89e400ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:37.113 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.111+0000 7f89f9d9b700 1 -- 172.21.15.90:0/4110784065 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f89e4003a20 msgr2=0x7f89e4003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:37.113 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.111+0000 7f89f9d9b700 1 --2- 172.21.15.90:0/4110784065 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f89e4003a20 0x7f89e4003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:37.113 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.111+0000 7f89f9d9b700 1 -- 172.21.15.90:0/4110784065 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f89e40050d0 msgr2=0x7f89e400ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:37.114 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.111+0000 7f89f9d9b700 1 --2- 172.21.15.90:0/4110784065 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f89e40050d0 0x7f89e400ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:37.114 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.111+0000 7f89f9d9b700 1 -- 172.21.15.90:0/4110784065 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89e40035d0 con 0x7f89e4004410 2023-06-09T04:42:37.114 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.111+0000 7f89fad9d700 1 --2- 172.21.15.90:0/4110784065 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f89e40050d0 0x7f89e400ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:42:37.114 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.111+0000 7f89fad9d700 1 -- 172.21.15.90:0/4110784065 reap_dead start 2023-06-09T04:42:37.114 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.111+0000 7f89f9d9b700 1 --2- 172.21.15.90:0/4110784065 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f89e4004410 0x7f89e40048d0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f89f00017e0 tx=0x7f89e40058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32f27bcacf71613d server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:37.114 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.111+0000 7f89f959a700 1 -- 172.21.15.90:0/4110784065 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89f00052d0 con 0x7f89e4004410 2023-06-09T04:42:37.115 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.111+0000 7f89f959a700 1 -- 172.21.15.90:0/4110784065 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89f0005450 con 0x7f89e4004410 2023-06-09T04:42:37.115 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.111+0000 7f89f959a700 1 -- 172.21.15.90:0/4110784065 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89f00038e0 con 0x7f89e4004410 2023-06-09T04:42:37.115 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.111+0000 7f89fb59e700 1 -- 172.21.15.90:0/4110784065 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f89e4004410 msgr2=0x7f89e40048d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:37.115 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.111+0000 7f89fb59e700 1 --2- 172.21.15.90:0/4110784065 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f89e4004410 0x7f89e40048d0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f89f00017e0 tx=0x7f89e40058a0 comp rx=0 tx=0).stop 2023-06-09T04:42:37.116 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.111+0000 7f89fb59e700 1 -- 172.21.15.90:0/4110784065 shutdown_connections 2023-06-09T04:42:37.116 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.111+0000 7f89fb59e700 1 --2- 172.21.15.90:0/4110784065 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f89e4004410 0x7f89e40048d0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:37.116 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.111+0000 7f89fb59e700 1 -- 172.21.15.90:0/4110784065 >> 172.21.15.90:0/4110784065 conn(0x7f89fc09b960 msgr2=0x7f89fc0b5540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:37.116 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.111+0000 7f89fb59e700 1 -- 172.21.15.90:0/4110784065 shutdown_connections 2023-06-09T04:42:37.116 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.111+0000 7f89fb59e700 1 -- 172.21.15.90:0/4110784065 wait complete. 2023-06-09T04:42:37.117 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.115+0000 7f89fb59e700 1 Processor -- start 2023-06-09T04:42:37.117 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.115+0000 7f89fb59e700 1 -- start start 2023-06-09T04:42:37.117 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.115+0000 7f89fb59e700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f89e4004410 0x7f89fc151fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:37.118 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.115+0000 7f89fb59e700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f89fc09c2d0 0x7f89fc15a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:37.118 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.115+0000 7f89fb59e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f89fc15ab60 0x7f89fc0cc080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:37.118 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.115+0000 7f89fb59e700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89fc06b840 con 0x7f89e4004410 2023-06-09T04:42:37.118 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.115+0000 7f89fb59e700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89fc06a950 con 0x7f89fc09c2d0 2023-06-09T04:42:37.118 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.115+0000 7f89fb59e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89fc06ac30 con 0x7f89fc15ab60 2023-06-09T04:42:37.119 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.115+0000 7f89fa59c700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f89e4004410 0x7f89fc151fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:37.120 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.115+0000 7f89fa59c700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f89e4004410 0x7f89fc151fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:52578/0 (socket says 172.21.15.90:52578) 2023-06-09T04:42:37.120 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.115+0000 7f89fa59c700 1 -- 172.21.15.90:0/1329928372 learned_addr learned my addr 172.21.15.90:0/1329928372 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:37.120 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.115+0000 7f89fad9d700 1 --2- 172.21.15.90:0/1329928372 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f89fc15ab60 0x7f89fc0cc080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:37.120 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.115+0000 7f89f9d9b700 1 --2- 172.21.15.90:0/1329928372 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f89fc09c2d0 0x7f89fc15a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:37.120 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.115+0000 7f89fa59c700 1 -- 172.21.15.90:0/1329928372 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f89fc15ab60 msgr2=0x7f89fc0cc080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:37.120 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.115+0000 7f89fa59c700 1 --2- 172.21.15.90:0/1329928372 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f89fc15ab60 0x7f89fc0cc080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:37.120 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.115+0000 7f89fa59c700 1 -- 172.21.15.90:0/1329928372 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f89fc09c2d0 msgr2=0x7f89fc15a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:37.121 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.115+0000 7f89fa59c700 1 --2- 172.21.15.90:0/1329928372 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f89fc09c2d0 0x7f89fc15a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:37.121 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.115+0000 7f89fa59c700 1 -- 172.21.15.90:0/1329928372 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89fc06af10 con 0x7f89e4004410 2023-06-09T04:42:37.121 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.115+0000 7f89f9d9b700 1 --2- 172.21.15.90:0/1329928372 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f89fc09c2d0 0x7f89fc15a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:42:37.121 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.115+0000 7f89fad9d700 1 --2- 172.21.15.90:0/1329928372 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f89fc15ab60 0x7f89fc0cc080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:42:37.121 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.119+0000 7f89fa59c700 1 --2- 172.21.15.90:0/1329928372 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f89e4004410 0x7f89fc151fd0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f89ec011aa0 tx=0x7f89ec011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:37.121 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.119+0000 7f89eaffd700 1 -- 172.21.15.90:0/1329928372 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89ec00f9e0 con 0x7f89e4004410 2023-06-09T04:42:37.121 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.119+0000 7f89eaffd700 1 -- 172.21.15.90:0/1329928372 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89ec00fb40 con 0x7f89e4004410 2023-06-09T04:42:37.121 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.119+0000 7f89fb59e700 1 -- 172.21.15.90:0/1329928372 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89fc06b1f0 con 0x7f89e4004410 2023-06-09T04:42:37.122 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.119+0000 7f89eaffd700 1 -- 172.21.15.90:0/1329928372 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89ec014440 con 0x7f89e4004410 2023-06-09T04:42:37.122 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.119+0000 7f89fb59e700 1 -- 172.21.15.90:0/1329928372 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89fc09c740 con 0x7f89e4004410 2023-06-09T04:42:37.122 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.119+0000 7f89fb59e700 1 -- 172.21.15.90:0/1329928372 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89fc04e380 con 0x7f89e4004410 2023-06-09T04:42:37.122 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.119+0000 7f89eaffd700 1 -- 172.21.15.90:0/1329928372 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f89ec0145a0 con 0x7f89e4004410 2023-06-09T04:42:37.124 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.123+0000 7f89eaffd700 1 --2- 172.21.15.90:0/1329928372 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f89dc066320 0x7f89dc0687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:37.124 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.123+0000 7f89eaffd700 1 -- 172.21.15.90:0/1329928372 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f89ec084530 con 0x7f89e4004410 2023-06-09T04:42:37.124 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.123+0000 7f89f9d9b700 1 --2- 172.21.15.90:0/1329928372 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f89dc066320 0x7f89dc0687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:37.125 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.123+0000 7f89f9d9b700 1 --2- 172.21.15.90:0/1329928372 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f89dc066320 0x7f89dc0687d0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f89fc15ee80 tx=0x7f89f0009030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:37.131 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.127+0000 7f89eaffd700 1 -- 172.21.15.90:0/1329928372 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f89ec051960 con 0x7f89e4004410 2023-06-09T04:42:37.303 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.299+0000 7f89fb59e700 1 -- 172.21.15.90:0/1329928372 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f89fc073bc0 con 0x7f89e4004410 2023-06-09T04:42:37.304 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.303+0000 7f89eaffd700 1 -- 172.21.15.90:0/1329928372 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v26) v1 ==== 92+0+10 (secure 0 0 0) 0x7f89ec054f80 con 0x7f89e4004410 2023-06-09T04:42:37.304 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 8 2023-06-09T04:42:37.306 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.303+0000 7f89fb59e700 1 -- 172.21.15.90:0/1329928372 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f89dc066320 msgr2=0x7f89dc0687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:37.306 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.303+0000 7f89fb59e700 1 --2- 172.21.15.90:0/1329928372 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f89dc066320 0x7f89dc0687d0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f89fc15ee80 tx=0x7f89f0009030 comp rx=0 tx=0).stop 2023-06-09T04:42:37.307 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.303+0000 7f89fb59e700 1 -- 172.21.15.90:0/1329928372 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f89e4004410 msgr2=0x7f89fc151fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:37.307 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.303+0000 7f89fb59e700 1 --2- 172.21.15.90:0/1329928372 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f89e4004410 0x7f89fc151fd0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f89ec011aa0 tx=0x7f89ec011e60 comp rx=0 tx=0).stop 2023-06-09T04:42:37.307 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.303+0000 7f89fb59e700 1 -- 172.21.15.90:0/1329928372 shutdown_connections 2023-06-09T04:42:37.307 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.303+0000 7f89fb59e700 1 --2- 172.21.15.90:0/1329928372 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f89dc066320 0x7f89dc0687d0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:37.307 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.303+0000 7f89fb59e700 1 --2- 172.21.15.90:0/1329928372 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f89fc15ab60 0x7f89fc0cc080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:37.307 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.303+0000 7f89fb59e700 1 --2- 172.21.15.90:0/1329928372 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f89fc09c2d0 0x7f89fc15a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:37.308 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.303+0000 7f89fb59e700 1 --2- 172.21.15.90:0/1329928372 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f89e4004410 0x7f89fc151fd0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:37.308 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.303+0000 7f89fb59e700 1 -- 172.21.15.90:0/1329928372 >> 172.21.15.90:0/1329928372 conn(0x7f89fc09b960 msgr2=0x7f89fc15c750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:37.308 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.303+0000 7f89fb59e700 1 -- 172.21.15.90:0/1329928372 shutdown_connections 2023-06-09T04:42:37.308 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.303+0000 7f89fb59e700 1 -- 172.21.15.90:0/1329928372 wait complete. 2023-06-09T04:42:37.329 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-09T04:42:37.508 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.507+0000 7fc29c1c1700 1 Processor -- start 2023-06-09T04:42:37.509 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.507+0000 7fc29c1c1700 1 -- start start 2023-06-09T04:42:37.512 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.511+0000 7fc29c1c1700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc29415fb30 0x7fc2940cfc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:37.512 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.511+0000 7fc29c1c1700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc2940d26f0 0x7fc2940d2b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:37.514 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.511+0000 7fc29c1c1700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2940d0150 con 0x7fc2940b7820 2023-06-09T04:42:37.514 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.511+0000 7fc29c1c1700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2940d0910 con 0x7fc29415fb30 2023-06-09T04:42:37.515 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.511+0000 7fc29c1c1700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2940d0bf0 con 0x7fc2940d26f0 2023-06-09T04:42:37.515 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.511+0000 7fc299f5d700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc29415fb30 0x7fc2940cfc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:37.515 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.511+0000 7fc29a75e700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7fc2940b7820 0x7fc2940b7ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.90:52402/0 (socket says 172.21.15.90:52402) 2023-06-09T04:42:37.516 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.511+0000 7fc29a75e700 1 -- 172.21.15.90:0/2125265308 learned_addr learned my addr 172.21.15.90:0/2125265308 (peer_addr_for_me v1:172.21.15.90:0/0) 2023-06-09T04:42:37.516 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.511+0000 7fc29975c700 1 --2- 172.21.15.90:0/2125265308 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc2940d26f0 0x7fc2940d2b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:37.516 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.511+0000 7fc298f5b700 1 -- 172.21.15.90:0/2125265308 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 709608794 0 0) 0x7fc2940d0150 con 0x7fc2940b7820 2023-06-09T04:42:37.516 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.511+0000 7fc298f5b700 1 -- 172.21.15.90:0/2125265308 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc2800035d0 con 0x7fc2940b7820 2023-06-09T04:42:37.517 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.511+0000 7fc29975c700 1 -- 172.21.15.90:0/2125265308 >> v2:172.21.15.174:3300/0 conn(0x7fc29415fb30 msgr2=0x7fc2940cfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:37.517 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.511+0000 7fc29975c700 1 --2- 172.21.15.90:0/2125265308 >> v2:172.21.15.174:3300/0 conn(0x7fc29415fb30 0x7fc2940cfc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:37.517 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.511+0000 7fc29975c700 1 -- 172.21.15.90:0/2125265308 >> v1:172.21.15.174:6789/0 conn(0x7fc2940b7820 legacy=0x7fc2940b7ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:37.517 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.511+0000 7fc29975c700 1 -- 172.21.15.90:0/2125265308 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2940d0ed0 con 0x7fc2940d26f0 2023-06-09T04:42:37.519 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.511+0000 7fc29975c700 1 --2- 172.21.15.90:0/2125265308 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc2940d26f0 0x7fc2940d2b40 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc284009850 tx=0x7fc284009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1701b26304c692de server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:37.520 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.515+0000 7fc298f5b700 1 -- 172.21.15.90:0/2125265308 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc284011830 con 0x7fc2940d26f0 2023-06-09T04:42:37.520 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.515+0000 7fc298f5b700 1 -- 172.21.15.90:0/2125265308 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc284011990 con 0x7fc2940d26f0 2023-06-09T04:42:37.520 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.515+0000 7fc298f5b700 1 -- 172.21.15.90:0/2125265308 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc284011d40 con 0x7fc2940d26f0 2023-06-09T04:42:37.520 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.515+0000 7fc29c1c1700 1 -- 172.21.15.90:0/2125265308 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc2940d26f0 msgr2=0x7fc2940d2b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:37.520 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.515+0000 7fc29c1c1700 1 --2- 172.21.15.90:0/2125265308 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc2940d26f0 0x7fc2940d2b40 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc284009850 tx=0x7fc284009b60 comp rx=0 tx=0).stop 2023-06-09T04:42:37.520 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.515+0000 7fc29c1c1700 1 -- 172.21.15.90:0/2125265308 shutdown_connections 2023-06-09T04:42:37.521 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.515+0000 7fc29c1c1700 1 --2- 172.21.15.90:0/2125265308 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc2940d26f0 0x7fc2940d2b40 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:37.521 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.515+0000 7fc29c1c1700 1 --2- 172.21.15.90:0/2125265308 >> v2:172.21.15.174:3300/0 conn(0x7fc29415fb30 0x7fc2940cfc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:37.521 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.515+0000 7fc29c1c1700 1 -- 172.21.15.90:0/2125265308 >> 172.21.15.90:0/2125265308 conn(0x7fc2940b57d0 msgr2=0x7fc2940b5bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:37.521 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.515+0000 7fc29c1c1700 1 -- 172.21.15.90:0/2125265308 shutdown_connections 2023-06-09T04:42:37.521 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.515+0000 7fc29c1c1700 1 -- 172.21.15.90:0/2125265308 wait complete. 2023-06-09T04:42:37.522 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.519+0000 7fc29c1c1700 1 Processor -- start 2023-06-09T04:42:37.522 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.519+0000 7fc29c1c1700 1 -- start start 2023-06-09T04:42:37.522 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.519+0000 7fc29c1c1700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc2940b7820 0x7fc2940b4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:37.523 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.519+0000 7fc29c1c1700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc2940d26f0 0x7fc294150c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:37.523 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.519+0000 7fc29c1c1700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc29415fb30 0x7fc294069820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:37.523 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.519+0000 7fc29c1c1700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2940b48a0 con 0x7fc2940b7820 2023-06-09T04:42:37.523 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.519+0000 7fc29c1c1700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2940b5200 con 0x7fc2940d26f0 2023-06-09T04:42:37.523 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.519+0000 7fc29c1c1700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc29415d1f0 con 0x7fc29415fb30 2023-06-09T04:42:37.523 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.519+0000 7fc299f5d700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc2940b7820 0x7fc2940b4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:37.523 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.519+0000 7fc299f5d700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc2940b7820 0x7fc2940b4cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:52586/0 (socket says 172.21.15.90:52586) 2023-06-09T04:42:37.524 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.519+0000 7fc299f5d700 1 -- 172.21.15.90:0/2674075222 learned_addr learned my addr 172.21.15.90:0/2674075222 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:37.524 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.519+0000 7fc29a75e700 1 --2- 172.21.15.90:0/2674075222 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc29415fb30 0x7fc294069820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:37.524 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.519+0000 7fc29975c700 1 --2- 172.21.15.90:0/2674075222 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc2940d26f0 0x7fc294150c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:37.525 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.523+0000 7fc299f5d700 1 -- 172.21.15.90:0/2674075222 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc29415fb30 msgr2=0x7fc294069820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:37.525 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.523+0000 7fc299f5d700 1 --2- 172.21.15.90:0/2674075222 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc29415fb30 0x7fc294069820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:37.525 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.523+0000 7fc299f5d700 1 -- 172.21.15.90:0/2674075222 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc2940d26f0 msgr2=0x7fc294150c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:37.525 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.523+0000 7fc299f5d700 1 --2- 172.21.15.90:0/2674075222 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc2940d26f0 0x7fc294150c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:37.526 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.523+0000 7fc299f5d700 1 -- 172.21.15.90:0/2674075222 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2840094b0 con 0x7fc2940b7820 2023-06-09T04:42:37.526 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.523+0000 7fc299f5d700 1 --2- 172.21.15.90:0/2674075222 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc2940b7820 0x7fc2940b4cc0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fc29000e870 tx=0x7fc29000eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:37.526 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.523+0000 7fc28a7fc700 1 -- 172.21.15.90:0/2674075222 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2900095a0 con 0x7fc2940b7820 2023-06-09T04:42:37.526 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.523+0000 7fc28a7fc700 1 -- 172.21.15.90:0/2674075222 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc290013680 con 0x7fc2940b7820 2023-06-09T04:42:37.526 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.523+0000 7fc29c1c1700 1 -- 172.21.15.90:0/2674075222 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2941511b0 con 0x7fc2940b7820 2023-06-09T04:42:37.526 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.523+0000 7fc28a7fc700 1 -- 172.21.15.90:0/2674075222 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2900139f0 con 0x7fc2940b7820 2023-06-09T04:42:37.526 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.523+0000 7fc29c1c1700 1 -- 172.21.15.90:0/2674075222 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2940b3f00 con 0x7fc2940b7820 2023-06-09T04:42:37.527 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.523+0000 7fc29c1c1700 1 -- 172.21.15.90:0/2674075222 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2940b4b10 con 0x7fc2940b7820 2023-06-09T04:42:37.527 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.527+0000 7fc28a7fc700 1 -- 172.21.15.90:0/2674075222 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc290013b50 con 0x7fc2940b7820 2023-06-09T04:42:37.529 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.527+0000 7fc28a7fc700 1 --2- 172.21.15.90:0/2674075222 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fc2780662f0 0x7fc2780687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:37.529 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.527+0000 7fc28a7fc700 1 -- 172.21.15.90:0/2674075222 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fc290083c00 con 0x7fc2940b7820 2023-06-09T04:42:37.530 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.527+0000 7fc29975c700 1 --2- 172.21.15.90:0/2674075222 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fc2780662f0 0x7fc2780687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:37.531 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.531+0000 7fc29975c700 1 --2- 172.21.15.90:0/2674075222 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fc2780662f0 0x7fc2780687a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fc2840090b0 tx=0x7fc284008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:37.536 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.535+0000 7fc28a7fc700 1 -- 172.21.15.90:0/2674075222 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc290054a30 con 0x7fc2940b7820 2023-06-09T04:42:37.704 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.703+0000 7fc29c1c1700 1 -- 172.21.15.90:0/2674075222 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc29404db30 con 0x7fc2940b7820 2023-06-09T04:42:37.705 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.703+0000 7fc28a7fc700 1 -- 172.21.15.90:0/2674075222 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc2900545c0 con 0x7fc2940b7820 2023-06-09T04:42:37.705 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 32 2023-06-09T04:42:37.708 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.707+0000 7fc29c1c1700 1 -- 172.21.15.90:0/2674075222 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fc2780662f0 msgr2=0x7fc2780687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:37.708 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.707+0000 7fc29c1c1700 1 --2- 172.21.15.90:0/2674075222 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fc2780662f0 0x7fc2780687a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fc2840090b0 tx=0x7fc284008030 comp rx=0 tx=0).stop 2023-06-09T04:42:37.708 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.707+0000 7fc29c1c1700 1 -- 172.21.15.90:0/2674075222 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc2940b7820 msgr2=0x7fc2940b4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:37.708 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.707+0000 7fc29c1c1700 1 --2- 172.21.15.90:0/2674075222 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc2940b7820 0x7fc2940b4cc0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fc29000e870 tx=0x7fc29000eb80 comp rx=0 tx=0).stop 2023-06-09T04:42:37.708 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.707+0000 7fc29c1c1700 1 -- 172.21.15.90:0/2674075222 shutdown_connections 2023-06-09T04:42:37.709 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.707+0000 7fc29c1c1700 1 --2- 172.21.15.90:0/2674075222 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fc2780662f0 0x7fc2780687a0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:37.709 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.707+0000 7fc29c1c1700 1 --2- 172.21.15.90:0/2674075222 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc29415fb30 0x7fc294069820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:37.709 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.707+0000 7fc29c1c1700 1 --2- 172.21.15.90:0/2674075222 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc2940d26f0 0x7fc294150c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:37.709 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.707+0000 7fc29c1c1700 1 --2- 172.21.15.90:0/2674075222 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc2940b7820 0x7fc2940b4cc0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:37.710 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.707+0000 7fc29c1c1700 1 -- 172.21.15.90:0/2674075222 >> 172.21.15.90:0/2674075222 conn(0x7fc2940b57d0 msgr2=0x7fc29415ed60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:37.710 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.707+0000 7fc29c1c1700 1 -- 172.21.15.90:0/2674075222 shutdown_connections 2023-06-09T04:42:37.710 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.707+0000 7fc29c1c1700 1 -- 172.21.15.90:0/2674075222 wait complete. 2023-06-09T04:42:37.727 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-09T04:42:37.900 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.899+0000 7f294d469700 1 Processor -- start 2023-06-09T04:42:37.900 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.899+0000 7f294d469700 1 -- start start 2023-06-09T04:42:37.903 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.903+0000 7f294d469700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f294815de00 0x7f29481612e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:37.903 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.903+0000 7f294d469700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f29480c3170 0x7f29480c35f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:37.903 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.903+0000 7f294d469700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29480cc230 con 0x7f29480cda20 2023-06-09T04:42:37.903 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.903+0000 7f294d469700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29480cde90 con 0x7f29480c3170 2023-06-09T04:42:37.904 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.903+0000 7f294d469700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f294806ab90 con 0x7f294815de00 2023-06-09T04:42:37.904 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.903+0000 7f2946ffd700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f294815de00 0x7f29481612e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:37.904 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.903+0000 7f29477fe700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f29480c3170 0x7f29480c35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:37.904 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.903+0000 7f2946ffd700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f294815de00 0x7f29481612e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.90:37778/0 (socket says 172.21.15.90:37778) 2023-06-09T04:42:37.905 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.903+0000 7f2946ffd700 1 -- 172.21.15.90:0/3874067769 learned_addr learned my addr 172.21.15.90:0/3874067769 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:37.905 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.903+0000 7f29477fe700 1 -- 172.21.15.90:0/3874067769 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f294815de00 msgr2=0x7f29481612e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:37.905 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.903+0000 7f29477fe700 1 --2- 172.21.15.90:0/3874067769 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f294815de00 0x7f29481612e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:37.905 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.903+0000 7f29477fe700 1 -- 172.21.15.90:0/3874067769 >> v1:172.21.15.174:6789/0 conn(0x7f29480cda20 legacy=0x7f29480c4640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:37.906 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.903+0000 7f29477fe700 1 -- 172.21.15.90:0/3874067769 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f294815e1d0 con 0x7f29480c3170 2023-06-09T04:42:37.906 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.903+0000 7f2945ffb700 1 -- 172.21.15.90:0/3874067769 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2420956051 0 0) 0x7f29480cc230 con 0x7f29480cda20 2023-06-09T04:42:37.906 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.903+0000 7f29477fe700 1 --2- 172.21.15.90:0/3874067769 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f29480c3170 0x7f29480c35f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f2940009d90 tx=0x7f294000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ad4a68b62b1a258d server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:37.907 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.903+0000 7f2945ffb700 1 -- 172.21.15.90:0/3874067769 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f294000e070 con 0x7f29480c3170 2023-06-09T04:42:37.907 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.903+0000 7f2945ffb700 1 -- 172.21.15.90:0/3874067769 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f294000bb20 con 0x7f29480c3170 2023-06-09T04:42:37.907 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.903+0000 7f2945ffb700 1 -- 172.21.15.90:0/3874067769 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2940012430 con 0x7f29480c3170 2023-06-09T04:42:37.907 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.907+0000 7f294d469700 1 -- 172.21.15.90:0/3874067769 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f29480c3170 msgr2=0x7f29480c35f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:37.908 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.907+0000 7f294d469700 1 --2- 172.21.15.90:0/3874067769 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f29480c3170 0x7f29480c35f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f2940009d90 tx=0x7f294000b330 comp rx=0 tx=0).stop 2023-06-09T04:42:37.908 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.907+0000 7f294d469700 1 -- 172.21.15.90:0/3874067769 shutdown_connections 2023-06-09T04:42:37.908 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.907+0000 7f294d469700 1 --2- 172.21.15.90:0/3874067769 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f29480c3170 0x7f29480c35f0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:37.908 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.907+0000 7f294d469700 1 --2- 172.21.15.90:0/3874067769 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f294815de00 0x7f29481612e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:37.908 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.907+0000 7f294d469700 1 -- 172.21.15.90:0/3874067769 >> 172.21.15.90:0/3874067769 conn(0x7f29480aff00 msgr2=0x7f29480b0300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:37.909 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.907+0000 7f294d469700 1 -- 172.21.15.90:0/3874067769 shutdown_connections 2023-06-09T04:42:37.909 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.907+0000 7f294d469700 1 -- 172.21.15.90:0/3874067769 wait complete. 2023-06-09T04:42:37.911 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.911+0000 7f294d469700 1 Processor -- start 2023-06-09T04:42:37.911 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.911+0000 7f294d469700 1 -- start start 2023-06-09T04:42:37.912 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.911+0000 7f294d469700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f29480c3170 0x7f294814e730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:37.913 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.911+0000 7f294d469700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f29480cda20 0x7f2948161e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:37.913 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.911+0000 7f294d469700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f294815de00 0x7f29480b1200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:37.913 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.911+0000 7f294d469700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29480b4140 con 0x7f29480c3170 2023-06-09T04:42:37.913 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.911+0000 7f294d469700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2948162380 con 0x7f29480cda20 2023-06-09T04:42:37.913 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.911+0000 7f294d469700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29480b3530 con 0x7f294815de00 2023-06-09T04:42:37.914 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.911+0000 7f2946ffd700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f29480c3170 0x7f294814e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:37.914 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.911+0000 7f2946ffd700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f29480c3170 0x7f294814e730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:52596/0 (socket says 172.21.15.90:52596) 2023-06-09T04:42:37.915 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.911+0000 7f2946ffd700 1 -- 172.21.15.90:0/1050076588 learned_addr learned my addr 172.21.15.90:0/1050076588 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:37.915 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.911+0000 7f29477fe700 1 --2- 172.21.15.90:0/1050076588 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f294815de00 0x7f29480b1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:37.915 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.911+0000 7f29467fc700 1 --2- 172.21.15.90:0/1050076588 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f29480cda20 0x7f2948161e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:37.915 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.911+0000 7f2946ffd700 1 -- 172.21.15.90:0/1050076588 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f294815de00 msgr2=0x7f29480b1200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:37.915 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.911+0000 7f2946ffd700 1 --2- 172.21.15.90:0/1050076588 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f294815de00 0x7f29480b1200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:37.915 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.911+0000 7f2946ffd700 1 -- 172.21.15.90:0/1050076588 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f29480cda20 msgr2=0x7f2948161e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:37.915 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.911+0000 7f2946ffd700 1 --2- 172.21.15.90:0/1050076588 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f29480cda20 0x7f2948161e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:37.915 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.911+0000 7f2946ffd700 1 -- 172.21.15.90:0/1050076588 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2940009a70 con 0x7f29480c3170 2023-06-09T04:42:37.916 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.911+0000 7f2946ffd700 1 --2- 172.21.15.90:0/1050076588 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f29480c3170 0x7f294814e730 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f293800e960 tx=0x7f293800ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:37.916 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.915+0000 7f292f7fe700 1 -- 172.21.15.90:0/1050076588 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29380096c0 con 0x7f29480c3170 2023-06-09T04:42:37.916 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.915+0000 7f292f7fe700 1 -- 172.21.15.90:0/1050076588 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2938013680 con 0x7f29480c3170 2023-06-09T04:42:37.917 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.915+0000 7f294d469700 1 -- 172.21.15.90:0/1050076588 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29480b3810 con 0x7f29480c3170 2023-06-09T04:42:37.917 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.915+0000 7f292f7fe700 1 -- 172.21.15.90:0/1050076588 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2938013a30 con 0x7f29480c3170 2023-06-09T04:42:37.917 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.915+0000 7f294d469700 1 -- 172.21.15.90:0/1050076588 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29480b3dd0 con 0x7f29480c3170 2023-06-09T04:42:37.917 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.915+0000 7f294d469700 1 -- 172.21.15.90:0/1050076588 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f294804e380 con 0x7f29480c3170 2023-06-09T04:42:37.919 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.915+0000 7f292f7fe700 1 -- 172.21.15.90:0/1050076588 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2938013b90 con 0x7f29480c3170 2023-06-09T04:42:37.920 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.919+0000 7f292f7fe700 1 --2- 172.21.15.90:0/1050076588 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f29340662f0 0x7f29340687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:37.921 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.919+0000 7f292f7fe700 1 -- 172.21.15.90:0/1050076588 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f2938083d00 con 0x7f29480c3170 2023-06-09T04:42:37.921 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.919+0000 7f29467fc700 1 --2- 172.21.15.90:0/1050076588 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f29340662f0 0x7f29340687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:37.922 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.919+0000 7f29467fc700 1 --2- 172.21.15.90:0/1050076588 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f29340662f0 0x7f29340687a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f29480cacb0 tx=0x7f293c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:37.926 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:37.923+0000 7f292f7fe700 1 -- 172.21.15.90:0/1050076588 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f29380510a0 con 0x7f29480c3170 2023-06-09T04:42:38.096 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:38.095+0000 7f294d469700 1 -- 172.21.15.90:0/1050076588 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f29480b0a80 con 0x7f29480c3170 2023-06-09T04:42:38.096 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:38.095+0000 7f292f7fe700 1 -- 172.21.15.90:0/1050076588 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f29380546c0 con 0x7f29480c3170 2023-06-09T04:42:38.097 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 64 2023-06-09T04:42:38.100 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:38.099+0000 7f294d469700 1 -- 172.21.15.90:0/1050076588 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f29340662f0 msgr2=0x7f29340687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:38.101 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:38.099+0000 7f294d469700 1 --2- 172.21.15.90:0/1050076588 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f29340662f0 0x7f29340687a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f29480cacb0 tx=0x7f293c009040 comp rx=0 tx=0).stop 2023-06-09T04:42:38.101 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:38.099+0000 7f294d469700 1 -- 172.21.15.90:0/1050076588 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f29480c3170 msgr2=0x7f294814e730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:38.101 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:38.099+0000 7f294d469700 1 --2- 172.21.15.90:0/1050076588 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f29480c3170 0x7f294814e730 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f293800e960 tx=0x7f293800ec70 comp rx=0 tx=0).stop 2023-06-09T04:42:38.101 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:38.099+0000 7f294d469700 1 -- 172.21.15.90:0/1050076588 shutdown_connections 2023-06-09T04:42:38.101 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:38.099+0000 7f294d469700 1 --2- 172.21.15.90:0/1050076588 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f29340662f0 0x7f29340687a0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:38.101 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:38.099+0000 7f294d469700 1 --2- 172.21.15.90:0/1050076588 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f294815de00 0x7f29480b1200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:38.101 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:38.099+0000 7f294d469700 1 --2- 172.21.15.90:0/1050076588 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f29480cda20 0x7f2948161e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:38.102 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:38.099+0000 7f294d469700 1 --2- 172.21.15.90:0/1050076588 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f29480c3170 0x7f294814e730 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:38.102 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:38.099+0000 7f294d469700 1 -- 172.21.15.90:0/1050076588 >> 172.21.15.90:0/1050076588 conn(0x7f29480aff00 msgr2=0x7f294806f860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:38.102 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:38.099+0000 7f294d469700 1 -- 172.21.15.90:0/1050076588 shutdown_connections 2023-06-09T04:42:38.102 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:38.099+0000 7f294d469700 1 -- 172.21.15.90:0/1050076588 wait complete. 2023-06-09T04:42:38.121 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-06-09T04:42:38.285 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:38.283+0000 7f238e66d700 1 Processor -- start 2023-06-09T04:42:38.286 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:38.283+0000 7f238e66d700 1 -- start start 2023-06-09T04:42:38.288 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:38.287+0000 7f238e66d700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f238815c3d0 0x7f238806d400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:38.288 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:38.287+0000 7f238e66d700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f23880711b0 0x7f23880b3600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:38.289 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:38.287+0000 7f238e66d700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23880cd420 con 0x7f238806d940 2023-06-09T04:42:38.289 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:38.287+0000 7f238e66d700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23880cbab0 con 0x7f23880711b0 2023-06-09T04:42:38.289 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:38.287+0000 7f238e66d700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f238815c7a0 con 0x7f238815c3d0 2023-06-09T04:42:38.290 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:38.287+0000 7f238ce6a700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f238806d940 0x7f2388070aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:56574/0 (socket says 172.21.15.90:56574) 2023-06-09T04:42:38.290 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:38.287+0000 7f238ce6a700 1 -- 172.21.15.90:0/4039241256 learned_addr learned my addr 172.21.15.90:0/4039241256 (peer_addr_for_me v1:172.21.15.90:0/0) 2023-06-09T04:42:38.290 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:38.287+0000 7f238de6c700 1 --2- 172.21.15.90:0/4039241256 >> v2:172.21.15.90:3300/0 conn(0x7f23880711b0 0x7f23880b3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:38.290 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:38.287+0000 7f238d66b700 1 --2- 172.21.15.90:0/4039241256 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f238815c3d0 0x7f238806d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:38.290 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:38.287+0000 7f238de6c700 1 -- 172.21.15.90:0/4039241256 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f238815c3d0 msgr2=0x7f238806d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:38.290 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:38.287+0000 7f238de6c700 1 --2- 172.21.15.90:0/4039241256 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f238815c3d0 0x7f238806d400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:38.290 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:38.287+0000 7f238de6c700 1 -- 172.21.15.90:0/4039241256 >> v1:172.21.15.90:6789/0 conn(0x7f238806d940 legacy=0x7f2388070aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:38.291 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:38.287+0000 7f238de6c700 1 -- 172.21.15.90:0/4039241256 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23880cd700 con 0x7f23880711b0 2023-06-09T04:42:38.291 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:38.287+0000 7f238de6c700 1 --2- 172.21.15.90:0/4039241256 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f23880711b0 0x7f23880b3600 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f2380009dc0 tx=0x7f238000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c0c194c2c728892 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:38.291 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:38.287+0000 7f2387fff700 1 -- 172.21.15.90:0/4039241256 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f238000e070 con 0x7f23880711b0 2023-06-09T04:42:38.292 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:38.287+0000 7f2387fff700 1 -- 172.21.15.90:0/4039241256 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f238000bb90 con 0x7f23880711b0 2023-06-09T04:42:38.292 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:38.287+0000 7f2387fff700 1 -- 172.21.15.90:0/4039241256 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2380012430 con 0x7f23880711b0 2023-06-09T04:42:38.292 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:38.291+0000 7f238e66d700 1 -- 172.21.15.90:0/4039241256 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f23880711b0 msgr2=0x7f23880b3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:38.292 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:38.291+0000 7f238e66d700 1 --2- 172.21.15.90:0/4039241256 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f23880711b0 0x7f23880b3600 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f2380009dc0 tx=0x7f238000b330 comp rx=0 tx=0).stop 2023-06-09T04:42:38.293 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:38.291+0000 7f238e66d700 1 -- 172.21.15.90:0/4039241256 shutdown_connections 2023-06-09T04:42:38.293 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:38.291+0000 7f238e66d700 1 --2- 172.21.15.90:0/4039241256 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f23880711b0 0x7f23880b3600 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:38.293 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:38.291+0000 7f238e66d700 1 --2- 172.21.15.90:0/4039241256 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f238815c3d0 0x7f238806d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:38.293 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:38.291+0000 7f238e66d700 1 -- 172.21.15.90:0/4039241256 >> 172.21.15.90:0/4039241256 conn(0x7f23880cf4e0 msgr2=0x7f23880cf8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:38.293 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:38.291+0000 7f238e66d700 1 -- 172.21.15.90:0/4039241256 shutdown_connections 2023-06-09T04:42:38.293 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:38.291+0000 7f238e66d700 1 -- 172.21.15.90:0/4039241256 wait complete. 2023-06-09T04:42:38.295 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:38.295+0000 7f238e66d700 1 Processor -- start 2023-06-09T04:42:38.295 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:38.295+0000 7f238e66d700 1 -- start start 2023-06-09T04:42:38.296 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:38.295+0000 7f238e66d700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f238806d940 0x7f238814d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:38.297 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:38.295+0000 7f238e66d700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f23880711b0 0x7f238806be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:38.297 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:38.295+0000 7f238e66d700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f238815c3d0 0x7f23881f0a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:38.297 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:38.295+0000 7f238e66d700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23880c37e0 con 0x7f23880711b0 2023-06-09T04:42:38.297 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:38.295+0000 7f238e66d700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f238806c800 con 0x7f238806d940 2023-06-09T04:42:38.297 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:38.295+0000 7f238e66d700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f238806cae0 con 0x7f238815c3d0 2023-06-09T04:42:38.298 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:38.295+0000 7f238ce6a700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f23880711b0 0x7f238806be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:38.298 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:38.295+0000 7f238ce6a700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f23880711b0 0x7f238806be40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:52608/0 (socket says 172.21.15.90:52608) 2023-06-09T04:42:38.298 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:38.295+0000 7f238ce6a700 1 -- 172.21.15.90:0/2950886133 learned_addr learned my addr 172.21.15.90:0/2950886133 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:38.299 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:38.295+0000 7f238d66b700 1 --2- 172.21.15.90:0/2950886133 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f238806d940 0x7f238814d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:38.299 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:38.295+0000 7f238de6c700 1 --2- 172.21.15.90:0/2950886133 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f238815c3d0 0x7f23881f0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:38.299 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:38.295+0000 7f238ce6a700 1 -- 172.21.15.90:0/2950886133 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f238815c3d0 msgr2=0x7f23881f0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:38.299 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:38.295+0000 7f238ce6a700 1 --2- 172.21.15.90:0/2950886133 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f238815c3d0 0x7f23881f0a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:38.299 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:38.295+0000 7f238ce6a700 1 -- 172.21.15.90:0/2950886133 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f238806d940 msgr2=0x7f238814d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:38.299 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:38.295+0000 7f238ce6a700 1 --2- 172.21.15.90:0/2950886133 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f238806d940 0x7f238814d350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:38.299 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:38.295+0000 7f238ce6a700 1 -- 172.21.15.90:0/2950886133 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2380009a70 con 0x7f23880711b0 2023-06-09T04:42:38.299 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:38.295+0000 7f238d66b700 1 --2- 172.21.15.90:0/2950886133 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f238806d940 0x7f238814d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:42:38.300 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:38.295+0000 7f238ce6a700 1 --2- 172.21.15.90:0/2950886133 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f23880711b0 0x7f238806be40 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f237c001eb0 tx=0x7f237c00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:38.300 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:38.295+0000 7f2385ffb700 1 -- 172.21.15.90:0/2950886133 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f237c005d90 con 0x7f23880711b0 2023-06-09T04:42:38.300 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:38.295+0000 7f2385ffb700 1 -- 172.21.15.90:0/2950886133 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f237c0070d0 con 0x7f23880711b0 2023-06-09T04:42:38.301 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:38.295+0000 7f2385ffb700 1 -- 172.21.15.90:0/2950886133 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f237c007440 con 0x7f23880711b0 2023-06-09T04:42:38.301 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:38.295+0000 7f238e66d700 1 -- 172.21.15.90:0/2950886133 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f238806cdc0 con 0x7f23880711b0 2023-06-09T04:42:38.301 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:38.299+0000 7f238e66d700 1 -- 172.21.15.90:0/2950886133 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f238814d890 con 0x7f23880711b0 2023-06-09T04:42:38.301 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:38.299+0000 7f238e66d700 1 -- 172.21.15.90:0/2950886133 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23880c3920 con 0x7f23880711b0 2023-06-09T04:42:38.302 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:38.299+0000 7f2385ffb700 1 -- 172.21.15.90:0/2950886133 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f237c0075a0 con 0x7f23880711b0 2023-06-09T04:42:38.303 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:38.303+0000 7f2385ffb700 1 --2- 172.21.15.90:0/2950886133 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f23740662f0 0x7f23740687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:38.303 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:38.303+0000 7f2385ffb700 1 -- 172.21.15.90:0/2950886133 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f237c083130 con 0x7f23880711b0 2023-06-09T04:42:38.303 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:38.303+0000 7f238d66b700 1 --2- 172.21.15.90:0/2950886133 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f23740662f0 0x7f23740687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:38.305 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:38.303+0000 7f238d66b700 1 --2- 172.21.15.90:0/2950886133 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f23740662f0 0x7f23740687a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f2378007a70 tx=0x7f2378008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:38.310 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:38.307+0000 7f2385ffb700 1 -- 172.21.15.90:0/2950886133 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f23880c3920 con 0x7f23880711b0 2023-06-09T04:42:38.495 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:38.495+0000 7f238e66d700 1 -- 172.21.15.90:0/2950886133 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f23880c3920 con 0x7f23880711b0 2023-06-09T04:42:38.496 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:38.495+0000 7f2385ffb700 1 -- 172.21.15.90:0/2950886133 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7f23880c3920 con 0x7f23880711b0 2023-06-09T04:42:38.499 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:38.495+0000 7f238e66d700 1 -- 172.21.15.90:0/2950886133 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f23740662f0 msgr2=0x7f23740687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:38.499 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:38.495+0000 7f238e66d700 1 --2- 172.21.15.90:0/2950886133 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f23740662f0 0x7f23740687a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f2378007a70 tx=0x7f2378008040 comp rx=0 tx=0).stop 2023-06-09T04:42:38.499 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:38.495+0000 7f238e66d700 1 -- 172.21.15.90:0/2950886133 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f23880711b0 msgr2=0x7f238806be40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:38.499 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:38.495+0000 7f238e66d700 1 --2- 172.21.15.90:0/2950886133 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f23880711b0 0x7f238806be40 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f237c001eb0 tx=0x7f237c00c860 comp rx=0 tx=0).stop 2023-06-09T04:42:38.500 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:38.499+0000 7f238e66d700 1 -- 172.21.15.90:0/2950886133 shutdown_connections 2023-06-09T04:42:38.500 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:38.499+0000 7f238e66d700 1 --2- 172.21.15.90:0/2950886133 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f23740662f0 0x7f23740687a0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:38.500 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:38.499+0000 7f238e66d700 1 --2- 172.21.15.90:0/2950886133 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f238815c3d0 0x7f23881f0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:38.500 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:38.499+0000 7f238e66d700 1 --2- 172.21.15.90:0/2950886133 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f23880711b0 0x7f238806be40 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:38.500 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:38.499+0000 7f238e66d700 1 --2- 172.21.15.90:0/2950886133 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f238806d940 0x7f238814d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:38.500 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:38.499+0000 7f238e66d700 1 -- 172.21.15.90:0/2950886133 >> 172.21.15.90:0/2950886133 conn(0x7f23880cf4e0 msgr2=0x7f23880aeff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:38.500 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:38.499+0000 7f238e66d700 1 -- 172.21.15.90:0/2950886133 shutdown_connections 2023-06-09T04:42:38.501 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:38.499+0000 7f238e66d700 1 -- 172.21.15.90:0/2950886133 wait complete. 2023-06-09T04:42:38.501 INFO:teuthology.orchestra.run.smithi090.stderr:listed 0 entries 2023-06-09T04:42:38.520 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2023-06-09T04:42:38.520 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:42:38.521 DEBUG:teuthology.orchestra.run.smithi090:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2023-06-09T04:42:38.575 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi090.front.sepia.ceph.com 2023-06-09T04:42:38.576 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:42:38.576 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-06-09T04:42:38.595 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2023-06-09T04:42:38.595 DEBUG:teuthology.orchestra.run.smithi174:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-09T04:42:38.612 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2023-06-09T04:42:38.613 DEBUG:teuthology.orchestra.run.smithi174:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-09T04:42:38.676 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2023-06-09T04:42:38.676 DEBUG:teuthology.orchestra.run.smithi174:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-09T04:42:38.736 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T04:42:38.915 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:38.915+0000 7f91f8a93700 1 Processor -- start 2023-06-09T04:42:38.916 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:38.915+0000 7f91f8a93700 1 -- start start 2023-06-09T04:42:38.918 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:38.915+0000 7f91f8a93700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f91f40cb310 0x7f91f40cdb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:38.918 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:38.915+0000 7f91f8a93700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f91f41608d0 0x7f91f4160d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:38.918 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:38.915+0000 7f91f8a93700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91f41647b0 con 0x7f91f41574c0 2023-06-09T04:42:38.919 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:38.915+0000 7f91f8a93700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91f4157890 con 0x7f91f40cb310 2023-06-09T04:42:38.919 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:38.915+0000 7f91f8a93700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91f40ce040 con 0x7f91f41608d0 2023-06-09T04:42:38.919 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:38.919+0000 7f91f2ffd700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f91f40cb310 0x7f91f40cdb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:38.919 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:38.919+0000 7f91f37fe700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f91f41574c0 0x7f91f40cac00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.90:52414/0 (socket says 172.21.15.90:52414) 2023-06-09T04:42:38.920 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:38.919+0000 7f91f37fe700 1 -- 172.21.15.90:0/4102920284 learned_addr learned my addr 172.21.15.90:0/4102920284 (peer_addr_for_me v1:172.21.15.90:0/0) 2023-06-09T04:42:38.920 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:38.919+0000 7f91f3fff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f91f41608d0 0x7f91f4160d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:38.921 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:38.919+0000 7f91f27fc700 1 -- 172.21.15.90:0/4102920284 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2883199753 0 0) 0x7f91f41647b0 con 0x7f91f41574c0 2023-06-09T04:42:38.921 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:38.919+0000 7f91f27fc700 1 -- 172.21.15.90:0/4102920284 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f91dc0035d0 con 0x7f91f41574c0 2023-06-09T04:42:38.921 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:38.919+0000 7f91f2ffd700 1 -- 172.21.15.90:0/4102920284 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f91f41608d0 msgr2=0x7f91f4160d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:38.921 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:38.919+0000 7f91f2ffd700 1 --2- 172.21.15.90:0/4102920284 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f91f41608d0 0x7f91f4160d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:38.921 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:38.919+0000 7f91f2ffd700 1 -- 172.21.15.90:0/4102920284 >> v1:172.21.15.174:6789/0 conn(0x7f91f41574c0 legacy=0x7f91f40cac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:38.921 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:38.919+0000 7f91f2ffd700 1 -- 172.21.15.90:0/4102920284 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91f4163ec0 con 0x7f91f40cb310 2023-06-09T04:42:38.921 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:38.919+0000 7f91f3fff700 1 --2- 172.21.15.90:0/4102920284 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f91f41608d0 0x7f91f4160d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:42:38.922 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:38.919+0000 7f91f2ffd700 1 --2- 172.21.15.90:0/4102920284 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f91f40cb310 0x7f91f40cdb00 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f91e8009850 tx=0x7f91e8009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99a733abf9c85cdf server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:38.922 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:38.919+0000 7f91f27fc700 1 -- 172.21.15.90:0/4102920284 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91e8011830 con 0x7f91f40cb310 2023-06-09T04:42:38.923 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:38.919+0000 7f91f27fc700 1 -- 172.21.15.90:0/4102920284 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91e8011990 con 0x7f91f40cb310 2023-06-09T04:42:38.923 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:38.919+0000 7f91f27fc700 1 -- 172.21.15.90:0/4102920284 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91e8011d40 con 0x7f91f40cb310 2023-06-09T04:42:38.923 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:38.919+0000 7f91f8a93700 1 -- 172.21.15.90:0/4102920284 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f91f40cb310 msgr2=0x7f91f40cdb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:38.923 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:38.919+0000 7f91f8a93700 1 --2- 172.21.15.90:0/4102920284 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f91f40cb310 0x7f91f40cdb00 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f91e8009850 tx=0x7f91e8009b60 comp rx=0 tx=0).stop 2023-06-09T04:42:38.923 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:38.919+0000 7f91f8a93700 1 -- 172.21.15.90:0/4102920284 shutdown_connections 2023-06-09T04:42:38.923 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:38.919+0000 7f91f8a93700 1 --2- 172.21.15.90:0/4102920284 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f91f41608d0 0x7f91f4160d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:38.923 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:38.919+0000 7f91f8a93700 1 --2- 172.21.15.90:0/4102920284 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f91f40cb310 0x7f91f40cdb00 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:38.924 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:38.919+0000 7f91f8a93700 1 -- 172.21.15.90:0/4102920284 >> 172.21.15.90:0/4102920284 conn(0x7f91f406c690 msgr2=0x7f91f40aff00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:38.924 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:38.919+0000 7f91f8a93700 1 -- 172.21.15.90:0/4102920284 shutdown_connections 2023-06-09T04:42:38.924 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:38.919+0000 7f91f8a93700 1 -- 172.21.15.90:0/4102920284 wait complete. 2023-06-09T04:42:38.925 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:38.923+0000 7f91f8a93700 1 Processor -- start 2023-06-09T04:42:38.926 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:38.923+0000 7f91f8a93700 1 -- start start 2023-06-09T04:42:38.927 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:38.927+0000 7f91f8a93700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f91f40cb310 0x7f91f4155ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:38.928 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:38.927+0000 7f91f8a93700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f91f41574c0 0x7f91f40b3570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:38.928 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:38.927+0000 7f91f8a93700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f91f41608d0 0x7f91f40b3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:38.928 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:38.927+0000 7f91f8a93700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91f40b29c0 con 0x7f91f41608d0 2023-06-09T04:42:38.928 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:38.927+0000 7f91f8a93700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91f40b1d40 con 0x7f91f40cb310 2023-06-09T04:42:38.928 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:38.927+0000 7f91f8a93700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91f40b2020 con 0x7f91f41574c0 2023-06-09T04:42:38.929 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:38.927+0000 7f91f3fff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f91f41608d0 0x7f91f40b3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:38.929 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:38.927+0000 7f91f3fff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f91f41608d0 0x7f91f40b3ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:52636/0 (socket says 172.21.15.90:52636) 2023-06-09T04:42:38.929 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:38.927+0000 7f91f3fff700 1 -- 172.21.15.90:0/3909920665 learned_addr learned my addr 172.21.15.90:0/3909920665 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:38.929 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:38.927+0000 7f91f37fe700 1 --2- 172.21.15.90:0/3909920665 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f91f40cb310 0x7f91f4155ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:38.930 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:38.927+0000 7f91f2ffd700 1 --2- 172.21.15.90:0/3909920665 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f91f41574c0 0x7f91f40b3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:38.930 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:38.927+0000 7f91f3fff700 1 -- 172.21.15.90:0/3909920665 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f91f41574c0 msgr2=0x7f91f40b3570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:38.930 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:38.927+0000 7f91f3fff700 1 --2- 172.21.15.90:0/3909920665 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f91f41574c0 0x7f91f40b3570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:38.930 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:38.927+0000 7f91f3fff700 1 -- 172.21.15.90:0/3909920665 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f91f40cb310 msgr2=0x7f91f4155ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:38.930 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:38.927+0000 7f91f3fff700 1 --2- 172.21.15.90:0/3909920665 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f91f40cb310 0x7f91f4155ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:38.930 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:38.927+0000 7f91f3fff700 1 -- 172.21.15.90:0/3909920665 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91ec009a70 con 0x7f91f41608d0 2023-06-09T04:42:38.931 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:38.927+0000 7f91f3fff700 1 --2- 172.21.15.90:0/3909920665 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f91f41608d0 0x7f91f40b3ab0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f91ec00efc0 tx=0x7f91ec00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:38.931 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:38.927+0000 7f91dbfff700 1 -- 172.21.15.90:0/3909920665 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91ec00ca90 con 0x7f91f41608d0 2023-06-09T04:42:38.931 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:38.927+0000 7f91dbfff700 1 -- 172.21.15.90:0/3909920665 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91ec00f040 con 0x7f91f41608d0 2023-06-09T04:42:38.931 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:38.927+0000 7f91dbfff700 1 -- 172.21.15.90:0/3909920665 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91ec00ce30 con 0x7f91f41608d0 2023-06-09T04:42:38.932 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:38.927+0000 7f91f8a93700 1 -- 172.21.15.90:0/3909920665 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91e80094b0 con 0x7f91f41608d0 2023-06-09T04:42:38.932 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:38.927+0000 7f91f8a93700 1 -- 172.21.15.90:0/3909920665 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91f40b25e0 con 0x7f91f41608d0 2023-06-09T04:42:38.932 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:38.931+0000 7f91f8a93700 1 -- 172.21.15.90:0/3909920665 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91f406b390 con 0x7f91f41608d0 2023-06-09T04:42:38.934 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:38.931+0000 7f91dbfff700 1 -- 172.21.15.90:0/3909920665 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f91ec014480 con 0x7f91f41608d0 2023-06-09T04:42:38.935 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:38.935+0000 7f91dbfff700 1 --2- 172.21.15.90:0/3909920665 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f91e00662f0 0x7f91e00687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:38.936 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:38.935+0000 7f91dbfff700 1 -- 172.21.15.90:0/3909920665 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f91ec084410 con 0x7f91f41608d0 2023-06-09T04:42:38.936 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:38.935+0000 7f91f37fe700 1 --2- 172.21.15.90:0/3909920665 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f91e00662f0 0x7f91e00687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:38.937 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:38.935+0000 7f91f37fe700 1 --2- 172.21.15.90:0/3909920665 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f91e00662f0 0x7f91e00687a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f91e4007fd0 tx=0x7f91e4007de0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:38.941 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:38.939+0000 7f91dbfff700 1 -- 172.21.15.90:0/3909920665 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f91ec0517b0 con 0x7f91f41608d0 2023-06-09T04:42:39.112 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:39.111+0000 7f91f8a93700 1 -- 172.21.15.90:0/3909920665 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f91f40b2b00 con 0x7f91f41608d0 2023-06-09T04:42:39.113 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:39.111+0000 7f91dbfff700 1 -- 172.21.15.90:0/3909920665 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18375 (secure 0 0 0) 0x7f91f40b2b00 con 0x7f91f41608d0 2023-06-09T04:42:39.114 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:42:39.115 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":26,"fsid":"700369c0-a111-43b4-9415-844ad1742b70","created":"2023-06-09T04:41:28.180311+0000","modified":"2023-06-09T04:42:36.122304+0000","last_up_change":"2023-06-09T04:41:40.746475+0000","last_in_change":"2023-06-09T04:41:31.262765+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-09T04:41:42.402564+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-09T04:41:47.607323+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-09T04:41:52.543474+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-09T04:41:53.382940+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"46a4a7c5-babd-4ef3-9830-51487cff5eb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":2780271267},{"type":"v1","addr":"172.21.15.90:6809","nonce":2780271267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2780271267},{"type":"v1","addr":"172.21.15.90:6811","nonce":2780271267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2780271267},{"type":"v1","addr":"172.21.15.90:6815","nonce":2780271267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2780271267},{"type":"v1","addr":"172.21.15.90:6813","nonce":2780271267}]},"public_addr":"172.21.15.90:6809/2780271267","cluster_addr":"172.21.15.90:6811/2780271267","heartbeat_back_addr":"172.21.15.90:6815/2780271267","heartbeat_front_addr":"172.21.15.90:6813/2780271267","state":["exists","up"]},{"osd":1,"uuid":"1543988f-c498-494a-a6f9-fac8413db6ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":3064028136},{"type":"v1","addr":"172.21.15.90:6801","nonce":3064028136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":3064028136},{"type":"v1","addr":"172.21.15.90:6803","nonce":3064028136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":3064028136},{"type":"v1","addr":"172.21.15.90:6807","nonce":3064028136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":3064028136},{"type":"v1","addr":"172.21.15.90:6805","nonce":3064028136}]},"public_addr":"172.21.15.90:6801/3064028136","cluster_addr":"172.21.15.90:6803/3064028136","heartbeat_back_addr":"172.21.15.90:6807/3064028136","heartbeat_front_addr":"172.21.15.90:6805/3064028136","state":["exists","up"]},{"osd":2,"uuid":"79669dd6-ffc8-4197-b9f7-b3b372b2b9b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":3713146326},{"type":"v1","addr":"172.21.15.90:6825","nonce":3713146326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":3713146326},{"type":"v1","addr":"172.21.15.90:6827","nonce":3713146326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":3713146326},{"type":"v1","addr":"172.21.15.90:6831","nonce":3713146326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":3713146326},{"type":"v1","addr":"172.21.15.90:6829","nonce":3713146326}]},"public_addr":"172.21.15.90:6825/3713146326","cluster_addr":"172.21.15.90:6827/3713146326","heartbeat_back_addr":"172.21.15.90:6831/3713146326","heartbeat_front_addr":"172.21.15.90:6829/3713146326","state":["exists","up"]},{"osd":3,"uuid":"4062ab6f-ce40-450a-aa17-b10098766c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":3499839122},{"type":"v1","addr":"172.21.15.90:6817","nonce":3499839122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":3499839122},{"type":"v1","addr":"172.21.15.90:6819","nonce":3499839122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":3499839122},{"type":"v1","addr":"172.21.15.90:6823","nonce":3499839122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":3499839122},{"type":"v1","addr":"172.21.15.90:6821","nonce":3499839122}]},"public_addr":"172.21.15.90:6817/3499839122","cluster_addr":"172.21.15.90:6819/3499839122","heartbeat_back_addr":"172.21.15.90:6823/3499839122","heartbeat_front_addr":"172.21.15.90:6821/3499839122","state":["exists","up"]},{"osd":4,"uuid":"a10820e4-b348-4d92-9796-3b01484ace1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6817","nonce":1138565854},{"type":"v1","addr":"172.21.15.174:6819","nonce":1138565854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6821","nonce":1138565854},{"type":"v1","addr":"172.21.15.174:6823","nonce":1138565854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":1138565854},{"type":"v1","addr":"172.21.15.174:6831","nonce":1138565854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":1138565854},{"type":"v1","addr":"172.21.15.174:6829","nonce":1138565854}]},"public_addr":"172.21.15.174:6819/1138565854","cluster_addr":"172.21.15.174:6823/1138565854","heartbeat_back_addr":"172.21.15.174:6831/1138565854","heartbeat_front_addr":"172.21.15.174:6829/1138565854","state":["exists","up"]},{"osd":5,"uuid":"b4da1c32-be05-420b-9346-90d91aa70569","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":1707702879},{"type":"v1","addr":"172.21.15.174:6818","nonce":1707702879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":1707702879},{"type":"v1","addr":"172.21.15.174:6822","nonce":1707702879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6827","nonce":1707702879},{"type":"v1","addr":"172.21.15.174:6828","nonce":1707702879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":1707702879},{"type":"v1","addr":"172.21.15.174:6825","nonce":1707702879}]},"public_addr":"172.21.15.174:6818/1707702879","cluster_addr":"172.21.15.174:6822/1707702879","heartbeat_back_addr":"172.21.15.174:6828/1707702879","heartbeat_front_addr":"172.21.15.174:6825/1707702879","state":["exists","up"]},{"osd":6,"uuid":"d1b98041-d243-4355-bd0a-e22cf9875b32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":864450534},{"type":"v1","addr":"172.21.15.174:6801","nonce":864450534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":864450534},{"type":"v1","addr":"172.21.15.174:6803","nonce":864450534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":864450534},{"type":"v1","addr":"172.21.15.174:6807","nonce":864450534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":864450534},{"type":"v1","addr":"172.21.15.174:6805","nonce":864450534}]},"public_addr":"172.21.15.174:6801/864450534","cluster_addr":"172.21.15.174:6803/864450534","heartbeat_back_addr":"172.21.15.174:6807/864450534","heartbeat_front_addr":"172.21.15.174:6805/864450534","state":["exists","up"]},{"osd":7,"uuid":"5a207936-f89f-416b-b79b-34ec96f77c8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":2527640659},{"type":"v1","addr":"172.21.15.174:6809","nonce":2527640659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":2527640659},{"type":"v1","addr":"172.21.15.174:6811","nonce":2527640659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":2527640659},{"type":"v1","addr":"172.21.15.174:6815","nonce":2527640659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":2527640659},{"type":"v1","addr":"172.21.15.174:6813","nonce":2527640659}]},"public_addr":"172.21.15.174:6809/2527640659","cluster_addr":"172.21.15.174:6811/2527640659","heartbeat_back_addr":"172.21.15.174:6815/2527640659","heartbeat_front_addr":"172.21.15.174:6813/2527640659","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:36.972152+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:36.984561+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:36.998817+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:37.054944+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:37.085014+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:37.115125+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:36.854608+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:36.971685+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.11","mappings":[{"from":3,"to":2}]},{"pgid":"4.3e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:42:39.116 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:39.115+0000 7f91f8a93700 1 -- 172.21.15.90:0/3909920665 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f91e00662f0 msgr2=0x7f91e00687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:39.117 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:39.115+0000 7f91f8a93700 1 --2- 172.21.15.90:0/3909920665 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f91e00662f0 0x7f91e00687a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f91e4007fd0 tx=0x7f91e4007de0 comp rx=0 tx=0).stop 2023-06-09T04:42:39.117 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:39.115+0000 7f91f8a93700 1 -- 172.21.15.90:0/3909920665 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f91f41608d0 msgr2=0x7f91f40b3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:39.117 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:39.115+0000 7f91f8a93700 1 --2- 172.21.15.90:0/3909920665 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f91f41608d0 0x7f91f40b3ab0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f91ec00efc0 tx=0x7f91ec00c3a0 comp rx=0 tx=0).stop 2023-06-09T04:42:39.118 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:39.115+0000 7f91f8a93700 1 -- 172.21.15.90:0/3909920665 shutdown_connections 2023-06-09T04:42:39.118 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:39.115+0000 7f91f8a93700 1 --2- 172.21.15.90:0/3909920665 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f91e00662f0 0x7f91e00687a0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:39.118 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:39.115+0000 7f91f8a93700 1 --2- 172.21.15.90:0/3909920665 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f91f41608d0 0x7f91f40b3ab0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:39.118 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:39.115+0000 7f91f8a93700 1 --2- 172.21.15.90:0/3909920665 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f91f41574c0 0x7f91f40b3570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:39.119 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:39.115+0000 7f91f8a93700 1 --2- 172.21.15.90:0/3909920665 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f91f40cb310 0x7f91f4155ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:39.119 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:39.115+0000 7f91f8a93700 1 -- 172.21.15.90:0/3909920665 >> 172.21.15.90:0/3909920665 conn(0x7f91f406c690 msgr2=0x7f91f415fb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:39.119 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:39.115+0000 7f91f8a93700 1 -- 172.21.15.90:0/3909920665 shutdown_connections 2023-06-09T04:42:39.119 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:39.115+0000 7f91f8a93700 1 -- 172.21.15.90:0/3909920665 wait complete. 2023-06-09T04:42:39.138 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-09T04:41:42.402564+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-09T04:41:47.607323+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-09T04:41:52.543474+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-09T04:41:53.382940+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-09T04:42:39.138 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-09T04:42:39.323 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:39.323+0000 7fbefffff700 1 Processor -- start 2023-06-09T04:42:39.323 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:39.323+0000 7fbefffff700 1 -- start start 2023-06-09T04:42:39.325 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:39.323+0000 7fbefffff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbf0015c670 0x7fbf0015caa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:39.325 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:39.323+0000 7fbefffff700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fbf0015cfe0 0x7fbf000d06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:39.325 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:39.323+0000 7fbefffff700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf000ce270 con 0x7fbf0015c2a0 2023-06-09T04:42:39.325 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:39.323+0000 7fbefffff700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf0006a9f0 con 0x7fbf0015cfe0 2023-06-09T04:42:39.325 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:39.323+0000 7fbefffff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf000ce060 con 0x7fbf0015c670 2023-06-09T04:42:39.326 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:39.323+0000 7fbefeffd700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7fbf0015c2a0 0x7fbf0006a1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:56580/0 (socket says 172.21.15.90:56580) 2023-06-09T04:42:39.326 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:39.323+0000 7fbefeffd700 1 -- 172.21.15.90:0/919760529 learned_addr learned my addr 172.21.15.90:0/919760529 (peer_addr_for_me v1:172.21.15.90:0/0) 2023-06-09T04:42:39.326 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:39.323+0000 7fbefe7fc700 1 --2- 172.21.15.90:0/919760529 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbf0015c670 0x7fbf0015caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:39.326 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:39.323+0000 7fbeff7fe700 1 --2- 172.21.15.90:0/919760529 >> v2:172.21.15.90:3300/0 conn(0x7fbf0015cfe0 0x7fbf000d06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:39.327 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:39.323+0000 7fbefe7fc700 1 -- 172.21.15.90:0/919760529 >> v2:172.21.15.90:3300/0 conn(0x7fbf0015cfe0 msgr2=0x7fbf000d06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:39.327 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:39.323+0000 7fbefe7fc700 1 --2- 172.21.15.90:0/919760529 >> v2:172.21.15.90:3300/0 conn(0x7fbf0015cfe0 0x7fbf000d06d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:39.327 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:39.323+0000 7fbefdffb700 1 -- 172.21.15.90:0/919760529 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1653158055 0 0) 0x7fbf000ce270 con 0x7fbf0015c2a0 2023-06-09T04:42:39.327 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:39.323+0000 7fbefe7fc700 1 -- 172.21.15.90:0/919760529 >> v1:172.21.15.90:6789/0 conn(0x7fbf0015c2a0 legacy=0x7fbf0006a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:39.327 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:39.323+0000 7fbefe7fc700 1 -- 172.21.15.90:0/919760529 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf000ce550 con 0x7fbf0015c670 2023-06-09T04:42:39.328 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:39.323+0000 7fbefe7fc700 1 --2- 172.21.15.90:0/919760529 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbf0015c670 0x7fbf0015caa0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fbef4009850 tx=0x7fbef4009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a660611ee991a7d0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:39.328 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:39.327+0000 7fbefdffb700 1 -- 172.21.15.90:0/919760529 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbef4011830 con 0x7fbf0015c670 2023-06-09T04:42:39.328 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:39.327+0000 7fbefdffb700 1 -- 172.21.15.90:0/919760529 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbef4011990 con 0x7fbf0015c670 2023-06-09T04:42:39.328 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:39.327+0000 7fbefdffb700 1 -- 172.21.15.90:0/919760529 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbef4011d40 con 0x7fbf0015c670 2023-06-09T04:42:39.329 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:39.327+0000 7fbefffff700 1 -- 172.21.15.90:0/919760529 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbf0015c670 msgr2=0x7fbf0015caa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:39.329 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:39.327+0000 7fbefffff700 1 --2- 172.21.15.90:0/919760529 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbf0015c670 0x7fbf0015caa0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fbef4009850 tx=0x7fbef4009b60 comp rx=0 tx=0).stop 2023-06-09T04:42:39.329 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:39.327+0000 7fbefffff700 1 -- 172.21.15.90:0/919760529 shutdown_connections 2023-06-09T04:42:39.329 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:39.327+0000 7fbefffff700 1 --2- 172.21.15.90:0/919760529 >> v2:172.21.15.90:3300/0 conn(0x7fbf0015cfe0 0x7fbf000d06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:39.329 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:39.327+0000 7fbefffff700 1 --2- 172.21.15.90:0/919760529 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbf0015c670 0x7fbf0015caa0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:39.330 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:39.327+0000 7fbefffff700 1 -- 172.21.15.90:0/919760529 >> 172.21.15.90:0/919760529 conn(0x7fbf000b4ee0 msgr2=0x7fbf000d2720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:39.330 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:39.327+0000 7fbefffff700 1 -- 172.21.15.90:0/919760529 shutdown_connections 2023-06-09T04:42:39.330 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:39.327+0000 7fbefffff700 1 -- 172.21.15.90:0/919760529 wait complete. 2023-06-09T04:42:39.331 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:39.331+0000 7fbefffff700 1 Processor -- start 2023-06-09T04:42:39.332 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:39.331+0000 7fbefffff700 1 -- start start 2023-06-09T04:42:39.333 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:39.331+0000 7fbefffff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbf0015c2a0 0x7fbf000c61f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:39.333 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:39.331+0000 7fbefffff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbf0015c670 0x7fbf00150d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:39.333 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:39.331+0000 7fbefffff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbf0015cfe0 0x7fbf00153060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:39.334 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:39.331+0000 7fbefffff700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf00151680 con 0x7fbf0015cfe0 2023-06-09T04:42:39.334 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:39.331+0000 7fbefffff700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf000ca900 con 0x7fbf0015c670 2023-06-09T04:42:39.334 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:39.331+0000 7fbefffff700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf000cabe0 con 0x7fbf0015c2a0 2023-06-09T04:42:39.335 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:39.331+0000 7fbeff7fe700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbf0015cfe0 0x7fbf00153060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:39.335 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:39.331+0000 7fbeff7fe700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbf0015cfe0 0x7fbf00153060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:52656/0 (socket says 172.21.15.90:52656) 2023-06-09T04:42:39.335 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:39.331+0000 7fbeff7fe700 1 -- 172.21.15.90:0/598814417 learned_addr learned my addr 172.21.15.90:0/598814417 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:39.335 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:39.331+0000 7fbefeffd700 1 --2- 172.21.15.90:0/598814417 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbf0015c2a0 0x7fbf000c61f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:39.335 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:39.331+0000 7fbefe7fc700 1 --2- 172.21.15.90:0/598814417 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbf0015c670 0x7fbf00150d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:39.335 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:39.331+0000 7fbeff7fe700 1 -- 172.21.15.90:0/598814417 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbf0015c2a0 msgr2=0x7fbf000c61f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:39.336 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:39.331+0000 7fbeff7fe700 1 --2- 172.21.15.90:0/598814417 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbf0015c2a0 0x7fbf000c61f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:39.336 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:39.331+0000 7fbeff7fe700 1 -- 172.21.15.90:0/598814417 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbf0015c670 msgr2=0x7fbf00150d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:39.336 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:39.331+0000 7fbeff7fe700 1 --2- 172.21.15.90:0/598814417 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbf0015c670 0x7fbf00150d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:39.336 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:39.331+0000 7fbeff7fe700 1 -- 172.21.15.90:0/598814417 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbef40094b0 con 0x7fbf0015cfe0 2023-06-09T04:42:39.336 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:39.331+0000 7fbefe7fc700 1 --2- 172.21.15.90:0/598814417 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbf0015c670 0x7fbf00150d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:42:39.337 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:39.335+0000 7fbeff7fe700 1 --2- 172.21.15.90:0/598814417 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbf0015cfe0 0x7fbf00153060 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fbef800efc0 tx=0x7fbef800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:39.337 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:39.335+0000 7fbee77fe700 1 -- 172.21.15.90:0/598814417 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbef8009ba0 con 0x7fbf0015cfe0 2023-06-09T04:42:39.338 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:39.335+0000 7fbee77fe700 1 -- 172.21.15.90:0/598814417 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbef800f040 con 0x7fbf0015cfe0 2023-06-09T04:42:39.338 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:39.335+0000 7fbefffff700 1 -- 172.21.15.90:0/598814417 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf000caec0 con 0x7fbf0015cfe0 2023-06-09T04:42:39.338 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:39.335+0000 7fbee77fe700 1 -- 172.21.15.90:0/598814417 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbef8014480 con 0x7fbf0015cfe0 2023-06-09T04:42:39.338 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:39.335+0000 7fbefffff700 1 -- 172.21.15.90:0/598814417 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf00151270 con 0x7fbf0015cfe0 2023-06-09T04:42:39.338 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:39.335+0000 7fbefffff700 1 -- 172.21.15.90:0/598814417 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf00065900 con 0x7fbf0015cfe0 2023-06-09T04:42:39.339 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:39.339+0000 7fbee77fe700 1 -- 172.21.15.90:0/598814417 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fbef80145e0 con 0x7fbf0015cfe0 2023-06-09T04:42:39.341 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:39.339+0000 7fbee77fe700 1 --2- 172.21.15.90:0/598814417 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fbeec0662f0 0x7fbeec0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:39.341 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:39.339+0000 7fbee77fe700 1 -- 172.21.15.90:0/598814417 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fbef80846b0 con 0x7fbf0015cfe0 2023-06-09T04:42:39.341 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:39.339+0000 7fbefeffd700 1 --2- 172.21.15.90:0/598814417 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fbeec0662f0 0x7fbeec0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:39.342 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:39.339+0000 7fbefeffd700 1 --2- 172.21.15.90:0/598814417 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fbeec0662f0 0x7fbeec0687a0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fbef0000f60 tx=0x7fbef0007c00 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:39.346 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:39.343+0000 7fbee77fe700 1 -- 172.21.15.90:0/598814417 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fbef8051a50 con 0x7fbf0015cfe0 2023-06-09T04:42:39.514 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:39.511+0000 7fbefffff700 1 -- 172.21.15.90:0/598814417 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbf000ce800 con 0x7fbf0015cfe0 2023-06-09T04:42:39.515 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:39.511+0000 7fbee77fe700 1 -- 172.21.15.90:0/598814417 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbef8055070 con 0x7fbf0015cfe0 2023-06-09T04:42:39.515 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 1 2023-06-09T04:42:39.519 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:39.515+0000 7fbefffff700 1 -- 172.21.15.90:0/598814417 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fbeec0662f0 msgr2=0x7fbeec0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:39.519 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:39.515+0000 7fbefffff700 1 --2- 172.21.15.90:0/598814417 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fbeec0662f0 0x7fbeec0687a0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fbef0000f60 tx=0x7fbef0007c00 comp rx=0 tx=0).stop 2023-06-09T04:42:39.519 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:39.515+0000 7fbefffff700 1 -- 172.21.15.90:0/598814417 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbf0015cfe0 msgr2=0x7fbf00153060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:39.519 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:39.515+0000 7fbefffff700 1 --2- 172.21.15.90:0/598814417 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbf0015cfe0 0x7fbf00153060 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fbef800efc0 tx=0x7fbef800c3a0 comp rx=0 tx=0).stop 2023-06-09T04:42:39.519 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:39.515+0000 7fbefffff700 1 -- 172.21.15.90:0/598814417 shutdown_connections 2023-06-09T04:42:39.519 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:39.515+0000 7fbefffff700 1 --2- 172.21.15.90:0/598814417 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fbeec0662f0 0x7fbeec0687a0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:39.519 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:39.515+0000 7fbefffff700 1 --2- 172.21.15.90:0/598814417 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbf0015cfe0 0x7fbf00153060 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:39.520 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:39.515+0000 7fbefffff700 1 --2- 172.21.15.90:0/598814417 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbf0015c670 0x7fbf00150d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:39.520 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:39.515+0000 7fbefffff700 1 --2- 172.21.15.90:0/598814417 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbf0015c2a0 0x7fbf000c61f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:39.520 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:39.515+0000 7fbefffff700 1 -- 172.21.15.90:0/598814417 >> 172.21.15.90:0/598814417 conn(0x7fbf000b4ee0 msgr2=0x7fbf000d1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:39.520 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:39.519+0000 7fbefffff700 1 -- 172.21.15.90:0/598814417 shutdown_connections 2023-06-09T04:42:39.521 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:39.519+0000 7fbefffff700 1 -- 172.21.15.90:0/598814417 wait complete. 2023-06-09T04:42:39.539 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-09T04:42:39.720 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:39.719+0000 7f16de121700 1 Processor -- start 2023-06-09T04:42:39.720 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:39.719+0000 7f16de121700 1 -- start start 2023-06-09T04:42:39.722 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:39.719+0000 7f16de121700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f16d8159ed0 0x7f16d80718d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:39.723 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:39.719+0000 7f16de121700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f16d806a230 0x7f16d80cc080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:39.723 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:39.723+0000 7f16de121700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16d80ccf60 con 0x7f16d80cc5c0 2023-06-09T04:42:39.723 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:39.723+0000 7f16de121700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16d80cca10 con 0x7f16d8159ed0 2023-06-09T04:42:39.723 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:39.723+0000 7f16de121700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16d80c91a0 con 0x7f16d806a230 2023-06-09T04:42:39.724 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:39.723+0000 7f16d77fe700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f16d8159ed0 0x7f16d80718d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:39.724 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:39.723+0000 7f16d6ffd700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f16d806a230 0x7f16d80cc080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:39.724 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:39.723+0000 7f16d7fff700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f16d80cc5c0 0x7f16d815da40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.90:52424/0 (socket says 172.21.15.90:52424) 2023-06-09T04:42:39.724 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:39.723+0000 7f16d77fe700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f16d8159ed0 0x7f16d80718d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.90:47556/0 (socket says 172.21.15.90:47556) 2023-06-09T04:42:39.724 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:39.723+0000 7f16d7fff700 1 -- 172.21.15.90:0/3097888092 learned_addr learned my addr 172.21.15.90:0/3097888092 (peer_addr_for_me v1:172.21.15.90:0/0) 2023-06-09T04:42:39.725 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:39.723+0000 7f16d6ffd700 1 -- 172.21.15.90:0/3097888092 >> v2:172.21.15.174:3300/0 conn(0x7f16d8159ed0 msgr2=0x7f16d80718d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:39.725 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:39.723+0000 7f16d6ffd700 1 --2- 172.21.15.90:0/3097888092 >> v2:172.21.15.174:3300/0 conn(0x7f16d8159ed0 0x7f16d80718d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:39.725 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:39.723+0000 7f16d6ffd700 1 -- 172.21.15.90:0/3097888092 >> v1:172.21.15.174:6789/0 conn(0x7f16d80cc5c0 legacy=0x7f16d815da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:39.725 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:39.723+0000 7f16d6ffd700 1 -- 172.21.15.90:0/3097888092 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16d8071e10 con 0x7f16d806a230 2023-06-09T04:42:39.726 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:39.723+0000 7f16d6ffd700 1 --2- 172.21.15.90:0/3097888092 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f16d806a230 0x7f16d80cc080 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f16cc009850 tx=0x7f16cc009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=40452693f6bbe9a8 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:39.726 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:39.723+0000 7f16d67fc700 1 -- 172.21.15.90:0/3097888092 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16cc011830 con 0x7f16d806a230 2023-06-09T04:42:39.726 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:39.723+0000 7f16d67fc700 1 -- 172.21.15.90:0/3097888092 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16cc011990 con 0x7f16d806a230 2023-06-09T04:42:39.727 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:39.723+0000 7f16d67fc700 1 -- 172.21.15.90:0/3097888092 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16cc011d40 con 0x7f16d806a230 2023-06-09T04:42:39.727 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:39.727+0000 7f16de121700 1 -- 172.21.15.90:0/3097888092 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f16d806a230 msgr2=0x7f16d80cc080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:39.727 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:39.727+0000 7f16de121700 1 --2- 172.21.15.90:0/3097888092 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f16d806a230 0x7f16d80cc080 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f16cc009850 tx=0x7f16cc009b60 comp rx=0 tx=0).stop 2023-06-09T04:42:39.728 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:39.727+0000 7f16de121700 1 -- 172.21.15.90:0/3097888092 shutdown_connections 2023-06-09T04:42:39.728 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:39.727+0000 7f16de121700 1 --2- 172.21.15.90:0/3097888092 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f16d806a230 0x7f16d80cc080 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:39.728 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:39.727+0000 7f16de121700 1 --2- 172.21.15.90:0/3097888092 >> v2:172.21.15.174:3300/0 conn(0x7f16d8159ed0 0x7f16d80718d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:39.729 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:39.727+0000 7f16de121700 1 -- 172.21.15.90:0/3097888092 >> 172.21.15.90:0/3097888092 conn(0x7f16d80b00e0 msgr2=0x7f16d80b04b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:39.729 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:39.727+0000 7f16de121700 1 -- 172.21.15.90:0/3097888092 shutdown_connections 2023-06-09T04:42:39.729 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:39.727+0000 7f16de121700 1 -- 172.21.15.90:0/3097888092 wait complete. 2023-06-09T04:42:39.731 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:39.731+0000 7f16de121700 1 Processor -- start 2023-06-09T04:42:39.731 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:39.731+0000 7f16de121700 1 -- start start 2023-06-09T04:42:39.733 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:39.731+0000 7f16de121700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f16d806a230 0x7f16d80b13e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:39.733 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:39.731+0000 7f16de121700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f16d80cc5c0 0x7f16d8151510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:39.733 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:39.731+0000 7f16de121700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f16d8159ed0 0x7f16d80af100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:39.733 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:39.731+0000 7f16de121700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16d80b1920 con 0x7f16d8159ed0 2023-06-09T04:42:39.733 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:39.731+0000 7f16de121700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16d8152820 con 0x7f16d806a230 2023-06-09T04:42:39.734 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:39.731+0000 7f16de121700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16d8152b00 con 0x7f16d80cc5c0 2023-06-09T04:42:39.734 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:39.731+0000 7f16d7fff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f16d8159ed0 0x7f16d80af100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:39.735 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:39.731+0000 7f16d7fff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f16d8159ed0 0x7f16d80af100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:52672/0 (socket says 172.21.15.90:52672) 2023-06-09T04:42:39.735 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:39.731+0000 7f16d7fff700 1 -- 172.21.15.90:0/647127511 learned_addr learned my addr 172.21.15.90:0/647127511 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:39.735 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:39.731+0000 7f16d6ffd700 1 --2- 172.21.15.90:0/647127511 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f16d80cc5c0 0x7f16d8151510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:39.735 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:39.731+0000 7f16d77fe700 1 --2- 172.21.15.90:0/647127511 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f16d806a230 0x7f16d80b13e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:39.735 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:39.731+0000 7f16d7fff700 1 -- 172.21.15.90:0/647127511 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f16d80cc5c0 msgr2=0x7f16d8151510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:39.735 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:39.731+0000 7f16d7fff700 1 --2- 172.21.15.90:0/647127511 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f16d80cc5c0 0x7f16d8151510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:39.735 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:39.731+0000 7f16d7fff700 1 -- 172.21.15.90:0/647127511 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f16d806a230 msgr2=0x7f16d80b13e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:39.736 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:39.731+0000 7f16d7fff700 1 --2- 172.21.15.90:0/647127511 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f16d806a230 0x7f16d80b13e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:39.736 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:39.731+0000 7f16d7fff700 1 -- 172.21.15.90:0/647127511 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16cc0094b0 con 0x7f16d8159ed0 2023-06-09T04:42:39.736 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:39.731+0000 7f16d7fff700 1 --2- 172.21.15.90:0/647127511 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f16d8159ed0 0x7f16d80af100 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f16d000cbc0 tx=0x7f16d000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:39.736 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:39.735+0000 7f16bffff700 1 -- 172.21.15.90:0/647127511 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16d0007480 con 0x7f16d8159ed0 2023-06-09T04:42:39.737 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:39.735+0000 7f16bffff700 1 -- 172.21.15.90:0/647127511 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16d00075e0 con 0x7f16d8159ed0 2023-06-09T04:42:39.737 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:39.735+0000 7f16de121700 1 -- 172.21.15.90:0/647127511 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16d8150a30 con 0x7f16d8159ed0 2023-06-09T04:42:39.737 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:39.735+0000 7f16bffff700 1 -- 172.21.15.90:0/647127511 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16d0007950 con 0x7f16d8159ed0 2023-06-09T04:42:39.737 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:39.735+0000 7f16de121700 1 -- 172.21.15.90:0/647127511 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16d8150ff0 con 0x7f16d8159ed0 2023-06-09T04:42:39.737 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:39.735+0000 7f16de121700 1 -- 172.21.15.90:0/647127511 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16d804db30 con 0x7f16d8159ed0 2023-06-09T04:42:39.739 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:39.739+0000 7f16bffff700 1 -- 172.21.15.90:0/647127511 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f16d0012400 con 0x7f16d8159ed0 2023-06-09T04:42:39.740 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:39.739+0000 7f16bffff700 1 --2- 172.21.15.90:0/647127511 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f16c4066320 0x7f16c40687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:39.741 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:39.739+0000 7f16bffff700 1 -- 172.21.15.90:0/647127511 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f16d00833f0 con 0x7f16d8159ed0 2023-06-09T04:42:39.741 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:39.739+0000 7f16d77fe700 1 --2- 172.21.15.90:0/647127511 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f16c4066320 0x7f16c40687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:39.742 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:39.739+0000 7f16d77fe700 1 --2- 172.21.15.90:0/647127511 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f16c4066320 0x7f16c40687d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f16c8009bf0 tx=0x7f16c8009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:39.746 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:39.743+0000 7f16bffff700 1 -- 172.21.15.90:0/647127511 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f16d00508d0 con 0x7f16d8159ed0 2023-06-09T04:42:39.915 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:39.915+0000 7f16de121700 1 -- 172.21.15.90:0/647127511 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f16d80ccf60 con 0x7f16d8159ed0 2023-06-09T04:42:39.916 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:39.915+0000 7f16bffff700 1 -- 172.21.15.90:0/647127511 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v26) v1 ==== 92+0+10 (secure 0 0 0) 0x7f16d80ccf60 con 0x7f16d8159ed0 2023-06-09T04:42:39.916 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 8 2023-06-09T04:42:39.920 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:39.919+0000 7f16de121700 1 -- 172.21.15.90:0/647127511 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f16c4066320 msgr2=0x7f16c40687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:39.920 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:39.919+0000 7f16de121700 1 --2- 172.21.15.90:0/647127511 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f16c4066320 0x7f16c40687d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f16c8009bf0 tx=0x7f16c8009240 comp rx=0 tx=0).stop 2023-06-09T04:42:39.920 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:39.919+0000 7f16de121700 1 -- 172.21.15.90:0/647127511 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f16d8159ed0 msgr2=0x7f16d80af100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:39.921 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:39.919+0000 7f16de121700 1 --2- 172.21.15.90:0/647127511 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f16d8159ed0 0x7f16d80af100 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f16d000cbc0 tx=0x7f16d000cbf0 comp rx=0 tx=0).stop 2023-06-09T04:42:39.921 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:39.919+0000 7f16de121700 1 -- 172.21.15.90:0/647127511 shutdown_connections 2023-06-09T04:42:39.921 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:39.919+0000 7f16de121700 1 --2- 172.21.15.90:0/647127511 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f16c4066320 0x7f16c40687d0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:39.921 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:39.919+0000 7f16de121700 1 --2- 172.21.15.90:0/647127511 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f16d8159ed0 0x7f16d80af100 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:39.921 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:39.919+0000 7f16de121700 1 --2- 172.21.15.90:0/647127511 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f16d80cc5c0 0x7f16d8151510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:39.921 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:39.919+0000 7f16de121700 1 --2- 172.21.15.90:0/647127511 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f16d806a230 0x7f16d80b13e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:39.921 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:39.919+0000 7f16de121700 1 -- 172.21.15.90:0/647127511 >> 172.21.15.90:0/647127511 conn(0x7f16d80b00e0 msgr2=0x7f16d80701c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:39.922 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:39.919+0000 7f16de121700 1 -- 172.21.15.90:0/647127511 shutdown_connections 2023-06-09T04:42:39.922 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:39.919+0000 7f16de121700 1 -- 172.21.15.90:0/647127511 wait complete. 2023-06-09T04:42:39.941 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-09T04:42:40.114 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.111+0000 7f0b609d9700 1 Processor -- start 2023-06-09T04:42:40.114 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.111+0000 7f0b609d9700 1 -- start start 2023-06-09T04:42:40.117 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.115+0000 7f0b609d9700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0b5c0b18d0 0x7f0b5c160920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:40.117 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.115+0000 7f0b609d9700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0b5c0b1ca0 0x7f0b5c0cee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:40.118 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.115+0000 7f0b609d9700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b5c15c6b0 con 0x7f0b5c0d2400 2023-06-09T04:42:40.118 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.115+0000 7f0b609d9700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b5c0cf3d0 con 0x7f0b5c0b1ca0 2023-06-09T04:42:40.118 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.115+0000 7f0b609d9700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b5c0cf6a0 con 0x7f0b5c0b18d0 2023-06-09T04:42:40.119 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.115+0000 7f0b5affd700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0b5c0b1ca0 0x7f0b5c0cee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:40.119 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.115+0000 7f0b5affd700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0b5c0b1ca0 0x7f0b5c0cee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:52674/0 (socket says 172.21.15.90:52674) 2023-06-09T04:42:40.119 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.115+0000 7f0b5affd700 1 -- 172.21.15.90:0/3166849151 learned_addr learned my addr 172.21.15.90:0/3166849151 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:40.119 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.115+0000 7f0b5b7fe700 1 --2- 172.21.15.90:0/3166849151 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0b5c0b18d0 0x7f0b5c160920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:40.120 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.115+0000 7f0b5affd700 1 -- 172.21.15.90:0/3166849151 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0b5c0b18d0 msgr2=0x7f0b5c160920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:40.120 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.115+0000 7f0b5affd700 1 --2- 172.21.15.90:0/3166849151 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0b5c0b18d0 0x7f0b5c160920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:40.120 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.115+0000 7f0b5affd700 1 -- 172.21.15.90:0/3166849151 >> v1:172.21.15.174:6789/0 conn(0x7f0b5c0d2400 legacy=0x7f0b5c0d28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:40.120 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.119+0000 7f0b5affd700 1 -- 172.21.15.90:0/3166849151 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b5c0cf980 con 0x7f0b5c0b1ca0 2023-06-09T04:42:40.120 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.119+0000 7f0b5affd700 1 --2- 172.21.15.90:0/3166849151 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0b5c0b1ca0 0x7f0b5c0cee90 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f0b50009940 tx=0x7f0b50009c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bf28a6350eea23c server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:40.121 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.119+0000 7f0b5a7fc700 1 -- 172.21.15.90:0/3166849151 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b50011830 con 0x7f0b5c0b1ca0 2023-06-09T04:42:40.121 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.119+0000 7f0b5a7fc700 1 -- 172.21.15.90:0/3166849151 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b50011990 con 0x7f0b5c0b1ca0 2023-06-09T04:42:40.121 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.119+0000 7f0b5a7fc700 1 -- 172.21.15.90:0/3166849151 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b50011d20 con 0x7f0b5c0b1ca0 2023-06-09T04:42:40.121 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.119+0000 7f0b609d9700 1 -- 172.21.15.90:0/3166849151 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0b5c0b1ca0 msgr2=0x7f0b5c0cee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:40.122 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.119+0000 7f0b609d9700 1 --2- 172.21.15.90:0/3166849151 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0b5c0b1ca0 0x7f0b5c0cee90 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f0b50009940 tx=0x7f0b50009c50 comp rx=0 tx=0).stop 2023-06-09T04:42:40.122 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.119+0000 7f0b609d9700 1 -- 172.21.15.90:0/3166849151 shutdown_connections 2023-06-09T04:42:40.122 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.119+0000 7f0b609d9700 1 --2- 172.21.15.90:0/3166849151 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0b5c0b1ca0 0x7f0b5c0cee90 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:40.122 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.119+0000 7f0b609d9700 1 --2- 172.21.15.90:0/3166849151 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0b5c0b18d0 0x7f0b5c160920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:40.122 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.119+0000 7f0b609d9700 1 -- 172.21.15.90:0/3166849151 >> 172.21.15.90:0/3166849151 conn(0x7f0b5c09b9b0 msgr2=0x7f0b5c0b55d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:40.122 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.119+0000 7f0b609d9700 1 -- 172.21.15.90:0/3166849151 shutdown_connections 2023-06-09T04:42:40.123 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.119+0000 7f0b609d9700 1 -- 172.21.15.90:0/3166849151 wait complete. 2023-06-09T04:42:40.123 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.123+0000 7f0b609d9700 1 Processor -- start 2023-06-09T04:42:40.124 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.123+0000 7f0b609d9700 1 -- start start 2023-06-09T04:42:40.125 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.123+0000 7f0b609d9700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0b5c0b18d0 0x7f0b5c15ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:40.125 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.123+0000 7f0b609d9700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0b5c0b1ca0 0x7f0b5c0c8730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:40.126 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.123+0000 7f0b609d9700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0b5c0d2400 0x7f0b5c0cbe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:40.126 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.123+0000 7f0b609d9700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b5c15f3a0 con 0x7f0b5c0d2400 2023-06-09T04:42:40.126 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.123+0000 7f0b609d9700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b5c15ddc0 con 0x7f0b5c0b1ca0 2023-06-09T04:42:40.126 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.123+0000 7f0b609d9700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b5c15e0a0 con 0x7f0b5c0b18d0 2023-06-09T04:42:40.127 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.123+0000 7f0b5bfff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0b5c0d2400 0x7f0b5c0cbe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:40.127 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.123+0000 7f0b5b7fe700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0b5c0b18d0 0x7f0b5c15ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:40.127 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.123+0000 7f0b5bfff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0b5c0d2400 0x7f0b5c0cbe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:52680/0 (socket says 172.21.15.90:52680) 2023-06-09T04:42:40.127 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.123+0000 7f0b5bfff700 1 -- 172.21.15.90:0/2754663409 learned_addr learned my addr 172.21.15.90:0/2754663409 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:40.127 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.123+0000 7f0b5affd700 1 --2- 172.21.15.90:0/2754663409 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0b5c0b1ca0 0x7f0b5c0c8730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:40.128 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.123+0000 7f0b5bfff700 1 -- 172.21.15.90:0/2754663409 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0b5c0b18d0 msgr2=0x7f0b5c15ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:40.128 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.123+0000 7f0b5bfff700 1 --2- 172.21.15.90:0/2754663409 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0b5c0b18d0 0x7f0b5c15ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:40.128 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.123+0000 7f0b5bfff700 1 -- 172.21.15.90:0/2754663409 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0b5c0b1ca0 msgr2=0x7f0b5c0c8730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:40.128 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.123+0000 7f0b5bfff700 1 --2- 172.21.15.90:0/2754663409 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0b5c0b1ca0 0x7f0b5c0c8730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:40.128 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.123+0000 7f0b5bfff700 1 -- 172.21.15.90:0/2754663409 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b50009570 con 0x7f0b5c0d2400 2023-06-09T04:42:40.128 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.127+0000 7f0b5bfff700 1 --2- 172.21.15.90:0/2754663409 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0b5c0d2400 0x7f0b5c0cbe20 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f0b5400cb50 tx=0x7f0b5400ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:40.129 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.127+0000 7f0b43fff700 1 -- 172.21.15.90:0/2754663409 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b54003c20 con 0x7f0b5c0d2400 2023-06-09T04:42:40.129 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.127+0000 7f0b43fff700 1 -- 172.21.15.90:0/2754663409 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b54003d80 con 0x7f0b5c0d2400 2023-06-09T04:42:40.129 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.127+0000 7f0b609d9700 1 -- 172.21.15.90:0/2754663409 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b5c15e380 con 0x7f0b5c0d2400 2023-06-09T04:42:40.129 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.127+0000 7f0b43fff700 1 -- 172.21.15.90:0/2754663409 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b5400aa20 con 0x7f0b5c0d2400 2023-06-09T04:42:40.129 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.127+0000 7f0b609d9700 1 -- 172.21.15.90:0/2754663409 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b5c15e940 con 0x7f0b5c0d2400 2023-06-09T04:42:40.130 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.127+0000 7f0b609d9700 1 -- 172.21.15.90:0/2754663409 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b5c04e380 con 0x7f0b5c0d2400 2023-06-09T04:42:40.131 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.131+0000 7f0b43fff700 1 -- 172.21.15.90:0/2754663409 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0b5400ab80 con 0x7f0b5c0d2400 2023-06-09T04:42:40.132 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.131+0000 7f0b43fff700 1 --2- 172.21.15.90:0/2754663409 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f0b480662f0 0x7f0b480687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:40.133 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.131+0000 7f0b43fff700 1 -- 172.21.15.90:0/2754663409 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f0b54083d10 con 0x7f0b5c0d2400 2023-06-09T04:42:40.133 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.131+0000 7f0b5b7fe700 1 --2- 172.21.15.90:0/2754663409 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f0b480662f0 0x7f0b480687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:40.134 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.131+0000 7f0b5b7fe700 1 --2- 172.21.15.90:0/2754663409 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f0b480662f0 0x7f0b480687a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c009be0 tx=0x7f0b4c0091c0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:40.138 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.135+0000 7f0b43fff700 1 -- 172.21.15.90:0/2754663409 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0b54089020 con 0x7f0b5c0d2400 2023-06-09T04:42:40.315 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.311+0000 7f0b609d9700 1 -- 172.21.15.90:0/2754663409 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0b5c0d1960 con 0x7f0b5c0d2400 2023-06-09T04:42:40.316 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.315+0000 7f0b43fff700 1 -- 172.21.15.90:0/2754663409 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0b54051140 con 0x7f0b5c0d2400 2023-06-09T04:42:40.316 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 32 2023-06-09T04:42:40.321 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.319+0000 7f0b609d9700 1 -- 172.21.15.90:0/2754663409 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f0b480662f0 msgr2=0x7f0b480687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:40.321 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.319+0000 7f0b609d9700 1 --2- 172.21.15.90:0/2754663409 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f0b480662f0 0x7f0b480687a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c009be0 tx=0x7f0b4c0091c0 comp rx=0 tx=0).stop 2023-06-09T04:42:40.321 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.319+0000 7f0b609d9700 1 -- 172.21.15.90:0/2754663409 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0b5c0d2400 msgr2=0x7f0b5c0cbe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:40.322 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.319+0000 7f0b609d9700 1 --2- 172.21.15.90:0/2754663409 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0b5c0d2400 0x7f0b5c0cbe20 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f0b5400cb50 tx=0x7f0b5400ce60 comp rx=0 tx=0).stop 2023-06-09T04:42:40.322 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.319+0000 7f0b609d9700 1 -- 172.21.15.90:0/2754663409 shutdown_connections 2023-06-09T04:42:40.322 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.319+0000 7f0b609d9700 1 --2- 172.21.15.90:0/2754663409 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f0b480662f0 0x7f0b480687a0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:40.322 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.319+0000 7f0b609d9700 1 --2- 172.21.15.90:0/2754663409 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0b5c0d2400 0x7f0b5c0cbe20 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:40.322 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.319+0000 7f0b609d9700 1 --2- 172.21.15.90:0/2754663409 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0b5c0b1ca0 0x7f0b5c0c8730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:40.322 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.319+0000 7f0b609d9700 1 --2- 172.21.15.90:0/2754663409 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0b5c0b18d0 0x7f0b5c15ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:40.323 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.319+0000 7f0b609d9700 1 -- 172.21.15.90:0/2754663409 >> 172.21.15.90:0/2754663409 conn(0x7f0b5c09b9b0 msgr2=0x7f0b5c0afab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:40.323 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.319+0000 7f0b609d9700 1 -- 172.21.15.90:0/2754663409 shutdown_connections 2023-06-09T04:42:40.323 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.319+0000 7f0b609d9700 1 -- 172.21.15.90:0/2754663409 wait complete. 2023-06-09T04:42:40.344 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-09T04:42:40.522 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.519+0000 7f1fe9ba1700 1 Processor -- start 2023-06-09T04:42:40.523 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.519+0000 7f1fe9ba1700 1 -- start start 2023-06-09T04:42:40.526 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.523+0000 7f1fe9ba1700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1fe4158d00 0x7f1fe406a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:40.526 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.523+0000 7f1fe9ba1700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1fe40cc460 0x7f1fe40ca4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:40.526 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.523+0000 7f1fe9ba1700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fe40ca050 con 0x7f1fe40cad00 2023-06-09T04:42:40.527 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.523+0000 7f1fe9ba1700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fe41590d0 con 0x7f1fe40cc460 2023-06-09T04:42:40.527 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.523+0000 7f1fe9ba1700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fe40c91c0 con 0x7f1fe4158d00 2023-06-09T04:42:40.527 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.527+0000 7f1fe8b9f700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1fe4158d00 0x7f1fe406a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:40.527 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.527+0000 7f1fe8b9f700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1fe4158d00 0x7f1fe406a930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.90:37894/0 (socket says 172.21.15.90:37894) 2023-06-09T04:42:40.528 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.527+0000 7f1fe3fff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1fe40cc460 0x7f1fe40ca4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:40.528 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.527+0000 7f1fe8b9f700 1 -- 172.21.15.90:0/1622310972 learned_addr learned my addr 172.21.15.90:0/1622310972 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:40.528 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.527+0000 7f1fe8b9f700 1 -- 172.21.15.90:0/1622310972 >> v2:172.21.15.174:3300/0 conn(0x7f1fe40cc460 msgr2=0x7f1fe40ca4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:40.529 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.527+0000 7f1fe8b9f700 1 --2- 172.21.15.90:0/1622310972 >> v2:172.21.15.174:3300/0 conn(0x7f1fe40cc460 0x7f1fe40ca4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:40.529 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.527+0000 7f1fe8b9f700 1 -- 172.21.15.90:0/1622310972 >> v1:172.21.15.174:6789/0 conn(0x7f1fe40cad00 legacy=0x7f1fe40c3170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:40.529 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.527+0000 7f1fe8b9f700 1 -- 172.21.15.90:0/1622310972 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fe40c9440 con 0x7f1fe4158d00 2023-06-09T04:42:40.529 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.527+0000 7f1fe37fe700 1 -- 172.21.15.90:0/1622310972 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2904721482 0 0) 0x7f1fe40ca050 con 0x7f1fe40cad00 2023-06-09T04:42:40.529 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.527+0000 7f1fe8b9f700 1 --2- 172.21.15.90:0/1622310972 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1fe4158d00 0x7f1fe406a930 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1fd8009910 tx=0x7f1fd8009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b19678f45566d787 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:40.530 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.527+0000 7f1fe37fe700 1 -- 172.21.15.90:0/1622310972 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fd8011830 con 0x7f1fe4158d00 2023-06-09T04:42:40.530 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.527+0000 7f1fe37fe700 1 -- 172.21.15.90:0/1622310972 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fd8011990 con 0x7f1fe4158d00 2023-06-09T04:42:40.531 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.527+0000 7f1fe37fe700 1 -- 172.21.15.90:0/1622310972 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fd8011d40 con 0x7f1fe4158d00 2023-06-09T04:42:40.531 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.527+0000 7f1fe9ba1700 1 -- 172.21.15.90:0/1622310972 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1fe4158d00 msgr2=0x7f1fe406a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:40.531 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.527+0000 7f1fe9ba1700 1 --2- 172.21.15.90:0/1622310972 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1fe4158d00 0x7f1fe406a930 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1fd8009910 tx=0x7f1fd8009c20 comp rx=0 tx=0).stop 2023-06-09T04:42:40.531 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.527+0000 7f1fe9ba1700 1 -- 172.21.15.90:0/1622310972 shutdown_connections 2023-06-09T04:42:40.531 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.527+0000 7f1fe9ba1700 1 --2- 172.21.15.90:0/1622310972 >> v2:172.21.15.174:3300/0 conn(0x7f1fe40cc460 0x7f1fe40ca4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:40.531 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.527+0000 7f1fe9ba1700 1 --2- 172.21.15.90:0/1622310972 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1fe4158d00 0x7f1fe406a930 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:40.531 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.527+0000 7f1fe9ba1700 1 -- 172.21.15.90:0/1622310972 >> 172.21.15.90:0/1622310972 conn(0x7f1fe40aff00 msgr2=0x7f1fe40b0300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:40.532 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.527+0000 7f1fe9ba1700 1 -- 172.21.15.90:0/1622310972 shutdown_connections 2023-06-09T04:42:40.532 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.527+0000 7f1fe9ba1700 1 -- 172.21.15.90:0/1622310972 wait complete. 2023-06-09T04:42:40.533 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.531+0000 7f1fe9ba1700 1 Processor -- start 2023-06-09T04:42:40.533 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.531+0000 7f1fe9ba1700 1 -- start start 2023-06-09T04:42:40.535 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.531+0000 7f1fe9ba1700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1fe40cad00 0x7f1fe40ac480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:40.535 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.535+0000 7f1fe9ba1700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1fe40cc460 0x7f1fe40b3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:40.535 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.535+0000 7f1fe9ba1700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1fe4158d00 0x7f1fe40ce3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:40.535 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.535+0000 7f1fe9ba1700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fe40700e0 con 0x7f1fe40cad00 2023-06-09T04:42:40.535 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.535+0000 7f1fe9ba1700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fe40b41c0 con 0x7f1fe40cc460 2023-06-09T04:42:40.536 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.535+0000 7f1fe9ba1700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fe40b3ee0 con 0x7f1fe4158d00 2023-06-09T04:42:40.536 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.535+0000 7f1fe8b9f700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1fe40cad00 0x7f1fe40ac480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:40.537 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.535+0000 7f1fe8b9f700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1fe40cad00 0x7f1fe40ac480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:52686/0 (socket says 172.21.15.90:52686) 2023-06-09T04:42:40.537 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.535+0000 7f1fe8b9f700 1 -- 172.21.15.90:0/830945146 learned_addr learned my addr 172.21.15.90:0/830945146 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:40.537 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.535+0000 7f1fe3fff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1fe40cc460 0x7f1fe40b3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:40.537 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.535+0000 7f1fe93a0700 1 --2- 172.21.15.90:0/830945146 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1fe4158d00 0x7f1fe40ce3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:40.537 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.535+0000 7f1fe8b9f700 1 -- 172.21.15.90:0/830945146 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1fe4158d00 msgr2=0x7f1fe40ce3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:40.537 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.535+0000 7f1fe8b9f700 1 --2- 172.21.15.90:0/830945146 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1fe4158d00 0x7f1fe40ce3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:40.537 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.535+0000 7f1fe8b9f700 1 -- 172.21.15.90:0/830945146 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1fe40cc460 msgr2=0x7f1fe40b3690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:40.537 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.535+0000 7f1fe8b9f700 1 --2- 172.21.15.90:0/830945146 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1fe40cc460 0x7f1fe40b3690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:40.538 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.535+0000 7f1fe8b9f700 1 -- 172.21.15.90:0/830945146 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fd8009570 con 0x7f1fe40cad00 2023-06-09T04:42:40.538 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.535+0000 7f1fe8b9f700 1 --2- 172.21.15.90:0/830945146 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1fe40cad00 0x7f1fe40ac480 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f1fd8014040 tx=0x7f1fd8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:40.539 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.535+0000 7f1fe17fa700 1 -- 172.21.15.90:0/830945146 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fd801a8f0 con 0x7f1fe40cad00 2023-06-09T04:42:40.539 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.535+0000 7f1fe17fa700 1 -- 172.21.15.90:0/830945146 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fd801e070 con 0x7f1fe40cad00 2023-06-09T04:42:40.539 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.535+0000 7f1fe17fa700 1 -- 172.21.15.90:0/830945146 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fd801acb0 con 0x7f1fe40cad00 2023-06-09T04:42:40.539 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.535+0000 7f1fe9ba1700 1 -- 172.21.15.90:0/830945146 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fe406fa20 con 0x7f1fe40cad00 2023-06-09T04:42:40.539 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.535+0000 7f1fe9ba1700 1 -- 172.21.15.90:0/830945146 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fe40b3bd0 con 0x7f1fe40cad00 2023-06-09T04:42:40.540 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.539+0000 7f1fe9ba1700 1 -- 172.21.15.90:0/830945146 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fe404e380 con 0x7f1fe40cad00 2023-06-09T04:42:40.541 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.539+0000 7f1fe17fa700 1 -- 172.21.15.90:0/830945146 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f1fd802d450 con 0x7f1fe40cad00 2023-06-09T04:42:40.542 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.539+0000 7f1fe17fa700 1 --2- 172.21.15.90:0/830945146 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f1fc80662f0 0x7f1fc80687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:40.543 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.539+0000 7f1fe17fa700 1 -- 172.21.15.90:0/830945146 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f1fd8084ba0 con 0x7f1fe40cad00 2023-06-09T04:42:40.543 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.543+0000 7f1fe3fff700 1 --2- 172.21.15.90:0/830945146 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f1fc80662f0 0x7f1fc80687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:40.544 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.543+0000 7f1fe3fff700 1 --2- 172.21.15.90:0/830945146 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f1fc80662f0 0x7f1fc80687a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f1fe4158580 tx=0x7f1fd0009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:40.549 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.547+0000 7f1fe17fa700 1 -- 172.21.15.90:0/830945146 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1fd8052070 con 0x7f1fe40cad00 2023-06-09T04:42:40.719 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.719+0000 7f1fe9ba1700 1 -- 172.21.15.90:0/830945146 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1fe40adb50 con 0x7f1fe40cad00 2023-06-09T04:42:40.720 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.719+0000 7f1fe17fa700 1 -- 172.21.15.90:0/830945146 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1fd80200a0 con 0x7f1fe40cad00 2023-06-09T04:42:40.720 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 64 2023-06-09T04:42:40.723 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.719+0000 7f1fe9ba1700 1 -- 172.21.15.90:0/830945146 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f1fc80662f0 msgr2=0x7f1fc80687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:40.723 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.719+0000 7f1fe9ba1700 1 --2- 172.21.15.90:0/830945146 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f1fc80662f0 0x7f1fc80687a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f1fe4158580 tx=0x7f1fd0009240 comp rx=0 tx=0).stop 2023-06-09T04:42:40.723 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.719+0000 7f1fe9ba1700 1 -- 172.21.15.90:0/830945146 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1fe40cad00 msgr2=0x7f1fe40ac480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:40.723 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.719+0000 7f1fe9ba1700 1 --2- 172.21.15.90:0/830945146 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1fe40cad00 0x7f1fe40ac480 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f1fd8014040 tx=0x7f1fd8004770 comp rx=0 tx=0).stop 2023-06-09T04:42:40.724 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.723+0000 7f1fe9ba1700 1 -- 172.21.15.90:0/830945146 shutdown_connections 2023-06-09T04:42:40.724 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.723+0000 7f1fe9ba1700 1 --2- 172.21.15.90:0/830945146 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f1fc80662f0 0x7f1fc80687a0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:40.724 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.723+0000 7f1fe9ba1700 1 --2- 172.21.15.90:0/830945146 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1fe4158d00 0x7f1fe40ce3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:40.724 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.723+0000 7f1fe9ba1700 1 --2- 172.21.15.90:0/830945146 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1fe40cc460 0x7f1fe40b3690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:40.725 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.723+0000 7f1fe9ba1700 1 --2- 172.21.15.90:0/830945146 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1fe40cad00 0x7f1fe40ac480 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:40.725 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.723+0000 7f1fe9ba1700 1 -- 172.21.15.90:0/830945146 >> 172.21.15.90:0/830945146 conn(0x7f1fe40aff00 msgr2=0x7f1fe4153b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:40.725 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.723+0000 7f1fe9ba1700 1 -- 172.21.15.90:0/830945146 shutdown_connections 2023-06-09T04:42:40.725 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.723+0000 7f1fe9ba1700 1 -- 172.21.15.90:0/830945146 wait complete. 2023-06-09T04:42:40.743 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-06-09T04:42:40.921 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.919+0000 7fc98c54d700 1 Processor -- start 2023-06-09T04:42:40.922 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.919+0000 7fc98c54d700 1 -- start start 2023-06-09T04:42:40.925 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.923+0000 7fc98c54d700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc9840cd600 0x7fc9840cc0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:40.925 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.923+0000 7fc98c54d700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9840cca60 con 0x7fc984160660 2023-06-09T04:42:40.926 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.923+0000 7fc98c54d700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9840cb140 con 0x7fc9840cc600 2023-06-09T04:42:40.926 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.923+0000 7fc98c54d700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9840c9250 con 0x7fc9840cd600 2023-06-09T04:42:40.926 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.923+0000 7fc98a2e9700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7fc984160660 0x7fc9840c8b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:56596/0 (socket says 172.21.15.90:56596) 2023-06-09T04:42:40.926 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.923+0000 7fc98a2e9700 1 -- 172.21.15.90:0/605019711 learned_addr learned my addr 172.21.15.90:0/605019711 (peer_addr_for_me v1:172.21.15.90:0/0) 2023-06-09T04:42:40.927 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.923+0000 7fc989ae8700 1 --2- 172.21.15.90:0/605019711 >> v2:172.21.15.174:3300/0 conn(0x7fc9840cd600 0x7fc9840cc0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:40.927 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.923+0000 7fc9892e7700 1 -- 172.21.15.90:0/605019711 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 61330904 0 0) 0x7fc9840cca60 con 0x7fc984160660 2023-06-09T04:42:40.927 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.923+0000 7fc9892e7700 1 -- 172.21.15.90:0/605019711 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc9700035d0 con 0x7fc984160660 2023-06-09T04:42:40.927 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.923+0000 7fc989ae8700 1 -- 172.21.15.90:0/605019711 >> v1:172.21.15.174:6789/0 conn(0x7fc9840cc600 legacy=0x7fc984069c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:40.927 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.923+0000 7fc989ae8700 1 -- 172.21.15.90:0/605019711 >> v1:172.21.15.90:6789/0 conn(0x7fc984160660 legacy=0x7fc9840c8b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:40.928 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.927+0000 7fc989ae8700 1 -- 172.21.15.90:0/605019711 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc98406fb00 con 0x7fc9840cd600 2023-06-09T04:42:40.928 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.923+0000 7fc9892e7700 1 -- 172.21.15.90:0/605019711 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3978424159 0 0) 0x7fc9700035d0 con 0x7fc984160660 2023-06-09T04:42:40.928 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.927+0000 7fc989ae8700 1 --2- 172.21.15.90:0/605019711 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc9840cd600 0x7fc9840cc0c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fc974009850 tx=0x7fc974009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=344eb89267350acd server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:40.929 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.927+0000 7fc9892e7700 1 -- 172.21.15.90:0/605019711 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc974011830 con 0x7fc9840cd600 2023-06-09T04:42:40.929 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.927+0000 7fc9892e7700 1 -- 172.21.15.90:0/605019711 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc974011990 con 0x7fc9840cd600 2023-06-09T04:42:40.929 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.927+0000 7fc9892e7700 1 -- 172.21.15.90:0/605019711 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc974011d40 con 0x7fc9840cd600 2023-06-09T04:42:40.930 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.927+0000 7fc98c54d700 1 -- 172.21.15.90:0/605019711 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc9840cd600 msgr2=0x7fc9840cc0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:40.930 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.927+0000 7fc98c54d700 1 --2- 172.21.15.90:0/605019711 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc9840cd600 0x7fc9840cc0c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fc974009850 tx=0x7fc974009b60 comp rx=0 tx=0).stop 2023-06-09T04:42:40.930 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.927+0000 7fc98c54d700 1 -- 172.21.15.90:0/605019711 shutdown_connections 2023-06-09T04:42:40.930 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.927+0000 7fc98c54d700 1 --2- 172.21.15.90:0/605019711 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc9840cd600 0x7fc9840cc0c0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:40.930 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.927+0000 7fc98c54d700 1 -- 172.21.15.90:0/605019711 >> 172.21.15.90:0/605019711 conn(0x7fc98406c810 msgr2=0x7fc9840b0000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:40.930 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.927+0000 7fc98c54d700 1 -- 172.21.15.90:0/605019711 shutdown_connections 2023-06-09T04:42:40.931 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.927+0000 7fc98c54d700 1 -- 172.21.15.90:0/605019711 wait complete. 2023-06-09T04:42:40.932 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.931+0000 7fc98c54d700 1 Processor -- start 2023-06-09T04:42:40.933 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.931+0000 7fc98c54d700 1 -- start start 2023-06-09T04:42:40.935 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.931+0000 7fc98c54d700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc9840cc600 0x7fc98406a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:40.936 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.931+0000 7fc98c54d700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc9840cd600 0x7fc9840cccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:40.936 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.931+0000 7fc98c54d700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc984160660 0x7fc98415c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:40.936 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.931+0000 7fc98c54d700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc98406acf0 con 0x7fc9840cc600 2023-06-09T04:42:40.937 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.931+0000 7fc98c54d700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9840c3110 con 0x7fc984160660 2023-06-09T04:42:40.937 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.931+0000 7fc98c54d700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9840c33f0 con 0x7fc9840cd600 2023-06-09T04:42:40.937 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.931+0000 7fc98a2e9700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc9840cc600 0x7fc98406a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:40.937 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.931+0000 7fc98a2e9700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc9840cc600 0x7fc98406a7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:52688/0 (socket says 172.21.15.90:52688) 2023-06-09T04:42:40.938 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.931+0000 7fc98a2e9700 1 -- 172.21.15.90:0/2332223890 learned_addr learned my addr 172.21.15.90:0/2332223890 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:40.938 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.931+0000 7fc989ae8700 1 --2- 172.21.15.90:0/2332223890 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc9840cd600 0x7fc9840cccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:40.938 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.935+0000 7fc98aaea700 1 --2- 172.21.15.90:0/2332223890 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc984160660 0x7fc98415c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:40.939 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.935+0000 7fc98a2e9700 1 -- 172.21.15.90:0/2332223890 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc9840cd600 msgr2=0x7fc9840cccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:40.939 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.935+0000 7fc98a2e9700 1 --2- 172.21.15.90:0/2332223890 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc9840cd600 0x7fc9840cccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:40.939 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.935+0000 7fc98a2e9700 1 -- 172.21.15.90:0/2332223890 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc984160660 msgr2=0x7fc98415c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:40.939 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.935+0000 7fc98a2e9700 1 --2- 172.21.15.90:0/2332223890 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc984160660 0x7fc98415c800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:40.940 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.935+0000 7fc98a2e9700 1 -- 172.21.15.90:0/2332223890 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9740094b0 con 0x7fc9840cc600 2023-06-09T04:42:40.940 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.935+0000 7fc989ae8700 1 --2- 172.21.15.90:0/2332223890 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc9840cd600 0x7fc9840cccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:42:40.940 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.935+0000 7fc98a2e9700 1 --2- 172.21.15.90:0/2332223890 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc9840cc600 0x7fc98406a7b0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fc98000c470 tx=0x7fc98000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:40.942 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.935+0000 7fc97affd700 1 -- 172.21.15.90:0/2332223890 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc980005d90 con 0x7fc9840cc600 2023-06-09T04:42:40.942 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.935+0000 7fc97affd700 1 -- 172.21.15.90:0/2332223890 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9800070d0 con 0x7fc9840cc600 2023-06-09T04:42:40.942 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.935+0000 7fc98c54d700 1 -- 172.21.15.90:0/2332223890 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9840c36d0 con 0x7fc9840cc600 2023-06-09T04:42:40.942 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.935+0000 7fc97affd700 1 -- 172.21.15.90:0/2332223890 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc980007440 con 0x7fc9840cc600 2023-06-09T04:42:40.943 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.935+0000 7fc98c54d700 1 -- 172.21.15.90:0/2332223890 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9840cd210 con 0x7fc9840cc600 2023-06-09T04:42:40.943 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.935+0000 7fc98c54d700 1 -- 172.21.15.90:0/2332223890 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9841619d0 con 0x7fc9840cc600 2023-06-09T04:42:40.943 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.939+0000 7fc97affd700 1 -- 172.21.15.90:0/2332223890 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc9800075a0 con 0x7fc9840cc600 2023-06-09T04:42:40.943 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.939+0000 7fc97affd700 1 --2- 172.21.15.90:0/2332223890 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fc9680662f0 0x7fc9680687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:40.943 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.939+0000 7fc97affd700 1 -- 172.21.15.90:0/2332223890 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fc980083130 con 0x7fc9840cc600 2023-06-09T04:42:40.944 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.939+0000 7fc989ae8700 1 --2- 172.21.15.90:0/2332223890 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fc9680662f0 0x7fc9680687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:40.944 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.943+0000 7fc989ae8700 1 --2- 172.21.15.90:0/2332223890 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fc9680662f0 0x7fc9680687a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fc9740090b0 tx=0x7fc974008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:40.947 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:40.947+0000 7fc97affd700 1 -- 172.21.15.90:0/2332223890 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc9841619d0 con 0x7fc9840cc600 2023-06-09T04:42:41.132 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:41.131+0000 7fc98c54d700 1 -- 172.21.15.90:0/2332223890 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fc9841619d0 con 0x7fc9840cc600 2023-06-09T04:42:41.133 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:41.131+0000 7fc97affd700 1 -- 172.21.15.90:0/2332223890 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7fc9841619d0 con 0x7fc9840cc600 2023-06-09T04:42:41.136 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:41.135+0000 7fc98c54d700 1 -- 172.21.15.90:0/2332223890 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fc9680662f0 msgr2=0x7fc9680687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:41.137 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:41.135+0000 7fc98c54d700 1 --2- 172.21.15.90:0/2332223890 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fc9680662f0 0x7fc9680687a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fc9740090b0 tx=0x7fc974008030 comp rx=0 tx=0).stop 2023-06-09T04:42:41.137 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:41.135+0000 7fc98c54d700 1 -- 172.21.15.90:0/2332223890 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc9840cc600 msgr2=0x7fc98406a7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:41.137 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:41.135+0000 7fc98c54d700 1 --2- 172.21.15.90:0/2332223890 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc9840cc600 0x7fc98406a7b0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fc98000c470 tx=0x7fc98000c830 comp rx=0 tx=0).stop 2023-06-09T04:42:41.137 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:41.135+0000 7fc98c54d700 1 -- 172.21.15.90:0/2332223890 shutdown_connections 2023-06-09T04:42:41.137 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:41.135+0000 7fc98c54d700 1 --2- 172.21.15.90:0/2332223890 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fc9680662f0 0x7fc9680687a0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:41.137 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:41.135+0000 7fc98c54d700 1 --2- 172.21.15.90:0/2332223890 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc984160660 0x7fc98415c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:41.137 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:41.135+0000 7fc98c54d700 1 --2- 172.21.15.90:0/2332223890 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc9840cd600 0x7fc9840cccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:41.138 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:41.135+0000 7fc98c54d700 1 --2- 172.21.15.90:0/2332223890 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc9840cc600 0x7fc98406a7b0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:41.138 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:41.135+0000 7fc98c54d700 1 -- 172.21.15.90:0/2332223890 >> 172.21.15.90:0/2332223890 conn(0x7fc98406c810 msgr2=0x7fc98415e210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:41.138 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:41.135+0000 7fc98c54d700 1 -- 172.21.15.90:0/2332223890 shutdown_connections 2023-06-09T04:42:41.138 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:41.135+0000 7fc98c54d700 1 -- 172.21.15.90:0/2332223890 wait complete. 2023-06-09T04:42:41.139 INFO:teuthology.orchestra.run.smithi090.stderr:listed 0 entries 2023-06-09T04:42:41.155 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2023-06-09T04:42:41.156 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:42:41.156 DEBUG:teuthology.orchestra.run.smithi174:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2023-06-09T04:42:41.222 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi174.front.sepia.ceph.com 2023-06-09T04:42:41.223 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:42:41.223 DEBUG:teuthology.orchestra.run.smithi174:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-06-09T04:42:41.240 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-06-09T04:42:41.240 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-09T04:42:41.412 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:41.411+0000 7fd1057af700 1 Processor -- start 2023-06-09T04:42:41.413 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:41.411+0000 7fd1057af700 1 -- start start 2023-06-09T04:42:41.416 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:41.415+0000 7fd1057af700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fd1000b0610 0x7fd10006fb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:41.416 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:41.415+0000 7fd1057af700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd100069f30 0x7fd1000700b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:41.416 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:41.415+0000 7fd1057af700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd10006aa30 con 0x7fd1000b09e0 2023-06-09T04:42:41.417 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:41.415+0000 7fd1057af700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd10006a470 con 0x7fd1000b0610 2023-06-09T04:42:41.417 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:41.415+0000 7fd1057af700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd10006a750 con 0x7fd100069f30 2023-06-09T04:42:41.417 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:41.415+0000 7fd0fffff700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fd1000b0610 0x7fd10006fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:41.417 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:41.415+0000 7fd0f77fe700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7fd1000b09e0 0x7fd100069820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:56608/0 (socket says 172.21.15.90:56608) 2023-06-09T04:42:41.417 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:41.415+0000 7fd0fffff700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fd1000b0610 0x7fd10006fb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:52696/0 (socket says 172.21.15.90:52696) 2023-06-09T04:42:41.418 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:41.415+0000 7fd0f77fe700 1 -- 172.21.15.90:0/1739173247 learned_addr learned my addr 172.21.15.90:0/1739173247 (peer_addr_for_me v1:172.21.15.90:0/0) 2023-06-09T04:42:41.418 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:41.415+0000 7fd104fae700 1 --2- 172.21.15.90:0/1739173247 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd100069f30 0x7fd1000700b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:41.418 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:41.415+0000 7fd0fffff700 1 -- 172.21.15.90:0/1739173247 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd100069f30 msgr2=0x7fd1000700b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:41.418 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:41.415+0000 7fd0fffff700 1 --2- 172.21.15.90:0/1739173247 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd100069f30 0x7fd1000700b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:41.418 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:41.415+0000 7fd0fffff700 1 -- 172.21.15.90:0/1739173247 >> v1:172.21.15.90:6789/0 conn(0x7fd1000b09e0 legacy=0x7fd100069820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:41.418 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:41.415+0000 7fd0fffff700 1 -- 172.21.15.90:0/1739173247 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd100159ba0 con 0x7fd1000b0610 2023-06-09T04:42:41.418 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:41.415+0000 7fd0ff7fe700 1 -- 172.21.15.90:0/1739173247 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2595748922 0 0) 0x7fd10006aa30 con 0x7fd1000b09e0 2023-06-09T04:42:41.419 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:41.415+0000 7fd0fffff700 1 --2- 172.21.15.90:0/1739173247 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd1000b0610 0x7fd10006fb70 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fd0f0009850 tx=0x7fd0f0009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2f90d272dbc8da3 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:41.419 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:41.415+0000 7fd0ff7fe700 1 -- 172.21.15.90:0/1739173247 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0f0011830 con 0x7fd1000b0610 2023-06-09T04:42:41.420 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:41.415+0000 7fd0ff7fe700 1 -- 172.21.15.90:0/1739173247 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0f0011990 con 0x7fd1000b0610 2023-06-09T04:42:41.420 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:41.415+0000 7fd0ff7fe700 1 -- 172.21.15.90:0/1739173247 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0f0011d20 con 0x7fd1000b0610 2023-06-09T04:42:41.420 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:41.419+0000 7fd1057af700 1 -- 172.21.15.90:0/1739173247 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd1000b0610 msgr2=0x7fd10006fb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:41.420 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:41.419+0000 7fd1057af700 1 --2- 172.21.15.90:0/1739173247 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd1000b0610 0x7fd10006fb70 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fd0f0009850 tx=0x7fd0f0009b60 comp rx=0 tx=0).stop 2023-06-09T04:42:41.420 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:41.419+0000 7fd1057af700 1 -- 172.21.15.90:0/1739173247 shutdown_connections 2023-06-09T04:42:41.420 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:41.419+0000 7fd1057af700 1 --2- 172.21.15.90:0/1739173247 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd100069f30 0x7fd1000700b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:41.420 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:41.419+0000 7fd1057af700 1 --2- 172.21.15.90:0/1739173247 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd1000b0610 0x7fd10006fb70 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:41.421 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:41.419+0000 7fd1057af700 1 -- 172.21.15.90:0/1739173247 >> 172.21.15.90:0/1739173247 conn(0x7fd10006c690 msgr2=0x7fd1000aff00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:41.421 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:41.419+0000 7fd1057af700 1 -- 172.21.15.90:0/1739173247 shutdown_connections 2023-06-09T04:42:41.421 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:41.419+0000 7fd1057af700 1 -- 172.21.15.90:0/1739173247 wait complete. 2023-06-09T04:42:41.422 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:41.419+0000 7fd1057af700 1 Processor -- start 2023-06-09T04:42:41.422 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:41.419+0000 7fd1057af700 1 -- start start 2023-06-09T04:42:41.424 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:41.423+0000 7fd1057af700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd100069f30 0x7fd100142d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:41.424 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:41.423+0000 7fd1057af700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd1000b0610 0x7fd1001443e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:41.424 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:41.423+0000 7fd1057af700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd1000b09e0 0x7fd10013d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:41.425 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:41.423+0000 7fd1057af700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd10013db50 con 0x7fd100069f30 2023-06-09T04:42:41.425 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:41.423+0000 7fd1057af700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd100143340 con 0x7fd1000b09e0 2023-06-09T04:42:41.425 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:41.423+0000 7fd1057af700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd100143620 con 0x7fd1000b0610 2023-06-09T04:42:41.425 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:41.423+0000 7fd0fffff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd100069f30 0x7fd100142d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:41.425 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:41.423+0000 7fd0fffff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd100069f30 0x7fd100142d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:52710/0 (socket says 172.21.15.90:52710) 2023-06-09T04:42:41.425 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:41.423+0000 7fd0fffff700 1 -- 172.21.15.90:0/2450722222 learned_addr learned my addr 172.21.15.90:0/2450722222 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:41.426 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:41.423+0000 7fd0f77fe700 1 --2- 172.21.15.90:0/2450722222 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd1000b0610 0x7fd1001443e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:41.426 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:41.423+0000 7fd0fffff700 1 -- 172.21.15.90:0/2450722222 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd1000b0610 msgr2=0x7fd1001443e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:41.427 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:41.423+0000 7fd0fffff700 1 --2- 172.21.15.90:0/2450722222 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd1000b0610 0x7fd1001443e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:41.427 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:41.423+0000 7fd0fffff700 1 -- 172.21.15.90:0/2450722222 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd1000b09e0 msgr2=0x7fd10013d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:41.427 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:41.423+0000 7fd0fffff700 1 --2- 172.21.15.90:0/2450722222 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd1000b09e0 0x7fd10013d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:41.427 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:41.423+0000 7fd0fffff700 1 -- 172.21.15.90:0/2450722222 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0f00094b0 con 0x7fd100069f30 2023-06-09T04:42:41.427 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:41.423+0000 7fd0f77fe700 1 --2- 172.21.15.90:0/2450722222 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd1000b0610 0x7fd1001443e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:42:41.427 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:41.423+0000 7fd0fffff700 1 --2- 172.21.15.90:0/2450722222 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd100069f30 0x7fd100142d60 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fd0f0000c00 tx=0x7fd0f0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:41.427 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:41.423+0000 7fd0fd7fa700 1 -- 172.21.15.90:0/2450722222 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0f0004480 con 0x7fd100069f30 2023-06-09T04:42:41.428 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:41.423+0000 7fd0fd7fa700 1 -- 172.21.15.90:0/2450722222 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0f001f070 con 0x7fd100069f30 2023-06-09T04:42:41.428 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:41.423+0000 7fd1057af700 1 -- 172.21.15.90:0/2450722222 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd100143900 con 0x7fd100069f30 2023-06-09T04:42:41.428 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:41.423+0000 7fd0fd7fa700 1 -- 172.21.15.90:0/2450722222 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0f0003900 con 0x7fd100069f30 2023-06-09T04:42:41.428 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:41.423+0000 7fd1057af700 1 -- 172.21.15.90:0/2450722222 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd100143ec0 con 0x7fd100069f30 2023-06-09T04:42:41.428 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:41.427+0000 7fd1057af700 1 -- 172.21.15.90:0/2450722222 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd10004e380 con 0x7fd100069f30 2023-06-09T04:42:41.429 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:41.427+0000 7fd0fd7fa700 1 -- 172.21.15.90:0/2450722222 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd0f0021030 con 0x7fd100069f30 2023-06-09T04:42:41.432 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:41.431+0000 7fd0fd7fa700 1 --2- 172.21.15.90:0/2450722222 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fd0e00662f0 0x7fd0e00687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:41.432 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:41.431+0000 7fd0fd7fa700 1 -- 172.21.15.90:0/2450722222 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fd0f00851b0 con 0x7fd100069f30 2023-06-09T04:42:41.433 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:41.431+0000 7fd0f77fe700 1 --2- 172.21.15.90:0/2450722222 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fd0e00662f0 0x7fd0e00687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:41.433 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:41.431+0000 7fd0f77fe700 1 --2- 172.21.15.90:0/2450722222 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fd0e00662f0 0x7fd0e00687a0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fd1000cb620 tx=0x7fd0e8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:41.438 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:41.435+0000 7fd0fd7fa700 1 -- 172.21.15.90:0/2450722222 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd0f00525e0 con 0x7fd100069f30 2023-06-09T04:42:41.639 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:41.639+0000 7fd1057af700 1 -- 172.21.15.90:0/2450722222 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd1000cdac0 con 0x7fd100069f30 2023-06-09T04:42:41.640 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:41.639+0000 7fd0fd7fa700 1 -- 172.21.15.90:0/2450722222 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4668 (secure 0 0 0) 0x7fd0f0055c00 con 0x7fd100069f30 2023-06-09T04:42:41.641 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:42:41.641 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6836/271257743","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":271257743},{"type":"v1","addr":"172.21.15.174:6836","nonce":271257743}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4269,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6833/2861565528","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":2861565528},{"type":"v1","addr":"172.21.15.90:6833","nonce":2861565528}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/1212048840","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1212048840},{"type":"v1","addr":"172.21.15.90:6835","nonce":1212048840}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-09T04:41:54.383738+0000","modified":"2023-06-09T04:41:57.405504+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4306},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4306":{"gid":4306,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.174:6837/2976585572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6835","nonce":2976585572},{"type":"v1","addr":"172.21.15.174:6837","nonce":2976585572}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-06-09T04:42:41.643 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:41.643+0000 7fd1057af700 1 -- 172.21.15.90:0/2450722222 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fd0e00662f0 msgr2=0x7fd0e00687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:41.643 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:41.643+0000 7fd1057af700 1 --2- 172.21.15.90:0/2450722222 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fd0e00662f0 0x7fd0e00687a0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fd1000cb620 tx=0x7fd0e8009040 comp rx=0 tx=0).stop 2023-06-09T04:42:41.643 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:41.643+0000 7fd1057af700 1 -- 172.21.15.90:0/2450722222 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd100069f30 msgr2=0x7fd100142d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:41.643 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:41.643+0000 7fd1057af700 1 --2- 172.21.15.90:0/2450722222 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd100069f30 0x7fd100142d60 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fd0f0000c00 tx=0x7fd0f0004770 comp rx=0 tx=0).stop 2023-06-09T04:42:41.644 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:41.643+0000 7fd1057af700 1 -- 172.21.15.90:0/2450722222 shutdown_connections 2023-06-09T04:42:41.644 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:41.643+0000 7fd1057af700 1 --2- 172.21.15.90:0/2450722222 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fd0e00662f0 0x7fd0e00687a0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:41.644 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:41.643+0000 7fd1057af700 1 --2- 172.21.15.90:0/2450722222 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd1000b09e0 0x7fd10013d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:41.644 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:41.643+0000 7fd1057af700 1 --2- 172.21.15.90:0/2450722222 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd1000b0610 0x7fd1001443e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:41.645 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:41.643+0000 7fd1057af700 1 --2- 172.21.15.90:0/2450722222 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd100069f30 0x7fd100142d60 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:41.645 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:41.643+0000 7fd1057af700 1 -- 172.21.15.90:0/2450722222 >> 172.21.15.90:0/2450722222 conn(0x7fd10006c690 msgr2=0x7fd1000cc5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:41.645 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:41.643+0000 7fd1057af700 1 -- 172.21.15.90:0/2450722222 shutdown_connections 2023-06-09T04:42:41.645 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:41.643+0000 7fd1057af700 1 -- 172.21.15.90:0/2450722222 wait complete. 2023-06-09T04:42:41.647 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 8 2023-06-09T04:42:41.662 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T04:42:41.831 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:41.831+0000 7f193b4d8700 1 Processor -- start 2023-06-09T04:42:41.832 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:41.831+0000 7f193b4d8700 1 -- start start 2023-06-09T04:42:41.834 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:41.831+0000 7f193b4d8700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f19341574c0 0x7f19340cdb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:41.834 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:41.831+0000 7f193b4d8700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f19340cac00 0x7f19340cb050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:41.834 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:41.831+0000 7f193b4d8700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1934069820 0x7f1934069ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:41.834 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:41.831+0000 7f193b4d8700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1934157890 con 0x7f19341574c0 2023-06-09T04:42:41.834 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:41.831+0000 7f193b4d8700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19340cb590 con 0x7f1934069820 2023-06-09T04:42:41.834 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:41.831+0000 7f193b4d8700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19341647b0 con 0x7f19340cac00 2023-06-09T04:42:41.835 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:41.831+0000 7f193a4d6700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f19341574c0 0x7f19340cdb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:41.835 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:41.831+0000 7f193a4d6700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f19341574c0 0x7f19340cdb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:52714/0 (socket says 172.21.15.90:52714) 2023-06-09T04:42:41.835 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:41.831+0000 7f193a4d6700 1 -- 172.21.15.90:0/3842924919 learned_addr learned my addr 172.21.15.90:0/3842924919 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:41.836 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:41.831+0000 7f1939cd5700 1 --2- 172.21.15.90:0/3842924919 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f19340cac00 0x7f19340cb050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:41.836 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:41.831+0000 7f193acd7700 1 --2- 172.21.15.90:0/3842924919 >> v2:172.21.15.174:3300/0 conn(0x7f1934069820 0x7f1934069ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:41.836 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:41.835+0000 7f193a4d6700 1 -- 172.21.15.90:0/3842924919 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f19340cac00 msgr2=0x7f19340cb050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:41.836 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:41.835+0000 7f193a4d6700 1 --2- 172.21.15.90:0/3842924919 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f19340cac00 0x7f19340cb050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:41.836 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:41.835+0000 7f193a4d6700 1 -- 172.21.15.90:0/3842924919 >> v2:172.21.15.174:3300/0 conn(0x7f1934069820 msgr2=0x7f1934069ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:41.837 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:41.835+0000 7f193a4d6700 1 --2- 172.21.15.90:0/3842924919 >> v2:172.21.15.174:3300/0 conn(0x7f1934069820 0x7f1934069ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:41.837 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:41.835+0000 7f193a4d6700 1 -- 172.21.15.90:0/3842924919 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19340ce040 con 0x7f19341574c0 2023-06-09T04:42:41.837 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:41.835+0000 7f1939cd5700 1 --2- 172.21.15.90:0/3842924919 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f19340cac00 0x7f19340cb050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:42:41.837 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:41.835+0000 7f193acd7700 1 --2- 172.21.15.90:0/3842924919 >> v2:172.21.15.174:3300/0 conn(0x7f1934069820 0x7f1934069ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:42:41.838 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:41.835+0000 7f193a4d6700 1 --2- 172.21.15.90:0/3842924919 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f19341574c0 0x7f19340cdb00 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f1930009e50 tx=0x7f193000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3af822f985a08868 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:41.838 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:41.835+0000 7f19394d4700 1 -- 172.21.15.90:0/3842924919 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f193000e070 con 0x7f19341574c0 2023-06-09T04:42:41.838 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:41.835+0000 7f19394d4700 1 -- 172.21.15.90:0/3842924919 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f193000b980 con 0x7f19341574c0 2023-06-09T04:42:41.838 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:41.835+0000 7f19394d4700 1 -- 172.21.15.90:0/3842924919 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f193000bd30 con 0x7f19341574c0 2023-06-09T04:42:41.838 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:41.835+0000 7f193b4d8700 1 -- 172.21.15.90:0/3842924919 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f19341574c0 msgr2=0x7f19340cdb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:41.839 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:41.835+0000 7f193b4d8700 1 --2- 172.21.15.90:0/3842924919 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f19341574c0 0x7f19340cdb00 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f1930009e50 tx=0x7f193000b330 comp rx=0 tx=0).stop 2023-06-09T04:42:41.839 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:41.835+0000 7f193b4d8700 1 -- 172.21.15.90:0/3842924919 shutdown_connections 2023-06-09T04:42:41.839 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:41.835+0000 7f193b4d8700 1 --2- 172.21.15.90:0/3842924919 >> v2:172.21.15.174:3300/0 conn(0x7f1934069820 0x7f1934069ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:41.839 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:41.835+0000 7f193b4d8700 1 --2- 172.21.15.90:0/3842924919 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f19340cac00 0x7f19340cb050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:41.839 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:41.835+0000 7f193b4d8700 1 --2- 172.21.15.90:0/3842924919 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f19341574c0 0x7f19340cdb00 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:41.839 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:41.835+0000 7f193b4d8700 1 -- 172.21.15.90:0/3842924919 >> 172.21.15.90:0/3842924919 conn(0x7f193406c690 msgr2=0x7f19340aff00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:41.839 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:41.835+0000 7f193b4d8700 1 -- 172.21.15.90:0/3842924919 shutdown_connections 2023-06-09T04:42:41.839 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:41.835+0000 7f193b4d8700 1 -- 172.21.15.90:0/3842924919 wait complete. 2023-06-09T04:42:41.841 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:41.839+0000 7f193b4d8700 1 Processor -- start 2023-06-09T04:42:41.842 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:41.839+0000 7f193b4d8700 1 -- start start 2023-06-09T04:42:41.843 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:41.843+0000 7f193b4d8700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1934069820 0x7f1934155ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:41.843 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:41.843+0000 7f193b4d8700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f19340cac00 0x7f1934158d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:41.843 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:41.843+0000 7f193b4d8700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f19341574c0 0x7f1934155510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:41.843 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:41.843+0000 7f193b4d8700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1934158890 con 0x7f19341574c0 2023-06-09T04:42:41.844 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:41.843+0000 7f193b4d8700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1934159260 con 0x7f1934069820 2023-06-09T04:42:41.844 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:41.843+0000 7f193b4d8700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1934155a50 con 0x7f19340cac00 2023-06-09T04:42:41.845 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:41.843+0000 7f193acd7700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f19341574c0 0x7f1934155510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:41.845 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:41.843+0000 7f193acd7700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f19341574c0 0x7f1934155510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:52720/0 (socket says 172.21.15.90:52720) 2023-06-09T04:42:41.845 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:41.843+0000 7f193acd7700 1 -- 172.21.15.90:0/1127542957 learned_addr learned my addr 172.21.15.90:0/1127542957 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:41.845 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:41.843+0000 7f193a4d6700 1 --2- 172.21.15.90:0/1127542957 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1934069820 0x7f1934155ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:41.845 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:41.843+0000 7f1939cd5700 1 --2- 172.21.15.90:0/1127542957 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f19340cac00 0x7f1934158d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:41.845 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:41.843+0000 7f193acd7700 1 -- 172.21.15.90:0/1127542957 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f19340cac00 msgr2=0x7f1934158d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:41.846 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:41.843+0000 7f193acd7700 1 --2- 172.21.15.90:0/1127542957 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f19340cac00 0x7f1934158d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:41.846 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:41.843+0000 7f193acd7700 1 -- 172.21.15.90:0/1127542957 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1934069820 msgr2=0x7f1934155ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:41.846 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:41.843+0000 7f193acd7700 1 --2- 172.21.15.90:0/1127542957 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1934069820 0x7f1934155ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:41.846 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:41.843+0000 7f193acd7700 1 -- 172.21.15.90:0/1127542957 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1930009b30 con 0x7f19341574c0 2023-06-09T04:42:41.846 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:41.843+0000 7f193a4d6700 1 --2- 172.21.15.90:0/1127542957 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1934069820 0x7f1934155ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:42:41.846 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:41.843+0000 7f193acd7700 1 --2- 172.21.15.90:0/1127542957 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f19341574c0 0x7f1934155510 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f192c00d800 tx=0x7f192c00dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:41.847 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:41.843+0000 7f192affd700 1 -- 172.21.15.90:0/1127542957 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f192c004030 con 0x7f19341574c0 2023-06-09T04:42:41.847 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:41.843+0000 7f192affd700 1 -- 172.21.15.90:0/1127542957 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f192c004190 con 0x7f19341574c0 2023-06-09T04:42:41.847 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:41.843+0000 7f193b4d8700 1 -- 172.21.15.90:0/1127542957 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f193415d7e0 con 0x7f19341574c0 2023-06-09T04:42:41.847 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:41.843+0000 7f192affd700 1 -- 172.21.15.90:0/1127542957 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f192c004520 con 0x7f19341574c0 2023-06-09T04:42:41.847 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:41.843+0000 7f193b4d8700 1 -- 172.21.15.90:0/1127542957 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1934163390 con 0x7f19341574c0 2023-06-09T04:42:41.848 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:41.847+0000 7f193b4d8700 1 -- 172.21.15.90:0/1127542957 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f193406b390 con 0x7f19341574c0 2023-06-09T04:42:41.849 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:41.847+0000 7f192affd700 1 -- 172.21.15.90:0/1127542957 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f192c0036c0 con 0x7f19341574c0 2023-06-09T04:42:41.851 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:41.847+0000 7f192affd700 1 --2- 172.21.15.90:0/1127542957 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f1918066320 0x7f19180687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:41.851 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:41.851+0000 7f192affd700 1 -- 172.21.15.90:0/1127542957 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f192c0842b0 con 0x7f19341574c0 2023-06-09T04:42:41.851 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:41.851+0000 7f193a4d6700 1 --2- 172.21.15.90:0/1127542957 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f1918066320 0x7f19180687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:41.853 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:41.851+0000 7f193a4d6700 1 --2- 172.21.15.90:0/1127542957 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f1918066320 0x7f19180687d0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f193000b370 tx=0x7f1930009000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:41.855 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:41.855+0000 7f192affd700 1 -- 172.21.15.90:0/1127542957 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f192c0516e0 con 0x7f19341574c0 2023-06-09T04:42:42.027 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.027+0000 7f193b4d8700 1 -- 172.21.15.90:0/1127542957 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1934071c30 con 0x7f19341574c0 2023-06-09T04:42:42.030 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.027+0000 7f192affd700 1 -- 172.21.15.90:0/1127542957 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18375 (secure 0 0 0) 0x7f192c054d00 con 0x7f19341574c0 2023-06-09T04:42:42.031 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:42:42.031 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":26,"fsid":"700369c0-a111-43b4-9415-844ad1742b70","created":"2023-06-09T04:41:28.180311+0000","modified":"2023-06-09T04:42:36.122304+0000","last_up_change":"2023-06-09T04:41:40.746475+0000","last_in_change":"2023-06-09T04:41:31.262765+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-09T04:41:42.402564+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-09T04:41:47.607323+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-09T04:41:52.543474+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-09T04:41:53.382940+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"46a4a7c5-babd-4ef3-9830-51487cff5eb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":2780271267},{"type":"v1","addr":"172.21.15.90:6809","nonce":2780271267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2780271267},{"type":"v1","addr":"172.21.15.90:6811","nonce":2780271267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2780271267},{"type":"v1","addr":"172.21.15.90:6815","nonce":2780271267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2780271267},{"type":"v1","addr":"172.21.15.90:6813","nonce":2780271267}]},"public_addr":"172.21.15.90:6809/2780271267","cluster_addr":"172.21.15.90:6811/2780271267","heartbeat_back_addr":"172.21.15.90:6815/2780271267","heartbeat_front_addr":"172.21.15.90:6813/2780271267","state":["exists","up"]},{"osd":1,"uuid":"1543988f-c498-494a-a6f9-fac8413db6ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":3064028136},{"type":"v1","addr":"172.21.15.90:6801","nonce":3064028136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":3064028136},{"type":"v1","addr":"172.21.15.90:6803","nonce":3064028136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":3064028136},{"type":"v1","addr":"172.21.15.90:6807","nonce":3064028136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":3064028136},{"type":"v1","addr":"172.21.15.90:6805","nonce":3064028136}]},"public_addr":"172.21.15.90:6801/3064028136","cluster_addr":"172.21.15.90:6803/3064028136","heartbeat_back_addr":"172.21.15.90:6807/3064028136","heartbeat_front_addr":"172.21.15.90:6805/3064028136","state":["exists","up"]},{"osd":2,"uuid":"79669dd6-ffc8-4197-b9f7-b3b372b2b9b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":3713146326},{"type":"v1","addr":"172.21.15.90:6825","nonce":3713146326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":3713146326},{"type":"v1","addr":"172.21.15.90:6827","nonce":3713146326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":3713146326},{"type":"v1","addr":"172.21.15.90:6831","nonce":3713146326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":3713146326},{"type":"v1","addr":"172.21.15.90:6829","nonce":3713146326}]},"public_addr":"172.21.15.90:6825/3713146326","cluster_addr":"172.21.15.90:6827/3713146326","heartbeat_back_addr":"172.21.15.90:6831/3713146326","heartbeat_front_addr":"172.21.15.90:6829/3713146326","state":["exists","up"]},{"osd":3,"uuid":"4062ab6f-ce40-450a-aa17-b10098766c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":3499839122},{"type":"v1","addr":"172.21.15.90:6817","nonce":3499839122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":3499839122},{"type":"v1","addr":"172.21.15.90:6819","nonce":3499839122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":3499839122},{"type":"v1","addr":"172.21.15.90:6823","nonce":3499839122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":3499839122},{"type":"v1","addr":"172.21.15.90:6821","nonce":3499839122}]},"public_addr":"172.21.15.90:6817/3499839122","cluster_addr":"172.21.15.90:6819/3499839122","heartbeat_back_addr":"172.21.15.90:6823/3499839122","heartbeat_front_addr":"172.21.15.90:6821/3499839122","state":["exists","up"]},{"osd":4,"uuid":"a10820e4-b348-4d92-9796-3b01484ace1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6817","nonce":1138565854},{"type":"v1","addr":"172.21.15.174:6819","nonce":1138565854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6821","nonce":1138565854},{"type":"v1","addr":"172.21.15.174:6823","nonce":1138565854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":1138565854},{"type":"v1","addr":"172.21.15.174:6831","nonce":1138565854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":1138565854},{"type":"v1","addr":"172.21.15.174:6829","nonce":1138565854}]},"public_addr":"172.21.15.174:6819/1138565854","cluster_addr":"172.21.15.174:6823/1138565854","heartbeat_back_addr":"172.21.15.174:6831/1138565854","heartbeat_front_addr":"172.21.15.174:6829/1138565854","state":["exists","up"]},{"osd":5,"uuid":"b4da1c32-be05-420b-9346-90d91aa70569","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":1707702879},{"type":"v1","addr":"172.21.15.174:6818","nonce":1707702879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":1707702879},{"type":"v1","addr":"172.21.15.174:6822","nonce":1707702879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6827","nonce":1707702879},{"type":"v1","addr":"172.21.15.174:6828","nonce":1707702879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":1707702879},{"type":"v1","addr":"172.21.15.174:6825","nonce":1707702879}]},"public_addr":"172.21.15.174:6818/1707702879","cluster_addr":"172.21.15.174:6822/1707702879","heartbeat_back_addr":"172.21.15.174:6828/1707702879","heartbeat_front_addr":"172.21.15.174:6825/1707702879","state":["exists","up"]},{"osd":6,"uuid":"d1b98041-d243-4355-bd0a-e22cf9875b32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":864450534},{"type":"v1","addr":"172.21.15.174:6801","nonce":864450534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":864450534},{"type":"v1","addr":"172.21.15.174:6803","nonce":864450534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":864450534},{"type":"v1","addr":"172.21.15.174:6807","nonce":864450534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":864450534},{"type":"v1","addr":"172.21.15.174:6805","nonce":864450534}]},"public_addr":"172.21.15.174:6801/864450534","cluster_addr":"172.21.15.174:6803/864450534","heartbeat_back_addr":"172.21.15.174:6807/864450534","heartbeat_front_addr":"172.21.15.174:6805/864450534","state":["exists","up"]},{"osd":7,"uuid":"5a207936-f89f-416b-b79b-34ec96f77c8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":2527640659},{"type":"v1","addr":"172.21.15.174:6809","nonce":2527640659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":2527640659},{"type":"v1","addr":"172.21.15.174:6811","nonce":2527640659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":2527640659},{"type":"v1","addr":"172.21.15.174:6815","nonce":2527640659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":2527640659},{"type":"v1","addr":"172.21.15.174:6813","nonce":2527640659}]},"public_addr":"172.21.15.174:6809/2527640659","cluster_addr":"172.21.15.174:6811/2527640659","heartbeat_back_addr":"172.21.15.174:6815/2527640659","heartbeat_front_addr":"172.21.15.174:6813/2527640659","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:36.972152+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:36.984561+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:36.998817+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:37.054944+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:37.085014+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:37.115125+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:36.854608+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:36.971685+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.11","mappings":[{"from":3,"to":2}]},{"pgid":"4.3e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:42:42.035 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.031+0000 7f193b4d8700 1 -- 172.21.15.90:0/1127542957 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f1918066320 msgr2=0x7f19180687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:42.035 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.031+0000 7f193b4d8700 1 --2- 172.21.15.90:0/1127542957 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f1918066320 0x7f19180687d0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f193000b370 tx=0x7f1930009000 comp rx=0 tx=0).stop 2023-06-09T04:42:42.035 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.031+0000 7f193b4d8700 1 -- 172.21.15.90:0/1127542957 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f19341574c0 msgr2=0x7f1934155510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:42.036 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.031+0000 7f193b4d8700 1 --2- 172.21.15.90:0/1127542957 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f19341574c0 0x7f1934155510 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f192c00d800 tx=0x7f192c00dbc0 comp rx=0 tx=0).stop 2023-06-09T04:42:42.036 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.035+0000 7f193b4d8700 1 -- 172.21.15.90:0/1127542957 shutdown_connections 2023-06-09T04:42:42.036 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.035+0000 7f193b4d8700 1 --2- 172.21.15.90:0/1127542957 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f1918066320 0x7f19180687d0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:42.036 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.035+0000 7f193b4d8700 1 --2- 172.21.15.90:0/1127542957 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f19341574c0 0x7f1934155510 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:42.036 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.035+0000 7f193b4d8700 1 --2- 172.21.15.90:0/1127542957 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f19340cac00 0x7f1934158d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:42.036 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.035+0000 7f193b4d8700 1 --2- 172.21.15.90:0/1127542957 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1934069820 0x7f1934155ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:42.036 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.035+0000 7f193b4d8700 1 -- 172.21.15.90:0/1127542957 >> 172.21.15.90:0/1127542957 conn(0x7f193406c690 msgr2=0x7f19340b3840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:42.037 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.035+0000 7f193b4d8700 1 -- 172.21.15.90:0/1127542957 shutdown_connections 2023-06-09T04:42:42.037 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.035+0000 7f193b4d8700 1 -- 172.21.15.90:0/1127542957 wait complete. 2023-06-09T04:42:42.057 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-09T04:41:42.402564+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-09T04:41:47.607323+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-09T04:41:52.543474+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-09T04:41:53.382940+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-09T04:42:42.058 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-09T04:42:42.235 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.231+0000 7f2deb346700 1 Processor -- start 2023-06-09T04:42:42.235 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.231+0000 7f2deb346700 1 -- start start 2023-06-09T04:42:42.237 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.235+0000 7f2deb346700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2de4159ed0 0x7f2de40718d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:42.237 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.235+0000 7f2deb346700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2de40cc790 0x7f2de40ca5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:42.237 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.235+0000 7f2deb346700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2de40ccf60 con 0x7f2de406a230 2023-06-09T04:42:42.237 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.235+0000 7f2deb346700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2de40c91a0 con 0x7f2de4159ed0 2023-06-09T04:42:42.238 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.235+0000 7f2deb346700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2de4071e10 con 0x7f2de40cc790 2023-06-09T04:42:42.239 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.235+0000 7f2de90e2700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2de4159ed0 0x7f2de40718d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:42.240 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.235+0000 7f2de90e2700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2de4159ed0 0x7f2de40718d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:52726/0 (socket says 172.21.15.90:52726) 2023-06-09T04:42:42.240 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.235+0000 7f2de90e2700 1 -- 172.21.15.90:0/2290309533 learned_addr learned my addr 172.21.15.90:0/2290309533 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:42.240 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.235+0000 7f2de98e3700 1 --2- 172.21.15.90:0/2290309533 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2de40cc790 0x7f2de40ca5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:42.240 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.235+0000 7f2de90e2700 1 -- 172.21.15.90:0/2290309533 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2de40cc790 msgr2=0x7f2de40ca5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:42.240 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.235+0000 7f2de90e2700 1 --2- 172.21.15.90:0/2290309533 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2de40cc790 0x7f2de40ca5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:42.241 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.235+0000 7f2de90e2700 1 -- 172.21.15.90:0/2290309533 >> v1:172.21.15.174:6789/0 conn(0x7f2de406a230 legacy=0x7f2de40cc080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:42.241 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.235+0000 7f2de90e2700 1 -- 172.21.15.90:0/2290309533 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2de415a2a0 con 0x7f2de4159ed0 2023-06-09T04:42:42.241 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.235+0000 7f2de90e2700 1 --2- 172.21.15.90:0/2290309533 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2de4159ed0 0x7f2de40718d0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f2de0009910 tx=0x7f2de0009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7781f8560dce46a server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:42.241 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.239+0000 7f2ddbfff700 1 -- 172.21.15.90:0/2290309533 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2de0011830 con 0x7f2de4159ed0 2023-06-09T04:42:42.241 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.239+0000 7f2ddbfff700 1 -- 172.21.15.90:0/2290309533 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2de0011990 con 0x7f2de4159ed0 2023-06-09T04:42:42.241 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.239+0000 7f2ddbfff700 1 -- 172.21.15.90:0/2290309533 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2de0011d40 con 0x7f2de4159ed0 2023-06-09T04:42:42.242 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.239+0000 7f2deb346700 1 -- 172.21.15.90:0/2290309533 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2de4159ed0 msgr2=0x7f2de40718d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:42.242 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.239+0000 7f2deb346700 1 --2- 172.21.15.90:0/2290309533 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2de4159ed0 0x7f2de40718d0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f2de0009910 tx=0x7f2de0009c20 comp rx=0 tx=0).stop 2023-06-09T04:42:42.242 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.239+0000 7f2deb346700 1 -- 172.21.15.90:0/2290309533 shutdown_connections 2023-06-09T04:42:42.243 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.239+0000 7f2deb346700 1 --2- 172.21.15.90:0/2290309533 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2de40cc790 0x7f2de40ca5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:42.243 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.239+0000 7f2deb346700 1 --2- 172.21.15.90:0/2290309533 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2de4159ed0 0x7f2de40718d0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:42.243 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.239+0000 7f2deb346700 1 -- 172.21.15.90:0/2290309533 >> 172.21.15.90:0/2290309533 conn(0x7f2de40b00e0 msgr2=0x7f2de40b04b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:42.243 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.239+0000 7f2deb346700 1 -- 172.21.15.90:0/2290309533 shutdown_connections 2023-06-09T04:42:42.243 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.239+0000 7f2deb346700 1 -- 172.21.15.90:0/2290309533 wait complete. 2023-06-09T04:42:42.243 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.239+0000 7f2deb346700 1 Processor -- start 2023-06-09T04:42:42.244 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.239+0000 7f2deb346700 1 -- start start 2023-06-09T04:42:42.244 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.243+0000 7f2deb346700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2de406a230 0x7f2de414b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:42.245 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.243+0000 7f2deb346700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2de40cc790 0x7f2de40c5580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:42.245 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.243+0000 7f2deb346700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2de4159ed0 0x7f2de40c71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:42.245 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.243+0000 7f2deb346700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2de40c6790 con 0x7f2de406a230 2023-06-09T04:42:42.245 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.243+0000 7f2deb346700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2de40c5ac0 con 0x7f2de4159ed0 2023-06-09T04:42:42.245 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.243+0000 7f2deb346700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2de40c7f60 con 0x7f2de40cc790 2023-06-09T04:42:42.245 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.243+0000 7f2de90e2700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2de406a230 0x7f2de414b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:42.245 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.243+0000 7f2de90e2700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2de406a230 0x7f2de414b0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:52736/0 (socket says 172.21.15.90:52736) 2023-06-09T04:42:42.246 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.243+0000 7f2de90e2700 1 -- 172.21.15.90:0/3701524913 learned_addr learned my addr 172.21.15.90:0/3701524913 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:42.246 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.243+0000 7f2de88e1700 1 --2- 172.21.15.90:0/3701524913 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2de40cc790 0x7f2de40c5580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:42.246 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.243+0000 7f2de98e3700 1 --2- 172.21.15.90:0/3701524913 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2de4159ed0 0x7f2de40c71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:42.247 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.243+0000 7f2de90e2700 1 -- 172.21.15.90:0/3701524913 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2de40cc790 msgr2=0x7f2de40c5580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:42.247 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.243+0000 7f2de90e2700 1 --2- 172.21.15.90:0/3701524913 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2de40cc790 0x7f2de40c5580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:42.247 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.243+0000 7f2de90e2700 1 -- 172.21.15.90:0/3701524913 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2de4159ed0 msgr2=0x7f2de40c71e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:42.247 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.243+0000 7f2de90e2700 1 --2- 172.21.15.90:0/3701524913 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2de4159ed0 0x7f2de40c71e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:42.247 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.243+0000 7f2de90e2700 1 -- 172.21.15.90:0/3701524913 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2de0009570 con 0x7f2de406a230 2023-06-09T04:42:42.247 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.243+0000 7f2de90e2700 1 --2- 172.21.15.90:0/3701524913 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2de406a230 0x7f2de414b0a0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f2de406d060 tx=0x7f2de0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:42.248 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.243+0000 7f2dd9ffb700 1 -- 172.21.15.90:0/3701524913 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2de0004510 con 0x7f2de406a230 2023-06-09T04:42:42.248 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.243+0000 7f2dd9ffb700 1 -- 172.21.15.90:0/3701524913 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2de001e070 con 0x7f2de406a230 2023-06-09T04:42:42.248 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.243+0000 7f2deb346700 1 -- 172.21.15.90:0/3701524913 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2de40c8240 con 0x7f2de406a230 2023-06-09T04:42:42.248 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.243+0000 7f2dd9ffb700 1 -- 172.21.15.90:0/3701524913 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2de0003900 con 0x7f2de406a230 2023-06-09T04:42:42.248 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.243+0000 7f2deb346700 1 -- 172.21.15.90:0/3701524913 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2de40c6cc0 con 0x7f2de406a230 2023-06-09T04:42:42.249 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.247+0000 7f2deb346700 1 -- 172.21.15.90:0/3701524913 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2de404db30 con 0x7f2de406a230 2023-06-09T04:42:42.249 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.247+0000 7f2dd9ffb700 1 -- 172.21.15.90:0/3701524913 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2de0003a60 con 0x7f2de406a230 2023-06-09T04:42:42.251 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.251+0000 7f2dd9ffb700 1 --2- 172.21.15.90:0/3701524913 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f2dc80662f0 0x7f2dc80687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:42.251 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.251+0000 7f2dd9ffb700 1 -- 172.21.15.90:0/3701524913 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f2de0084960 con 0x7f2de406a230 2023-06-09T04:42:42.252 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.251+0000 7f2de88e1700 1 --2- 172.21.15.90:0/3701524913 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f2dc80662f0 0x7f2dc80687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:42.253 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.251+0000 7f2de88e1700 1 --2- 172.21.15.90:0/3701524913 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f2dc80662f0 0x7f2dc80687a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f2de40b4300 tx=0x7f2dd4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:42.256 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.255+0000 7f2dd9ffb700 1 -- 172.21.15.90:0/3701524913 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2de0051d90 con 0x7f2de406a230 2023-06-09T04:42:42.429 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.427+0000 7f2deb346700 1 -- 172.21.15.90:0/3701524913 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2de41576f0 con 0x7f2de406a230 2023-06-09T04:42:42.430 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.427+0000 7f2dd9ffb700 1 -- 172.21.15.90:0/3701524913 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2de00200a0 con 0x7f2de406a230 2023-06-09T04:42:42.430 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 1 2023-06-09T04:42:42.433 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.431+0000 7f2deb346700 1 -- 172.21.15.90:0/3701524913 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f2dc80662f0 msgr2=0x7f2dc80687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:42.433 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.431+0000 7f2deb346700 1 --2- 172.21.15.90:0/3701524913 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f2dc80662f0 0x7f2dc80687a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f2de40b4300 tx=0x7f2dd4009040 comp rx=0 tx=0).stop 2023-06-09T04:42:42.433 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.431+0000 7f2deb346700 1 -- 172.21.15.90:0/3701524913 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2de406a230 msgr2=0x7f2de414b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:42.433 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.431+0000 7f2deb346700 1 --2- 172.21.15.90:0/3701524913 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2de406a230 0x7f2de414b0a0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f2de406d060 tx=0x7f2de0004770 comp rx=0 tx=0).stop 2023-06-09T04:42:42.434 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.431+0000 7f2deb346700 1 -- 172.21.15.90:0/3701524913 shutdown_connections 2023-06-09T04:42:42.434 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.431+0000 7f2deb346700 1 --2- 172.21.15.90:0/3701524913 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f2dc80662f0 0x7f2dc80687a0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:42.434 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.431+0000 7f2deb346700 1 --2- 172.21.15.90:0/3701524913 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2de4159ed0 0x7f2de40c71e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:42.434 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.431+0000 7f2deb346700 1 --2- 172.21.15.90:0/3701524913 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2de40cc790 0x7f2de40c5580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:42.434 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.431+0000 7f2deb346700 1 --2- 172.21.15.90:0/3701524913 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2de406a230 0x7f2de414b0a0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:42.434 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.431+0000 7f2deb346700 1 -- 172.21.15.90:0/3701524913 >> 172.21.15.90:0/3701524913 conn(0x7f2de40b00e0 msgr2=0x7f2de41591b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:42.434 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.431+0000 7f2deb346700 1 -- 172.21.15.90:0/3701524913 shutdown_connections 2023-06-09T04:42:42.435 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.431+0000 7f2deb346700 1 -- 172.21.15.90:0/3701524913 wait complete. 2023-06-09T04:42:42.454 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-09T04:42:42.628 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.627+0000 7f03a8907700 1 Processor -- start 2023-06-09T04:42:42.628 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.627+0000 7f03a8907700 1 -- start start 2023-06-09T04:42:42.631 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.631+0000 7f03a8907700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f03a415de00 0x7f03a41612e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:42.631 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.631+0000 7f03a8907700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f03a40cda20 0x7f03a40c4640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:42.631 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.631+0000 7f03a8907700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03a40cc230 con 0x7f03a40c3170 2023-06-09T04:42:42.631 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.631+0000 7f03a8907700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03a40cde90 con 0x7f03a40cda20 2023-06-09T04:42:42.632 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.631+0000 7f03a8907700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03a406ab90 con 0x7f03a415de00 2023-06-09T04:42:42.634 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.631+0000 7f03a259c700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f03a40cda20 0x7f03a40c4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:42.634 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.631+0000 7f03a359e700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f03a40c3170 0x7f03a4069820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.90:52448/0 (socket says 172.21.15.90:52448) 2023-06-09T04:42:42.634 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.631+0000 7f03a359e700 1 -- 172.21.15.90:0/1987978858 learned_addr learned my addr 172.21.15.90:0/1987978858 (peer_addr_for_me v1:172.21.15.90:0/0) 2023-06-09T04:42:42.634 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.631+0000 7f03a2d9d700 1 --2- 172.21.15.90:0/1987978858 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f03a415de00 0x7f03a41612e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:42.635 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.631+0000 7f03a1d9b700 1 -- 172.21.15.90:0/1987978858 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 89179198 0 0) 0x7f03a40cc230 con 0x7f03a40c3170 2023-06-09T04:42:42.635 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.631+0000 7f03a1d9b700 1 -- 172.21.15.90:0/1987978858 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f038c0035d0 con 0x7f03a40c3170 2023-06-09T04:42:42.635 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.631+0000 7f03a259c700 1 -- 172.21.15.90:0/1987978858 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f03a415de00 msgr2=0x7f03a41612e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:42.636 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.631+0000 7f03a259c700 1 --2- 172.21.15.90:0/1987978858 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f03a415de00 0x7f03a41612e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:42.636 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.631+0000 7f03a259c700 1 -- 172.21.15.90:0/1987978858 >> v1:172.21.15.174:6789/0 conn(0x7f03a40c3170 legacy=0x7f03a4069820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:42.636 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.631+0000 7f03a259c700 1 -- 172.21.15.90:0/1987978858 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03a415e1d0 con 0x7f03a40cda20 2023-06-09T04:42:42.637 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.631+0000 7f03a2d9d700 1 --2- 172.21.15.90:0/1987978858 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f03a415de00 0x7f03a41612e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:42:42.638 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.631+0000 7f03a259c700 1 --2- 172.21.15.90:0/1987978858 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f03a40cda20 0x7f03a40c4640 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f0398009850 tx=0x7f0398009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eb3d2d5a4de7ed72 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:42.638 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.631+0000 7f03a1d9b700 1 -- 172.21.15.90:0/1987978858 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0398011830 con 0x7f03a40cda20 2023-06-09T04:42:42.638 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.635+0000 7f03a1d9b700 1 -- 172.21.15.90:0/1987978858 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0398011990 con 0x7f03a40cda20 2023-06-09T04:42:42.638 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.635+0000 7f03a1d9b700 1 -- 172.21.15.90:0/1987978858 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0398011d40 con 0x7f03a40cda20 2023-06-09T04:42:42.638 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.635+0000 7f03a8907700 1 -- 172.21.15.90:0/1987978858 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f03a40cda20 msgr2=0x7f03a40c4640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:42.638 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.635+0000 7f03a8907700 1 --2- 172.21.15.90:0/1987978858 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f03a40cda20 0x7f03a40c4640 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f0398009850 tx=0x7f0398009b60 comp rx=0 tx=0).stop 2023-06-09T04:42:42.639 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.635+0000 7f03a8907700 1 -- 172.21.15.90:0/1987978858 shutdown_connections 2023-06-09T04:42:42.639 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.635+0000 7f03a8907700 1 --2- 172.21.15.90:0/1987978858 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f03a40cda20 0x7f03a40c4640 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:42.639 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.635+0000 7f03a8907700 1 --2- 172.21.15.90:0/1987978858 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f03a415de00 0x7f03a41612e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:42.639 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.635+0000 7f03a8907700 1 -- 172.21.15.90:0/1987978858 >> 172.21.15.90:0/1987978858 conn(0x7f03a40aff00 msgr2=0x7f03a40b0300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:42.639 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.635+0000 7f03a8907700 1 -- 172.21.15.90:0/1987978858 shutdown_connections 2023-06-09T04:42:42.639 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.635+0000 7f03a8907700 1 -- 172.21.15.90:0/1987978858 wait complete. 2023-06-09T04:42:42.640 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.639+0000 7f03a8907700 1 Processor -- start 2023-06-09T04:42:42.641 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.639+0000 7f03a8907700 1 -- start start 2023-06-09T04:42:42.641 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.639+0000 7f03a8907700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f03a40c3170 0x7f03a41f5370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:42.641 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.639+0000 7f03a8907700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f03a40cda20 0x7f03a40c53c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:42.641 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.639+0000 7f03a8907700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f03a415de00 0x7f03a4162800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:42.642 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.639+0000 7f03a8907700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03a40c9eb0 con 0x7f03a40c3170 2023-06-09T04:42:42.642 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.639+0000 7f03a8907700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03a41632c0 con 0x7f03a40cda20 2023-06-09T04:42:42.642 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.639+0000 7f03a8907700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03a40ca090 con 0x7f03a415de00 2023-06-09T04:42:42.644 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.639+0000 7f03a2d9d700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f03a40c3170 0x7f03a41f5370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:42.644 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.639+0000 7f03a2d9d700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f03a40c3170 0x7f03a41f5370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:52746/0 (socket says 172.21.15.90:52746) 2023-06-09T04:42:42.644 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.639+0000 7f03a2d9d700 1 -- 172.21.15.90:0/29754715 learned_addr learned my addr 172.21.15.90:0/29754715 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:42.644 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.639+0000 7f03a259c700 1 --2- 172.21.15.90:0/29754715 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f03a40cda20 0x7f03a40c53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:42.644 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.639+0000 7f03a359e700 1 --2- 172.21.15.90:0/29754715 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f03a415de00 0x7f03a4162800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:42.645 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.639+0000 7f03a2d9d700 1 -- 172.21.15.90:0/29754715 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f03a415de00 msgr2=0x7f03a4162800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:42.645 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.639+0000 7f03a2d9d700 1 --2- 172.21.15.90:0/29754715 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f03a415de00 0x7f03a4162800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:42.645 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.639+0000 7f03a2d9d700 1 -- 172.21.15.90:0/29754715 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f03a40cda20 msgr2=0x7f03a40c53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:42.645 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.639+0000 7f03a2d9d700 1 --2- 172.21.15.90:0/29754715 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f03a40cda20 0x7f03a40c53c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:42.645 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.639+0000 7f03a2d9d700 1 -- 172.21.15.90:0/29754715 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03940094b0 con 0x7f03a40c3170 2023-06-09T04:42:42.645 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.639+0000 7f03a259c700 1 --2- 172.21.15.90:0/29754715 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f03a40cda20 0x7f03a40c53c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:42:42.645 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.639+0000 7f03a2d9d700 1 --2- 172.21.15.90:0/29754715 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f03a40c3170 0x7f03a41f5370 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f039400ec10 tx=0x7f039400ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:42.646 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.639+0000 7f038b7fe700 1 -- 172.21.15.90:0/29754715 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f039400c850 con 0x7f03a40c3170 2023-06-09T04:42:42.646 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.639+0000 7f038b7fe700 1 -- 172.21.15.90:0/29754715 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f039400c9b0 con 0x7f03a40c3170 2023-06-09T04:42:42.646 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.639+0000 7f03a8907700 1 -- 172.21.15.90:0/29754715 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03980094b0 con 0x7f03a40c3170 2023-06-09T04:42:42.646 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.639+0000 7f038b7fe700 1 -- 172.21.15.90:0/29754715 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f039400cd40 con 0x7f03a40c3170 2023-06-09T04:42:42.646 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.643+0000 7f03a8907700 1 -- 172.21.15.90:0/29754715 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03a40ca650 con 0x7f03a40c3170 2023-06-09T04:42:42.646 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.643+0000 7f03a8907700 1 -- 172.21.15.90:0/29754715 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03a404e380 con 0x7f03a40c3170 2023-06-09T04:42:42.647 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.643+0000 7f038b7fe700 1 -- 172.21.15.90:0/29754715 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0394013470 con 0x7f03a40c3170 2023-06-09T04:42:42.647 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.647+0000 7f038b7fe700 1 --2- 172.21.15.90:0/29754715 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f03900662f0 0x7f03900687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:42.648 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.647+0000 7f038b7fe700 1 -- 172.21.15.90:0/29754715 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f0394084210 con 0x7f03a40c3170 2023-06-09T04:42:42.648 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.647+0000 7f03a259c700 1 --2- 172.21.15.90:0/29754715 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f03900662f0 0x7f03900687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:42.649 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.647+0000 7f03a259c700 1 --2- 172.21.15.90:0/29754715 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f03900662f0 0x7f03900687a0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f03980090b0 tx=0x7f0398008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:42.653 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.651+0000 7f038b7fe700 1 -- 172.21.15.90:0/29754715 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0394051530 con 0x7f03a40c3170 2023-06-09T04:42:42.822 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.819+0000 7f03a8907700 1 -- 172.21.15.90:0/29754715 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f03a415e600 con 0x7f03a40c3170 2023-06-09T04:42:42.823 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.823+0000 7f038b7fe700 1 -- 172.21.15.90:0/29754715 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v26) v1 ==== 92+0+10 (secure 0 0 0) 0x7f039400cea0 con 0x7f03a40c3170 2023-06-09T04:42:42.823 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 8 2023-06-09T04:42:42.828 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.827+0000 7f03a8907700 1 -- 172.21.15.90:0/29754715 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f03900662f0 msgr2=0x7f03900687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:42.828 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.827+0000 7f03a8907700 1 --2- 172.21.15.90:0/29754715 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f03900662f0 0x7f03900687a0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f03980090b0 tx=0x7f0398008030 comp rx=0 tx=0).stop 2023-06-09T04:42:42.828 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.827+0000 7f03a8907700 1 -- 172.21.15.90:0/29754715 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f03a40c3170 msgr2=0x7f03a41f5370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:42.828 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.827+0000 7f03a8907700 1 --2- 172.21.15.90:0/29754715 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f03a40c3170 0x7f03a41f5370 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f039400ec10 tx=0x7f039400ef20 comp rx=0 tx=0).stop 2023-06-09T04:42:42.828 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.827+0000 7f03a8907700 1 -- 172.21.15.90:0/29754715 shutdown_connections 2023-06-09T04:42:42.829 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.827+0000 7f03a8907700 1 --2- 172.21.15.90:0/29754715 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f03900662f0 0x7f03900687a0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:42.829 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.827+0000 7f03a8907700 1 --2- 172.21.15.90:0/29754715 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f03a415de00 0x7f03a4162800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:42.829 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.827+0000 7f03a8907700 1 --2- 172.21.15.90:0/29754715 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f03a40cda20 0x7f03a40c53c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:42.829 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.827+0000 7f03a8907700 1 --2- 172.21.15.90:0/29754715 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f03a40c3170 0x7f03a41f5370 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:42.829 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.827+0000 7f03a8907700 1 -- 172.21.15.90:0/29754715 >> 172.21.15.90:0/29754715 conn(0x7f03a40aff00 msgr2=0x7f03a4070470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:42.829 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.827+0000 7f03a8907700 1 -- 172.21.15.90:0/29754715 shutdown_connections 2023-06-09T04:42:42.830 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:42.827+0000 7f03a8907700 1 -- 172.21.15.90:0/29754715 wait complete. 2023-06-09T04:42:42.847 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-09T04:42:43.018 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.015+0000 7f0e4359e700 1 Processor -- start 2023-06-09T04:42:43.019 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.015+0000 7f0e4359e700 1 -- start start 2023-06-09T04:42:43.020 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.019+0000 7f0e4359e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0e440cb3d0 0x7f0e4415a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:43.021 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.019+0000 7f0e4359e700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e440c8c90 con 0x7f0e440cd5a0 2023-06-09T04:42:43.021 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.019+0000 7f0e4359e700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e4415d9a0 con 0x7f0e4406a230 2023-06-09T04:42:43.021 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.019+0000 7f0e4359e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e4415a990 con 0x7f0e440cb3d0 2023-06-09T04:42:43.021 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.019+0000 7f0e42d9d700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f0e440cd5a0 0x7f0e4415de80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:56614/0 (socket says 172.21.15.90:56614) 2023-06-09T04:42:43.022 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.019+0000 7f0e42d9d700 1 -- 172.21.15.90:0/1679626200 learned_addr learned my addr 172.21.15.90:0/1679626200 (peer_addr_for_me v1:172.21.15.90:0/0) 2023-06-09T04:42:43.022 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.019+0000 7f0e39d9b700 1 --1- 172.21.15.90:0/1679626200 >> v1:172.21.15.174:6789/0 conn(0x7f0e4406a230 0x7f0e440ca2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.90:52452/0 (socket says 172.21.15.90:52452) 2023-06-09T04:42:43.022 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.019+0000 7f0e4259c700 1 --2- 172.21.15.90:0/1679626200 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0e440cb3d0 0x7f0e4415a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:43.023 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.019+0000 7f0e41d9b700 1 -- 172.21.15.90:0/1679626200 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 530022926 0 0) 0x7f0e4415d9a0 con 0x7f0e4406a230 2023-06-09T04:42:43.023 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.019+0000 7f0e41d9b700 1 -- 172.21.15.90:0/1679626200 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e300035d0 con 0x7f0e4406a230 2023-06-09T04:42:43.023 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.019+0000 7f0e41d9b700 1 -- 172.21.15.90:0/1679626200 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 262437106 0 0) 0x7f0e440c8c90 con 0x7f0e440cd5a0 2023-06-09T04:42:43.023 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.019+0000 7f0e41d9b700 1 -- 172.21.15.90:0/1679626200 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e4415d9a0 con 0x7f0e440cd5a0 2023-06-09T04:42:43.023 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.019+0000 7f0e4259c700 1 -- 172.21.15.90:0/1679626200 >> v1:172.21.15.174:6789/0 conn(0x7f0e4406a230 legacy=0x7f0e440ca2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:43.023 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.019+0000 7f0e4259c700 1 -- 172.21.15.90:0/1679626200 >> v1:172.21.15.90:6789/0 conn(0x7f0e440cd5a0 legacy=0x7f0e4415de80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:43.023 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.019+0000 7f0e4259c700 1 -- 172.21.15.90:0/1679626200 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e4415ac70 con 0x7f0e440cb3d0 2023-06-09T04:42:43.024 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.023+0000 7f0e4259c700 1 --2- 172.21.15.90:0/1679626200 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0e440cb3d0 0x7f0e4415a3b0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0e34009880 tx=0x7f0e34009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c9592e72d68fa55 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:43.024 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.023+0000 7f0e41d9b700 1 -- 172.21.15.90:0/1679626200 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e34011830 con 0x7f0e440cb3d0 2023-06-09T04:42:43.024 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.023+0000 7f0e41d9b700 1 -- 172.21.15.90:0/1679626200 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e34011990 con 0x7f0e440cb3d0 2023-06-09T04:42:43.025 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.023+0000 7f0e41d9b700 1 -- 172.21.15.90:0/1679626200 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e34011d20 con 0x7f0e440cb3d0 2023-06-09T04:42:43.025 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.023+0000 7f0e4359e700 1 -- 172.21.15.90:0/1679626200 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0e440cb3d0 msgr2=0x7f0e4415a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:43.025 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.023+0000 7f0e4359e700 1 --2- 172.21.15.90:0/1679626200 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0e440cb3d0 0x7f0e4415a3b0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0e34009880 tx=0x7f0e34009b90 comp rx=0 tx=0).stop 2023-06-09T04:42:43.026 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.023+0000 7f0e4359e700 1 -- 172.21.15.90:0/1679626200 shutdown_connections 2023-06-09T04:42:43.026 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.023+0000 7f0e4359e700 1 --2- 172.21.15.90:0/1679626200 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0e440cb3d0 0x7f0e4415a3b0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:43.026 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.023+0000 7f0e4359e700 1 -- 172.21.15.90:0/1679626200 >> 172.21.15.90:0/1679626200 conn(0x7f0e440aff00 msgr2=0x7f0e440b0300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:43.026 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.023+0000 7f0e4359e700 1 -- 172.21.15.90:0/1679626200 shutdown_connections 2023-06-09T04:42:43.026 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.023+0000 7f0e4359e700 1 -- 172.21.15.90:0/1679626200 wait complete. 2023-06-09T04:42:43.029 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.027+0000 7f0e4359e700 1 Processor -- start 2023-06-09T04:42:43.029 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.027+0000 7f0e4359e700 1 -- start start 2023-06-09T04:42:43.032 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.031+0000 7f0e4359e700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0e4406a230 0x7f0e441f0410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:43.032 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.031+0000 7f0e4359e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0e440cb3d0 0x7f0e441f31f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:43.032 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.031+0000 7f0e4359e700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0e440cd5a0 0x7f0e440c78c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:43.032 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.031+0000 7f0e4359e700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e441f0950 con 0x7f0e4406a230 2023-06-09T04:42:43.032 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.031+0000 7f0e4359e700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e441f3de0 con 0x7f0e440cd5a0 2023-06-09T04:42:43.032 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.031+0000 7f0e4359e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e440b3250 con 0x7f0e440cb3d0 2023-06-09T04:42:43.033 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.031+0000 7f0e4259c700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0e4406a230 0x7f0e441f0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:43.033 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.031+0000 7f0e4259c700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0e4406a230 0x7f0e441f0410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:52752/0 (socket says 172.21.15.90:52752) 2023-06-09T04:42:43.034 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.031+0000 7f0e4259c700 1 -- 172.21.15.90:0/563959268 learned_addr learned my addr 172.21.15.90:0/563959268 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:43.034 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.031+0000 7f0e42d9d700 1 --2- 172.21.15.90:0/563959268 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0e440cd5a0 0x7f0e440c78c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:43.034 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.031+0000 7f0e39d9b700 1 --2- 172.21.15.90:0/563959268 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0e440cb3d0 0x7f0e441f31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:43.034 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.031+0000 7f0e4259c700 1 -- 172.21.15.90:0/563959268 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0e440cb3d0 msgr2=0x7f0e441f31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:43.036 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.031+0000 7f0e4259c700 1 --2- 172.21.15.90:0/563959268 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0e440cb3d0 0x7f0e441f31f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:43.036 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.031+0000 7f0e4259c700 1 -- 172.21.15.90:0/563959268 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0e440cd5a0 msgr2=0x7f0e440c78c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:43.036 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.031+0000 7f0e4259c700 1 --2- 172.21.15.90:0/563959268 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0e440cd5a0 0x7f0e440c78c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:43.037 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.031+0000 7f0e4259c700 1 -- 172.21.15.90:0/563959268 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e340094b0 con 0x7f0e4406a230 2023-06-09T04:42:43.037 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.031+0000 7f0e4259c700 1 --2- 172.21.15.90:0/563959268 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0e4406a230 0x7f0e441f0410 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f0e34013040 tx=0x7f0e34004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:43.037 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.031+0000 7f0e3b7fe700 1 -- 172.21.15.90:0/563959268 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e3401a8c0 con 0x7f0e4406a230 2023-06-09T04:42:43.038 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.031+0000 7f0e3b7fe700 1 -- 172.21.15.90:0/563959268 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e3401e070 con 0x7f0e4406a230 2023-06-09T04:42:43.038 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.031+0000 7f0e4359e700 1 -- 172.21.15.90:0/563959268 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e440b3530 con 0x7f0e4406a230 2023-06-09T04:42:43.038 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.031+0000 7f0e3b7fe700 1 -- 172.21.15.90:0/563959268 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e3401ac40 con 0x7f0e4406a230 2023-06-09T04:42:43.038 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.031+0000 7f0e4359e700 1 -- 172.21.15.90:0/563959268 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e440b3af0 con 0x7f0e4406a230 2023-06-09T04:42:43.038 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.035+0000 7f0e4359e700 1 -- 172.21.15.90:0/563959268 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e4406a020 con 0x7f0e4406a230 2023-06-09T04:42:43.038 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.035+0000 7f0e3b7fe700 1 -- 172.21.15.90:0/563959268 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0e3402d450 con 0x7f0e4406a230 2023-06-09T04:42:43.039 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.039+0000 7f0e3b7fe700 1 --2- 172.21.15.90:0/563959268 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f0e240662f0 0x7f0e240687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:43.039 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.039+0000 7f0e3b7fe700 1 -- 172.21.15.90:0/563959268 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f0e34084c40 con 0x7f0e4406a230 2023-06-09T04:42:43.040 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.039+0000 7f0e39d9b700 1 --2- 172.21.15.90:0/563959268 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f0e240662f0 0x7f0e240687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:43.041 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.039+0000 7f0e39d9b700 1 --2- 172.21.15.90:0/563959268 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f0e240662f0 0x7f0e240687a0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f0e441ed580 tx=0x7f0e2c0018f0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:43.047 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.047+0000 7f0e3b7fe700 1 -- 172.21.15.90:0/563959268 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0e34052070 con 0x7f0e4406a230 2023-06-09T04:42:43.218 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.215+0000 7f0e4359e700 1 -- 172.21.15.90:0/563959268 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0e4404e380 con 0x7f0e4406a230 2023-06-09T04:42:43.219 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.215+0000 7f0e3b7fe700 1 -- 172.21.15.90:0/563959268 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0e340200a0 con 0x7f0e4406a230 2023-06-09T04:42:43.219 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 32 2023-06-09T04:42:43.221 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.219+0000 7f0e4359e700 1 -- 172.21.15.90:0/563959268 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f0e240662f0 msgr2=0x7f0e240687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:43.222 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.219+0000 7f0e4359e700 1 --2- 172.21.15.90:0/563959268 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f0e240662f0 0x7f0e240687a0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f0e441ed580 tx=0x7f0e2c0018f0 comp rx=0 tx=0).stop 2023-06-09T04:42:43.222 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.219+0000 7f0e4359e700 1 -- 172.21.15.90:0/563959268 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0e4406a230 msgr2=0x7f0e441f0410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:43.222 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.219+0000 7f0e4359e700 1 --2- 172.21.15.90:0/563959268 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0e4406a230 0x7f0e441f0410 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f0e34013040 tx=0x7f0e34004770 comp rx=0 tx=0).stop 2023-06-09T04:42:43.222 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.219+0000 7f0e4359e700 1 -- 172.21.15.90:0/563959268 shutdown_connections 2023-06-09T04:42:43.222 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.219+0000 7f0e4359e700 1 --2- 172.21.15.90:0/563959268 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f0e240662f0 0x7f0e240687a0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:43.222 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.219+0000 7f0e4359e700 1 --2- 172.21.15.90:0/563959268 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0e440cd5a0 0x7f0e440c78c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:43.222 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.219+0000 7f0e4359e700 1 --2- 172.21.15.90:0/563959268 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0e440cb3d0 0x7f0e441f31f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:43.223 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.219+0000 7f0e4359e700 1 --2- 172.21.15.90:0/563959268 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0e4406a230 0x7f0e441f0410 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:43.223 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.219+0000 7f0e4359e700 1 -- 172.21.15.90:0/563959268 >> 172.21.15.90:0/563959268 conn(0x7f0e440aff00 msgr2=0x7f0e44152f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:43.223 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.219+0000 7f0e4359e700 1 -- 172.21.15.90:0/563959268 shutdown_connections 2023-06-09T04:42:43.223 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.219+0000 7f0e4359e700 1 -- 172.21.15.90:0/563959268 wait complete. 2023-06-09T04:42:43.241 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-09T04:42:43.417 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.415+0000 7f79171d9700 1 Processor -- start 2023-06-09T04:42:43.417 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.415+0000 7f79171d9700 1 -- start start 2023-06-09T04:42:43.419 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.415+0000 7f79171d9700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f791015de00 0x7f79101612e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:43.419 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.419+0000 7f79171d9700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79100cc230 con 0x7f79100cda20 2023-06-09T04:42:43.419 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.419+0000 7f79171d9700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f791015e1d0 con 0x7f79100c3170 2023-06-09T04:42:43.420 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.419+0000 7f79171d9700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79100cde90 con 0x7f791015de00 2023-06-09T04:42:43.420 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.419+0000 7f79161d7700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f791015de00 0x7f79101612e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:43.420 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.419+0000 7f79161d7700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f791015de00 0x7f79101612e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:52754/0 (socket says 172.21.15.90:52754) 2023-06-09T04:42:43.420 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.419+0000 7f79161d7700 1 -- 172.21.15.90:0/2401178729 learned_addr learned my addr 172.21.15.90:0/2401178729 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:43.420 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.419+0000 7f79159d6700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f79100cda20 0x7f79100c4640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:56620/0 (socket says 172.21.15.90:56620) 2023-06-09T04:42:43.421 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.419+0000 7f79161d7700 1 -- 172.21.15.90:0/2401178729 >> v1:172.21.15.174:6789/0 conn(0x7f79100c3170 legacy=0x7f7910069820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:43.421 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.419+0000 7f79161d7700 1 -- 172.21.15.90:0/2401178729 >> v1:172.21.15.90:6789/0 conn(0x7f79100cda20 legacy=0x7f79100c4640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:43.421 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.419+0000 7f79161d7700 1 -- 172.21.15.90:0/2401178729 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f791006ada0 con 0x7f791015de00 2023-06-09T04:42:43.421 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.419+0000 7f79161d7700 1 --2- 172.21.15.90:0/2401178729 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f791015de00 0x7f79101612e0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f790c009910 tx=0x7f790c009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2acc0a29482e9a0c server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:43.422 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.419+0000 7f79151d5700 1 -- 172.21.15.90:0/2401178729 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f790c004230 con 0x7f791015de00 2023-06-09T04:42:43.422 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.419+0000 7f79151d5700 1 -- 172.21.15.90:0/2401178729 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f790c004390 con 0x7f791015de00 2023-06-09T04:42:43.422 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.419+0000 7f79151d5700 1 -- 172.21.15.90:0/2401178729 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f790c009e60 con 0x7f791015de00 2023-06-09T04:42:43.422 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.419+0000 7f79171d9700 1 -- 172.21.15.90:0/2401178729 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f791015de00 msgr2=0x7f79101612e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:43.423 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.419+0000 7f79171d9700 1 --2- 172.21.15.90:0/2401178729 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f791015de00 0x7f79101612e0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f790c009910 tx=0x7f790c009c20 comp rx=0 tx=0).stop 2023-06-09T04:42:43.423 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.419+0000 7f79171d9700 1 -- 172.21.15.90:0/2401178729 shutdown_connections 2023-06-09T04:42:43.423 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.419+0000 7f79171d9700 1 --2- 172.21.15.90:0/2401178729 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f791015de00 0x7f79101612e0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:43.423 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.419+0000 7f79171d9700 1 -- 172.21.15.90:0/2401178729 >> 172.21.15.90:0/2401178729 conn(0x7f79100aff00 msgr2=0x7f79100b0300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:43.423 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.419+0000 7f79171d9700 1 -- 172.21.15.90:0/2401178729 shutdown_connections 2023-06-09T04:42:43.423 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.419+0000 7f79171d9700 1 -- 172.21.15.90:0/2401178729 wait complete. 2023-06-09T04:42:43.424 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.423+0000 7f79171d9700 1 Processor -- start 2023-06-09T04:42:43.425 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.423+0000 7f79171d9700 1 -- start start 2023-06-09T04:42:43.425 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.423+0000 7f79171d9700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f79100c3170 0x7f79100b1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:43.426 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.423+0000 7f79171d9700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f79100cda20 0x7f79101f5d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:43.426 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.423+0000 7f79171d9700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f791015de00 0x7f79100c73e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:43.426 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.423+0000 7f79171d9700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79101625f0 con 0x7f79100cda20 2023-06-09T04:42:43.426 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.423+0000 7f79171d9700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79101f6570 con 0x7f791015de00 2023-06-09T04:42:43.426 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.423+0000 7f79171d9700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79101f6850 con 0x7f79100c3170 2023-06-09T04:42:43.427 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.423+0000 7f79159d6700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f79100cda20 0x7f79101f5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:43.427 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.423+0000 7f79159d6700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f79100cda20 0x7f79101f5d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:52768/0 (socket says 172.21.15.90:52768) 2023-06-09T04:42:43.427 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.423+0000 7f79159d6700 1 -- 172.21.15.90:0/1043515769 learned_addr learned my addr 172.21.15.90:0/1043515769 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:43.427 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.423+0000 7f79161d7700 1 --2- 172.21.15.90:0/1043515769 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f79100c3170 0x7f79100b1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:43.428 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.423+0000 7f79169d8700 1 --2- 172.21.15.90:0/1043515769 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f791015de00 0x7f79100c73e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:43.428 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.423+0000 7f79159d6700 1 -- 172.21.15.90:0/1043515769 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f79100c3170 msgr2=0x7f79100b1fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:43.428 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.423+0000 7f79159d6700 1 --2- 172.21.15.90:0/1043515769 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f79100c3170 0x7f79100b1fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:43.428 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.423+0000 7f79159d6700 1 -- 172.21.15.90:0/1043515769 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f791015de00 msgr2=0x7f79100c73e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:43.428 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.423+0000 7f79159d6700 1 --2- 172.21.15.90:0/1043515769 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f791015de00 0x7f79100c73e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:43.428 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.423+0000 7f79159d6700 1 -- 172.21.15.90:0/1043515769 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f790c009570 con 0x7f79100cda20 2023-06-09T04:42:43.429 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.427+0000 7f79161d7700 1 --2- 172.21.15.90:0/1043515769 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f79100c3170 0x7f79100b1fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:42:43.429 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.427+0000 7f79169d8700 1 --2- 172.21.15.90:0/1043515769 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f791015de00 0x7f79100c73e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:42:43.429 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.427+0000 7f79159d6700 1 --2- 172.21.15.90:0/1043515769 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f79100cda20 0x7f79101f5d20 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f790000c500 tx=0x7f790000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:43.430 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.427+0000 7f7906ffd700 1 -- 172.21.15.90:0/1043515769 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7900005cd0 con 0x7f79100cda20 2023-06-09T04:42:43.430 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.427+0000 7f7906ffd700 1 -- 172.21.15.90:0/1043515769 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7900005e30 con 0x7f79100cda20 2023-06-09T04:42:43.430 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.427+0000 7f7906ffd700 1 -- 172.21.15.90:0/1043515769 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79000072f0 con 0x7f79100cda20 2023-06-09T04:42:43.430 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.427+0000 7f79171d9700 1 -- 172.21.15.90:0/1043515769 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79101f6b30 con 0x7f79100cda20 2023-06-09T04:42:43.430 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.427+0000 7f79171d9700 1 -- 172.21.15.90:0/1043515769 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79101f6260 con 0x7f79100cda20 2023-06-09T04:42:43.430 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.427+0000 7f79171d9700 1 -- 172.21.15.90:0/1043515769 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79101629e0 con 0x7f79100cda20 2023-06-09T04:42:43.431 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.427+0000 7f7906ffd700 1 -- 172.21.15.90:0/1043515769 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7900007450 con 0x7f79100cda20 2023-06-09T04:42:43.431 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.431+0000 7f7906ffd700 1 --2- 172.21.15.90:0/1043515769 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f78f40662f0 0x7f78f40687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:43.432 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.431+0000 7f7906ffd700 1 -- 172.21.15.90:0/1043515769 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f7900083260 con 0x7f79100cda20 2023-06-09T04:42:43.432 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.431+0000 7f79161d7700 1 --2- 172.21.15.90:0/1043515769 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f78f40662f0 0x7f78f40687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:43.433 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.431+0000 7f79161d7700 1 --2- 172.21.15.90:0/1043515769 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f78f40662f0 0x7f78f40687a0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f790c009910 tx=0x7f790c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:43.439 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.439+0000 7f7906ffd700 1 -- 172.21.15.90:0/1043515769 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f79000506a0 con 0x7f79100cda20 2023-06-09T04:42:43.613 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.611+0000 7f79171d9700 1 -- 172.21.15.90:0/1043515769 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f791004e380 con 0x7f79100cda20 2023-06-09T04:42:43.614 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.611+0000 7f7906ffd700 1 -- 172.21.15.90:0/1043515769 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7900053cc0 con 0x7f79100cda20 2023-06-09T04:42:43.614 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 64 2023-06-09T04:42:43.617 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.615+0000 7f79171d9700 1 -- 172.21.15.90:0/1043515769 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f78f40662f0 msgr2=0x7f78f40687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:43.617 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.615+0000 7f79171d9700 1 --2- 172.21.15.90:0/1043515769 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f78f40662f0 0x7f78f40687a0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f790c009910 tx=0x7f790c008030 comp rx=0 tx=0).stop 2023-06-09T04:42:43.618 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.615+0000 7f79171d9700 1 -- 172.21.15.90:0/1043515769 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f79100cda20 msgr2=0x7f79101f5d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:43.618 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.615+0000 7f79171d9700 1 --2- 172.21.15.90:0/1043515769 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f79100cda20 0x7f79101f5d20 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f790000c500 tx=0x7f790000c8c0 comp rx=0 tx=0).stop 2023-06-09T04:42:43.618 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.615+0000 7f79171d9700 1 -- 172.21.15.90:0/1043515769 shutdown_connections 2023-06-09T04:42:43.619 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.615+0000 7f79171d9700 1 --2- 172.21.15.90:0/1043515769 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f78f40662f0 0x7f78f40687a0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:43.619 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.615+0000 7f79171d9700 1 --2- 172.21.15.90:0/1043515769 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f791015de00 0x7f79100c73e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:43.619 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.615+0000 7f79171d9700 1 --2- 172.21.15.90:0/1043515769 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f79100cda20 0x7f79101f5d20 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:43.619 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.615+0000 7f79171d9700 1 --2- 172.21.15.90:0/1043515769 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f79100c3170 0x7f79100b1fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:43.620 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.615+0000 7f79171d9700 1 -- 172.21.15.90:0/1043515769 >> 172.21.15.90:0/1043515769 conn(0x7f79100aff00 msgr2=0x7f7910070fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:43.620 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.615+0000 7f79171d9700 1 -- 172.21.15.90:0/1043515769 shutdown_connections 2023-06-09T04:42:43.620 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.615+0000 7f79171d9700 1 -- 172.21.15.90:0/1043515769 wait complete. 2023-06-09T04:42:43.636 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-09T04:42:43.802 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.799+0000 7ff5457aa700 1 Processor -- start 2023-06-09T04:42:43.803 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.799+0000 7ff5457aa700 1 -- start start 2023-06-09T04:42:43.804 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.803+0000 7ff5457aa700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ff540154370 0x7ff5400c8b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:43.804 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.803+0000 7ff5457aa700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7ff5400ca7a0 0x7ff5400ad920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:43.805 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.803+0000 7ff5457aa700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5400cae10 con 0x7ff54015da10 2023-06-09T04:42:43.805 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.803+0000 7ff5457aa700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5400cac20 con 0x7ff5400ca7a0 2023-06-09T04:42:43.805 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.803+0000 7ff5457aa700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5400cb0f0 con 0x7ff540154370 2023-06-09T04:42:43.806 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.803+0000 7ff5367fc700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7ff5400ca7a0 0x7ff5400ad920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:43.806 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.803+0000 7ff5367fc700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7ff5400ca7a0 0x7ff5400ad920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:52782/0 (socket says 172.21.15.90:52782) 2023-06-09T04:42:43.806 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.803+0000 7ff5367fc700 1 -- 172.21.15.90:0/791536424 learned_addr learned my addr 172.21.15.90:0/791536424 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:43.806 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.803+0000 7ff53f7fe700 1 --1- 172.21.15.90:0/791536424 >> v1:172.21.15.90:6789/0 conn(0x7ff54015da10 0x7ff5400b3340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:56626/0 (socket says 172.21.15.90:56626) 2023-06-09T04:42:43.806 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.803+0000 7ff53effd700 1 --2- 172.21.15.90:0/791536424 >> v2:172.21.15.174:3300/0 conn(0x7ff540154370 0x7ff5400c8b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:43.807 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.803+0000 7ff5367fc700 1 -- 172.21.15.90:0/791536424 >> v2:172.21.15.174:3300/0 conn(0x7ff540154370 msgr2=0x7ff5400c8b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:43.807 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.803+0000 7ff5367fc700 1 --2- 172.21.15.90:0/791536424 >> v2:172.21.15.174:3300/0 conn(0x7ff540154370 0x7ff5400c8b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:43.807 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.803+0000 7ff5367fc700 1 -- 172.21.15.90:0/791536424 >> v1:172.21.15.90:6789/0 conn(0x7ff54015da10 legacy=0x7ff5400b3340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:43.807 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.803+0000 7ff5367fc700 1 -- 172.21.15.90:0/791536424 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5400cb3d0 con 0x7ff5400ca7a0 2023-06-09T04:42:43.807 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.803+0000 7ff5367fc700 1 --2- 172.21.15.90:0/791536424 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff5400ca7a0 0x7ff5400ad920 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7ff54006dda0 tx=0x7ff528009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c81725172eaedb61 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:43.808 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.803+0000 7ff53e7fc700 1 -- 172.21.15.90:0/791536424 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff52800b8a0 con 0x7ff5400ca7a0 2023-06-09T04:42:43.808 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.803+0000 7ff53e7fc700 1 -- 172.21.15.90:0/791536424 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff52800ba00 con 0x7ff5400ca7a0 2023-06-09T04:42:43.809 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.803+0000 7ff53e7fc700 1 -- 172.21.15.90:0/791536424 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff52800bd90 con 0x7ff5400ca7a0 2023-06-09T04:42:43.809 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.807+0000 7ff5457aa700 1 -- 172.21.15.90:0/791536424 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff5400ca7a0 msgr2=0x7ff5400ad920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:43.809 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.807+0000 7ff5457aa700 1 --2- 172.21.15.90:0/791536424 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff5400ca7a0 0x7ff5400ad920 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7ff54006dda0 tx=0x7ff528009bf0 comp rx=0 tx=0).stop 2023-06-09T04:42:43.809 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.807+0000 7ff5457aa700 1 -- 172.21.15.90:0/791536424 shutdown_connections 2023-06-09T04:42:43.809 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.807+0000 7ff5457aa700 1 --2- 172.21.15.90:0/791536424 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff5400ca7a0 0x7ff5400ad920 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:43.809 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.807+0000 7ff5457aa700 1 --2- 172.21.15.90:0/791536424 >> v2:172.21.15.174:3300/0 conn(0x7ff540154370 0x7ff5400c8b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:43.809 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.807+0000 7ff5457aa700 1 -- 172.21.15.90:0/791536424 >> 172.21.15.90:0/791536424 conn(0x7ff54006c810 msgr2=0x7ff5400b0000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:43.810 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.807+0000 7ff5457aa700 1 -- 172.21.15.90:0/791536424 shutdown_connections 2023-06-09T04:42:43.810 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.807+0000 7ff5457aa700 1 -- 172.21.15.90:0/791536424 wait complete. 2023-06-09T04:42:43.810 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.807+0000 7ff5457aa700 1 Processor -- start 2023-06-09T04:42:43.811 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.811+0000 7ff5457aa700 1 -- start start 2023-06-09T04:42:43.812 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.811+0000 7ff5457aa700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff5400ca7a0 0x7ff5400c4420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:43.812 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.811+0000 7ff5457aa700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff540154370 0x7ff540156f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:43.813 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.811+0000 7ff5457aa700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff54015da10 0x7ff540157fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:43.813 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.811+0000 7ff5457aa700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5400c2620 con 0x7ff5400ca7a0 2023-06-09T04:42:43.813 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.811+0000 7ff5457aa700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5400c2060 con 0x7ff54015da10 2023-06-09T04:42:43.813 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.811+0000 7ff5457aa700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff540157870 con 0x7ff540154370 2023-06-09T04:42:43.814 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.811+0000 7ff53effd700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff5400ca7a0 0x7ff5400c4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:43.815 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.811+0000 7ff53effd700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff5400ca7a0 0x7ff5400c4420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:52792/0 (socket says 172.21.15.90:52792) 2023-06-09T04:42:43.815 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.811+0000 7ff53effd700 1 -- 172.21.15.90:0/3046867983 learned_addr learned my addr 172.21.15.90:0/3046867983 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:43.815 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.811+0000 7ff53f7fe700 1 --2- 172.21.15.90:0/3046867983 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff54015da10 0x7ff540157fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:43.815 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.811+0000 7ff5367fc700 1 --2- 172.21.15.90:0/3046867983 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff540154370 0x7ff540156f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:43.815 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.811+0000 7ff53effd700 1 -- 172.21.15.90:0/3046867983 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff540154370 msgr2=0x7ff540156f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:43.815 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.811+0000 7ff53effd700 1 --2- 172.21.15.90:0/3046867983 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff540154370 0x7ff540156f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:43.815 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.811+0000 7ff53effd700 1 -- 172.21.15.90:0/3046867983 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff54015da10 msgr2=0x7ff540157fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:43.816 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.811+0000 7ff53effd700 1 --2- 172.21.15.90:0/3046867983 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff54015da10 0x7ff540157fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:43.816 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.811+0000 7ff53effd700 1 -- 172.21.15.90:0/3046867983 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff528009570 con 0x7ff5400ca7a0 2023-06-09T04:42:43.816 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.811+0000 7ff5367fc700 1 --2- 172.21.15.90:0/3046867983 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff540154370 0x7ff540156f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:42:43.816 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.811+0000 7ff53f7fe700 1 --2- 172.21.15.90:0/3046867983 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff54015da10 0x7ff540157fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:42:43.816 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.811+0000 7ff53effd700 1 --2- 172.21.15.90:0/3046867983 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff5400ca7a0 0x7ff5400c4420 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7ff53000e760 tx=0x7ff53000eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:43.816 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.811+0000 7ff537fff700 1 -- 172.21.15.90:0/3046867983 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff530013610 con 0x7ff5400ca7a0 2023-06-09T04:42:43.817 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.811+0000 7ff537fff700 1 -- 172.21.15.90:0/3046867983 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff530013770 con 0x7ff5400ca7a0 2023-06-09T04:42:43.817 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.811+0000 7ff537fff700 1 -- 172.21.15.90:0/3046867983 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff530013ae0 con 0x7ff5400ca7a0 2023-06-09T04:42:43.817 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.811+0000 7ff5457aa700 1 -- 172.21.15.90:0/3046867983 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5401548c0 con 0x7ff5400ca7a0 2023-06-09T04:42:43.817 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.811+0000 7ff5457aa700 1 -- 172.21.15.90:0/3046867983 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5400c22b0 con 0x7ff5400ca7a0 2023-06-09T04:42:43.817 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.815+0000 7ff5457aa700 1 -- 172.21.15.90:0/3046867983 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff54004db30 con 0x7ff5400ca7a0 2023-06-09T04:42:43.818 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.815+0000 7ff537fff700 1 -- 172.21.15.90:0/3046867983 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff530013c40 con 0x7ff5400ca7a0 2023-06-09T04:42:43.819 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.819+0000 7ff537fff700 1 --2- 172.21.15.90:0/3046867983 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7ff5200662f0 0x7ff5200687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:43.819 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.819+0000 7ff537fff700 1 -- 172.21.15.90:0/3046867983 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7ff530083a00 con 0x7ff5400ca7a0 2023-06-09T04:42:43.820 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.819+0000 7ff5367fc700 1 --2- 172.21.15.90:0/3046867983 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7ff5200662f0 0x7ff5200687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:43.821 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.819+0000 7ff5367fc700 1 --2- 172.21.15.90:0/3046867983 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7ff5200662f0 0x7ff5200687a0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7ff540159740 tx=0x7ff528008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:43.824 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:43.823+0000 7ff537fff700 1 -- 172.21.15.90:0/3046867983 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff5300548c0 con 0x7ff5400ca7a0 2023-06-09T04:42:44.027 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.027+0000 7ff5457aa700 1 -- 172.21.15.90:0/3046867983 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff5400730b0 con 0x7ff5400ca7a0 2023-06-09T04:42:44.028 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.027+0000 7ff537fff700 1 -- 172.21.15.90:0/3046867983 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4668 (secure 0 0 0) 0x7ff530054450 con 0x7ff5400ca7a0 2023-06-09T04:42:44.029 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:42:44.029 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6836/271257743","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":271257743},{"type":"v1","addr":"172.21.15.174:6836","nonce":271257743}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4269,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6833/2861565528","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":2861565528},{"type":"v1","addr":"172.21.15.90:6833","nonce":2861565528}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/1212048840","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1212048840},{"type":"v1","addr":"172.21.15.90:6835","nonce":1212048840}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-09T04:41:54.383738+0000","modified":"2023-06-09T04:41:57.405504+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4306},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4306":{"gid":4306,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.174:6837/2976585572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6835","nonce":2976585572},{"type":"v1","addr":"172.21.15.174:6837","nonce":2976585572}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-06-09T04:42:44.031 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.027+0000 7ff5457aa700 1 -- 172.21.15.90:0/3046867983 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7ff5200662f0 msgr2=0x7ff5200687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:44.031 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.027+0000 7ff5457aa700 1 --2- 172.21.15.90:0/3046867983 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7ff5200662f0 0x7ff5200687a0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7ff540159740 tx=0x7ff528008030 comp rx=0 tx=0).stop 2023-06-09T04:42:44.031 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.027+0000 7ff5457aa700 1 -- 172.21.15.90:0/3046867983 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff5400ca7a0 msgr2=0x7ff5400c4420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:44.032 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.027+0000 7ff5457aa700 1 --2- 172.21.15.90:0/3046867983 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff5400ca7a0 0x7ff5400c4420 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7ff53000e760 tx=0x7ff53000eb20 comp rx=0 tx=0).stop 2023-06-09T04:42:44.032 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.031+0000 7ff5457aa700 1 -- 172.21.15.90:0/3046867983 shutdown_connections 2023-06-09T04:42:44.032 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.031+0000 7ff5457aa700 1 --2- 172.21.15.90:0/3046867983 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7ff5200662f0 0x7ff5200687a0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:44.032 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.031+0000 7ff5457aa700 1 --2- 172.21.15.90:0/3046867983 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff54015da10 0x7ff540157fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:44.032 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.031+0000 7ff5457aa700 1 --2- 172.21.15.90:0/3046867983 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff540154370 0x7ff540156f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:44.033 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.031+0000 7ff5457aa700 1 --2- 172.21.15.90:0/3046867983 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff5400ca7a0 0x7ff5400c4420 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:44.033 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.031+0000 7ff5457aa700 1 -- 172.21.15.90:0/3046867983 >> 172.21.15.90:0/3046867983 conn(0x7ff54006c810 msgr2=0x7ff5400ced60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:44.033 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.031+0000 7ff5457aa700 1 -- 172.21.15.90:0/3046867983 shutdown_connections 2023-06-09T04:42:44.033 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.031+0000 7ff5457aa700 1 -- 172.21.15.90:0/3046867983 wait complete. 2023-06-09T04:42:44.034 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 8 2023-06-09T04:42:44.051 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T04:42:44.219 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.215+0000 7f5b1312b700 1 Processor -- start 2023-06-09T04:42:44.219 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.215+0000 7f5b1312b700 1 -- start start 2023-06-09T04:42:44.222 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.219+0000 7f5b1312b700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5b0c0b0610 0x7f5b0c06fb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:44.222 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.219+0000 7f5b1312b700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5b0c0b09e0 0x7f5b0c0700b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:44.222 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.219+0000 7f5b1312b700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f5b0c069820 0x7f5b0c069c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:44.223 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.219+0000 7f5b1312b700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b0c06aa30 con 0x7f5b0c0b0610 2023-06-09T04:42:44.223 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.219+0000 7f5b1312b700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b0c06a1c0 con 0x7f5b0c069820 2023-06-09T04:42:44.223 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.219+0000 7f5b1312b700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b0c06a470 con 0x7f5b0c0b09e0 2023-06-09T04:42:44.224 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.219+0000 7f5b12129700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5b0c0b0610 0x7f5b0c06fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:44.224 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.219+0000 7f5b12129700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5b0c0b0610 0x7f5b0c06fb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:52802/0 (socket says 172.21.15.90:52802) 2023-06-09T04:42:44.224 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.219+0000 7f5b12129700 1 -- 172.21.15.90:0/379583710 learned_addr learned my addr 172.21.15.90:0/379583710 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:44.224 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.223+0000 7f5b11928700 1 --2- 172.21.15.90:0/379583710 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5b0c0b09e0 0x7f5b0c0700b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:44.225 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.223+0000 7f5b1292a700 1 --2- 172.21.15.90:0/379583710 >> v2:172.21.15.174:3300/0 conn(0x7f5b0c069820 0x7f5b0c069c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:44.225 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.223+0000 7f5b12129700 1 -- 172.21.15.90:0/379583710 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5b0c0b09e0 msgr2=0x7f5b0c0700b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:44.225 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.223+0000 7f5b12129700 1 --2- 172.21.15.90:0/379583710 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5b0c0b09e0 0x7f5b0c0700b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:44.225 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.223+0000 7f5b12129700 1 -- 172.21.15.90:0/379583710 >> v2:172.21.15.174:3300/0 conn(0x7f5b0c069820 msgr2=0x7f5b0c069c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:44.225 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.223+0000 7f5b12129700 1 --2- 172.21.15.90:0/379583710 >> v2:172.21.15.174:3300/0 conn(0x7f5b0c069820 0x7f5b0c069c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:44.225 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.223+0000 7f5b12129700 1 -- 172.21.15.90:0/379583710 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b0c06a750 con 0x7f5b0c0b0610 2023-06-09T04:42:44.225 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.223+0000 7f5b1292a700 1 --2- 172.21.15.90:0/379583710 >> v2:172.21.15.174:3300/0 conn(0x7f5b0c069820 0x7f5b0c069c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:42:44.226 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.223+0000 7f5b11928700 1 --2- 172.21.15.90:0/379583710 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5b0c0b09e0 0x7f5b0c0700b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:42:44.226 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.223+0000 7f5b12129700 1 --2- 172.21.15.90:0/379583710 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5b0c0b0610 0x7f5b0c06fb70 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f5b0c06f250 tx=0x7f5b08009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87ed751ccd93c6b5 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:44.227 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.223+0000 7f5b11127700 1 -- 172.21.15.90:0/379583710 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b0800b8a0 con 0x7f5b0c0b0610 2023-06-09T04:42:44.227 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.223+0000 7f5b11127700 1 -- 172.21.15.90:0/379583710 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b0800ba00 con 0x7f5b0c0b0610 2023-06-09T04:42:44.227 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.223+0000 7f5b11127700 1 -- 172.21.15.90:0/379583710 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b0800bd90 con 0x7f5b0c0b0610 2023-06-09T04:42:44.227 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.223+0000 7f5b1312b700 1 -- 172.21.15.90:0/379583710 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5b0c0b0610 msgr2=0x7f5b0c06fb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:44.227 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.223+0000 7f5b1312b700 1 --2- 172.21.15.90:0/379583710 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5b0c0b0610 0x7f5b0c06fb70 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f5b0c06f250 tx=0x7f5b08009bf0 comp rx=0 tx=0).stop 2023-06-09T04:42:44.228 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.223+0000 7f5b1312b700 1 -- 172.21.15.90:0/379583710 shutdown_connections 2023-06-09T04:42:44.228 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.223+0000 7f5b1312b700 1 --2- 172.21.15.90:0/379583710 >> v2:172.21.15.174:3300/0 conn(0x7f5b0c069820 0x7f5b0c069c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:44.228 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.223+0000 7f5b1312b700 1 --2- 172.21.15.90:0/379583710 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5b0c0b09e0 0x7f5b0c0700b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:44.228 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.223+0000 7f5b1312b700 1 --2- 172.21.15.90:0/379583710 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5b0c0b0610 0x7f5b0c06fb70 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:44.228 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.223+0000 7f5b1312b700 1 -- 172.21.15.90:0/379583710 >> 172.21.15.90:0/379583710 conn(0x7f5b0c06c690 msgr2=0x7f5b0c0aff00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:44.228 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.223+0000 7f5b1312b700 1 -- 172.21.15.90:0/379583710 shutdown_connections 2023-06-09T04:42:44.228 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.223+0000 7f5b1312b700 1 -- 172.21.15.90:0/379583710 wait complete. 2023-06-09T04:42:44.229 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.227+0000 7f5b1312b700 1 Processor -- start 2023-06-09T04:42:44.229 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.227+0000 7f5b1312b700 1 -- start start 2023-06-09T04:42:44.230 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.227+0000 7f5b1312b700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5b0c069820 0x7f5b0c1e0990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:44.231 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.227+0000 7f5b1312b700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5b0c0b0610 0x7f5b0c0afaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:44.231 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.227+0000 7f5b1312b700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5b0c0b09e0 0x7f5b0c13f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:44.231 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.227+0000 7f5b1312b700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b0c1e3af0 con 0x7f5b0c0b09e0 2023-06-09T04:42:44.231 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.227+0000 7f5b1312b700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b0c13d0a0 con 0x7f5b0c0b0610 2023-06-09T04:42:44.231 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.227+0000 7f5b1312b700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b0c13c520 con 0x7f5b0c069820 2023-06-09T04:42:44.232 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.231+0000 7f5b1292a700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5b0c0b09e0 0x7f5b0c13f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:44.232 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.231+0000 7f5b11928700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5b0c0b0610 0x7f5b0c0afaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:44.232 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.231+0000 7f5b1292a700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5b0c0b09e0 0x7f5b0c13f5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:52806/0 (socket says 172.21.15.90:52806) 2023-06-09T04:42:44.233 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.231+0000 7f5b1292a700 1 -- 172.21.15.90:0/4211009541 learned_addr learned my addr 172.21.15.90:0/4211009541 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:44.233 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.231+0000 7f5b12129700 1 --2- 172.21.15.90:0/4211009541 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5b0c069820 0x7f5b0c1e0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:44.233 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.231+0000 7f5b1292a700 1 -- 172.21.15.90:0/4211009541 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5b0c069820 msgr2=0x7f5b0c1e0990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:44.233 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.231+0000 7f5b1292a700 1 --2- 172.21.15.90:0/4211009541 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5b0c069820 0x7f5b0c1e0990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:44.233 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.231+0000 7f5b1292a700 1 -- 172.21.15.90:0/4211009541 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5b0c0b0610 msgr2=0x7f5b0c0afaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:44.233 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.231+0000 7f5b1292a700 1 --2- 172.21.15.90:0/4211009541 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5b0c0b0610 0x7f5b0c0afaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:44.234 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.231+0000 7f5b1292a700 1 -- 172.21.15.90:0/4211009541 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b08009570 con 0x7f5b0c0b09e0 2023-06-09T04:42:44.234 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.231+0000 7f5b1292a700 1 --2- 172.21.15.90:0/4211009541 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5b0c0b09e0 0x7f5b0c13f5e0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f5b0400cd10 tx=0x7f5b0400a560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:44.234 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.231+0000 7f5b02ffd700 1 -- 172.21.15.90:0/4211009541 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b0400ce60 con 0x7f5b0c0b09e0 2023-06-09T04:42:44.235 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.231+0000 7f5b02ffd700 1 -- 172.21.15.90:0/4211009541 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b0400f480 con 0x7f5b0c0b09e0 2023-06-09T04:42:44.235 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.231+0000 7f5b1312b700 1 -- 172.21.15.90:0/4211009541 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b0c13c800 con 0x7f5b0c0b09e0 2023-06-09T04:42:44.235 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.231+0000 7f5b02ffd700 1 -- 172.21.15.90:0/4211009541 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b0400f810 con 0x7f5b0c0b09e0 2023-06-09T04:42:44.235 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.231+0000 7f5b1312b700 1 -- 172.21.15.90:0/4211009541 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b0c13cdc0 con 0x7f5b0c0b09e0 2023-06-09T04:42:44.235 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.231+0000 7f5b1312b700 1 -- 172.21.15.90:0/4211009541 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b0c1e0ed0 con 0x7f5b0c0b09e0 2023-06-09T04:42:44.236 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.235+0000 7f5b02ffd700 1 -- 172.21.15.90:0/4211009541 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5b0400b040 con 0x7f5b0c0b09e0 2023-06-09T04:42:44.237 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.235+0000 7f5b02ffd700 1 --2- 172.21.15.90:0/4211009541 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f5af00662f0 0x7f5af00687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:44.238 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.235+0000 7f5b02ffd700 1 -- 172.21.15.90:0/4211009541 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f5b04084370 con 0x7f5b0c0b09e0 2023-06-09T04:42:44.238 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.235+0000 7f5b12129700 1 --2- 172.21.15.90:0/4211009541 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f5af00662f0 0x7f5af00687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:44.239 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.239+0000 7f5b12129700 1 --2- 172.21.15.90:0/4211009541 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f5af00662f0 0x7f5af00687a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f5b08000c00 tx=0x7f5b08008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:44.243 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.243+0000 7f5b02ffd700 1 -- 172.21.15.90:0/4211009541 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5b040517a0 con 0x7f5b0c0b09e0 2023-06-09T04:42:44.415 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.415+0000 7f5b1312b700 1 -- 172.21.15.90:0/4211009541 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5b0c04e380 con 0x7f5b0c0b09e0 2023-06-09T04:42:44.418 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.415+0000 7f5b02ffd700 1 -- 172.21.15.90:0/4211009541 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18375 (secure 0 0 0) 0x7f5b04054dc0 con 0x7f5b0c0b09e0 2023-06-09T04:42:44.419 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:42:44.419 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":26,"fsid":"700369c0-a111-43b4-9415-844ad1742b70","created":"2023-06-09T04:41:28.180311+0000","modified":"2023-06-09T04:42:36.122304+0000","last_up_change":"2023-06-09T04:41:40.746475+0000","last_in_change":"2023-06-09T04:41:31.262765+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-09T04:41:42.402564+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-09T04:41:47.607323+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-09T04:41:52.543474+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-09T04:41:53.382940+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"46a4a7c5-babd-4ef3-9830-51487cff5eb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":2780271267},{"type":"v1","addr":"172.21.15.90:6809","nonce":2780271267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2780271267},{"type":"v1","addr":"172.21.15.90:6811","nonce":2780271267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2780271267},{"type":"v1","addr":"172.21.15.90:6815","nonce":2780271267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2780271267},{"type":"v1","addr":"172.21.15.90:6813","nonce":2780271267}]},"public_addr":"172.21.15.90:6809/2780271267","cluster_addr":"172.21.15.90:6811/2780271267","heartbeat_back_addr":"172.21.15.90:6815/2780271267","heartbeat_front_addr":"172.21.15.90:6813/2780271267","state":["exists","up"]},{"osd":1,"uuid":"1543988f-c498-494a-a6f9-fac8413db6ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":3064028136},{"type":"v1","addr":"172.21.15.90:6801","nonce":3064028136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":3064028136},{"type":"v1","addr":"172.21.15.90:6803","nonce":3064028136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":3064028136},{"type":"v1","addr":"172.21.15.90:6807","nonce":3064028136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":3064028136},{"type":"v1","addr":"172.21.15.90:6805","nonce":3064028136}]},"public_addr":"172.21.15.90:6801/3064028136","cluster_addr":"172.21.15.90:6803/3064028136","heartbeat_back_addr":"172.21.15.90:6807/3064028136","heartbeat_front_addr":"172.21.15.90:6805/3064028136","state":["exists","up"]},{"osd":2,"uuid":"79669dd6-ffc8-4197-b9f7-b3b372b2b9b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":3713146326},{"type":"v1","addr":"172.21.15.90:6825","nonce":3713146326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":3713146326},{"type":"v1","addr":"172.21.15.90:6827","nonce":3713146326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":3713146326},{"type":"v1","addr":"172.21.15.90:6831","nonce":3713146326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":3713146326},{"type":"v1","addr":"172.21.15.90:6829","nonce":3713146326}]},"public_addr":"172.21.15.90:6825/3713146326","cluster_addr":"172.21.15.90:6827/3713146326","heartbeat_back_addr":"172.21.15.90:6831/3713146326","heartbeat_front_addr":"172.21.15.90:6829/3713146326","state":["exists","up"]},{"osd":3,"uuid":"4062ab6f-ce40-450a-aa17-b10098766c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":3499839122},{"type":"v1","addr":"172.21.15.90:6817","nonce":3499839122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":3499839122},{"type":"v1","addr":"172.21.15.90:6819","nonce":3499839122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":3499839122},{"type":"v1","addr":"172.21.15.90:6823","nonce":3499839122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":3499839122},{"type":"v1","addr":"172.21.15.90:6821","nonce":3499839122}]},"public_addr":"172.21.15.90:6817/3499839122","cluster_addr":"172.21.15.90:6819/3499839122","heartbeat_back_addr":"172.21.15.90:6823/3499839122","heartbeat_front_addr":"172.21.15.90:6821/3499839122","state":["exists","up"]},{"osd":4,"uuid":"a10820e4-b348-4d92-9796-3b01484ace1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6817","nonce":1138565854},{"type":"v1","addr":"172.21.15.174:6819","nonce":1138565854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6821","nonce":1138565854},{"type":"v1","addr":"172.21.15.174:6823","nonce":1138565854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":1138565854},{"type":"v1","addr":"172.21.15.174:6831","nonce":1138565854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":1138565854},{"type":"v1","addr":"172.21.15.174:6829","nonce":1138565854}]},"public_addr":"172.21.15.174:6819/1138565854","cluster_addr":"172.21.15.174:6823/1138565854","heartbeat_back_addr":"172.21.15.174:6831/1138565854","heartbeat_front_addr":"172.21.15.174:6829/1138565854","state":["exists","up"]},{"osd":5,"uuid":"b4da1c32-be05-420b-9346-90d91aa70569","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":1707702879},{"type":"v1","addr":"172.21.15.174:6818","nonce":1707702879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":1707702879},{"type":"v1","addr":"172.21.15.174:6822","nonce":1707702879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6827","nonce":1707702879},{"type":"v1","addr":"172.21.15.174:6828","nonce":1707702879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":1707702879},{"type":"v1","addr":"172.21.15.174:6825","nonce":1707702879}]},"public_addr":"172.21.15.174:6818/1707702879","cluster_addr":"172.21.15.174:6822/1707702879","heartbeat_back_addr":"172.21.15.174:6828/1707702879","heartbeat_front_addr":"172.21.15.174:6825/1707702879","state":["exists","up"]},{"osd":6,"uuid":"d1b98041-d243-4355-bd0a-e22cf9875b32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":864450534},{"type":"v1","addr":"172.21.15.174:6801","nonce":864450534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":864450534},{"type":"v1","addr":"172.21.15.174:6803","nonce":864450534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":864450534},{"type":"v1","addr":"172.21.15.174:6807","nonce":864450534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":864450534},{"type":"v1","addr":"172.21.15.174:6805","nonce":864450534}]},"public_addr":"172.21.15.174:6801/864450534","cluster_addr":"172.21.15.174:6803/864450534","heartbeat_back_addr":"172.21.15.174:6807/864450534","heartbeat_front_addr":"172.21.15.174:6805/864450534","state":["exists","up"]},{"osd":7,"uuid":"5a207936-f89f-416b-b79b-34ec96f77c8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":2527640659},{"type":"v1","addr":"172.21.15.174:6809","nonce":2527640659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":2527640659},{"type":"v1","addr":"172.21.15.174:6811","nonce":2527640659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":2527640659},{"type":"v1","addr":"172.21.15.174:6815","nonce":2527640659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":2527640659},{"type":"v1","addr":"172.21.15.174:6813","nonce":2527640659}]},"public_addr":"172.21.15.174:6809/2527640659","cluster_addr":"172.21.15.174:6811/2527640659","heartbeat_back_addr":"172.21.15.174:6815/2527640659","heartbeat_front_addr":"172.21.15.174:6813/2527640659","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:36.972152+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:36.984561+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:36.998817+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:37.054944+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:37.085014+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:37.115125+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:36.854608+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:36.971685+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.11","mappings":[{"from":3,"to":2}]},{"pgid":"4.3e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:42:44.423 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.419+0000 7f5b1312b700 1 -- 172.21.15.90:0/4211009541 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f5af00662f0 msgr2=0x7f5af00687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:44.423 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.419+0000 7f5b1312b700 1 --2- 172.21.15.90:0/4211009541 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f5af00662f0 0x7f5af00687a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f5b08000c00 tx=0x7f5b08008030 comp rx=0 tx=0).stop 2023-06-09T04:42:44.423 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.419+0000 7f5b1312b700 1 -- 172.21.15.90:0/4211009541 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5b0c0b09e0 msgr2=0x7f5b0c13f5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:44.423 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.419+0000 7f5b1312b700 1 --2- 172.21.15.90:0/4211009541 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5b0c0b09e0 0x7f5b0c13f5e0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f5b0400cd10 tx=0x7f5b0400a560 comp rx=0 tx=0).stop 2023-06-09T04:42:44.423 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.419+0000 7f5b1312b700 1 -- 172.21.15.90:0/4211009541 shutdown_connections 2023-06-09T04:42:44.424 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.419+0000 7f5b1312b700 1 --2- 172.21.15.90:0/4211009541 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f5af00662f0 0x7f5af00687a0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:44.424 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.419+0000 7f5b1312b700 1 --2- 172.21.15.90:0/4211009541 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5b0c0b09e0 0x7f5b0c13f5e0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:44.424 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.419+0000 7f5b1312b700 1 --2- 172.21.15.90:0/4211009541 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5b0c0b0610 0x7f5b0c0afaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:44.424 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.419+0000 7f5b1312b700 1 --2- 172.21.15.90:0/4211009541 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5b0c069820 0x7f5b0c1e0990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:44.424 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.419+0000 7f5b1312b700 1 -- 172.21.15.90:0/4211009541 >> 172.21.15.90:0/4211009541 conn(0x7f5b0c06c690 msgr2=0x7f5b0c070c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:44.424 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.419+0000 7f5b1312b700 1 -- 172.21.15.90:0/4211009541 shutdown_connections 2023-06-09T04:42:44.424 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.419+0000 7f5b1312b700 1 -- 172.21.15.90:0/4211009541 wait complete. 2023-06-09T04:42:44.444 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-06-09T04:42:44.445 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-09T04:42:44.614 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.611+0000 7f548f59e700 1 Processor -- start 2023-06-09T04:42:44.615 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.611+0000 7f548f59e700 1 -- start start 2023-06-09T04:42:44.616 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.615+0000 7f548f59e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f549015bf60 0x7f549006f960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:44.617 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.615+0000 7f548f59e700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f549006fea0 con 0x7f54900cc0f0 2023-06-09T04:42:44.617 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.615+0000 7f548f59e700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54900cc6b0 con 0x7f54900ab890 2023-06-09T04:42:44.617 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.615+0000 7f548f59e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54900cc990 con 0x7f549015bf60 2023-06-09T04:42:44.618 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.615+0000 7f548dd9b700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f54900cc0f0 0x7f54900cd750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:56636/0 (socket says 172.21.15.90:56636) 2023-06-09T04:42:44.618 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.615+0000 7f548dd9b700 1 -- 172.21.15.90:0/2437353995 learned_addr learned my addr 172.21.15.90:0/2437353995 (peer_addr_for_me v1:172.21.15.90:0/0) 2023-06-09T04:42:44.619 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.615+0000 7f548e59c700 1 --2- 172.21.15.90:0/2437353995 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f549015bf60 0x7f549006f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:44.619 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.615+0000 7f548d59a700 1 -- 172.21.15.90:0/2437353995 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 528078687 0 0) 0x7f549006fea0 con 0x7f54900cc0f0 2023-06-09T04:42:44.619 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.615+0000 7f548d59a700 1 -- 172.21.15.90:0/2437353995 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f54780035d0 con 0x7f54900cc0f0 2023-06-09T04:42:44.619 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.615+0000 7f548d59a700 1 -- 172.21.15.90:0/2437353995 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3434565729 0 0) 0x7f54900cc6b0 con 0x7f54900ab890 2023-06-09T04:42:44.619 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.615+0000 7f548d59a700 1 -- 172.21.15.90:0/2437353995 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f549006fea0 con 0x7f54900ab890 2023-06-09T04:42:44.619 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.615+0000 7f548e59c700 1 -- 172.21.15.90:0/2437353995 >> v1:172.21.15.174:6789/0 conn(0x7f54900ab890 legacy=0x7f54900cac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:44.620 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.615+0000 7f548e59c700 1 -- 172.21.15.90:0/2437353995 >> v1:172.21.15.90:6789/0 conn(0x7f54900cc0f0 legacy=0x7f54900cd750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:44.620 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.615+0000 7f548e59c700 1 -- 172.21.15.90:0/2437353995 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54900ccc70 con 0x7f549015bf60 2023-06-09T04:42:44.621 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.619+0000 7f548e59c700 1 --2- 172.21.15.90:0/2437353995 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f549015bf60 0x7f549006f960 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5480009880 tx=0x7f5480009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=42526fd8db1168b5 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:44.621 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.619+0000 7f548d59a700 1 -- 172.21.15.90:0/2437353995 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5480011830 con 0x7f549015bf60 2023-06-09T04:42:44.621 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.619+0000 7f548d59a700 1 -- 172.21.15.90:0/2437353995 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5480011990 con 0x7f549015bf60 2023-06-09T04:42:44.621 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.619+0000 7f548d59a700 1 -- 172.21.15.90:0/2437353995 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5480011d00 con 0x7f549015bf60 2023-06-09T04:42:44.621 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.619+0000 7f548f59e700 1 -- 172.21.15.90:0/2437353995 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f549015bf60 msgr2=0x7f549006f960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:44.621 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.619+0000 7f548f59e700 1 --2- 172.21.15.90:0/2437353995 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f549015bf60 0x7f549006f960 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5480009880 tx=0x7f5480009b90 comp rx=0 tx=0).stop 2023-06-09T04:42:44.622 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.619+0000 7f548f59e700 1 -- 172.21.15.90:0/2437353995 shutdown_connections 2023-06-09T04:42:44.622 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.619+0000 7f548f59e700 1 --2- 172.21.15.90:0/2437353995 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f549015bf60 0x7f549006f960 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:44.622 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.619+0000 7f548f59e700 1 -- 172.21.15.90:0/2437353995 >> 172.21.15.90:0/2437353995 conn(0x7f549006c690 msgr2=0x7f54900aff00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:44.622 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.619+0000 7f548f59e700 1 -- 172.21.15.90:0/2437353995 shutdown_connections 2023-06-09T04:42:44.622 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.619+0000 7f548f59e700 1 -- 172.21.15.90:0/2437353995 wait complete. 2023-06-09T04:42:44.625 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.623+0000 7f548f59e700 1 Processor -- start 2023-06-09T04:42:44.626 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.623+0000 7f548f59e700 1 -- start start 2023-06-09T04:42:44.626 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.623+0000 7f548f59e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f54900ab890 0x7f5490154b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:44.627 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.623+0000 7f548f59e700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f54900cc0f0 0x7f5490153a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:44.627 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.623+0000 7f548f59e700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f549015bf60 0x7f54900af630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:44.627 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.623+0000 7f548f59e700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54901f52c0 con 0x7f54900cc0f0 2023-06-09T04:42:44.627 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.623+0000 7f548f59e700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54901550b0 con 0x7f549015bf60 2023-06-09T04:42:44.627 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.623+0000 7f548f59e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54901e24e0 con 0x7f54900ab890 2023-06-09T04:42:44.628 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.627+0000 7f548dd9b700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f54900cc0f0 0x7f5490153a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:44.629 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.627+0000 7f548dd9b700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f54900cc0f0 0x7f5490153a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:52822/0 (socket says 172.21.15.90:52822) 2023-06-09T04:42:44.629 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.627+0000 7f548dd9b700 1 -- 172.21.15.90:0/3019553463 learned_addr learned my addr 172.21.15.90:0/3019553463 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:44.629 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.627+0000 7f548e59c700 1 --2- 172.21.15.90:0/3019553463 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f54900ab890 0x7f5490154b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:44.629 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.627+0000 7f548ed9d700 1 --2- 172.21.15.90:0/3019553463 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f549015bf60 0x7f54900af630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:44.629 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.627+0000 7f548dd9b700 1 -- 172.21.15.90:0/3019553463 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f54900ab890 msgr2=0x7f5490154b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:44.629 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.627+0000 7f548dd9b700 1 --2- 172.21.15.90:0/3019553463 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f54900ab890 0x7f5490154b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:44.630 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.627+0000 7f548dd9b700 1 -- 172.21.15.90:0/3019553463 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f549015bf60 msgr2=0x7f54900af630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:44.630 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.627+0000 7f548dd9b700 1 --2- 172.21.15.90:0/3019553463 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f549015bf60 0x7f54900af630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:44.630 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.627+0000 7f548dd9b700 1 -- 172.21.15.90:0/3019553463 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54800094b0 con 0x7f54900cc0f0 2023-06-09T04:42:44.630 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.627+0000 7f548dd9b700 1 --2- 172.21.15.90:0/3019553463 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f54900cc0f0 0x7f5490153a10 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f548400c560 tx=0x7f548400c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:44.630 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.627+0000 7f547effd700 1 -- 172.21.15.90:0/3019553463 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5484005d90 con 0x7f54900cc0f0 2023-06-09T04:42:44.630 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.627+0000 7f547effd700 1 -- 172.21.15.90:0/3019553463 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54840070d0 con 0x7f54900cc0f0 2023-06-09T04:42:44.630 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.627+0000 7f548f59e700 1 -- 172.21.15.90:0/3019553463 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54901e1f20 con 0x7f54900cc0f0 2023-06-09T04:42:44.631 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.627+0000 7f547effd700 1 -- 172.21.15.90:0/3019553463 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5484007460 con 0x7f54900cc0f0 2023-06-09T04:42:44.631 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.627+0000 7f548f59e700 1 -- 172.21.15.90:0/3019553463 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f549014f800 con 0x7f54900cc0f0 2023-06-09T04:42:44.631 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.627+0000 7f548f59e700 1 -- 172.21.15.90:0/3019553463 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f549004e380 con 0x7f54900cc0f0 2023-06-09T04:42:44.633 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.631+0000 7f547effd700 1 -- 172.21.15.90:0/3019553463 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f54840075c0 con 0x7f54900cc0f0 2023-06-09T04:42:44.634 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.631+0000 7f547effd700 1 --2- 172.21.15.90:0/3019553463 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f5470066320 0x7f54700687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:44.635 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.631+0000 7f547effd700 1 -- 172.21.15.90:0/3019553463 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f5484083310 con 0x7f54900cc0f0 2023-06-09T04:42:44.635 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.635+0000 7f548e59c700 1 --2- 172.21.15.90:0/3019553463 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f5470066320 0x7f54700687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:44.636 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.635+0000 7f548e59c700 1 --2- 172.21.15.90:0/3019553463 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f5470066320 0x7f54700687d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f54800090b0 tx=0x7f5480010000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:44.639 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.639+0000 7f547effd700 1 -- 172.21.15.90:0/3019553463 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f54840506b0 con 0x7f54900cc0f0 2023-06-09T04:42:44.846 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.843+0000 7f548f59e700 1 -- 172.21.15.90:0/3019553463 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f549006b310 con 0x7f54900cc0f0 2023-06-09T04:42:44.847 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.847+0000 7f547effd700 1 -- 172.21.15.90:0/3019553463 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4668 (secure 0 0 0) 0x7f5484053cd0 con 0x7f54900cc0f0 2023-06-09T04:42:44.847 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:42:44.848 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6836/271257743","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":271257743},{"type":"v1","addr":"172.21.15.174:6836","nonce":271257743}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4269,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6833/2861565528","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":2861565528},{"type":"v1","addr":"172.21.15.90:6833","nonce":2861565528}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/1212048840","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1212048840},{"type":"v1","addr":"172.21.15.90:6835","nonce":1212048840}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-09T04:41:54.383738+0000","modified":"2023-06-09T04:41:57.405504+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4306},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4306":{"gid":4306,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.174:6837/2976585572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6835","nonce":2976585572},{"type":"v1","addr":"172.21.15.174:6837","nonce":2976585572}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-06-09T04:42:44.852 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.851+0000 7f548f59e700 1 -- 172.21.15.90:0/3019553463 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f5470066320 msgr2=0x7f54700687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:44.852 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.851+0000 7f548f59e700 1 --2- 172.21.15.90:0/3019553463 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f5470066320 0x7f54700687d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f54800090b0 tx=0x7f5480010000 comp rx=0 tx=0).stop 2023-06-09T04:42:44.852 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.851+0000 7f548f59e700 1 -- 172.21.15.90:0/3019553463 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f54900cc0f0 msgr2=0x7f5490153a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:44.852 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.851+0000 7f548f59e700 1 --2- 172.21.15.90:0/3019553463 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f54900cc0f0 0x7f5490153a10 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f548400c560 tx=0x7f548400c870 comp rx=0 tx=0).stop 2023-06-09T04:42:44.852 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.851+0000 7f548f59e700 1 -- 172.21.15.90:0/3019553463 shutdown_connections 2023-06-09T04:42:44.853 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.851+0000 7f548f59e700 1 --2- 172.21.15.90:0/3019553463 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f5470066320 0x7f54700687d0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:44.853 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.851+0000 7f548f59e700 1 --2- 172.21.15.90:0/3019553463 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f549015bf60 0x7f54900af630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:44.853 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.851+0000 7f548f59e700 1 --2- 172.21.15.90:0/3019553463 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f54900cc0f0 0x7f5490153a10 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:44.853 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.851+0000 7f548f59e700 1 --2- 172.21.15.90:0/3019553463 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f54900ab890 0x7f5490154b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:44.853 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.851+0000 7f548f59e700 1 -- 172.21.15.90:0/3019553463 >> 172.21.15.90:0/3019553463 conn(0x7f549006c690 msgr2=0x7f549015ab50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:44.853 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.851+0000 7f548f59e700 1 -- 172.21.15.90:0/3019553463 shutdown_connections 2023-06-09T04:42:44.853 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:44.851+0000 7f548f59e700 1 -- 172.21.15.90:0/3019553463 wait complete. 2023-06-09T04:42:44.854 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 8 2023-06-09T04:42:44.874 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-09T04:42:45.040 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.039+0000 7ff34ce56700 1 Processor -- start 2023-06-09T04:42:45.041 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.039+0000 7ff34ce56700 1 -- start start 2023-06-09T04:42:45.043 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.043+0000 7ff34ce56700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ff3481574c0 0x7ff3480cdb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:45.043 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.043+0000 7ff34ce56700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff3480cac00 0x7ff3480cb050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:45.043 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.043+0000 7ff34ce56700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7ff348069820 0x7ff348069ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:45.044 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.043+0000 7ff34ce56700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff348157890 con 0x7ff348069820 2023-06-09T04:42:45.044 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.043+0000 7ff34ce56700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3480cb590 con 0x7ff3481574c0 2023-06-09T04:42:45.044 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.043+0000 7ff34ce56700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3481647b0 con 0x7ff3480cac00 2023-06-09T04:42:45.045 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.043+0000 7ff347fff700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7ff348069820 0x7ff348069ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:45.045 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.043+0000 7ff347fff700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7ff348069820 0x7ff348069ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:52826/0 (socket says 172.21.15.90:52826) 2023-06-09T04:42:45.045 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.043+0000 7ff347fff700 1 -- 172.21.15.90:0/4244189949 learned_addr learned my addr 172.21.15.90:0/4244189949 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:45.045 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.043+0000 7ff33ffff700 1 --2- 172.21.15.90:0/4244189949 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff3480cac00 0x7ff3480cb050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:45.046 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.043+0000 7ff3477fe700 1 --2- 172.21.15.90:0/4244189949 >> v2:172.21.15.174:3300/0 conn(0x7ff3481574c0 0x7ff3480cdb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:45.046 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.043+0000 7ff347fff700 1 -- 172.21.15.90:0/4244189949 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff3480cac00 msgr2=0x7ff3480cb050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:45.046 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.043+0000 7ff347fff700 1 --2- 172.21.15.90:0/4244189949 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff3480cac00 0x7ff3480cb050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:45.046 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.043+0000 7ff347fff700 1 -- 172.21.15.90:0/4244189949 >> v2:172.21.15.174:3300/0 conn(0x7ff3481574c0 msgr2=0x7ff3480cdb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:45.046 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.043+0000 7ff347fff700 1 --2- 172.21.15.90:0/4244189949 >> v2:172.21.15.174:3300/0 conn(0x7ff3481574c0 0x7ff3480cdb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:45.046 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.043+0000 7ff347fff700 1 -- 172.21.15.90:0/4244189949 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3480ce040 con 0x7ff348069820 2023-06-09T04:42:45.046 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.043+0000 7ff3477fe700 1 --2- 172.21.15.90:0/4244189949 >> v2:172.21.15.174:3300/0 conn(0x7ff3481574c0 0x7ff3480cdb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:42:45.047 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.043+0000 7ff347fff700 1 --2- 172.21.15.90:0/4244189949 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff348069820 0x7ff348069ca0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7ff340009e50 tx=0x7ff34000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac899509c70baf6a server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:45.048 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.043+0000 7ff346ffd700 1 -- 172.21.15.90:0/4244189949 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff34000e070 con 0x7ff348069820 2023-06-09T04:42:45.048 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.043+0000 7ff346ffd700 1 -- 172.21.15.90:0/4244189949 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff34000b8d0 con 0x7ff348069820 2023-06-09T04:42:45.048 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.043+0000 7ff346ffd700 1 -- 172.21.15.90:0/4244189949 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff34000bc80 con 0x7ff348069820 2023-06-09T04:42:45.048 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.043+0000 7ff34ce56700 1 -- 172.21.15.90:0/4244189949 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff348069820 msgr2=0x7ff348069ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:45.048 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.043+0000 7ff34ce56700 1 --2- 172.21.15.90:0/4244189949 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff348069820 0x7ff348069ca0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7ff340009e50 tx=0x7ff34000b330 comp rx=0 tx=0).stop 2023-06-09T04:42:45.048 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.047+0000 7ff34ce56700 1 -- 172.21.15.90:0/4244189949 shutdown_connections 2023-06-09T04:42:45.049 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.047+0000 7ff34ce56700 1 --2- 172.21.15.90:0/4244189949 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff348069820 0x7ff348069ca0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:45.049 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.047+0000 7ff34ce56700 1 --2- 172.21.15.90:0/4244189949 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff3480cac00 0x7ff3480cb050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:45.049 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.047+0000 7ff34ce56700 1 --2- 172.21.15.90:0/4244189949 >> v2:172.21.15.174:3300/0 conn(0x7ff3481574c0 0x7ff3480cdb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:45.049 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.047+0000 7ff34ce56700 1 -- 172.21.15.90:0/4244189949 >> 172.21.15.90:0/4244189949 conn(0x7ff34806c690 msgr2=0x7ff3480aff00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:45.049 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.047+0000 7ff34ce56700 1 -- 172.21.15.90:0/4244189949 shutdown_connections 2023-06-09T04:42:45.049 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.047+0000 7ff34ce56700 1 -- 172.21.15.90:0/4244189949 wait complete. 2023-06-09T04:42:45.050 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.047+0000 7ff34ce56700 1 Processor -- start 2023-06-09T04:42:45.050 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.047+0000 7ff34ce56700 1 -- start start 2023-06-09T04:42:45.051 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.047+0000 7ff34ce56700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff348069820 0x7ff3481f5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:45.051 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.051+0000 7ff34ce56700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff3480cac00 0x7ff34815c320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:45.051 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.051+0000 7ff34ce56700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff3481574c0 0x7ff34815dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:45.052 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.051+0000 7ff34ce56700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff34814baf0 con 0x7ff348069820 2023-06-09T04:42:45.052 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.051+0000 7ff34ce56700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff34814afd0 con 0x7ff3480cac00 2023-06-09T04:42:45.052 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.051+0000 7ff34ce56700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff34815c860 con 0x7ff3481574c0 2023-06-09T04:42:45.052 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.051+0000 7ff3477fe700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff348069820 0x7ff3481f5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:45.052 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.051+0000 7ff3477fe700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff348069820 0x7ff3481f5230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:52834/0 (socket says 172.21.15.90:52834) 2023-06-09T04:42:45.052 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.051+0000 7ff3477fe700 1 -- 172.21.15.90:0/1726153326 learned_addr learned my addr 172.21.15.90:0/1726153326 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:45.053 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.051+0000 7ff33ffff700 1 --2- 172.21.15.90:0/1726153326 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff3480cac00 0x7ff34815c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:45.054 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.051+0000 7ff347fff700 1 --2- 172.21.15.90:0/1726153326 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff3481574c0 0x7ff34815dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:45.054 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.051+0000 7ff3477fe700 1 -- 172.21.15.90:0/1726153326 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff3481574c0 msgr2=0x7ff34815dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:45.054 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.051+0000 7ff3477fe700 1 --2- 172.21.15.90:0/1726153326 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff3481574c0 0x7ff34815dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:45.054 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.051+0000 7ff3477fe700 1 -- 172.21.15.90:0/1726153326 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff3480cac00 msgr2=0x7ff34815c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:45.054 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.051+0000 7ff3477fe700 1 --2- 172.21.15.90:0/1726153326 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff3480cac00 0x7ff34815c320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:45.054 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.051+0000 7ff3477fe700 1 -- 172.21.15.90:0/1726153326 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff340009b30 con 0x7ff348069820 2023-06-09T04:42:45.055 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.051+0000 7ff33ffff700 1 --2- 172.21.15.90:0/1726153326 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff3480cac00 0x7ff34815c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:42:45.055 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.051+0000 7ff3477fe700 1 --2- 172.21.15.90:0/1726153326 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff348069820 0x7ff3481f5230 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7ff33800e840 tx=0x7ff33800eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:45.055 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.051+0000 7ff344ff9700 1 -- 172.21.15.90:0/1726153326 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff338004230 con 0x7ff348069820 2023-06-09T04:42:45.055 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.051+0000 7ff344ff9700 1 -- 172.21.15.90:0/1726153326 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff338004390 con 0x7ff348069820 2023-06-09T04:42:45.055 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.051+0000 7ff34ce56700 1 -- 172.21.15.90:0/1726153326 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff34815cb00 con 0x7ff348069820 2023-06-09T04:42:45.055 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.051+0000 7ff344ff9700 1 -- 172.21.15.90:0/1726153326 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3380036c0 con 0x7ff348069820 2023-06-09T04:42:45.055 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.051+0000 7ff34ce56700 1 -- 172.21.15.90:0/1726153326 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff34815d0c0 con 0x7ff348069820 2023-06-09T04:42:45.056 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.055+0000 7ff34ce56700 1 -- 172.21.15.90:0/1726153326 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff34806b390 con 0x7ff348069820 2023-06-09T04:42:45.056 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.055+0000 7ff344ff9700 1 -- 172.21.15.90:0/1726153326 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff338003840 con 0x7ff348069820 2023-06-09T04:42:45.057 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.055+0000 7ff344ff9700 1 --2- 172.21.15.90:0/1726153326 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7ff3280662f0 0x7ff3280687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:45.057 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.055+0000 7ff344ff9700 1 -- 172.21.15.90:0/1726153326 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7ff338083650 con 0x7ff348069820 2023-06-09T04:42:45.057 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.055+0000 7ff33ffff700 1 --2- 172.21.15.90:0/1726153326 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7ff3280662f0 0x7ff3280687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:45.058 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.055+0000 7ff33ffff700 1 --2- 172.21.15.90:0/1726153326 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7ff3280662f0 0x7ff3280687a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7ff34815eb10 tx=0x7ff330008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:45.062 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.059+0000 7ff344ff9700 1 -- 172.21.15.90:0/1726153326 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff338050a90 con 0x7ff348069820 2023-06-09T04:42:45.268 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.266+0000 7ff34ce56700 1 -- 172.21.15.90:0/1726153326 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff34804e380 con 0x7ff348069820 2023-06-09T04:42:45.270 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.266+0000 7ff344ff9700 1 -- 172.21.15.90:0/1726153326 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4668 (secure 0 0 0) 0x7ff3380540b0 con 0x7ff348069820 2023-06-09T04:42:45.270 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:42:45.270 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6836/271257743","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":271257743},{"type":"v1","addr":"172.21.15.174:6836","nonce":271257743}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4269,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6833/2861565528","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":2861565528},{"type":"v1","addr":"172.21.15.90:6833","nonce":2861565528}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/1212048840","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1212048840},{"type":"v1","addr":"172.21.15.90:6835","nonce":1212048840}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-09T04:41:54.383738+0000","modified":"2023-06-09T04:41:57.405504+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4306},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4306":{"gid":4306,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.174:6837/2976585572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6835","nonce":2976585572},{"type":"v1","addr":"172.21.15.174:6837","nonce":2976585572}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-06-09T04:42:45.272 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.270+0000 7ff34ce56700 1 -- 172.21.15.90:0/1726153326 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7ff3280662f0 msgr2=0x7ff3280687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:45.273 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.270+0000 7ff34ce56700 1 --2- 172.21.15.90:0/1726153326 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7ff3280662f0 0x7ff3280687a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7ff34815eb10 tx=0x7ff330008040 comp rx=0 tx=0).stop 2023-06-09T04:42:45.273 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.270+0000 7ff34ce56700 1 -- 172.21.15.90:0/1726153326 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff348069820 msgr2=0x7ff3481f5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:45.273 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.270+0000 7ff34ce56700 1 --2- 172.21.15.90:0/1726153326 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff348069820 0x7ff3481f5230 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7ff33800e840 tx=0x7ff33800eb50 comp rx=0 tx=0).stop 2023-06-09T04:42:45.273 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.270+0000 7ff34ce56700 1 -- 172.21.15.90:0/1726153326 shutdown_connections 2023-06-09T04:42:45.273 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.270+0000 7ff34ce56700 1 --2- 172.21.15.90:0/1726153326 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7ff3280662f0 0x7ff3280687a0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:45.273 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.270+0000 7ff34ce56700 1 --2- 172.21.15.90:0/1726153326 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff3481574c0 0x7ff34815dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:45.274 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.270+0000 7ff34ce56700 1 --2- 172.21.15.90:0/1726153326 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff3480cac00 0x7ff34815c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:45.274 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.270+0000 7ff34ce56700 1 --2- 172.21.15.90:0/1726153326 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff348069820 0x7ff3481f5230 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:45.274 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.270+0000 7ff34ce56700 1 -- 172.21.15.90:0/1726153326 >> 172.21.15.90:0/1726153326 conn(0x7ff34806c690 msgr2=0x7ff3480b3380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:45.274 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.270+0000 7ff34ce56700 1 -- 172.21.15.90:0/1726153326 shutdown_connections 2023-06-09T04:42:45.274 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.270+0000 7ff34ce56700 1 -- 172.21.15.90:0/1726153326 wait complete. 2023-06-09T04:42:45.275 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 8 2023-06-09T04:42:45.294 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T04:42:45.467 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.462+0000 7f03b6d15700 1 Processor -- start 2023-06-09T04:42:45.467 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.466+0000 7f03b6d15700 1 -- start start 2023-06-09T04:42:45.469 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.466+0000 7f03b6d15700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f03b00cb310 0x7f03b00cdb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:45.470 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.466+0000 7f03b6d15700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03b01647b0 con 0x7f03b01574c0 2023-06-09T04:42:45.470 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.466+0000 7f03b6d15700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03b00ce040 con 0x7f03b01608d0 2023-06-09T04:42:45.470 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.466+0000 7f03b6d15700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03b0157890 con 0x7f03b00cb310 2023-06-09T04:42:45.470 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.466+0000 7f03b5d13700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f03b01574c0 0x7f03b00cac00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:56644/0 (socket says 172.21.15.90:56644) 2023-06-09T04:42:45.470 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.466+0000 7f03b5d13700 1 -- 172.21.15.90:0/471473311 learned_addr learned my addr 172.21.15.90:0/471473311 (peer_addr_for_me v1:172.21.15.90:0/0) 2023-06-09T04:42:45.471 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.466+0000 7f03b5512700 1 --2- 172.21.15.90:0/471473311 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f03b00cb310 0x7f03b00cdb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:45.471 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.466+0000 7f03b4d11700 1 -- 172.21.15.90:0/471473311 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1587434429 0 0) 0x7f03b01647b0 con 0x7f03b01574c0 2023-06-09T04:42:45.471 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.466+0000 7f03b4d11700 1 -- 172.21.15.90:0/471473311 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f039c0035d0 con 0x7f03b01574c0 2023-06-09T04:42:45.471 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.470+0000 7f03b5512700 1 -- 172.21.15.90:0/471473311 >> v1:172.21.15.174:6789/0 conn(0x7f03b01608d0 legacy=0x7f03b0160d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:45.472 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.470+0000 7f03b4d11700 1 -- 172.21.15.90:0/471473311 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1003085575 0 0) 0x7f039c0035d0 con 0x7f03b01574c0 2023-06-09T04:42:45.472 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.470+0000 7f03b5512700 1 -- 172.21.15.90:0/471473311 >> v1:172.21.15.90:6789/0 conn(0x7f03b01574c0 legacy=0x7f03b00cac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:45.472 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.470+0000 7f03b5512700 1 -- 172.21.15.90:0/471473311 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03b0163ec0 con 0x7f03b00cb310 2023-06-09T04:42:45.473 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.470+0000 7f03b5512700 1 --2- 172.21.15.90:0/471473311 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f03b00cb310 0x7f03b00cdb00 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f03a00098b0 tx=0x7f03a0009bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4326c28e3ec43286 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:45.473 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.470+0000 7f03b4d11700 1 -- 172.21.15.90:0/471473311 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03ac0019f0 con 0x7f03b00cb310 2023-06-09T04:42:45.473 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.470+0000 7f03b4d11700 1 -- 172.21.15.90:0/471473311 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03a0010590 con 0x7f03b00cb310 2023-06-09T04:42:45.473 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.470+0000 7f03b4d11700 1 -- 172.21.15.90:0/471473311 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03a0010940 con 0x7f03b00cb310 2023-06-09T04:42:45.473 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.470+0000 7f03b6d15700 1 -- 172.21.15.90:0/471473311 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f03b00cb310 msgr2=0x7f03b00cdb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:45.473 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.470+0000 7f03b6d15700 1 --2- 172.21.15.90:0/471473311 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f03b00cb310 0x7f03b00cdb00 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f03a00098b0 tx=0x7f03a0009bc0 comp rx=0 tx=0).stop 2023-06-09T04:42:45.474 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.470+0000 7f03b6d15700 1 -- 172.21.15.90:0/471473311 shutdown_connections 2023-06-09T04:42:45.474 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.470+0000 7f03b6d15700 1 --2- 172.21.15.90:0/471473311 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f03b00cb310 0x7f03b00cdb00 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:45.474 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.470+0000 7f03b6d15700 1 -- 172.21.15.90:0/471473311 >> 172.21.15.90:0/471473311 conn(0x7f03b006c690 msgr2=0x7f03b00aff00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:45.475 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.470+0000 7f03b6d15700 1 -- 172.21.15.90:0/471473311 shutdown_connections 2023-06-09T04:42:45.475 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.470+0000 7f03b6d15700 1 -- 172.21.15.90:0/471473311 wait complete. 2023-06-09T04:42:45.475 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.474+0000 7f03b6d15700 1 Processor -- start 2023-06-09T04:42:45.476 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.474+0000 7f03b6d15700 1 -- start start 2023-06-09T04:42:45.477 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.474+0000 7f03b6d15700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f03b00cb310 0x7f03b0145b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:45.477 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.474+0000 7f03b6d15700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f03b01574c0 0x7f03b015d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:45.477 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.474+0000 7f03b6d15700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f03b01608d0 0x7f03b00b1200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:45.477 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.474+0000 7f03b6d15700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03b01eaf10 con 0x7f03b01574c0 2023-06-09T04:42:45.478 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.474+0000 7f03b6d15700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03b01eb1f0 con 0x7f03b01608d0 2023-06-09T04:42:45.478 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.474+0000 7f03b6d15700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03b01eb4d0 con 0x7f03b00cb310 2023-06-09T04:42:45.479 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.474+0000 7f03b5512700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f03b01574c0 0x7f03b015d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:45.479 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.474+0000 7f03b5512700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f03b01574c0 0x7f03b015d7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:52840/0 (socket says 172.21.15.90:52840) 2023-06-09T04:42:45.479 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.474+0000 7f03b5512700 1 -- 172.21.15.90:0/2810860218 learned_addr learned my addr 172.21.15.90:0/2810860218 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:45.479 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.474+0000 7f03b6514700 1 --2- 172.21.15.90:0/2810860218 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f03b01608d0 0x7f03b00b1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:45.479 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.474+0000 7f03b5d13700 1 --2- 172.21.15.90:0/2810860218 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f03b00cb310 0x7f03b0145b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:45.480 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.474+0000 7f03b5512700 1 -- 172.21.15.90:0/2810860218 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f03b00cb310 msgr2=0x7f03b0145b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:45.480 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.474+0000 7f03b5512700 1 --2- 172.21.15.90:0/2810860218 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f03b00cb310 0x7f03b0145b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:45.480 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.474+0000 7f03b5512700 1 -- 172.21.15.90:0/2810860218 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f03b01608d0 msgr2=0x7f03b00b1200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:45.480 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.474+0000 7f03b5512700 1 --2- 172.21.15.90:0/2810860218 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f03b01608d0 0x7f03b00b1200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:45.480 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.474+0000 7f03b5512700 1 -- 172.21.15.90:0/2810860218 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03a00094b0 con 0x7f03b01574c0 2023-06-09T04:42:45.480 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.474+0000 7f03b5512700 1 --2- 172.21.15.90:0/2810860218 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f03b01574c0 0x7f03b015d7a0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f03a0013040 tx=0x7f03a0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:45.481 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.478+0000 7f03a67fc700 1 -- 172.21.15.90:0/2810860218 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03a0010e80 con 0x7f03b01574c0 2023-06-09T04:42:45.481 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.478+0000 7f03a67fc700 1 -- 172.21.15.90:0/2810860218 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03a00036c0 con 0x7f03b01574c0 2023-06-09T04:42:45.482 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.478+0000 7f03b6d15700 1 -- 172.21.15.90:0/2810860218 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03b01eb7b0 con 0x7f03b01574c0 2023-06-09T04:42:45.482 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.478+0000 7f03a67fc700 1 -- 172.21.15.90:0/2810860218 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03a0003a50 con 0x7f03b01574c0 2023-06-09T04:42:45.482 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.478+0000 7f03b6d15700 1 -- 172.21.15.90:0/2810860218 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03b0146060 con 0x7f03b01574c0 2023-06-09T04:42:45.482 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.478+0000 7f03b6d15700 1 -- 172.21.15.90:0/2810860218 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03b006b390 con 0x7f03b01574c0 2023-06-09T04:42:45.483 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.482+0000 7f03a67fc700 1 -- 172.21.15.90:0/2810860218 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f03a0003bb0 con 0x7f03b01574c0 2023-06-09T04:42:45.484 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.482+0000 7f03a67fc700 1 --2- 172.21.15.90:0/2810860218 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f03940662f0 0x7f03940687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:45.485 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.482+0000 7f03a67fc700 1 -- 172.21.15.90:0/2810860218 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f03a00852c0 con 0x7f03b01574c0 2023-06-09T04:42:45.485 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.482+0000 7f03b5d13700 1 --2- 172.21.15.90:0/2810860218 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f03940662f0 0x7f03940687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:45.486 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.482+0000 7f03b5d13700 1 --2- 172.21.15.90:0/2810860218 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f03940662f0 0x7f03940687a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f03ac001560 tx=0x7f03ac0018d0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:45.490 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.486+0000 7f03a67fc700 1 -- 172.21.15.90:0/2810860218 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f03a0052790 con 0x7f03b01574c0 2023-06-09T04:42:45.660 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.658+0000 7f03b6d15700 1 -- 172.21.15.90:0/2810860218 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f03b01ebcd0 con 0x7f03b01574c0 2023-06-09T04:42:45.663 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.662+0000 7f03a67fc700 1 -- 172.21.15.90:0/2810860218 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18375 (secure 0 0 0) 0x7f03b01ebcd0 con 0x7f03b01574c0 2023-06-09T04:42:45.664 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:42:45.664 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":26,"fsid":"700369c0-a111-43b4-9415-844ad1742b70","created":"2023-06-09T04:41:28.180311+0000","modified":"2023-06-09T04:42:36.122304+0000","last_up_change":"2023-06-09T04:41:40.746475+0000","last_in_change":"2023-06-09T04:41:31.262765+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-09T04:41:42.402564+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-09T04:41:47.607323+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-09T04:41:52.543474+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-09T04:41:53.382940+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"46a4a7c5-babd-4ef3-9830-51487cff5eb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":2780271267},{"type":"v1","addr":"172.21.15.90:6809","nonce":2780271267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2780271267},{"type":"v1","addr":"172.21.15.90:6811","nonce":2780271267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2780271267},{"type":"v1","addr":"172.21.15.90:6815","nonce":2780271267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2780271267},{"type":"v1","addr":"172.21.15.90:6813","nonce":2780271267}]},"public_addr":"172.21.15.90:6809/2780271267","cluster_addr":"172.21.15.90:6811/2780271267","heartbeat_back_addr":"172.21.15.90:6815/2780271267","heartbeat_front_addr":"172.21.15.90:6813/2780271267","state":["exists","up"]},{"osd":1,"uuid":"1543988f-c498-494a-a6f9-fac8413db6ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":3064028136},{"type":"v1","addr":"172.21.15.90:6801","nonce":3064028136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":3064028136},{"type":"v1","addr":"172.21.15.90:6803","nonce":3064028136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":3064028136},{"type":"v1","addr":"172.21.15.90:6807","nonce":3064028136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":3064028136},{"type":"v1","addr":"172.21.15.90:6805","nonce":3064028136}]},"public_addr":"172.21.15.90:6801/3064028136","cluster_addr":"172.21.15.90:6803/3064028136","heartbeat_back_addr":"172.21.15.90:6807/3064028136","heartbeat_front_addr":"172.21.15.90:6805/3064028136","state":["exists","up"]},{"osd":2,"uuid":"79669dd6-ffc8-4197-b9f7-b3b372b2b9b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":3713146326},{"type":"v1","addr":"172.21.15.90:6825","nonce":3713146326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":3713146326},{"type":"v1","addr":"172.21.15.90:6827","nonce":3713146326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":3713146326},{"type":"v1","addr":"172.21.15.90:6831","nonce":3713146326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":3713146326},{"type":"v1","addr":"172.21.15.90:6829","nonce":3713146326}]},"public_addr":"172.21.15.90:6825/3713146326","cluster_addr":"172.21.15.90:6827/3713146326","heartbeat_back_addr":"172.21.15.90:6831/3713146326","heartbeat_front_addr":"172.21.15.90:6829/3713146326","state":["exists","up"]},{"osd":3,"uuid":"4062ab6f-ce40-450a-aa17-b10098766c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":3499839122},{"type":"v1","addr":"172.21.15.90:6817","nonce":3499839122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":3499839122},{"type":"v1","addr":"172.21.15.90:6819","nonce":3499839122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":3499839122},{"type":"v1","addr":"172.21.15.90:6823","nonce":3499839122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":3499839122},{"type":"v1","addr":"172.21.15.90:6821","nonce":3499839122}]},"public_addr":"172.21.15.90:6817/3499839122","cluster_addr":"172.21.15.90:6819/3499839122","heartbeat_back_addr":"172.21.15.90:6823/3499839122","heartbeat_front_addr":"172.21.15.90:6821/3499839122","state":["exists","up"]},{"osd":4,"uuid":"a10820e4-b348-4d92-9796-3b01484ace1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6817","nonce":1138565854},{"type":"v1","addr":"172.21.15.174:6819","nonce":1138565854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6821","nonce":1138565854},{"type":"v1","addr":"172.21.15.174:6823","nonce":1138565854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":1138565854},{"type":"v1","addr":"172.21.15.174:6831","nonce":1138565854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":1138565854},{"type":"v1","addr":"172.21.15.174:6829","nonce":1138565854}]},"public_addr":"172.21.15.174:6819/1138565854","cluster_addr":"172.21.15.174:6823/1138565854","heartbeat_back_addr":"172.21.15.174:6831/1138565854","heartbeat_front_addr":"172.21.15.174:6829/1138565854","state":["exists","up"]},{"osd":5,"uuid":"b4da1c32-be05-420b-9346-90d91aa70569","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":1707702879},{"type":"v1","addr":"172.21.15.174:6818","nonce":1707702879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":1707702879},{"type":"v1","addr":"172.21.15.174:6822","nonce":1707702879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6827","nonce":1707702879},{"type":"v1","addr":"172.21.15.174:6828","nonce":1707702879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":1707702879},{"type":"v1","addr":"172.21.15.174:6825","nonce":1707702879}]},"public_addr":"172.21.15.174:6818/1707702879","cluster_addr":"172.21.15.174:6822/1707702879","heartbeat_back_addr":"172.21.15.174:6828/1707702879","heartbeat_front_addr":"172.21.15.174:6825/1707702879","state":["exists","up"]},{"osd":6,"uuid":"d1b98041-d243-4355-bd0a-e22cf9875b32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":864450534},{"type":"v1","addr":"172.21.15.174:6801","nonce":864450534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":864450534},{"type":"v1","addr":"172.21.15.174:6803","nonce":864450534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":864450534},{"type":"v1","addr":"172.21.15.174:6807","nonce":864450534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":864450534},{"type":"v1","addr":"172.21.15.174:6805","nonce":864450534}]},"public_addr":"172.21.15.174:6801/864450534","cluster_addr":"172.21.15.174:6803/864450534","heartbeat_back_addr":"172.21.15.174:6807/864450534","heartbeat_front_addr":"172.21.15.174:6805/864450534","state":["exists","up"]},{"osd":7,"uuid":"5a207936-f89f-416b-b79b-34ec96f77c8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":2527640659},{"type":"v1","addr":"172.21.15.174:6809","nonce":2527640659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":2527640659},{"type":"v1","addr":"172.21.15.174:6811","nonce":2527640659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":2527640659},{"type":"v1","addr":"172.21.15.174:6815","nonce":2527640659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":2527640659},{"type":"v1","addr":"172.21.15.174:6813","nonce":2527640659}]},"public_addr":"172.21.15.174:6809/2527640659","cluster_addr":"172.21.15.174:6811/2527640659","heartbeat_back_addr":"172.21.15.174:6815/2527640659","heartbeat_front_addr":"172.21.15.174:6813/2527640659","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:36.972152+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:36.984561+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:36.998817+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:37.054944+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:37.085014+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:37.115125+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:36.854608+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:36.971685+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.11","mappings":[{"from":3,"to":2}]},{"pgid":"4.3e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:42:45.666 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.662+0000 7f03b6d15700 1 -- 172.21.15.90:0/2810860218 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f03940662f0 msgr2=0x7f03940687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:45.666 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.662+0000 7f03b6d15700 1 --2- 172.21.15.90:0/2810860218 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f03940662f0 0x7f03940687a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f03ac001560 tx=0x7f03ac0018d0 comp rx=0 tx=0).stop 2023-06-09T04:42:45.666 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.662+0000 7f03b6d15700 1 -- 172.21.15.90:0/2810860218 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f03b01574c0 msgr2=0x7f03b015d7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:45.667 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.662+0000 7f03b6d15700 1 --2- 172.21.15.90:0/2810860218 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f03b01574c0 0x7f03b015d7a0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f03a0013040 tx=0x7f03a0004770 comp rx=0 tx=0).stop 2023-06-09T04:42:45.667 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.662+0000 7f03b6d15700 1 -- 172.21.15.90:0/2810860218 shutdown_connections 2023-06-09T04:42:45.667 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.662+0000 7f03b6d15700 1 --2- 172.21.15.90:0/2810860218 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f03940662f0 0x7f03940687a0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:45.667 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.662+0000 7f03b6d15700 1 --2- 172.21.15.90:0/2810860218 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f03b01608d0 0x7f03b00b1200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:45.667 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.662+0000 7f03b6d15700 1 --2- 172.21.15.90:0/2810860218 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f03b01574c0 0x7f03b015d7a0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:45.667 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.662+0000 7f03b6d15700 1 --2- 172.21.15.90:0/2810860218 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f03b00cb310 0x7f03b0145b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:45.667 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.662+0000 7f03b6d15700 1 -- 172.21.15.90:0/2810860218 >> 172.21.15.90:0/2810860218 conn(0x7f03b006c690 msgr2=0x7f03b00ae430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:45.668 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.662+0000 7f03b6d15700 1 -- 172.21.15.90:0/2810860218 shutdown_connections 2023-06-09T04:42:45.668 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.662+0000 7f03b6d15700 1 -- 172.21.15.90:0/2810860218 wait complete. 2023-06-09T04:42:45.690 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-06-09T04:42:45.862 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.858+0000 7fdbd759e700 1 Processor -- start 2023-06-09T04:42:45.862 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.858+0000 7fdbd759e700 1 -- start start 2023-06-09T04:42:45.864 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.862+0000 7fdbd759e700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fdbd815bf60 0x7fdbd806f960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:45.864 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.862+0000 7fdbd759e700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fdbd80ab890 0x7fdbd80abcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:45.864 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.862+0000 7fdbd759e700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbd806fea0 con 0x7fdbd80cc0f0 2023-06-09T04:42:45.864 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.862+0000 7fdbd759e700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbd80cc6b0 con 0x7fdbd80ab890 2023-06-09T04:42:45.864 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.862+0000 7fdbd759e700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbd80cc990 con 0x7fdbd815bf60 2023-06-09T04:42:45.865 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.862+0000 7fdbd6d9d700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fdbd80ab890 0x7fdbd80abcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:45.866 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.862+0000 7fdbd6d9d700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fdbd80ab890 0x7fdbd80abcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:52844/0 (socket says 172.21.15.90:52844) 2023-06-09T04:42:45.866 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.862+0000 7fdbd6d9d700 1 -- 172.21.15.90:0/2906451507 learned_addr learned my addr 172.21.15.90:0/2906451507 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:45.866 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.862+0000 7fdbd659c700 1 --2- 172.21.15.90:0/2906451507 >> v2:172.21.15.174:3300/0 conn(0x7fdbd815bf60 0x7fdbd806f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:45.866 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.862+0000 7fdbd6d9d700 1 -- 172.21.15.90:0/2906451507 >> v2:172.21.15.174:3300/0 conn(0x7fdbd815bf60 msgr2=0x7fdbd806f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:45.866 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.862+0000 7fdbd6d9d700 1 --2- 172.21.15.90:0/2906451507 >> v2:172.21.15.174:3300/0 conn(0x7fdbd815bf60 0x7fdbd806f960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:45.866 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.862+0000 7fdbd5d9b700 1 -- 172.21.15.90:0/2906451507 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2861631280 0 0) 0x7fdbd806fea0 con 0x7fdbd80cc0f0 2023-06-09T04:42:45.866 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.862+0000 7fdbd6d9d700 1 -- 172.21.15.90:0/2906451507 >> v1:172.21.15.174:6789/0 conn(0x7fdbd80cc0f0 legacy=0x7fdbd80cd750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:45.867 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.862+0000 7fdbd6d9d700 1 -- 172.21.15.90:0/2906451507 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbd80ccc70 con 0x7fdbd80ab890 2023-06-09T04:42:45.868 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.862+0000 7fdbd6d9d700 1 --2- 172.21.15.90:0/2906451507 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdbd80ab890 0x7fdbd80abcf0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fdbd80cbd70 tx=0x7fdbd000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=518c3656525752c0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:45.868 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.862+0000 7fdbd5d9b700 1 -- 172.21.15.90:0/2906451507 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbd000e070 con 0x7fdbd80ab890 2023-06-09T04:42:45.868 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.862+0000 7fdbd5d9b700 1 -- 172.21.15.90:0/2906451507 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbd000b910 con 0x7fdbd80ab890 2023-06-09T04:42:45.868 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.862+0000 7fdbd5d9b700 1 -- 172.21.15.90:0/2906451507 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbd000bcc0 con 0x7fdbd80ab890 2023-06-09T04:42:45.868 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.866+0000 7fdbd759e700 1 -- 172.21.15.90:0/2906451507 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdbd80ab890 msgr2=0x7fdbd80abcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:45.868 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.866+0000 7fdbd759e700 1 --2- 172.21.15.90:0/2906451507 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdbd80ab890 0x7fdbd80abcf0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fdbd80cbd70 tx=0x7fdbd000b330 comp rx=0 tx=0).stop 2023-06-09T04:42:45.869 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.866+0000 7fdbd759e700 1 -- 172.21.15.90:0/2906451507 shutdown_connections 2023-06-09T04:42:45.869 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.866+0000 7fdbd759e700 1 --2- 172.21.15.90:0/2906451507 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdbd80ab890 0x7fdbd80abcf0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:45.869 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.866+0000 7fdbd759e700 1 --2- 172.21.15.90:0/2906451507 >> v2:172.21.15.174:3300/0 conn(0x7fdbd815bf60 0x7fdbd806f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:45.869 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.866+0000 7fdbd759e700 1 -- 172.21.15.90:0/2906451507 >> 172.21.15.90:0/2906451507 conn(0x7fdbd806c690 msgr2=0x7fdbd80aff00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:45.869 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.866+0000 7fdbd759e700 1 -- 172.21.15.90:0/2906451507 shutdown_connections 2023-06-09T04:42:45.869 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.866+0000 7fdbd759e700 1 -- 172.21.15.90:0/2906451507 wait complete. 2023-06-09T04:42:45.871 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.870+0000 7fdbd759e700 1 Processor -- start 2023-06-09T04:42:45.871 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.870+0000 7fdbd759e700 1 -- start start 2023-06-09T04:42:45.873 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.870+0000 7fdbd759e700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdbd80ab890 0x7fdbd81f2610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:45.873 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.870+0000 7fdbd759e700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdbd80cc0f0 0x7fdbd8152c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:45.873 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.870+0000 7fdbd759e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdbd815bf60 0x7fdbd81504e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:45.873 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.870+0000 7fdbd759e700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbd81f4af0 con 0x7fdbd80ab890 2023-06-09T04:42:45.873 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.870+0000 7fdbd759e700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbd8151240 con 0x7fdbd80cc0f0 2023-06-09T04:42:45.873 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.870+0000 7fdbd759e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbd81f4d00 con 0x7fdbd815bf60 2023-06-09T04:42:45.874 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.870+0000 7fdbd659c700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdbd80ab890 0x7fdbd81f2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:45.874 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.870+0000 7fdbd659c700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdbd80ab890 0x7fdbd81f2610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:52856/0 (socket says 172.21.15.90:52856) 2023-06-09T04:42:45.875 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.870+0000 7fdbd659c700 1 -- 172.21.15.90:0/1792980590 learned_addr learned my addr 172.21.15.90:0/1792980590 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:45.875 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.870+0000 7fdbcdd9b700 1 --2- 172.21.15.90:0/1792980590 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdbd80cc0f0 0x7fdbd8152c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:45.875 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.870+0000 7fdbd6d9d700 1 --2- 172.21.15.90:0/1792980590 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdbd815bf60 0x7fdbd81504e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:45.875 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.870+0000 7fdbd659c700 1 -- 172.21.15.90:0/1792980590 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdbd815bf60 msgr2=0x7fdbd81504e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:45.875 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.870+0000 7fdbd659c700 1 --2- 172.21.15.90:0/1792980590 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdbd815bf60 0x7fdbd81504e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:45.875 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.870+0000 7fdbd659c700 1 -- 172.21.15.90:0/1792980590 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdbd80cc0f0 msgr2=0x7fdbd8152c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:45.875 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.870+0000 7fdbd659c700 1 --2- 172.21.15.90:0/1792980590 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdbd80cc0f0 0x7fdbd8152c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:45.876 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.870+0000 7fdbd659c700 1 -- 172.21.15.90:0/1792980590 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbd0009b30 con 0x7fdbd80ab890 2023-06-09T04:42:45.876 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.870+0000 7fdbd659c700 1 --2- 172.21.15.90:0/1792980590 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdbd80ab890 0x7fdbd81f2610 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fdbc800e840 tx=0x7fdbc800ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:45.876 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.870+0000 7fdbcf7fe700 1 -- 172.21.15.90:0/1792980590 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbc80095a0 con 0x7fdbd80ab890 2023-06-09T04:42:45.876 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.870+0000 7fdbcf7fe700 1 -- 172.21.15.90:0/1792980590 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbc8013680 con 0x7fdbd80ab890 2023-06-09T04:42:45.877 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.870+0000 7fdbd759e700 1 -- 172.21.15.90:0/1792980590 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbd81f4fe0 con 0x7fdbd80ab890 2023-06-09T04:42:45.877 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.874+0000 7fdbcf7fe700 1 -- 172.21.15.90:0/1792980590 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbc80139f0 con 0x7fdbd80ab890 2023-06-09T04:42:45.877 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.874+0000 7fdbd759e700 1 -- 172.21.15.90:0/1792980590 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbd81f55a0 con 0x7fdbd80ab890 2023-06-09T04:42:45.877 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.874+0000 7fdbd759e700 1 -- 172.21.15.90:0/1792980590 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbd804e380 con 0x7fdbd80ab890 2023-06-09T04:42:45.878 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.874+0000 7fdbcf7fe700 1 -- 172.21.15.90:0/1792980590 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fdbc8013b50 con 0x7fdbd80ab890 2023-06-09T04:42:45.880 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.878+0000 7fdbcf7fe700 1 --2- 172.21.15.90:0/1792980590 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fdbb80662f0 0x7fdbb80687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:45.880 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.878+0000 7fdbcf7fe700 1 -- 172.21.15.90:0/1792980590 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fdbc8083d10 con 0x7fdbd80ab890 2023-06-09T04:42:45.881 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.878+0000 7fdbcdd9b700 1 --2- 172.21.15.90:0/1792980590 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fdbb80662f0 0x7fdbb80687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:45.882 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.878+0000 7fdbcdd9b700 1 --2- 172.21.15.90:0/1792980590 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fdbb80662f0 0x7fdbb80687a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fdbd80b40b0 tx=0x7fdbc0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:45.884 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:45.882+0000 7fdbcf7fe700 1 -- 172.21.15.90:0/1792980590 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fdbc8089020 con 0x7fdbd80ab890 2023-06-09T04:42:46.089 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:46.086+0000 7fdbd759e700 1 -- 172.21.15.90:0/1792980590 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fdbd806b310 con 0x7fdbd80ab890 2023-06-09T04:42:46.208 INFO:tasks.ceph.mon.a.smithi090.stderr:2023-06-09T04:42:46.206+0000 7fea81ff9700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-06-09T04:42:46.217 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:46.214+0000 7fdbcf7fe700 1 -- 172.21.15.90:0/1792980590 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) v1 ==== 161+0+0 (secure 0 0 0) 0x7fdbc8054b40 con 0x7fdbd80ab890 2023-06-09T04:42:46.221 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:46.218+0000 7fdbd759e700 1 -- 172.21.15.90:0/1792980590 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fdbb80662f0 msgr2=0x7fdbb80687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:46.222 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:46.218+0000 7fdbd759e700 1 --2- 172.21.15.90:0/1792980590 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fdbb80662f0 0x7fdbb80687a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fdbd80b40b0 tx=0x7fdbc0009040 comp rx=0 tx=0).stop 2023-06-09T04:42:46.222 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:46.218+0000 7fdbd759e700 1 -- 172.21.15.90:0/1792980590 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdbd80ab890 msgr2=0x7fdbd81f2610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:46.222 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:46.218+0000 7fdbd759e700 1 --2- 172.21.15.90:0/1792980590 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdbd80ab890 0x7fdbd81f2610 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fdbc800e840 tx=0x7fdbc800ec00 comp rx=0 tx=0).stop 2023-06-09T04:42:46.222 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:46.218+0000 7fdbd759e700 1 -- 172.21.15.90:0/1792980590 shutdown_connections 2023-06-09T04:42:46.222 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:46.218+0000 7fdbd759e700 1 --2- 172.21.15.90:0/1792980590 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fdbb80662f0 0x7fdbb80687a0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:46.222 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:46.218+0000 7fdbd759e700 1 --2- 172.21.15.90:0/1792980590 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdbd815bf60 0x7fdbd81504e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:46.223 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:46.218+0000 7fdbd759e700 1 --2- 172.21.15.90:0/1792980590 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdbd80cc0f0 0x7fdbd8152c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:46.223 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:46.218+0000 7fdbd759e700 1 --2- 172.21.15.90:0/1792980590 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdbd80ab890 0x7fdbd81f2610 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:46.223 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:46.218+0000 7fdbd759e700 1 -- 172.21.15.90:0/1792980590 >> 172.21.15.90:0/1792980590 conn(0x7fdbd806c690 msgr2=0x7fdbd80ce0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:46.223 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:46.218+0000 7fdbd759e700 1 -- 172.21.15.90:0/1792980590 shutdown_connections 2023-06-09T04:42:46.223 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:46.218+0000 7fdbd759e700 1 -- 172.21.15.90:0/1792980590 wait complete. 2023-06-09T04:42:46.224 INFO:teuthology.orchestra.run.smithi090.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-06-09T04:42:46.235 INFO:tasks.ceph.mds.b.smithi174.stderr: -6999> 2023-06-09T04:42:00.051+0000 7fc3ef4c4700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-06-09T04:42:46.245 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-06-09T04:42:46.297 INFO:tasks.ceph.mds.b.smithi174.stdout:starting mds.b at 2023-06-09T04:42:46.416 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:46.414+0000 7f2848897700 1 Processor -- start 2023-06-09T04:42:46.417 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:46.414+0000 7f2848897700 1 -- start start 2023-06-09T04:42:46.419 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:46.418+0000 7f2848897700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f284415a010 0x7f284406bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:46.419 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:46.418+0000 7f2848897700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f284406c1a0 0x7f28440cc550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:46.420 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:46.418+0000 7f2848897700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f284406c5f0 con 0x7f28440cca90 2023-06-09T04:42:46.420 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:46.418+0000 7f2848897700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f284406d0c0 con 0x7f284415a010 2023-06-09T04:42:46.420 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:46.418+0000 7f2848897700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f284415a3e0 con 0x7f284406c1a0 2023-06-09T04:42:46.421 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:46.418+0000 7f2842d9d700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f284415a010 0x7f284406bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:46.421 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:46.418+0000 7f2842d9d700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f284415a010 0x7f284406bc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:38534/0 (socket says 172.21.15.90:38534) 2023-06-09T04:42:46.421 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:46.418+0000 7f2842d9d700 1 -- 172.21.15.90:0/3166322056 learned_addr learned my addr 172.21.15.90:0/3166322056 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:46.421 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:46.418+0000 7f284259c700 1 --2- 172.21.15.90:0/3166322056 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f284406c1a0 0x7f28440cc550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:46.422 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:46.418+0000 7f2842d9d700 1 -- 172.21.15.90:0/3166322056 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f284406c1a0 msgr2=0x7f28440cc550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:46.422 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:46.418+0000 7f2842d9d700 1 --2- 172.21.15.90:0/3166322056 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f284406c1a0 0x7f28440cc550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:46.422 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:46.418+0000 7f2842d9d700 1 -- 172.21.15.90:0/3166322056 >> v1:172.21.15.174:6789/0 conn(0x7f28440cca90 legacy=0x7f2844070a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:46.422 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:46.418+0000 7f2842d9d700 1 -- 172.21.15.90:0/3166322056 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28440ccef0 con 0x7f284415a010 2023-06-09T04:42:46.422 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:46.418+0000 7f2842d9d700 1 --2- 172.21.15.90:0/3166322056 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f284415a010 0x7f284406bc60 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f2834009910 tx=0x7f2834009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ff62761f35053d4 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:46.423 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:46.418+0000 7f2841d9b700 1 -- 172.21.15.90:0/3166322056 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f283400ba60 con 0x7f284415a010 2023-06-09T04:42:46.423 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:46.418+0000 7f2841d9b700 1 -- 172.21.15.90:0/3166322056 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f283400bbc0 con 0x7f284415a010 2023-06-09T04:42:46.424 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:46.418+0000 7f2841d9b700 1 -- 172.21.15.90:0/3166322056 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2834009e60 con 0x7f284415a010 2023-06-09T04:42:46.424 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:46.422+0000 7f2848897700 1 -- 172.21.15.90:0/3166322056 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f284415a010 msgr2=0x7f284406bc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:46.424 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:46.422+0000 7f2848897700 1 --2- 172.21.15.90:0/3166322056 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f284415a010 0x7f284406bc60 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f2834009910 tx=0x7f2834009c20 comp rx=0 tx=0).stop 2023-06-09T04:42:46.424 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:46.422+0000 7f2848897700 1 -- 172.21.15.90:0/3166322056 shutdown_connections 2023-06-09T04:42:46.424 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:46.422+0000 7f2848897700 1 --2- 172.21.15.90:0/3166322056 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f284406c1a0 0x7f28440cc550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:46.424 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:46.422+0000 7f2848897700 1 --2- 172.21.15.90:0/3166322056 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f284415a010 0x7f284406bc60 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:46.425 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:46.422+0000 7f2848897700 1 -- 172.21.15.90:0/3166322056 >> 172.21.15.90:0/3166322056 conn(0x7f28440afe40 msgr2=0x7f28440b0240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:46.425 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:46.422+0000 7f2848897700 1 -- 172.21.15.90:0/3166322056 shutdown_connections 2023-06-09T04:42:46.425 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:46.422+0000 7f2848897700 1 -- 172.21.15.90:0/3166322056 wait complete. 2023-06-09T04:42:46.427 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:46.426+0000 7f2848897700 1 Processor -- start 2023-06-09T04:42:46.427 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:46.426+0000 7f2848897700 1 -- start start 2023-06-09T04:42:46.429 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:46.426+0000 7f2848897700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f284406c1a0 0x7f284409bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:46.429 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:46.426+0000 7f2848897700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f28440cca90 0x7f2844157110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:46.429 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:46.426+0000 7f2848897700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f284415a010 0x7f2844099110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:46.429 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:46.426+0000 7f2848897700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28440c1d80 con 0x7f28440cca90 2023-06-09T04:42:46.430 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:46.426+0000 7f2848897700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2844098f20 con 0x7f284406c1a0 2023-06-09T04:42:46.430 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:46.426+0000 7f2848897700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28440ca440 con 0x7f284415a010 2023-06-09T04:42:46.431 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:46.426+0000 7f284259c700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f28440cca90 0x7f2844157110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:46.431 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:46.426+0000 7f2842d9d700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f284406c1a0 0x7f284409bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:46.431 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:46.426+0000 7f284259c700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f28440cca90 0x7f2844157110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:38538/0 (socket says 172.21.15.90:38538) 2023-06-09T04:42:46.431 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:46.426+0000 7f2842d9d700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f284406c1a0 0x7f284409bc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.90:46018/0 (socket says 172.21.15.90:46018) 2023-06-09T04:42:46.432 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:46.426+0000 7f284359e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f284415a010 0x7f2844099110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:46.432 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:46.426+0000 7f284259c700 1 -- 172.21.15.90:0/4215596752 learned_addr learned my addr 172.21.15.90:0/4215596752 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:46.432 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:46.426+0000 7f284259c700 1 -- 172.21.15.90:0/4215596752 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f284415a010 msgr2=0x7f2844099110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:46.432 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:46.426+0000 7f284259c700 1 --2- 172.21.15.90:0/4215596752 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f284415a010 0x7f2844099110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:46.432 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:46.426+0000 7f284259c700 1 -- 172.21.15.90:0/4215596752 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f284406c1a0 msgr2=0x7f284409bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:46.432 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:46.426+0000 7f284259c700 1 --2- 172.21.15.90:0/4215596752 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f284406c1a0 0x7f284409bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:46.433 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:46.426+0000 7f284259c700 1 -- 172.21.15.90:0/4215596752 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2834009570 con 0x7f28440cca90 2023-06-09T04:42:46.433 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:46.426+0000 7f284259c700 1 --2- 172.21.15.90:0/4215596752 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f28440cca90 0x7f2844157110 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f282c00d830 tx=0x7f282c00db40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:46.433 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:46.426+0000 7f283b7fe700 1 -- 172.21.15.90:0/4215596752 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f282c0125f0 con 0x7f28440cca90 2023-06-09T04:42:46.433 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:46.426+0000 7f283b7fe700 1 -- 172.21.15.90:0/4215596752 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f282c012750 con 0x7f28440cca90 2023-06-09T04:42:46.433 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:46.426+0000 7f283b7fe700 1 -- 172.21.15.90:0/4215596752 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f282c012ac0 con 0x7f28440cca90 2023-06-09T04:42:46.433 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:46.426+0000 7f2848897700 1 -- 172.21.15.90:0/4215596752 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2844098680 con 0x7f28440cca90 2023-06-09T04:42:46.433 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:46.430+0000 7f2848897700 1 -- 172.21.15.90:0/4215596752 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2844098c40 con 0x7f28440cca90 2023-06-09T04:42:46.434 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:46.430+0000 7f2848897700 1 -- 172.21.15.90:0/4215596752 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28440c1b50 con 0x7f28440cca90 2023-06-09T04:42:46.434 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:46.430+0000 7f283b7fe700 1 -- 172.21.15.90:0/4215596752 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f282c012c20 con 0x7f28440cca90 2023-06-09T04:42:46.435 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:46.434+0000 7f283b7fe700 1 --2- 172.21.15.90:0/4215596752 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f2824066320 0x7f28240687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:46.435 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:46.434+0000 7f283b7fe700 1 -- 172.21.15.90:0/4215596752 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6206+0+0 (secure 0 0 0) 0x7f282c083d80 con 0x7f28440cca90 2023-06-09T04:42:46.436 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:46.434+0000 7f2842d9d700 1 --2- 172.21.15.90:0/4215596752 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f2824066320 0x7f28240687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:46.437 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:46.434+0000 7f2842d9d700 1 --2- 172.21.15.90:0/4215596752 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f2824066320 0x7f28240687d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f2834000c00 tx=0x7f2834008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:46.442 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:46.438+0000 7f283b7fe700 1 -- 172.21.15.90:0/4215596752 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f28440c1b50 con 0x7f28440cca90 2023-06-09T04:42:46.647 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:46.646+0000 7f2848897700 1 -- 172.21.15.90:0/4215596752 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f28440c1b50 con 0x7f28440cca90 2023-06-09T04:42:47.238 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:47.234+0000 7f283b7fe700 1 -- 172.21.15.90:0/4215596752 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) v1 ==== 104+0+0 (secure 0 0 0) 0x7f28440c1b50 con 0x7f28440cca90 2023-06-09T04:42:47.243 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:47.238+0000 7f2848897700 1 -- 172.21.15.90:0/4215596752 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f2824066320 msgr2=0x7f28240687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:47.243 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:47.238+0000 7f2848897700 1 --2- 172.21.15.90:0/4215596752 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f2824066320 0x7f28240687d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f2834000c00 tx=0x7f2834008030 comp rx=0 tx=0).stop 2023-06-09T04:42:47.243 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:47.238+0000 7f2848897700 1 -- 172.21.15.90:0/4215596752 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f28440cca90 msgr2=0x7f2844157110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:47.243 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:47.238+0000 7f2848897700 1 --2- 172.21.15.90:0/4215596752 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f28440cca90 0x7f2844157110 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f282c00d830 tx=0x7f282c00db40 comp rx=0 tx=0).stop 2023-06-09T04:42:47.244 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:47.242+0000 7f2848897700 1 -- 172.21.15.90:0/4215596752 shutdown_connections 2023-06-09T04:42:47.244 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:47.242+0000 7f2848897700 1 --2- 172.21.15.90:0/4215596752 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f2824066320 0x7f28240687d0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:47.244 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:47.242+0000 7f2848897700 1 --2- 172.21.15.90:0/4215596752 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f284415a010 0x7f2844099110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:47.244 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:47.242+0000 7f2848897700 1 --2- 172.21.15.90:0/4215596752 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f28440cca90 0x7f2844157110 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:47.244 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:47.242+0000 7f2848897700 1 --2- 172.21.15.90:0/4215596752 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f284406c1a0 0x7f284409bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:47.244 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:47.242+0000 7f2848897700 1 -- 172.21.15.90:0/4215596752 >> 172.21.15.90:0/4215596752 conn(0x7f28440afe40 msgr2=0x7f2844157bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:47.244 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:47.242+0000 7f2848897700 1 -- 172.21.15.90:0/4215596752 shutdown_connections 2023-06-09T04:42:47.245 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:47.242+0000 7f2848897700 1 -- 172.21.15.90:0/4215596752 wait complete. 2023-06-09T04:42:47.267 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-06-09T04:42:47.445 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:47.442+0000 7ff43f3bb700 1 Processor -- start 2023-06-09T04:42:47.445 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:47.442+0000 7ff43f3bb700 1 -- start start 2023-06-09T04:42:47.448 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:47.446+0000 7ff43f3bb700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ff4380ad000 0x7ff4380c8a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:47.449 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:47.446+0000 7ff43f3bb700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7ff438160420 0x7ff4380ca2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:47.449 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:47.446+0000 7ff43f3bb700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4380cde00 con 0x7ff4380ca820 2023-06-09T04:42:47.450 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:47.446+0000 7ff43f3bb700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff43815c350 con 0x7ff438160420 2023-06-09T04:42:47.450 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:47.446+0000 7ff43f3bb700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff43806b180 con 0x7ff4380ad000 2023-06-09T04:42:47.450 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:47.446+0000 7ff43dbb8700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7ff438160420 0x7ff4380ca2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:47.450 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:47.446+0000 7ff43dbb8700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7ff438160420 0x7ff4380ca2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:38554/0 (socket says 172.21.15.90:38554) 2023-06-09T04:42:47.450 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:47.446+0000 7ff43dbb8700 1 -- 172.21.15.90:0/3440002902 learned_addr learned my addr 172.21.15.90:0/3440002902 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:47.450 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:47.446+0000 7ff43e3b9700 1 --2- 172.21.15.90:0/3440002902 >> v2:172.21.15.174:3300/0 conn(0x7ff4380ad000 0x7ff4380c8a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:47.450 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:47.446+0000 7ff43dbb8700 1 -- 172.21.15.90:0/3440002902 >> v2:172.21.15.174:3300/0 conn(0x7ff4380ad000 msgr2=0x7ff4380c8a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:47.451 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:47.446+0000 7ff43dbb8700 1 --2- 172.21.15.90:0/3440002902 >> v2:172.21.15.174:3300/0 conn(0x7ff4380ad000 0x7ff4380c8a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:47.451 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:47.446+0000 7ff43dbb8700 1 -- 172.21.15.90:0/3440002902 >> v1:172.21.15.90:6789/0 conn(0x7ff4380ca820 legacy=0x7ff4380cbed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:47.451 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:47.446+0000 7ff43dbb8700 1 -- 172.21.15.90:0/3440002902 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff43806abc0 con 0x7ff438160420 2023-06-09T04:42:47.452 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:47.446+0000 7ff43e3b9700 1 --2- 172.21.15.90:0/3440002902 >> v2:172.21.15.174:3300/0 conn(0x7ff4380ad000 0x7ff4380c8a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:42:47.452 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:47.446+0000 7ff43dbb8700 1 --2- 172.21.15.90:0/3440002902 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff438160420 0x7ff4380ca2e0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7ff43806c9d0 tx=0x7ff428009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2db0daeab55fac6 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:47.452 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:47.446+0000 7ff43d3b7700 1 -- 172.21.15.90:0/3440002902 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff42800b8a0 con 0x7ff438160420 2023-06-09T04:42:47.452 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:47.446+0000 7ff43d3b7700 1 -- 172.21.15.90:0/3440002902 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff42800ba00 con 0x7ff438160420 2023-06-09T04:42:47.452 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:47.446+0000 7ff43d3b7700 1 -- 172.21.15.90:0/3440002902 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff42800bd90 con 0x7ff438160420 2023-06-09T04:42:47.452 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:47.450+0000 7ff43f3bb700 1 -- 172.21.15.90:0/3440002902 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff438160420 msgr2=0x7ff4380ca2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:47.452 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:47.450+0000 7ff43f3bb700 1 --2- 172.21.15.90:0/3440002902 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff438160420 0x7ff4380ca2e0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7ff43806c9d0 tx=0x7ff428009bf0 comp rx=0 tx=0).stop 2023-06-09T04:42:47.453 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:47.450+0000 7ff43f3bb700 1 -- 172.21.15.90:0/3440002902 shutdown_connections 2023-06-09T04:42:47.453 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:47.450+0000 7ff43f3bb700 1 --2- 172.21.15.90:0/3440002902 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff438160420 0x7ff4380ca2e0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:47.453 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:47.450+0000 7ff43f3bb700 1 --2- 172.21.15.90:0/3440002902 >> v2:172.21.15.174:3300/0 conn(0x7ff4380ad000 0x7ff4380c8a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:47.454 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:47.450+0000 7ff43f3bb700 1 -- 172.21.15.90:0/3440002902 >> 172.21.15.90:0/3440002902 conn(0x7ff4380b0b20 msgr2=0x7ff4380ce300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:47.454 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:47.450+0000 7ff43f3bb700 1 -- 172.21.15.90:0/3440002902 shutdown_connections 2023-06-09T04:42:47.454 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:47.450+0000 7ff43f3bb700 1 -- 172.21.15.90:0/3440002902 wait complete. 2023-06-09T04:42:47.455 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:47.454+0000 7ff43f3bb700 1 Processor -- start 2023-06-09T04:42:47.455 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:47.454+0000 7ff43f3bb700 1 -- start start 2023-06-09T04:42:47.457 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:47.454+0000 7ff43f3bb700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff4380ad000 0x7ff4380b3410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:47.458 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:47.454+0000 7ff43f3bb700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff4380ca820 0x7ff4381f0d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:47.458 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:47.454+0000 7ff43f3bb700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff438160420 0x7ff438069820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:47.458 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:47.454+0000 7ff43f3bb700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff438148f80 con 0x7ff4380ad000 2023-06-09T04:42:47.458 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:47.454+0000 7ff43f3bb700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4380b3c40 con 0x7ff4380ca820 2023-06-09T04:42:47.458 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:47.454+0000 7ff43f3bb700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4380b3f20 con 0x7ff438160420 2023-06-09T04:42:47.459 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:47.454+0000 7ff43e3b9700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff4380ad000 0x7ff4380b3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:47.459 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:47.454+0000 7ff43e3b9700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff4380ad000 0x7ff4380b3410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:38560/0 (socket says 172.21.15.90:38560) 2023-06-09T04:42:47.460 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:47.454+0000 7ff43e3b9700 1 -- 172.21.15.90:0/2207342949 learned_addr learned my addr 172.21.15.90:0/2207342949 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:47.460 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:47.454+0000 7ff43e3b9700 1 -- 172.21.15.90:0/2207342949 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff438160420 msgr2=0x7ff438069820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:47.460 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:47.454+0000 7ff43e3b9700 1 --2- 172.21.15.90:0/2207342949 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff438160420 0x7ff438069820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:47.460 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:47.454+0000 7ff43e3b9700 1 -- 172.21.15.90:0/2207342949 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff4380ca820 msgr2=0x7ff4381f0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:47.460 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:47.454+0000 7ff43e3b9700 1 --2- 172.21.15.90:0/2207342949 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff4380ca820 0x7ff4381f0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:47.460 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:47.454+0000 7ff43e3b9700 1 -- 172.21.15.90:0/2207342949 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff428009570 con 0x7ff4380ad000 2023-06-09T04:42:47.460 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:47.458+0000 7ff43e3b9700 1 --2- 172.21.15.90:0/2207342949 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff4380ad000 0x7ff4380b3410 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7ff43400c770 tx=0x7ff43400cb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:47.461 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:47.458+0000 7ff42effd700 1 -- 172.21.15.90:0/2207342949 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff434011800 con 0x7ff4380ad000 2023-06-09T04:42:47.461 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:47.458+0000 7ff42effd700 1 -- 172.21.15.90:0/2207342949 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff434011960 con 0x7ff4380ad000 2023-06-09T04:42:47.461 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:47.458+0000 7ff43f3bb700 1 -- 172.21.15.90:0/2207342949 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff43815c490 con 0x7ff4380ad000 2023-06-09T04:42:47.461 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:47.458+0000 7ff42effd700 1 -- 172.21.15.90:0/2207342949 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff434011d10 con 0x7ff4380ad000 2023-06-09T04:42:47.461 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:47.458+0000 7ff43f3bb700 1 -- 172.21.15.90:0/2207342949 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff43815ca50 con 0x7ff4380ad000 2023-06-09T04:42:47.461 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:47.458+0000 7ff43f3bb700 1 -- 172.21.15.90:0/2207342949 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff43815cc70 con 0x7ff4380ad000 2023-06-09T04:42:47.462 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:47.458+0000 7ff42effd700 1 -- 172.21.15.90:0/2207342949 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff434018360 con 0x7ff4380ad000 2023-06-09T04:42:47.464 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:47.462+0000 7ff42effd700 1 --2- 172.21.15.90:0/2207342949 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7ff41c0662f0 0x7ff41c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:47.465 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:47.462+0000 7ff42effd700 1 -- 172.21.15.90:0/2207342949 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6206+0+0 (secure 0 0 0) 0x7ff434083ea0 con 0x7ff4380ad000 2023-06-09T04:42:47.465 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:47.462+0000 7ff43dbb8700 1 --2- 172.21.15.90:0/2207342949 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7ff41c0662f0 0x7ff41c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:47.466 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:47.462+0000 7ff43dbb8700 1 --2- 172.21.15.90:0/2207342949 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7ff41c0662f0 0x7ff41c0687a0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ff43815a120 tx=0x7ff428010000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:47.468 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:47.466+0000 7ff42effd700 1 -- 172.21.15.90:0/2207342949 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff434051280 con 0x7ff4380ad000 2023-06-09T04:42:47.641 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:47.638+0000 7ff43f3bb700 1 -- 172.21.15.90:0/2207342949 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7ff4380b3d80 con 0x7ff4380ad000 2023-06-09T04:42:48.230 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:42:48.236 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:42:48.326 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:48.322+0000 7ff42effd700 1 -- 172.21.15.90:0/2207342949 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v28) v1 ==== 181+0+0 (secure 0 0 0) 0x7ff4380b3d80 con 0x7ff4380ad000 2023-06-09T04:42:48.330 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:48.326+0000 7ff43f3bb700 1 -- 172.21.15.90:0/2207342949 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7ff41c0662f0 msgr2=0x7ff41c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:48.331 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:48.326+0000 7ff43f3bb700 1 --2- 172.21.15.90:0/2207342949 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7ff41c0662f0 0x7ff41c0687a0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ff43815a120 tx=0x7ff428010000 comp rx=0 tx=0).stop 2023-06-09T04:42:48.331 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:48.326+0000 7ff43f3bb700 1 -- 172.21.15.90:0/2207342949 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff4380ad000 msgr2=0x7ff4380b3410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:48.331 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:48.326+0000 7ff43f3bb700 1 --2- 172.21.15.90:0/2207342949 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff4380ad000 0x7ff4380b3410 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7ff43400c770 tx=0x7ff43400cb30 comp rx=0 tx=0).stop 2023-06-09T04:42:48.331 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:48.326+0000 7ff43f3bb700 1 -- 172.21.15.90:0/2207342949 shutdown_connections 2023-06-09T04:42:48.331 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:48.326+0000 7ff43f3bb700 1 --2- 172.21.15.90:0/2207342949 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7ff41c0662f0 0x7ff41c0687a0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:48.331 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:48.326+0000 7ff43f3bb700 1 --2- 172.21.15.90:0/2207342949 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff438160420 0x7ff438069820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:48.332 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:48.326+0000 7ff43f3bb700 1 --2- 172.21.15.90:0/2207342949 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff4380ca820 0x7ff4381f0d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:48.332 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:48.326+0000 7ff43f3bb700 1 --2- 172.21.15.90:0/2207342949 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff4380ad000 0x7ff4380b3410 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:48.332 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:48.326+0000 7ff43f3bb700 1 -- 172.21.15.90:0/2207342949 >> 172.21.15.90:0/2207342949 conn(0x7ff4380b0b20 msgr2=0x7ff43815fcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:48.332 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:48.330+0000 7ff43f3bb700 1 -- 172.21.15.90:0/2207342949 shutdown_connections 2023-06-09T04:42:48.332 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:48.330+0000 7ff43f3bb700 1 -- 172.21.15.90:0/2207342949 wait complete. 2023-06-09T04:42:48.333 INFO:teuthology.orchestra.run.smithi090.stderr:pool 'cephfs_metadata' removed 2023-06-09T04:42:48.351 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-06-09T04:42:48.577 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:48.574+0000 7ff629e91700 1 Processor -- start 2023-06-09T04:42:48.578 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:48.574+0000 7ff629e91700 1 -- start start 2023-06-09T04:42:48.580 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:48.578+0000 7ff629e91700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7ff6240cdd40 0x7ff624158a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:48.580 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:48.578+0000 7ff629e91700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff6240cb320 0x7ff6240cc610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:48.580 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:48.578+0000 7ff629e91700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ff6240cb790 0x7ff6240ccb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:48.581 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:48.578+0000 7ff629e91700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff624159a30 con 0x7ff6240cdd40 2023-06-09T04:42:48.581 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:48.578+0000 7ff629e91700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff624158f60 con 0x7ff6240cb790 2023-06-09T04:42:48.581 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:48.578+0000 7ff629e91700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff62415c240 con 0x7ff6240cb320 2023-06-09T04:42:48.582 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:48.578+0000 7ff6237fe700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7ff6240cdd40 0x7ff624158a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:48.582 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:48.578+0000 7ff6237fe700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7ff6240cdd40 0x7ff624158a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:38570/0 (socket says 172.21.15.90:38570) 2023-06-09T04:42:48.582 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:48.578+0000 7ff6237fe700 1 -- 172.21.15.90:0/3539855460 learned_addr learned my addr 172.21.15.90:0/3539855460 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:48.582 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:48.578+0000 7ff622ffd700 1 --2- 172.21.15.90:0/3539855460 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff6240cb320 0x7ff6240cc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:48.582 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:48.578+0000 7ff623fff700 1 --2- 172.21.15.90:0/3539855460 >> v2:172.21.15.174:3300/0 conn(0x7ff6240cb790 0x7ff6240ccb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:48.583 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:48.578+0000 7ff6237fe700 1 -- 172.21.15.90:0/3539855460 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff6240cb320 msgr2=0x7ff6240cc610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:48.583 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:48.578+0000 7ff6237fe700 1 --2- 172.21.15.90:0/3539855460 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff6240cb320 0x7ff6240cc610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:48.583 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:48.578+0000 7ff6237fe700 1 -- 172.21.15.90:0/3539855460 >> v2:172.21.15.174:3300/0 conn(0x7ff6240cb790 msgr2=0x7ff6240ccb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:48.583 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:48.578+0000 7ff6237fe700 1 --2- 172.21.15.90:0/3539855460 >> v2:172.21.15.174:3300/0 conn(0x7ff6240cb790 0x7ff6240ccb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:48.583 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:48.578+0000 7ff6237fe700 1 -- 172.21.15.90:0/3539855460 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff624159190 con 0x7ff6240cdd40 2023-06-09T04:42:48.583 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:48.578+0000 7ff623fff700 1 --2- 172.21.15.90:0/3539855460 >> v2:172.21.15.174:3300/0 conn(0x7ff6240cb790 0x7ff6240ccb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:42:48.584 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:48.578+0000 7ff6237fe700 1 --2- 172.21.15.90:0/3539855460 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff6240cdd40 0x7ff624158a20 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7ff62406af30 tx=0x7ff614009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27865801abdee0c6 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:48.584 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:48.582+0000 7ff6227fc700 1 -- 172.21.15.90:0/3539855460 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff614011830 con 0x7ff6240cdd40 2023-06-09T04:42:48.585 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:48.582+0000 7ff6227fc700 1 -- 172.21.15.90:0/3539855460 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff614011990 con 0x7ff6240cdd40 2023-06-09T04:42:48.585 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:48.582+0000 7ff6227fc700 1 -- 172.21.15.90:0/3539855460 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff614011d20 con 0x7ff6240cdd40 2023-06-09T04:42:48.585 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:48.582+0000 7ff629e91700 1 -- 172.21.15.90:0/3539855460 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff6240cdd40 msgr2=0x7ff624158a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:48.585 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:48.582+0000 7ff629e91700 1 --2- 172.21.15.90:0/3539855460 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff6240cdd40 0x7ff624158a20 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7ff62406af30 tx=0x7ff614009bf0 comp rx=0 tx=0).stop 2023-06-09T04:42:48.585 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:48.582+0000 7ff629e91700 1 -- 172.21.15.90:0/3539855460 shutdown_connections 2023-06-09T04:42:48.585 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:48.582+0000 7ff629e91700 1 --2- 172.21.15.90:0/3539855460 >> v2:172.21.15.174:3300/0 conn(0x7ff6240cb790 0x7ff6240ccb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:48.585 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:48.582+0000 7ff629e91700 1 --2- 172.21.15.90:0/3539855460 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff6240cb320 0x7ff6240cc610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:48.586 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:48.582+0000 7ff629e91700 1 --2- 172.21.15.90:0/3539855460 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff6240cdd40 0x7ff624158a20 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:48.586 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:48.582+0000 7ff629e91700 1 -- 172.21.15.90:0/3539855460 >> 172.21.15.90:0/3539855460 conn(0x7ff62406bf30 msgr2=0x7ff62406c330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:48.586 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:48.582+0000 7ff629e91700 1 -- 172.21.15.90:0/3539855460 shutdown_connections 2023-06-09T04:42:48.586 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:48.582+0000 7ff629e91700 1 -- 172.21.15.90:0/3539855460 wait complete. 2023-06-09T04:42:48.586 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:48.582+0000 7ff629e91700 1 Processor -- start 2023-06-09T04:42:48.587 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:48.586+0000 7ff629e91700 1 -- start start 2023-06-09T04:42:48.588 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:48.586+0000 7ff629e91700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff6240cb320 0x7ff62414da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:48.588 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:48.586+0000 7ff629e91700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff6240cb790 0x7ff6240b2c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:48.588 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:48.586+0000 7ff629e91700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff6240cdd40 0x7ff6240b1280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:48.588 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:48.586+0000 7ff629e91700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6240b2790 con 0x7ff6240cdd40 2023-06-09T04:42:48.589 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:48.586+0000 7ff629e91700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff62414dfb0 con 0x7ff6240cb320 2023-06-09T04:42:48.589 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:48.586+0000 7ff629e91700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6240b3160 con 0x7ff6240cb790 2023-06-09T04:42:48.590 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:48.586+0000 7ff623fff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff6240cdd40 0x7ff6240b1280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:48.590 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:48.586+0000 7ff623fff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff6240cdd40 0x7ff6240b1280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:38584/0 (socket says 172.21.15.90:38584) 2023-06-09T04:42:48.590 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:48.586+0000 7ff623fff700 1 -- 172.21.15.90:0/92487229 learned_addr learned my addr 172.21.15.90:0/92487229 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:48.590 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:48.586+0000 7ff622ffd700 1 --2- 172.21.15.90:0/92487229 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff6240cb790 0x7ff6240b2c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:48.590 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:48.586+0000 7ff6237fe700 1 --2- 172.21.15.90:0/92487229 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff6240cb320 0x7ff62414da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:48.591 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:48.586+0000 7ff623fff700 1 -- 172.21.15.90:0/92487229 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff6240cb790 msgr2=0x7ff6240b2c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:48.591 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:48.586+0000 7ff623fff700 1 --2- 172.21.15.90:0/92487229 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff6240cb790 0x7ff6240b2c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:48.591 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:48.586+0000 7ff623fff700 1 -- 172.21.15.90:0/92487229 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff6240cb320 msgr2=0x7ff62414da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:48.591 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:48.586+0000 7ff623fff700 1 --2- 172.21.15.90:0/92487229 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff6240cb320 0x7ff62414da70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:48.591 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:48.586+0000 7ff623fff700 1 -- 172.21.15.90:0/92487229 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff614009570 con 0x7ff6240cdd40 2023-06-09T04:42:48.591 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:48.586+0000 7ff623fff700 1 --2- 172.21.15.90:0/92487229 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff6240cdd40 0x7ff6240b1280 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7ff61c007ec0 tx=0x7ff61c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:48.592 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:48.586+0000 7ff60bfff700 1 -- 172.21.15.90:0/92487229 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff61c00dd80 con 0x7ff6240cdd40 2023-06-09T04:42:48.592 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:48.586+0000 7ff629e91700 1 -- 172.21.15.90:0/92487229 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6240b1b80 con 0x7ff6240cdd40 2023-06-09T04:42:48.592 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:48.586+0000 7ff60bfff700 1 -- 172.21.15.90:0/92487229 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff61c00f040 con 0x7ff6240cdd40 2023-06-09T04:42:48.592 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:48.586+0000 7ff60bfff700 1 -- 172.21.15.90:0/92487229 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff61c003cd0 con 0x7ff6240cdd40 2023-06-09T04:42:48.592 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:48.586+0000 7ff629e91700 1 -- 172.21.15.90:0/92487229 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6240b2140 con 0x7ff6240cdd40 2023-06-09T04:42:48.593 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:48.590+0000 7ff629e91700 1 -- 172.21.15.90:0/92487229 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6240b2900 con 0x7ff6240cdd40 2023-06-09T04:42:48.594 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:48.590+0000 7ff60bfff700 1 -- 172.21.15.90:0/92487229 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff61c004030 con 0x7ff6240cdd40 2023-06-09T04:42:48.595 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:48.594+0000 7ff60bfff700 1 --2- 172.21.15.90:0/92487229 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7ff6100662f0 0x7ff6100687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:48.596 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:48.594+0000 7ff60bfff700 1 -- 172.21.15.90:0/92487229 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 5768+0+0 (secure 0 0 0) 0x7ff61c006e40 con 0x7ff6240cdd40 2023-06-09T04:42:48.596 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:48.594+0000 7ff6237fe700 1 --2- 172.21.15.90:0/92487229 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7ff6100662f0 0x7ff6100687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:48.597 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:48.594+0000 7ff6237fe700 1 --2- 172.21.15.90:0/92487229 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7ff6100662f0 0x7ff6100687a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7ff614000c00 tx=0x7ff614008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:48.600 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:48.598+0000 7ff60bfff700 1 -- 172.21.15.90:0/92487229 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff61c0511e0 con 0x7ff6240cdd40 2023-06-09T04:42:48.769 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:48.766+0000 7ff629e91700 1 -- 172.21.15.90:0/92487229 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7ff62404dba0 con 0x7ff6240cdd40 2023-06-09T04:42:49.343 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:49.338+0000 7ff60bfff700 1 -- 172.21.15.90:0/92487229 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v29) v1 ==== 169+0+0 (secure 0 0 0) 0x7ff61c054800 con 0x7ff6240cdd40 2023-06-09T04:42:49.349 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:49.346+0000 7ff629e91700 1 -- 172.21.15.90:0/92487229 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7ff6100662f0 msgr2=0x7ff6100687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:49.350 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:49.346+0000 7ff629e91700 1 --2- 172.21.15.90:0/92487229 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7ff6100662f0 0x7ff6100687a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7ff614000c00 tx=0x7ff614008030 comp rx=0 tx=0).stop 2023-06-09T04:42:49.350 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:49.346+0000 7ff629e91700 1 -- 172.21.15.90:0/92487229 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff6240cdd40 msgr2=0x7ff6240b1280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:49.350 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:49.346+0000 7ff629e91700 1 --2- 172.21.15.90:0/92487229 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff6240cdd40 0x7ff6240b1280 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7ff61c007ec0 tx=0x7ff61c00d3b0 comp rx=0 tx=0).stop 2023-06-09T04:42:49.350 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:49.346+0000 7ff629e91700 1 -- 172.21.15.90:0/92487229 shutdown_connections 2023-06-09T04:42:49.350 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:49.346+0000 7ff629e91700 1 --2- 172.21.15.90:0/92487229 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7ff6100662f0 0x7ff6100687a0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:49.350 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:49.346+0000 7ff629e91700 1 --2- 172.21.15.90:0/92487229 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff6240cdd40 0x7ff6240b1280 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:49.350 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:49.346+0000 7ff629e91700 1 --2- 172.21.15.90:0/92487229 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff6240cb790 0x7ff6240b2c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:49.351 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:49.346+0000 7ff629e91700 1 --2- 172.21.15.90:0/92487229 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff6240cb320 0x7ff62414da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:49.351 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:49.346+0000 7ff629e91700 1 -- 172.21.15.90:0/92487229 >> 172.21.15.90:0/92487229 conn(0x7ff62406bf30 msgr2=0x7ff62406fa00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:49.351 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:49.346+0000 7ff629e91700 1 -- 172.21.15.90:0/92487229 shutdown_connections 2023-06-09T04:42:49.351 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:49.346+0000 7ff629e91700 1 -- 172.21.15.90:0/92487229 wait complete. 2023-06-09T04:42:49.352 INFO:teuthology.orchestra.run.smithi090.stderr:pool 'cephfs_data' removed 2023-06-09T04:42:49.372 INFO:tasks.ceph.mds.a:Restarting daemon 2023-06-09T04:42:49.372 INFO:tasks.ceph.mds.a:Stopping old one... 2023-06-09T04:42:49.373 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-06-09T04:42:49.373 INFO:teuthology.orchestra.run:waiting for 300 2023-06-09T04:42:49.373 INFO:tasks.ceph.mds.c:Restarting daemon 2023-06-09T04:42:49.373 INFO:tasks.ceph.mds.c:Stopping old one... 2023-06-09T04:42:49.374 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-06-09T04:42:49.374 INFO:teuthology.orchestra.run:waiting for 300 2023-06-09T04:42:49.374 INFO:tasks.ceph.mds.b:Restarting daemon 2023-06-09T04:42:49.374 INFO:tasks.ceph.mds.b:Stopping old one... 2023-06-09T04:42:49.374 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-06-09T04:42:49.375 INFO:teuthology.orchestra.run:waiting for 300 2023-06-09T04:42:49.375 INFO:tasks.ceph.mds.d:Restarting daemon 2023-06-09T04:42:49.375 INFO:tasks.ceph.mds.d:Stopping old one... 2023-06-09T04:42:49.375 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-06-09T04:42:49.376 INFO:teuthology.orchestra.run:waiting for 300 2023-06-09T04:42:49.391 INFO:tasks.ceph.mds.a:Stopped 2023-06-09T04:42:49.391 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-06-09T04:42:49.393 INFO:tasks.ceph.mds.b:Stopped 2023-06-09T04:42:49.393 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-06-09T04:42:49.394 INFO:tasks.ceph.mds.c:Stopped 2023-06-09T04:42:49.394 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-06-09T04:42:49.394 INFO:tasks.ceph.mds.d:Stopped 2023-06-09T04:42:49.395 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-06-09T04:42:49.440 INFO:tasks.ceph.mds.b:Started 2023-06-09T04:42:49.440 DEBUG:teuthology.parallel:result is None 2023-06-09T04:42:49.443 INFO:tasks.ceph.mds.d:Started 2023-06-09T04:42:49.444 DEBUG:teuthology.parallel:result is None 2023-06-09T04:42:49.444 INFO:tasks.ceph.mds.a:Started 2023-06-09T04:42:49.445 DEBUG:teuthology.parallel:result is None 2023-06-09T04:42:49.451 INFO:tasks.ceph.mds.c:Started 2023-06-09T04:42:49.451 DEBUG:teuthology.parallel:result is None 2023-06-09T04:42:49.451 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-06-09T04:42:49.557 INFO:tasks.ceph.mds.b.smithi174.stdout:starting mds.b at 2023-06-09T04:42:49.558 INFO:tasks.ceph.mds.d.smithi174.stdout:starting mds.d at 2023-06-09T04:42:49.570 INFO:tasks.ceph.mds.a.smithi090.stdout:starting mds.a at 2023-06-09T04:42:49.578 INFO:tasks.ceph.mds.c.smithi090.stdout:starting mds.c at 2023-06-09T04:42:49.633 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:49.630+0000 7f4d31e76700 1 Processor -- start 2023-06-09T04:42:49.634 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:49.630+0000 7f4d31e76700 1 -- start start 2023-06-09T04:42:49.635 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:49.630+0000 7f4d31e76700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f4d2c154350 0x7f4d2c0cc0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:49.635 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:49.634+0000 7f4d31e76700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f4d2c0cafb0 0x7f4d2c06acf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:49.635 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:49.634+0000 7f4d31e76700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4d2c15d7a0 0x7f4d2c15dc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:49.635 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:49.634+0000 7f4d31e76700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d2c154720 con 0x7f4d2c0cafb0 2023-06-09T04:42:49.636 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:49.634+0000 7f4d31e76700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d2c15e160 con 0x7f4d2c154350 2023-06-09T04:42:49.636 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:49.634+0000 7f4d31e76700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d2c0cd8a0 con 0x7f4d2c15d7a0 2023-06-09T04:42:49.636 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:49.634+0000 7f4d2bfff700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f4d2c0cafb0 0x7f4d2c06acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:49.636 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:49.634+0000 7f4d2bfff700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f4d2c0cafb0 0x7f4d2c06acf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:38640/0 (socket says 172.21.15.90:38640) 2023-06-09T04:42:49.636 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:49.634+0000 7f4d2bfff700 1 -- 172.21.15.90:0/3852778680 learned_addr learned my addr 172.21.15.90:0/3852778680 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:49.638 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:49.634+0000 7f4d2bfff700 1 -- 172.21.15.90:0/3852778680 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4d2c15d7a0 msgr2=0x7f4d2c15dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:49.638 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:49.634+0000 7f4d2bfff700 1 --2- 172.21.15.90:0/3852778680 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4d2c15d7a0 0x7f4d2c15dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:49.638 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:49.634+0000 7f4d2bfff700 1 -- 172.21.15.90:0/3852778680 >> v2:172.21.15.174:3300/0 conn(0x7f4d2c154350 msgr2=0x7f4d2c0cc0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:49.638 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:49.634+0000 7f4d30e74700 1 --2- 172.21.15.90:0/3852778680 >> v2:172.21.15.174:3300/0 conn(0x7f4d2c154350 0x7f4d2c0cc0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:49.638 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:49.634+0000 7f4d2bfff700 1 --2- 172.21.15.90:0/3852778680 >> v2:172.21.15.174:3300/0 conn(0x7f4d2c154350 0x7f4d2c0cc0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:49.638 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:49.634+0000 7f4d2bfff700 1 -- 172.21.15.90:0/3852778680 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d2c0cb420 con 0x7f4d2c0cafb0 2023-06-09T04:42:49.638 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:49.634+0000 7f4d30e74700 1 --2- 172.21.15.90:0/3852778680 >> v2:172.21.15.174:3300/0 conn(0x7f4d2c154350 0x7f4d2c0cc0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:42:49.639 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:49.634+0000 7f4d2bfff700 1 --2- 172.21.15.90:0/3852778680 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4d2c0cafb0 0x7f4d2c06acf0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f4d2c06f160 tx=0x7f4d18009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdbce966840dbaf1 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:49.639 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:49.634+0000 7f4d2b7fe700 1 -- 172.21.15.90:0/3852778680 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d1800b8a0 con 0x7f4d2c0cafb0 2023-06-09T04:42:49.639 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:49.634+0000 7f4d2b7fe700 1 -- 172.21.15.90:0/3852778680 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d1800ba00 con 0x7f4d2c0cafb0 2023-06-09T04:42:49.639 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:49.634+0000 7f4d2b7fe700 1 -- 172.21.15.90:0/3852778680 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d1800bd90 con 0x7f4d2c0cafb0 2023-06-09T04:42:49.639 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:49.634+0000 7f4d31e76700 1 -- 172.21.15.90:0/3852778680 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4d2c0cafb0 msgr2=0x7f4d2c06acf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:49.639 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:49.634+0000 7f4d31e76700 1 --2- 172.21.15.90:0/3852778680 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4d2c0cafb0 0x7f4d2c06acf0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f4d2c06f160 tx=0x7f4d18009bf0 comp rx=0 tx=0).stop 2023-06-09T04:42:49.639 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:49.634+0000 7f4d31e76700 1 -- 172.21.15.90:0/3852778680 shutdown_connections 2023-06-09T04:42:49.639 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:49.634+0000 7f4d31e76700 1 --2- 172.21.15.90:0/3852778680 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4d2c15d7a0 0x7f4d2c15dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:49.640 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:49.634+0000 7f4d31e76700 1 --2- 172.21.15.90:0/3852778680 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4d2c0cafb0 0x7f4d2c06acf0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:49.640 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:49.634+0000 7f4d31e76700 1 --2- 172.21.15.90:0/3852778680 >> v2:172.21.15.174:3300/0 conn(0x7f4d2c154350 0x7f4d2c0cc0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:49.640 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:49.634+0000 7f4d31e76700 1 -- 172.21.15.90:0/3852778680 >> 172.21.15.90:0/3852778680 conn(0x7f4d2c06c690 msgr2=0x7f4d2c0aff00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:49.640 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:49.634+0000 7f4d31e76700 1 -- 172.21.15.90:0/3852778680 shutdown_connections 2023-06-09T04:42:49.640 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:49.634+0000 7f4d31e76700 1 -- 172.21.15.90:0/3852778680 wait complete. 2023-06-09T04:42:49.641 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:49.638+0000 7f4d31e76700 1 Processor -- start 2023-06-09T04:42:49.641 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:49.638+0000 7f4d31e76700 1 -- start start 2023-06-09T04:42:49.642 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:49.638+0000 7f4d31e76700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4d2c0cafb0 0x7f4d2c070370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:49.642 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:49.638+0000 7f4d31e76700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4d2c154350 0x7f4d2c0af030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:49.642 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:49.638+0000 7f4d31e76700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4d2c15d7a0 0x7f4d2c146d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:49.642 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:49.638+0000 7f4d31e76700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d2c1495a0 con 0x7f4d2c0cafb0 2023-06-09T04:42:49.642 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:49.638+0000 7f4d31e76700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d2c149880 con 0x7f4d2c154350 2023-06-09T04:42:49.643 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:49.638+0000 7f4d31e76700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d2c149b60 con 0x7f4d2c15d7a0 2023-06-09T04:42:49.644 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:49.638+0000 7f4d30e74700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4d2c0cafb0 0x7f4d2c070370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:49.644 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:49.638+0000 7f4d30e74700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4d2c0cafb0 0x7f4d2c070370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:38654/0 (socket says 172.21.15.90:38654) 2023-06-09T04:42:49.644 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:49.638+0000 7f4d30e74700 1 -- 172.21.15.90:0/1771960771 learned_addr learned my addr 172.21.15.90:0/1771960771 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:49.644 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:49.638+0000 7f4d2bfff700 1 --2- 172.21.15.90:0/1771960771 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4d2c154350 0x7f4d2c0af030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:49.644 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:49.638+0000 7f4d31675700 1 --2- 172.21.15.90:0/1771960771 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4d2c15d7a0 0x7f4d2c146d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:49.644 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:49.642+0000 7f4d30e74700 1 -- 172.21.15.90:0/1771960771 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4d2c15d7a0 msgr2=0x7f4d2c146d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:49.645 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:49.642+0000 7f4d30e74700 1 --2- 172.21.15.90:0/1771960771 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4d2c15d7a0 0x7f4d2c146d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:49.645 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:49.642+0000 7f4d30e74700 1 -- 172.21.15.90:0/1771960771 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4d2c154350 msgr2=0x7f4d2c0af030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:49.645 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:49.642+0000 7f4d30e74700 1 --2- 172.21.15.90:0/1771960771 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4d2c154350 0x7f4d2c0af030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:49.645 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:49.642+0000 7f4d30e74700 1 -- 172.21.15.90:0/1771960771 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d18009570 con 0x7f4d2c0cafb0 2023-06-09T04:42:49.645 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:49.642+0000 7f4d31675700 1 --2- 172.21.15.90:0/1771960771 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4d2c15d7a0 0x7f4d2c146d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:42:49.645 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:49.642+0000 7f4d30e74700 1 --2- 172.21.15.90:0/1771960771 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4d2c0cafb0 0x7f4d2c070370 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f4d2000c770 tx=0x7f4d2000ca80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:49.646 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:49.642+0000 7f4d297fa700 1 -- 172.21.15.90:0/1771960771 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d20011800 con 0x7f4d2c0cafb0 2023-06-09T04:42:49.646 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:49.642+0000 7f4d297fa700 1 -- 172.21.15.90:0/1771960771 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d20011960 con 0x7f4d2c0cafb0 2023-06-09T04:42:49.646 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:49.642+0000 7f4d31e76700 1 -- 172.21.15.90:0/1771960771 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d2c149e40 con 0x7f4d2c0cafb0 2023-06-09T04:42:49.646 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:49.642+0000 7f4d297fa700 1 -- 172.21.15.90:0/1771960771 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d20011d10 con 0x7f4d2c0cafb0 2023-06-09T04:42:49.646 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:49.642+0000 7f4d31e76700 1 -- 172.21.15.90:0/1771960771 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d2c0708b0 con 0x7f4d2c0cafb0 2023-06-09T04:42:49.647 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:49.642+0000 7f4d31e76700 1 -- 172.21.15.90:0/1771960771 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d2c06b390 con 0x7f4d2c0cafb0 2023-06-09T04:42:49.647 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:49.646+0000 7f4d297fa700 1 -- 172.21.15.90:0/1771960771 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4d20018360 con 0x7f4d2c0cafb0 2023-06-09T04:42:49.650 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:49.646+0000 7f4d297fa700 1 --2- 172.21.15.90:0/1771960771 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f4d10066320 0x7f4d100687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:49.650 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:49.646+0000 7f4d297fa700 1 -- 172.21.15.90:0/1771960771 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f4d20083a00 con 0x7f4d2c0cafb0 2023-06-09T04:42:49.650 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:49.646+0000 7f4d2bfff700 1 --2- 172.21.15.90:0/1771960771 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f4d10066320 0x7f4d100687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:49.651 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:49.650+0000 7f4d2bfff700 1 --2- 172.21.15.90:0/1771960771 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f4d10066320 0x7f4d100687d0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f4d18000c00 tx=0x7f4d18008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:49.656 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:49.654+0000 7f4d297fa700 1 -- 172.21.15.90:0/1771960771 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4d20051110 con 0x7f4d2c0cafb0 2023-06-09T04:42:49.838 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:49.834+0000 7f4d31e76700 1 -- 172.21.15.90:0/1771960771 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f4d2c14a360 con 0x7f4d2c0cafb0 2023-06-09T04:42:50.616 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:50.614+0000 7f4d297fa700 1 -- 172.21.15.90:0/1771960771 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v34) v1 ==== 97+0+0 (secure 0 0 0) 0x7f4d2c14a360 con 0x7f4d2c0cafb0 2023-06-09T04:42:50.620 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:50.618+0000 7f4d31e76700 1 -- 172.21.15.90:0/1771960771 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f4d10066320 msgr2=0x7f4d100687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:50.621 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:50.618+0000 7f4d31e76700 1 --2- 172.21.15.90:0/1771960771 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f4d10066320 0x7f4d100687d0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f4d18000c00 tx=0x7f4d18008030 comp rx=0 tx=0).stop 2023-06-09T04:42:50.621 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:50.618+0000 7f4d31e76700 1 -- 172.21.15.90:0/1771960771 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4d2c0cafb0 msgr2=0x7f4d2c070370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:50.621 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:50.618+0000 7f4d31e76700 1 --2- 172.21.15.90:0/1771960771 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4d2c0cafb0 0x7f4d2c070370 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f4d2000c770 tx=0x7f4d2000ca80 comp rx=0 tx=0).stop 2023-06-09T04:42:50.621 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:50.618+0000 7f4d31e76700 1 -- 172.21.15.90:0/1771960771 shutdown_connections 2023-06-09T04:42:50.621 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:50.618+0000 7f4d31e76700 1 --2- 172.21.15.90:0/1771960771 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f4d10066320 0x7f4d100687d0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:50.621 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:50.618+0000 7f4d31e76700 1 --2- 172.21.15.90:0/1771960771 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4d2c15d7a0 0x7f4d2c146d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:50.622 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:50.618+0000 7f4d31e76700 1 --2- 172.21.15.90:0/1771960771 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4d2c154350 0x7f4d2c0af030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:50.622 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:50.618+0000 7f4d31e76700 1 --2- 172.21.15.90:0/1771960771 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4d2c0cafb0 0x7f4d2c070370 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:50.622 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:50.618+0000 7f4d31e76700 1 -- 172.21.15.90:0/1771960771 >> 172.21.15.90:0/1771960771 conn(0x7f4d2c06c690 msgr2=0x7f4d2c15a220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:50.622 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:50.618+0000 7f4d31e76700 1 -- 172.21.15.90:0/1771960771 shutdown_connections 2023-06-09T04:42:50.622 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:50.618+0000 7f4d31e76700 1 -- 172.21.15.90:0/1771960771 wait complete. 2023-06-09T04:42:50.623 INFO:teuthology.orchestra.run.smithi090.stderr: removed all blocklist entries 2023-06-09T04:42:50.640 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-06-09T04:42:50.810 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:50.806+0000 7f6dabc98700 1 Processor -- start 2023-06-09T04:42:50.811 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:50.806+0000 7f6dabc98700 1 -- start start 2023-06-09T04:42:50.812 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:50.810+0000 7f6dabc98700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f6da40cd600 0x7f6da40cc0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:50.812 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:50.810+0000 7f6dabc98700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6da40cc600 0x7f6da4069c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:50.813 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:50.810+0000 7f6dabc98700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6da40cb140 con 0x7f6da4160660 2023-06-09T04:42:50.813 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:50.810+0000 7f6dabc98700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6da40c9250 con 0x7f6da40cd600 2023-06-09T04:42:50.813 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:50.810+0000 7f6dabc98700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6da40cca80 con 0x7f6da40cc600 2023-06-09T04:42:50.814 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:50.810+0000 7f6da9a34700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f6da4160660 0x7f6da40c8b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:39946/0 (socket says 172.21.15.90:39946) 2023-06-09T04:42:50.814 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:50.810+0000 7f6da9a34700 1 -- 172.21.15.90:0/1782911209 learned_addr learned my addr 172.21.15.90:0/1782911209 (peer_addr_for_me v1:172.21.15.90:0/0) 2023-06-09T04:42:50.814 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:50.810+0000 7f6daa235700 1 --2- 172.21.15.90:0/1782911209 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6da40cc600 0x7f6da4069c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:50.814 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:50.810+0000 7f6da9233700 1 --2- 172.21.15.90:0/1782911209 >> v2:172.21.15.174:3300/0 conn(0x7f6da40cd600 0x7f6da40cc0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:50.814 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:50.810+0000 7f6da8a32700 1 -- 172.21.15.90:0/1782911209 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 218344652 0 0) 0x7f6da40cb140 con 0x7f6da4160660 2023-06-09T04:42:50.814 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:50.810+0000 7f6da8a32700 1 -- 172.21.15.90:0/1782911209 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d900035d0 con 0x7f6da4160660 2023-06-09T04:42:50.815 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:50.810+0000 7f6daa235700 1 -- 172.21.15.90:0/1782911209 >> v2:172.21.15.174:3300/0 conn(0x7f6da40cd600 msgr2=0x7f6da40cc0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:50.815 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:50.810+0000 7f6daa235700 1 --2- 172.21.15.90:0/1782911209 >> v2:172.21.15.174:3300/0 conn(0x7f6da40cd600 0x7f6da40cc0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:50.815 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:50.810+0000 7f6daa235700 1 -- 172.21.15.90:0/1782911209 >> v1:172.21.15.90:6789/0 conn(0x7f6da4160660 legacy=0x7f6da40c8b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:50.815 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:50.810+0000 7f6da8a32700 1 -- 172.21.15.90:0/1782911209 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3785408374 0 0) 0x7f6d900035d0 con 0x7f6da4160660 2023-06-09T04:42:50.816 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:50.810+0000 7f6daa235700 1 -- 172.21.15.90:0/1782911209 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6da406fb00 con 0x7f6da40cc600 2023-06-09T04:42:50.816 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:50.814+0000 7f6daa235700 1 --2- 172.21.15.90:0/1782911209 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6da40cc600 0x7f6da4069c00 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f6d9c009d90 tx=0x7f6d9c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=18aec75d128a92da server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:50.816 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:50.814+0000 7f6da8a32700 1 -- 172.21.15.90:0/1782911209 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d9c00e070 con 0x7f6da40cc600 2023-06-09T04:42:50.816 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:50.814+0000 7f6da8a32700 1 -- 172.21.15.90:0/1782911209 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d9c003a40 con 0x7f6da40cc600 2023-06-09T04:42:50.817 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:50.814+0000 7f6da8a32700 1 -- 172.21.15.90:0/1782911209 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6da0001670 con 0x7f6da40cc600 2023-06-09T04:42:50.817 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:50.814+0000 7f6dabc98700 1 -- 172.21.15.90:0/1782911209 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6da40cc600 msgr2=0x7f6da4069c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:50.817 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:50.814+0000 7f6dabc98700 1 --2- 172.21.15.90:0/1782911209 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6da40cc600 0x7f6da4069c00 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f6d9c009d90 tx=0x7f6d9c00b330 comp rx=0 tx=0).stop 2023-06-09T04:42:50.818 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:50.814+0000 7f6dabc98700 1 -- 172.21.15.90:0/1782911209 shutdown_connections 2023-06-09T04:42:50.818 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:50.814+0000 7f6dabc98700 1 --2- 172.21.15.90:0/1782911209 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6da40cc600 0x7f6da4069c00 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:50.818 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:50.814+0000 7f6dabc98700 1 --2- 172.21.15.90:0/1782911209 >> v2:172.21.15.174:3300/0 conn(0x7f6da40cd600 0x7f6da40cc0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:50.818 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:50.814+0000 7f6dabc98700 1 -- 172.21.15.90:0/1782911209 >> 172.21.15.90:0/1782911209 conn(0x7f6da406c810 msgr2=0x7f6da40b0000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:50.818 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:50.814+0000 7f6dabc98700 1 -- 172.21.15.90:0/1782911209 shutdown_connections 2023-06-09T04:42:50.818 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:50.814+0000 7f6dabc98700 1 -- 172.21.15.90:0/1782911209 wait complete. 2023-06-09T04:42:50.821 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:50.818+0000 7f6dabc98700 1 Processor -- start 2023-06-09T04:42:50.821 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:50.818+0000 7f6dabc98700 1 -- start start 2023-06-09T04:42:50.823 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:50.818+0000 7f6dabc98700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6da40cc600 0x7f6da40c8370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:50.823 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:50.818+0000 7f6dabc98700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6da40cd600 0x7f6da40c55c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:50.823 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:50.818+0000 7f6dabc98700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6da4160660 0x7f6da40afa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:50.824 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:50.818+0000 7f6dabc98700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6da4153370 con 0x7f6da40cc600 2023-06-09T04:42:50.824 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:50.818+0000 7f6dabc98700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6da40c66b0 con 0x7f6da4160660 2023-06-09T04:42:50.824 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:50.818+0000 7f6dabc98700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6da40c88b0 con 0x7f6da40cd600 2023-06-09T04:42:50.824 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:50.822+0000 7f6da9a34700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6da40cc600 0x7f6da40c8370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:50.824 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:50.822+0000 7f6da9a34700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6da40cc600 0x7f6da40c8370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:38656/0 (socket says 172.21.15.90:38656) 2023-06-09T04:42:50.824 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:50.822+0000 7f6da9a34700 1 -- 172.21.15.90:0/2169754301 learned_addr learned my addr 172.21.15.90:0/2169754301 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:50.824 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:50.822+0000 7f6da9233700 1 --2- 172.21.15.90:0/2169754301 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6da40cd600 0x7f6da40c55c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:50.824 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:50.822+0000 7f6daa235700 1 --2- 172.21.15.90:0/2169754301 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6da4160660 0x7f6da40afa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:50.825 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:50.822+0000 7f6da9a34700 1 -- 172.21.15.90:0/2169754301 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6da40cd600 msgr2=0x7f6da40c55c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:50.826 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:50.822+0000 7f6da9a34700 1 --2- 172.21.15.90:0/2169754301 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6da40cd600 0x7f6da40c55c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:50.826 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:50.822+0000 7f6da9a34700 1 -- 172.21.15.90:0/2169754301 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6da4160660 msgr2=0x7f6da40afa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:50.826 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:50.822+0000 7f6da9a34700 1 --2- 172.21.15.90:0/2169754301 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6da4160660 0x7f6da40afa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:50.826 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:50.822+0000 7f6da9a34700 1 -- 172.21.15.90:0/2169754301 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d9c009a70 con 0x7f6da40cc600 2023-06-09T04:42:50.826 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:50.822+0000 7f6da9a34700 1 --2- 172.21.15.90:0/2169754301 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6da40cc600 0x7f6da40c8370 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f6da000c530 tx=0x7f6da000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:50.826 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:50.822+0000 7f6d9a7fc700 1 -- 172.21.15.90:0/2169754301 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6da0004ca0 con 0x7f6da40cc600 2023-06-09T04:42:50.826 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:50.822+0000 7f6d9a7fc700 1 -- 172.21.15.90:0/2169754301 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6da0004e00 con 0x7f6da40cc600 2023-06-09T04:42:50.827 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:50.822+0000 7f6d9a7fc700 1 -- 172.21.15.90:0/2169754301 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6da00072d0 con 0x7f6da40cc600 2023-06-09T04:42:50.827 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:50.822+0000 7f6dabc98700 1 -- 172.21.15.90:0/2169754301 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6da40c63d0 con 0x7f6da40cc600 2023-06-09T04:42:50.827 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:50.822+0000 7f6dabc98700 1 -- 172.21.15.90:0/2169754301 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6da41f9440 con 0x7f6da40cc600 2023-06-09T04:42:50.827 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:50.822+0000 7f6dabc98700 1 -- 172.21.15.90:0/2169754301 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6da404db30 con 0x7f6da40cc600 2023-06-09T04:42:50.827 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:50.826+0000 7f6d9a7fc700 1 -- 172.21.15.90:0/2169754301 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6da0007430 con 0x7f6da40cc600 2023-06-09T04:42:50.828 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:50.826+0000 7f6d9a7fc700 1 --2- 172.21.15.90:0/2169754301 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f6d880662f0 0x7f6d880687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:50.828 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:50.826+0000 7f6d9a7fc700 1 -- 172.21.15.90:0/2169754301 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f6da0083760 con 0x7f6da40cc600 2023-06-09T04:42:50.829 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:50.826+0000 7f6da9233700 1 --2- 172.21.15.90:0/2169754301 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f6d880662f0 0x7f6d880687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:50.830 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:50.826+0000 7f6da9233700 1 --2- 172.21.15.90:0/2169754301 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f6d880662f0 0x7f6d880687a0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f6da40b0720 tx=0x7f6d94008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:50.836 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:50.834+0000 7f6d9a7fc700 1 -- 172.21.15.90:0/2169754301 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6da0050f20 con 0x7f6da40cc600 2023-06-09T04:42:51.068 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:51.066+0000 7f6dabc98700 1 -- 172.21.15.90:0/2169754301 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f6da40b4470 con 0x7f6da40cc600 2023-06-09T04:42:51.069 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:51.066+0000 7f6d9a7fc700 1 -- 172.21.15.90:0/2169754301 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v4) v1 ==== 80+0+6645 (secure 0 0 0) 0x7f6da0054540 con 0x7f6da40cc600 2023-06-09T04:42:51.070 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:42:51.070 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2023-06-09T04:42:51.070 INFO:teuthology.orchestra.run.smithi090.stdout: "auth_dump": [ 2023-06-09T04:42:51.070 INFO:teuthology.orchestra.run.smithi090.stdout: { 2023-06-09T04:42:51.071 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "mds.a", 2023-06-09T04:42:51.071 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQBTrYJkwmTHAxAAvGnkxDjwaTsOj9lVipjiuw==", 2023-06-09T04:42:51.071 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2023-06-09T04:42:51.071 INFO:teuthology.orchestra.run.smithi090.stdout: "mds": "allow", 2023-06-09T04:42:51.071 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": "allow *", 2023-06-09T04:42:51.071 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow *", 2023-06-09T04:42:51.071 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow *" 2023-06-09T04:42:51.072 INFO:teuthology.orchestra.run.smithi090.stdout: } 2023-06-09T04:42:51.072 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2023-06-09T04:42:51.072 INFO:teuthology.orchestra.run.smithi090.stdout: { 2023-06-09T04:42:51.072 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "mds.b", 2023-06-09T04:42:51.072 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQBTrYJkGl8VFxAA61fApHDVnQ/R8gR8Ly0MUQ==", 2023-06-09T04:42:51.072 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2023-06-09T04:42:51.072 INFO:teuthology.orchestra.run.smithi090.stdout: "mds": "allow", 2023-06-09T04:42:51.072 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": "allow *", 2023-06-09T04:42:51.073 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow *", 2023-06-09T04:42:51.073 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow *" 2023-06-09T04:42:51.073 INFO:teuthology.orchestra.run.smithi090.stdout: } 2023-06-09T04:42:51.073 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2023-06-09T04:42:51.073 INFO:teuthology.orchestra.run.smithi090.stdout: { 2023-06-09T04:42:51.073 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "mds.c", 2023-06-09T04:42:51.073 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQBTrYJkKeC8DhAAtK6uJE3MeXIo2wr7yt3Wdg==", 2023-06-09T04:42:51.074 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2023-06-09T04:42:51.074 INFO:teuthology.orchestra.run.smithi090.stdout: "mds": "allow", 2023-06-09T04:42:51.074 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": "allow *", 2023-06-09T04:42:51.074 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow *", 2023-06-09T04:42:51.074 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow *" 2023-06-09T04:42:51.074 INFO:teuthology.orchestra.run.smithi090.stdout: } 2023-06-09T04:42:51.074 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2023-06-09T04:42:51.074 INFO:teuthology.orchestra.run.smithi090.stdout: { 2023-06-09T04:42:51.075 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "mds.d", 2023-06-09T04:42:51.075 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQBTrYJkQ24gIhAArIVH2s2uyytTIemU0qUdcw==", 2023-06-09T04:42:51.075 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2023-06-09T04:42:51.075 INFO:teuthology.orchestra.run.smithi090.stdout: "mds": "allow", 2023-06-09T04:42:51.075 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": "allow *", 2023-06-09T04:42:51.075 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow *", 2023-06-09T04:42:51.075 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow *" 2023-06-09T04:42:51.076 INFO:teuthology.orchestra.run.smithi090.stdout: } 2023-06-09T04:42:51.076 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2023-06-09T04:42:51.076 INFO:teuthology.orchestra.run.smithi090.stdout: { 2023-06-09T04:42:51.076 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "osd.0", 2023-06-09T04:42:51.076 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQBXrYJkCCQ5FBAAsQ3Bn8ASjG5NG0Irke/ngw==", 2023-06-09T04:42:51.076 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2023-06-09T04:42:51.076 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": "allow profile osd", 2023-06-09T04:42:51.076 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow profile osd", 2023-06-09T04:42:51.077 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow *" 2023-06-09T04:42:51.077 INFO:teuthology.orchestra.run.smithi090.stdout: } 2023-06-09T04:42:51.077 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2023-06-09T04:42:51.077 INFO:teuthology.orchestra.run.smithi090.stdout: { 2023-06-09T04:42:51.077 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "osd.1", 2023-06-09T04:42:51.077 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQBarYJk1MMiIRAAYrhOPrt2tagEqtErtABtVw==", 2023-06-09T04:42:51.077 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2023-06-09T04:42:51.078 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": "allow profile osd", 2023-06-09T04:42:51.078 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow profile osd", 2023-06-09T04:42:51.078 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow *" 2023-06-09T04:42:51.078 INFO:teuthology.orchestra.run.smithi090.stdout: } 2023-06-09T04:42:51.078 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2023-06-09T04:42:51.078 INFO:teuthology.orchestra.run.smithi090.stdout: { 2023-06-09T04:42:51.078 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "osd.2", 2023-06-09T04:42:51.078 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQBdrYJkraGfLhAAYFJjOwtn4DUmWUy8fpmpHg==", 2023-06-09T04:42:51.079 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2023-06-09T04:42:51.079 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": "allow profile osd", 2023-06-09T04:42:51.079 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow profile osd", 2023-06-09T04:42:51.079 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow *" 2023-06-09T04:42:51.079 INFO:teuthology.orchestra.run.smithi090.stdout: } 2023-06-09T04:42:51.079 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2023-06-09T04:42:51.079 INFO:teuthology.orchestra.run.smithi090.stdout: { 2023-06-09T04:42:51.080 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "osd.3", 2023-06-09T04:42:51.080 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQBgrYJkOkrcOhAAxcria0ETkdDsG1wsvFijSA==", 2023-06-09T04:42:51.080 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2023-06-09T04:42:51.080 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": "allow profile osd", 2023-06-09T04:42:51.080 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow profile osd", 2023-06-09T04:42:51.080 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow *" 2023-06-09T04:42:51.080 INFO:teuthology.orchestra.run.smithi090.stdout: } 2023-06-09T04:42:51.080 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2023-06-09T04:42:51.081 INFO:teuthology.orchestra.run.smithi090.stdout: { 2023-06-09T04:42:51.081 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "osd.4", 2023-06-09T04:42:51.081 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQBnrYJkXSfOFhAAdEX2NZcgYyQOIcnrBOCAcQ==", 2023-06-09T04:42:51.081 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2023-06-09T04:42:51.081 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": "allow profile osd", 2023-06-09T04:42:51.081 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow profile osd", 2023-06-09T04:42:51.081 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow *" 2023-06-09T04:42:51.081 INFO:teuthology.orchestra.run.smithi090.stdout: } 2023-06-09T04:42:51.082 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2023-06-09T04:42:51.082 INFO:teuthology.orchestra.run.smithi090.stdout: { 2023-06-09T04:42:51.082 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "osd.5", 2023-06-09T04:42:51.082 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQBqrYJkQ0PDJBAAsvUj6nqY8aNljo16VQQCFA==", 2023-06-09T04:42:51.082 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2023-06-09T04:42:51.082 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": "allow profile osd", 2023-06-09T04:42:51.082 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow profile osd", 2023-06-09T04:42:51.083 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow *" 2023-06-09T04:42:51.083 INFO:teuthology.orchestra.run.smithi090.stdout: } 2023-06-09T04:42:51.083 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2023-06-09T04:42:51.083 INFO:teuthology.orchestra.run.smithi090.stdout: { 2023-06-09T04:42:51.083 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "osd.6", 2023-06-09T04:42:51.083 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQBtrYJkY98tMxAA4cwO9N/Bq/LHakBLnPgwlg==", 2023-06-09T04:42:51.083 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2023-06-09T04:42:51.083 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": "allow profile osd", 2023-06-09T04:42:51.084 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow profile osd", 2023-06-09T04:42:51.084 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow *" 2023-06-09T04:42:51.084 INFO:teuthology.orchestra.run.smithi090.stdout: } 2023-06-09T04:42:51.084 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2023-06-09T04:42:51.084 INFO:teuthology.orchestra.run.smithi090.stdout: { 2023-06-09T04:42:51.084 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "osd.7", 2023-06-09T04:42:51.084 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQBxrYJkr7hNBBAASjmfYXWG1Bg0JpgeKFvBWg==", 2023-06-09T04:42:51.084 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2023-06-09T04:42:51.085 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": "allow profile osd", 2023-06-09T04:42:51.085 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow profile osd", 2023-06-09T04:42:51.085 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow *" 2023-06-09T04:42:51.085 INFO:teuthology.orchestra.run.smithi090.stdout: } 2023-06-09T04:42:51.085 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2023-06-09T04:42:51.085 INFO:teuthology.orchestra.run.smithi090.stdout: { 2023-06-09T04:42:51.085 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "client.0", 2023-06-09T04:42:51.086 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQBTrYJk2YfBKBAAKBjDM7uav/YVb8uSQPNRGA==", 2023-06-09T04:42:51.086 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2023-06-09T04:42:51.086 INFO:teuthology.orchestra.run.smithi090.stdout: "mds": "allow", 2023-06-09T04:42:51.086 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": "allow r", 2023-06-09T04:42:51.086 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow rw", 2023-06-09T04:42:51.086 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow rwx" 2023-06-09T04:42:51.086 INFO:teuthology.orchestra.run.smithi090.stdout: } 2023-06-09T04:42:51.086 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2023-06-09T04:42:51.087 INFO:teuthology.orchestra.run.smithi090.stdout: { 2023-06-09T04:42:51.087 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "client.1", 2023-06-09T04:42:51.087 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQBTrYJkVN7bNBAA3GsUGsmcOfG14+PYOmYDOQ==", 2023-06-09T04:42:51.087 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2023-06-09T04:42:51.087 INFO:teuthology.orchestra.run.smithi090.stdout: "mds": "allow", 2023-06-09T04:42:51.087 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": "allow r", 2023-06-09T04:42:51.087 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow rw", 2023-06-09T04:42:51.087 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow rwx" 2023-06-09T04:42:51.088 INFO:teuthology.orchestra.run.smithi090.stdout: } 2023-06-09T04:42:51.088 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2023-06-09T04:42:51.088 INFO:teuthology.orchestra.run.smithi090.stdout: { 2023-06-09T04:42:51.088 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "client.2", 2023-06-09T04:42:51.088 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQBTrYJk3ICZLhAAETQ8PH5RuHYoGlCYmEW2Wg==", 2023-06-09T04:42:51.088 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2023-06-09T04:42:51.088 INFO:teuthology.orchestra.run.smithi090.stdout: "mds": "allow", 2023-06-09T04:42:51.088 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": "allow r", 2023-06-09T04:42:51.089 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow rw", 2023-06-09T04:42:51.089 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow rwx" 2023-06-09T04:42:51.089 INFO:teuthology.orchestra.run.smithi090.stdout: } 2023-06-09T04:42:51.089 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2023-06-09T04:42:51.089 INFO:teuthology.orchestra.run.smithi090.stdout: { 2023-06-09T04:42:51.089 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "client.3", 2023-06-09T04:42:51.089 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQBTrYJkPd0JOxAASn4fN3nzWzehRxN6I321fw==", 2023-06-09T04:42:51.089 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2023-06-09T04:42:51.090 INFO:teuthology.orchestra.run.smithi090.stdout: "mds": "allow", 2023-06-09T04:42:51.090 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": "allow r", 2023-06-09T04:42:51.090 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow rw", 2023-06-09T04:42:51.090 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow rwx" 2023-06-09T04:42:51.090 INFO:teuthology.orchestra.run.smithi090.stdout: } 2023-06-09T04:42:51.090 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2023-06-09T04:42:51.090 INFO:teuthology.orchestra.run.smithi090.stdout: { 2023-06-09T04:42:51.091 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "client.admin", 2023-06-09T04:42:51.091 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQBSrYJkdxJcFhAA3pMTvAiq3IjuROLw5ndprg==", 2023-06-09T04:42:51.091 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2023-06-09T04:42:51.091 INFO:teuthology.orchestra.run.smithi090.stdout: "mds": "allow *", 2023-06-09T04:42:51.091 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": "allow *", 2023-06-09T04:42:51.091 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow *", 2023-06-09T04:42:51.091 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow *" 2023-06-09T04:42:51.091 INFO:teuthology.orchestra.run.smithi090.stdout: } 2023-06-09T04:42:51.092 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2023-06-09T04:42:51.092 INFO:teuthology.orchestra.run.smithi090.stdout: { 2023-06-09T04:42:51.092 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "client.bootstrap-mds", 2023-06-09T04:42:51.092 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQB4rYJk7K/OChAAmr1EHYAyjyqhdPxefTziXA==", 2023-06-09T04:42:51.092 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2023-06-09T04:42:51.092 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow profile bootstrap-mds" 2023-06-09T04:42:51.092 INFO:teuthology.orchestra.run.smithi090.stdout: } 2023-06-09T04:42:51.092 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2023-06-09T04:42:51.093 INFO:teuthology.orchestra.run.smithi090.stdout: { 2023-06-09T04:42:51.093 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "client.bootstrap-mgr", 2023-06-09T04:42:51.093 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQB4rYJkAMPOChAA09cjW4bU1tb9dYoPG/cskA==", 2023-06-09T04:42:51.093 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2023-06-09T04:42:51.093 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow profile bootstrap-mgr" 2023-06-09T04:42:51.093 INFO:teuthology.orchestra.run.smithi090.stdout: } 2023-06-09T04:42:51.093 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2023-06-09T04:42:51.093 INFO:teuthology.orchestra.run.smithi090.stdout: { 2023-06-09T04:42:51.094 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "client.bootstrap-osd", 2023-06-09T04:42:51.094 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQB4rYJkSNjOChAA0BieD7oDFopuXNVd0v5/uA==", 2023-06-09T04:42:51.094 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2023-06-09T04:42:51.094 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow profile bootstrap-osd" 2023-06-09T04:42:51.094 INFO:teuthology.orchestra.run.smithi090.stdout: } 2023-06-09T04:42:51.094 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2023-06-09T04:42:51.094 INFO:teuthology.orchestra.run.smithi090.stdout: { 2023-06-09T04:42:51.094 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "client.bootstrap-rbd", 2023-06-09T04:42:51.095 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQB4rYJkiujOChAAnp1CtUL4bHYOYWv1f9X1Dw==", 2023-06-09T04:42:51.095 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2023-06-09T04:42:51.095 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow profile bootstrap-rbd" 2023-06-09T04:42:51.095 INFO:teuthology.orchestra.run.smithi090.stdout: } 2023-06-09T04:42:51.095 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2023-06-09T04:42:51.095 INFO:teuthology.orchestra.run.smithi090.stdout: { 2023-06-09T04:42:51.095 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-06-09T04:42:51.096 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQB4rYJkCPnOChAANoAVmY13OTicLzy9hEZgSA==", 2023-06-09T04:42:51.096 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2023-06-09T04:42:51.096 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-06-09T04:42:51.096 INFO:teuthology.orchestra.run.smithi090.stdout: } 2023-06-09T04:42:51.096 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2023-06-09T04:42:51.096 INFO:teuthology.orchestra.run.smithi090.stdout: { 2023-06-09T04:42:51.096 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "client.bootstrap-rgw", 2023-06-09T04:42:51.096 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQB4rYJkagrPChAASDe+1qRLAbAC/Gj+OVPltg==", 2023-06-09T04:42:51.097 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2023-06-09T04:42:51.097 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow profile bootstrap-rgw" 2023-06-09T04:42:51.097 INFO:teuthology.orchestra.run.smithi090.stdout: } 2023-06-09T04:42:51.097 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2023-06-09T04:42:51.097 INFO:teuthology.orchestra.run.smithi090.stdout: { 2023-06-09T04:42:51.097 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "mgr.x", 2023-06-09T04:42:51.097 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQBSrYJkBZmHOBAA0UeOT/8Bua7Wvhs2WLgWhQ==", 2023-06-09T04:42:51.097 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2023-06-09T04:42:51.098 INFO:teuthology.orchestra.run.smithi090.stdout: "mds": "allow *", 2023-06-09T04:42:51.098 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow profile mgr", 2023-06-09T04:42:51.098 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow *" 2023-06-09T04:42:51.098 INFO:teuthology.orchestra.run.smithi090.stdout: } 2023-06-09T04:42:51.098 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2023-06-09T04:42:51.098 INFO:teuthology.orchestra.run.smithi090.stdout: { 2023-06-09T04:42:51.098 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "mgr.y", 2023-06-09T04:42:51.098 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQBSrYJkuyt1MhAAAO5JZufesMjU51hCG9Fz1g==", 2023-06-09T04:42:51.099 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2023-06-09T04:42:51.099 INFO:teuthology.orchestra.run.smithi090.stdout: "mds": "allow *", 2023-06-09T04:42:51.099 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow profile mgr", 2023-06-09T04:42:51.099 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow *" 2023-06-09T04:42:51.099 INFO:teuthology.orchestra.run.smithi090.stdout: } 2023-06-09T04:42:51.099 INFO:teuthology.orchestra.run.smithi090.stdout: } 2023-06-09T04:42:51.099 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2023-06-09T04:42:51.099 INFO:teuthology.orchestra.run.smithi090.stdout:} 2023-06-09T04:42:51.101 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:51.070+0000 7f6dabc98700 1 -- 172.21.15.90:0/2169754301 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f6d880662f0 msgr2=0x7f6d880687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:51.101 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:51.070+0000 7f6dabc98700 1 --2- 172.21.15.90:0/2169754301 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f6d880662f0 0x7f6d880687a0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f6da40b0720 tx=0x7f6d94008040 comp rx=0 tx=0).stop 2023-06-09T04:42:51.101 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:51.070+0000 7f6dabc98700 1 -- 172.21.15.90:0/2169754301 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6da40cc600 msgr2=0x7f6da40c8370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:51.101 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:51.070+0000 7f6dabc98700 1 --2- 172.21.15.90:0/2169754301 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6da40cc600 0x7f6da40c8370 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f6da000c530 tx=0x7f6da000c8f0 comp rx=0 tx=0).stop 2023-06-09T04:42:51.101 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:51.070+0000 7f6dabc98700 1 -- 172.21.15.90:0/2169754301 shutdown_connections 2023-06-09T04:42:51.102 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:51.070+0000 7f6dabc98700 1 --2- 172.21.15.90:0/2169754301 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f6d880662f0 0x7f6d880687a0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:51.102 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:51.070+0000 7f6dabc98700 1 --2- 172.21.15.90:0/2169754301 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6da4160660 0x7f6da40afa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:51.102 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:51.070+0000 7f6dabc98700 1 --2- 172.21.15.90:0/2169754301 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6da40cd600 0x7f6da40c55c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:51.102 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:51.070+0000 7f6dabc98700 1 --2- 172.21.15.90:0/2169754301 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6da40cc600 0x7f6da40c8370 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:51.102 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:51.070+0000 7f6dabc98700 1 -- 172.21.15.90:0/2169754301 >> 172.21.15.90:0/2169754301 conn(0x7f6da406c810 msgr2=0x7f6da40709d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:51.102 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:51.074+0000 7f6dabc98700 1 -- 172.21.15.90:0/2169754301 shutdown_connections 2023-06-09T04:42:51.102 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:51.074+0000 7f6dabc98700 1 -- 172.21.15.90:0/2169754301 wait complete. 2023-06-09T04:42:51.103 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-06-09T04:42:51.279 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:51.278+0000 7fc7c2903700 1 Processor -- start 2023-06-09T04:42:51.280 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:51.278+0000 7fc7c2903700 1 -- start start 2023-06-09T04:42:51.283 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:51.282+0000 7fc7c2903700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc7bc1574c0 0x7fc7bc0cdb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:51.284 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:51.282+0000 7fc7c2903700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fc7bc0cac00 0x7fc7bc0cb050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:51.284 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:51.282+0000 7fc7c2903700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7bc1618e0 con 0x7fc7bc069820 2023-06-09T04:42:51.284 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:51.282+0000 7fc7c2903700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7bc157890 con 0x7fc7bc0cac00 2023-06-09T04:42:51.284 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:51.282+0000 7fc7c2903700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7bc0cb590 con 0x7fc7bc1574c0 2023-06-09T04:42:51.285 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:51.282+0000 7fc7c1100700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fc7bc0cac00 0x7fc7bc0cb050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:51.285 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:51.282+0000 7fc7c1100700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fc7bc0cac00 0x7fc7bc0cb050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:38670/0 (socket says 172.21.15.90:38670) 2023-06-09T04:42:51.285 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:51.282+0000 7fc7c1100700 1 -- 172.21.15.90:0/860177903 learned_addr learned my addr 172.21.15.90:0/860177903 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:51.285 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:51.282+0000 7fc7c1901700 1 --2- 172.21.15.90:0/860177903 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc7bc1574c0 0x7fc7bc0cdb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:51.285 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:51.282+0000 7fc7c1100700 1 -- 172.21.15.90:0/860177903 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc7bc1574c0 msgr2=0x7fc7bc0cdb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:51.286 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:51.282+0000 7fc7c1100700 1 --2- 172.21.15.90:0/860177903 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc7bc1574c0 0x7fc7bc0cdb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:51.286 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:51.282+0000 7fc7c1100700 1 -- 172.21.15.90:0/860177903 >> v1:172.21.15.90:6789/0 conn(0x7fc7bc069820 legacy=0x7fc7bc069ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:51.286 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:51.282+0000 7fc7c1100700 1 -- 172.21.15.90:0/860177903 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7bc1647b0 con 0x7fc7bc0cac00 2023-06-09T04:42:51.286 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:51.282+0000 7fc7c1100700 1 --2- 172.21.15.90:0/860177903 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc7bc0cac00 0x7fc7bc0cb050 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fc7ac009940 tx=0x7fc7ac009c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c99bbe0cf948f60c server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:51.287 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:51.282+0000 7fc7c08ff700 1 -- 172.21.15.90:0/860177903 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7ac00ba20 con 0x7fc7bc0cac00 2023-06-09T04:42:51.287 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:51.282+0000 7fc7c08ff700 1 -- 172.21.15.90:0/860177903 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7ac009e90 con 0x7fc7bc0cac00 2023-06-09T04:42:51.287 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:51.282+0000 7fc7c08ff700 1 -- 172.21.15.90:0/860177903 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7ac00bda0 con 0x7fc7bc0cac00 2023-06-09T04:42:51.287 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:51.282+0000 7fc7c2903700 1 -- 172.21.15.90:0/860177903 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc7bc0cac00 msgr2=0x7fc7bc0cb050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:51.288 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:51.282+0000 7fc7c2903700 1 --2- 172.21.15.90:0/860177903 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc7bc0cac00 0x7fc7bc0cb050 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fc7ac009940 tx=0x7fc7ac009c50 comp rx=0 tx=0).stop 2023-06-09T04:42:51.288 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:51.282+0000 7fc7c2903700 1 -- 172.21.15.90:0/860177903 shutdown_connections 2023-06-09T04:42:51.288 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:51.282+0000 7fc7c2903700 1 --2- 172.21.15.90:0/860177903 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc7bc0cac00 0x7fc7bc0cb050 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:51.288 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:51.282+0000 7fc7c2903700 1 --2- 172.21.15.90:0/860177903 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc7bc1574c0 0x7fc7bc0cdb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:51.288 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:51.282+0000 7fc7c2903700 1 -- 172.21.15.90:0/860177903 >> 172.21.15.90:0/860177903 conn(0x7fc7bc06c690 msgr2=0x7fc7bc0aff00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:51.288 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:51.286+0000 7fc7c2903700 1 -- 172.21.15.90:0/860177903 shutdown_connections 2023-06-09T04:42:51.288 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:51.286+0000 7fc7c2903700 1 -- 172.21.15.90:0/860177903 wait complete. 2023-06-09T04:42:51.289 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:51.286+0000 7fc7c2903700 1 Processor -- start 2023-06-09T04:42:51.289 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:51.286+0000 7fc7c2903700 1 -- start start 2023-06-09T04:42:51.290 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:51.286+0000 7fc7c2903700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc7bc069820 0x7fc7bc0a7480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:51.290 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:51.286+0000 7fc7c2903700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc7bc0cac00 0x7fc7bc155580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:51.290 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:51.286+0000 7fc7c2903700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc7bc1574c0 0x7fc7bc0a9220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:51.290 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:51.286+0000 7fc7c2903700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7bc1ea550 con 0x7fc7bc069820 2023-06-09T04:42:51.291 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:51.286+0000 7fc7c2903700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7bc1ea830 con 0x7fc7bc1574c0 2023-06-09T04:42:51.291 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:51.286+0000 7fc7c2903700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7bc1eab10 con 0x7fc7bc0cac00 2023-06-09T04:42:51.292 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:51.286+0000 7fc7c1901700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc7bc069820 0x7fc7bc0a7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:51.292 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:51.286+0000 7fc7c1901700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc7bc069820 0x7fc7bc0a7480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:38684/0 (socket says 172.21.15.90:38684) 2023-06-09T04:42:51.292 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:51.286+0000 7fc7c1901700 1 -- 172.21.15.90:0/4263420369 learned_addr learned my addr 172.21.15.90:0/4263420369 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:51.292 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:51.286+0000 7fc7c1100700 1 --2- 172.21.15.90:0/4263420369 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc7bc0cac00 0x7fc7bc155580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:51.292 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:51.290+0000 7fc7c2102700 1 --2- 172.21.15.90:0/4263420369 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc7bc1574c0 0x7fc7bc0a9220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:51.292 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:51.290+0000 7fc7c1901700 1 -- 172.21.15.90:0/4263420369 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc7bc0cac00 msgr2=0x7fc7bc155580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:51.292 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:51.290+0000 7fc7c1901700 1 --2- 172.21.15.90:0/4263420369 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc7bc0cac00 0x7fc7bc155580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:51.293 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:51.290+0000 7fc7c1901700 1 -- 172.21.15.90:0/4263420369 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc7bc1574c0 msgr2=0x7fc7bc0a9220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:51.293 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:51.290+0000 7fc7c1901700 1 --2- 172.21.15.90:0/4263420369 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc7bc1574c0 0x7fc7bc0a9220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:51.293 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:51.290+0000 7fc7c1901700 1 -- 172.21.15.90:0/4263420369 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7ac009570 con 0x7fc7bc069820 2023-06-09T04:42:51.293 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:51.290+0000 7fc7c1100700 1 --2- 172.21.15.90:0/4263420369 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc7bc0cac00 0x7fc7bc155580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:42:51.293 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:51.290+0000 7fc7c2102700 1 --2- 172.21.15.90:0/4263420369 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc7bc1574c0 0x7fc7bc0a9220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:42:51.294 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:51.290+0000 7fc7c1901700 1 --2- 172.21.15.90:0/4263420369 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc7bc069820 0x7fc7bc0a7480 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fc7b800d800 tx=0x7fc7b800db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:51.294 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:51.290+0000 7fc7b27fc700 1 -- 172.21.15.90:0/4263420369 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7b80125f0 con 0x7fc7bc069820 2023-06-09T04:42:51.294 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:51.290+0000 7fc7b27fc700 1 -- 172.21.15.90:0/4263420369 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7b8012750 con 0x7fc7bc069820 2023-06-09T04:42:51.294 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:51.290+0000 7fc7c2903700 1 -- 172.21.15.90:0/4263420369 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7bc1eadf0 con 0x7fc7bc069820 2023-06-09T04:42:51.294 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:51.290+0000 7fc7b27fc700 1 -- 172.21.15.90:0/4263420369 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7b8012ac0 con 0x7fc7bc069820 2023-06-09T04:42:51.295 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:51.290+0000 7fc7c2903700 1 -- 172.21.15.90:0/4263420369 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7bc1eb3b0 con 0x7fc7bc069820 2023-06-09T04:42:51.295 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:51.290+0000 7fc7c2903700 1 -- 172.21.15.90:0/4263420369 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7bc06b390 con 0x7fc7bc069820 2023-06-09T04:42:51.295 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:51.294+0000 7fc7b27fc700 1 -- 172.21.15.90:0/4263420369 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc7b8012c20 con 0x7fc7bc069820 2023-06-09T04:42:51.296 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:51.294+0000 7fc7b27fc700 1 --2- 172.21.15.90:0/4263420369 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fc7a0066320 0x7fc7a00687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:51.297 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:51.294+0000 7fc7b27fc700 1 -- 172.21.15.90:0/4263420369 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fc7b8083a50 con 0x7fc7bc069820 2023-06-09T04:42:51.297 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:51.294+0000 7fc7c1100700 1 --2- 172.21.15.90:0/4263420369 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fc7a0066320 0x7fc7a00687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:51.298 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:51.294+0000 7fc7c1100700 1 --2- 172.21.15.90:0/4263420369 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fc7a0066320 0x7fc7a00687d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fc7ac000c00 tx=0x7fc7ac008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:51.303 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:51.298+0000 7fc7b27fc700 1 -- 172.21.15.90:0/4263420369 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc7b8051220 con 0x7fc7bc069820 2023-06-09T04:42:51.532 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:51.530+0000 7fc7c2903700 1 -- 172.21.15.90:0/4263420369 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7fc7bc04e380 con 0x7fc7bc069820 2023-06-09T04:42:51.542 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:51.538+0000 7fc7b27fc700 1 -- 172.21.15.90:0/4263420369 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v5) v1 ==== 90+0+0 (secure 0 0 0) 0x7fc7b8054840 con 0x7fc7bc069820 2023-06-09T04:42:51.545 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:51.542+0000 7fc7c2903700 1 -- 172.21.15.90:0/4263420369 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fc7a0066320 msgr2=0x7fc7a00687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:51.545 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:51.542+0000 7fc7c2903700 1 --2- 172.21.15.90:0/4263420369 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fc7a0066320 0x7fc7a00687d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fc7ac000c00 tx=0x7fc7ac008030 comp rx=0 tx=0).stop 2023-06-09T04:42:51.546 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:51.542+0000 7fc7c2903700 1 -- 172.21.15.90:0/4263420369 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc7bc069820 msgr2=0x7fc7bc0a7480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:51.546 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:51.542+0000 7fc7c2903700 1 --2- 172.21.15.90:0/4263420369 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc7bc069820 0x7fc7bc0a7480 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fc7b800d800 tx=0x7fc7b800db10 comp rx=0 tx=0).stop 2023-06-09T04:42:51.546 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:51.542+0000 7fc7c2903700 1 -- 172.21.15.90:0/4263420369 shutdown_connections 2023-06-09T04:42:51.546 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:51.542+0000 7fc7c2903700 1 --2- 172.21.15.90:0/4263420369 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fc7a0066320 0x7fc7a00687d0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:51.546 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:51.542+0000 7fc7c2903700 1 --2- 172.21.15.90:0/4263420369 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc7bc1574c0 0x7fc7bc0a9220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:51.546 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:51.542+0000 7fc7c2903700 1 --2- 172.21.15.90:0/4263420369 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc7bc0cac00 0x7fc7bc155580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:51.546 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:51.542+0000 7fc7c2903700 1 --2- 172.21.15.90:0/4263420369 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc7bc069820 0x7fc7bc0a7480 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:51.547 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:51.542+0000 7fc7c2903700 1 -- 172.21.15.90:0/4263420369 >> 172.21.15.90:0/4263420369 conn(0x7fc7bc06c690 msgr2=0x7fc7bc0b3210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:51.547 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:51.542+0000 7fc7c2903700 1 -- 172.21.15.90:0/4263420369 shutdown_connections 2023-06-09T04:42:51.547 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:51.542+0000 7fc7c2903700 1 -- 172.21.15.90:0/4263420369 wait complete. 2023-06-09T04:42:51.567 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-06-09T04:42:51.740 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:51.738+0000 7f6aaaacb700 1 Processor -- start 2023-06-09T04:42:51.741 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:51.738+0000 7f6aaaacb700 1 -- start start 2023-06-09T04:42:51.743 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:51.738+0000 7f6aaaacb700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f6aa40cb310 0x7f6aa40cdb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:51.743 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:51.742+0000 7f6aaaacb700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6aa41608d0 0x7f6aa4160d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:51.743 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:51.742+0000 7f6aaaacb700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6aa41647b0 con 0x7f6aa41574c0 2023-06-09T04:42:51.744 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:51.742+0000 7f6aaaacb700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6aa4157890 con 0x7f6aa40cb310 2023-06-09T04:42:51.744 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:51.742+0000 7f6aaaacb700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6aa40ce040 con 0x7f6aa41608d0 2023-06-09T04:42:51.744 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:51.742+0000 7f6aa92c8700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f6aa40cb310 0x7f6aa40cdb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:51.744 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:51.742+0000 7f6aa92c8700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f6aa40cb310 0x7f6aa40cdb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:38686/0 (socket says 172.21.15.90:38686) 2023-06-09T04:42:51.744 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:51.742+0000 7f6aa92c8700 1 -- 172.21.15.90:0/3019798006 learned_addr learned my addr 172.21.15.90:0/3019798006 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:51.745 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:51.742+0000 7f6aaa2ca700 1 --2- 172.21.15.90:0/3019798006 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6aa41608d0 0x7f6aa4160d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:51.746 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:51.742+0000 7f6aa92c8700 1 -- 172.21.15.90:0/3019798006 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6aa41608d0 msgr2=0x7f6aa4160d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:51.746 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:51.742+0000 7f6aa92c8700 1 --2- 172.21.15.90:0/3019798006 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6aa41608d0 0x7f6aa4160d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:51.746 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:51.742+0000 7f6aa92c8700 1 -- 172.21.15.90:0/3019798006 >> v1:172.21.15.174:6789/0 conn(0x7f6aa41574c0 legacy=0x7f6aa40cac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:51.746 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:51.742+0000 7f6aa92c8700 1 -- 172.21.15.90:0/3019798006 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6aa4163ec0 con 0x7f6aa40cb310 2023-06-09T04:42:51.746 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:51.742+0000 7f6aaa2ca700 1 --2- 172.21.15.90:0/3019798006 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6aa41608d0 0x7f6aa4160d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:42:51.746 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:51.742+0000 7f6aa92c8700 1 --2- 172.21.15.90:0/3019798006 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6aa40cb310 0x7f6aa40cdb00 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f6a94009910 tx=0x7f6a94009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3236f23b21d6ecdc server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:51.747 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:51.742+0000 7f6aa8ac7700 1 -- 172.21.15.90:0/3019798006 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a9400ba60 con 0x7f6aa40cb310 2023-06-09T04:42:51.747 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:51.742+0000 7f6aa8ac7700 1 -- 172.21.15.90:0/3019798006 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a9400bbc0 con 0x7f6aa40cb310 2023-06-09T04:42:51.747 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:51.742+0000 7f6aa8ac7700 1 -- 172.21.15.90:0/3019798006 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a94009e60 con 0x7f6aa40cb310 2023-06-09T04:42:51.748 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:51.742+0000 7f6aaaacb700 1 -- 172.21.15.90:0/3019798006 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6aa40cb310 msgr2=0x7f6aa40cdb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:51.748 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:51.742+0000 7f6aaaacb700 1 --2- 172.21.15.90:0/3019798006 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6aa40cb310 0x7f6aa40cdb00 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f6a94009910 tx=0x7f6a94009c20 comp rx=0 tx=0).stop 2023-06-09T04:42:51.748 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:51.742+0000 7f6aaaacb700 1 -- 172.21.15.90:0/3019798006 shutdown_connections 2023-06-09T04:42:51.748 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:51.742+0000 7f6aaaacb700 1 --2- 172.21.15.90:0/3019798006 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6aa41608d0 0x7f6aa4160d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:51.749 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:51.742+0000 7f6aaaacb700 1 --2- 172.21.15.90:0/3019798006 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6aa40cb310 0x7f6aa40cdb00 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:51.749 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:51.742+0000 7f6aaaacb700 1 -- 172.21.15.90:0/3019798006 >> 172.21.15.90:0/3019798006 conn(0x7f6aa406c690 msgr2=0x7f6aa40aff00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:51.749 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:51.742+0000 7f6aaaacb700 1 -- 172.21.15.90:0/3019798006 shutdown_connections 2023-06-09T04:42:51.749 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:51.746+0000 7f6aaaacb700 1 -- 172.21.15.90:0/3019798006 wait complete. 2023-06-09T04:42:51.750 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:51.746+0000 7f6aaaacb700 1 Processor -- start 2023-06-09T04:42:51.751 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:51.750+0000 7f6aaaacb700 1 -- start start 2023-06-09T04:42:51.752 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:51.750+0000 7f6aaaacb700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6aa40cb310 0x7f6aa4162960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:51.752 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:51.750+0000 7f6aaaacb700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6aa41574c0 0x7f6aa415a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:51.752 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:51.750+0000 7f6aaaacb700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6aa41608d0 0x7f6aa414f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:51.753 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:51.750+0000 7f6aaaacb700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6aa41f9270 con 0x7f6aa40cb310 2023-06-09T04:42:51.753 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:51.750+0000 7f6aaaacb700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6aa41f9550 con 0x7f6aa41574c0 2023-06-09T04:42:51.753 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:51.750+0000 7f6aaaacb700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6aa41f9830 con 0x7f6aa41608d0 2023-06-09T04:42:51.754 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:51.750+0000 7f6aa9ac9700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6aa40cb310 0x7f6aa4162960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:51.754 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:51.750+0000 7f6aa9ac9700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6aa40cb310 0x7f6aa4162960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:38690/0 (socket says 172.21.15.90:38690) 2023-06-09T04:42:51.754 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:51.750+0000 7f6aa9ac9700 1 -- 172.21.15.90:0/2192007252 learned_addr learned my addr 172.21.15.90:0/2192007252 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:51.754 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:51.750+0000 7f6aaa2ca700 1 --2- 172.21.15.90:0/2192007252 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6aa41608d0 0x7f6aa414f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:51.754 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:51.750+0000 7f6aa92c8700 1 --2- 172.21.15.90:0/2192007252 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6aa41574c0 0x7f6aa415a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:51.754 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:51.750+0000 7f6aa9ac9700 1 -- 172.21.15.90:0/2192007252 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6aa41608d0 msgr2=0x7f6aa414f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:51.755 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:51.750+0000 7f6aa9ac9700 1 --2- 172.21.15.90:0/2192007252 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6aa41608d0 0x7f6aa414f4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:51.755 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:51.750+0000 7f6aa9ac9700 1 -- 172.21.15.90:0/2192007252 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6aa41574c0 msgr2=0x7f6aa415a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:51.755 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:51.750+0000 7f6aa9ac9700 1 --2- 172.21.15.90:0/2192007252 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6aa41574c0 0x7f6aa415a0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:51.755 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:51.750+0000 7f6aa9ac9700 1 -- 172.21.15.90:0/2192007252 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a94009570 con 0x7f6aa40cb310 2023-06-09T04:42:51.756 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:51.750+0000 7f6aa9ac9700 1 --2- 172.21.15.90:0/2192007252 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6aa40cb310 0x7f6aa4162960 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f6aa000c500 tx=0x7f6aa000c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:51.756 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:51.750+0000 7f6a9a7fc700 1 -- 172.21.15.90:0/2192007252 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aa00052d0 con 0x7f6aa40cb310 2023-06-09T04:42:51.756 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:51.750+0000 7f6a9a7fc700 1 -- 172.21.15.90:0/2192007252 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6aa0005430 con 0x7f6aa40cb310 2023-06-09T04:42:51.756 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:51.750+0000 7f6aaaacb700 1 -- 172.21.15.90:0/2192007252 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6aa41f9b10 con 0x7f6aa40cb310 2023-06-09T04:42:51.756 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:51.750+0000 7f6a9a7fc700 1 -- 172.21.15.90:0/2192007252 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aa00055a0 con 0x7f6aa40cb310 2023-06-09T04:42:51.756 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:51.750+0000 7f6aaaacb700 1 -- 172.21.15.90:0/2192007252 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6aa415a630 con 0x7f6aa40cb310 2023-06-09T04:42:51.757 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:51.754+0000 7f6aaaacb700 1 -- 172.21.15.90:0/2192007252 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6aa406b390 con 0x7f6aa40cb310 2023-06-09T04:42:51.758 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:51.754+0000 7f6a9a7fc700 1 -- 172.21.15.90:0/2192007252 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6aa00038e0 con 0x7f6aa40cb310 2023-06-09T04:42:51.760 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:51.758+0000 7f6a9a7fc700 1 --2- 172.21.15.90:0/2192007252 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f6a880662f0 0x7f6a880687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:51.760 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:51.758+0000 7f6a9a7fc700 1 -- 172.21.15.90:0/2192007252 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f6aa0082df0 con 0x7f6aa40cb310 2023-06-09T04:42:51.761 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:51.758+0000 7f6aa92c8700 1 --2- 172.21.15.90:0/2192007252 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f6a880662f0 0x7f6a880687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:51.762 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:51.758+0000 7f6aa92c8700 1 --2- 172.21.15.90:0/2192007252 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f6a880662f0 0x7f6a880687a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f6aa40cb700 tx=0x7f6a94008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:51.767 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:51.766+0000 7f6a9a7fc700 1 -- 172.21.15.90:0/2192007252 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6aa0050520 con 0x7f6aa40cb310 2023-06-09T04:42:51.996 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:51.994+0000 7f6aaaacb700 1 -- 172.21.15.90:0/2192007252 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f6aa404e380 con 0x7f6aa40cb310 2023-06-09T04:42:52.006 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:52.002+0000 7f6a9a7fc700 1 -- 172.21.15.90:0/2192007252 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v6) v1 ==== 90+0+0 (secure 0 0 0) 0x7f6aa0053b40 con 0x7f6aa40cb310 2023-06-09T04:42:52.010 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:52.006+0000 7f6aaaacb700 1 -- 172.21.15.90:0/2192007252 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f6a880662f0 msgr2=0x7f6a880687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:52.011 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:52.006+0000 7f6aaaacb700 1 --2- 172.21.15.90:0/2192007252 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f6a880662f0 0x7f6a880687a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f6aa40cb700 tx=0x7f6a94008030 comp rx=0 tx=0).stop 2023-06-09T04:42:52.011 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:52.006+0000 7f6aaaacb700 1 -- 172.21.15.90:0/2192007252 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6aa40cb310 msgr2=0x7f6aa4162960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:52.011 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:52.006+0000 7f6aaaacb700 1 --2- 172.21.15.90:0/2192007252 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6aa40cb310 0x7f6aa4162960 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f6aa000c500 tx=0x7f6aa000c810 comp rx=0 tx=0).stop 2023-06-09T04:42:52.011 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:52.006+0000 7f6aaaacb700 1 -- 172.21.15.90:0/2192007252 shutdown_connections 2023-06-09T04:42:52.011 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:52.006+0000 7f6aaaacb700 1 --2- 172.21.15.90:0/2192007252 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f6a880662f0 0x7f6a880687a0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:52.011 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:52.006+0000 7f6aaaacb700 1 --2- 172.21.15.90:0/2192007252 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6aa41608d0 0x7f6aa414f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:52.011 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:52.006+0000 7f6aaaacb700 1 --2- 172.21.15.90:0/2192007252 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6aa41574c0 0x7f6aa415a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:52.012 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:52.006+0000 7f6aaaacb700 1 --2- 172.21.15.90:0/2192007252 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6aa40cb310 0x7f6aa4162960 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:52.012 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:52.006+0000 7f6aaaacb700 1 -- 172.21.15.90:0/2192007252 >> 172.21.15.90:0/2192007252 conn(0x7f6aa406c690 msgr2=0x7f6aa415fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:52.012 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:52.006+0000 7f6aaaacb700 1 -- 172.21.15.90:0/2192007252 shutdown_connections 2023-06-09T04:42:52.012 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:52.006+0000 7f6aaaacb700 1 -- 172.21.15.90:0/2192007252 wait complete. 2023-06-09T04:42:52.032 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-06-09T04:42:52.201 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:52.198+0000 7f288c3ec700 1 Processor -- start 2023-06-09T04:42:52.201 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:52.198+0000 7f288c3ec700 1 -- start start 2023-06-09T04:42:52.205 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:52.202+0000 7f288c3ec700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f2884160660 0x7f28840c8b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:52.205 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:52.202+0000 7f288c3ec700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f28840cd600 0x7f28840cc0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:52.205 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:52.202+0000 7f288c3ec700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28840cca60 con 0x7f28840cc600 2023-06-09T04:42:52.205 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:52.202+0000 7f288c3ec700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28840cb140 con 0x7f28840cd600 2023-06-09T04:42:52.205 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:52.202+0000 7f288c3ec700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f288406fb00 con 0x7f2884160660 2023-06-09T04:42:52.206 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:52.202+0000 7f2889987700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f28840cd600 0x7f28840cc0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:52.206 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:52.202+0000 7f2889987700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f28840cd600 0x7f28840cc0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:38698/0 (socket says 172.21.15.90:38698) 2023-06-09T04:42:52.207 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:52.202+0000 7f2889987700 1 -- 172.21.15.90:0/3751402860 learned_addr learned my addr 172.21.15.90:0/3751402860 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:52.207 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:52.202+0000 7f288a188700 1 --2- 172.21.15.90:0/3751402860 >> v2:172.21.15.174:3300/0 conn(0x7f2884160660 0x7f28840c8b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:52.207 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:52.202+0000 7f2889987700 1 -- 172.21.15.90:0/3751402860 >> v2:172.21.15.174:3300/0 conn(0x7f2884160660 msgr2=0x7f28840c8b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:52.207 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:52.202+0000 7f2889987700 1 --2- 172.21.15.90:0/3751402860 >> v2:172.21.15.174:3300/0 conn(0x7f2884160660 0x7f28840c8b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:52.207 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:52.202+0000 7f2889987700 1 -- 172.21.15.90:0/3751402860 >> v1:172.21.15.174:6789/0 conn(0x7f28840cc600 legacy=0x7f28841642e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:52.207 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:52.202+0000 7f2889987700 1 -- 172.21.15.90:0/3751402860 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28840cdb70 con 0x7f28840cd600 2023-06-09T04:42:52.207 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:52.202+0000 7f2889987700 1 --2- 172.21.15.90:0/3751402860 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f28840cd600 0x7f28840cc0c0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f288406f5b0 tx=0x7f2874009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a19aaf20de56f3d9 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:52.208 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:52.202+0000 7f2889186700 1 -- 172.21.15.90:0/3751402860 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2874004230 con 0x7f28840cd600 2023-06-09T04:42:52.208 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:52.202+0000 7f2889186700 1 -- 172.21.15.90:0/3751402860 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2874004390 con 0x7f28840cd600 2023-06-09T04:42:52.208 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:52.202+0000 7f2889186700 1 -- 172.21.15.90:0/3751402860 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28740036c0 con 0x7f28840cd600 2023-06-09T04:42:52.209 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:52.206+0000 7f288c3ec700 1 -- 172.21.15.90:0/3751402860 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f28840cd600 msgr2=0x7f28840cc0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:52.209 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:52.206+0000 7f288c3ec700 1 --2- 172.21.15.90:0/3751402860 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f28840cd600 0x7f28840cc0c0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f288406f5b0 tx=0x7f2874009bf0 comp rx=0 tx=0).stop 2023-06-09T04:42:52.209 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:52.206+0000 7f288c3ec700 1 -- 172.21.15.90:0/3751402860 shutdown_connections 2023-06-09T04:42:52.209 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:52.206+0000 7f288c3ec700 1 --2- 172.21.15.90:0/3751402860 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f28840cd600 0x7f28840cc0c0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:52.209 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:52.206+0000 7f288c3ec700 1 --2- 172.21.15.90:0/3751402860 >> v2:172.21.15.174:3300/0 conn(0x7f2884160660 0x7f28840c8b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:52.209 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:52.206+0000 7f288c3ec700 1 -- 172.21.15.90:0/3751402860 >> 172.21.15.90:0/3751402860 conn(0x7f288406c810 msgr2=0x7f28840b0000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:52.210 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:52.206+0000 7f288c3ec700 1 -- 172.21.15.90:0/3751402860 shutdown_connections 2023-06-09T04:42:52.210 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:52.206+0000 7f288c3ec700 1 -- 172.21.15.90:0/3751402860 wait complete. 2023-06-09T04:42:52.210 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:52.206+0000 7f288c3ec700 1 Processor -- start 2023-06-09T04:42:52.211 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:52.206+0000 7f288c3ec700 1 -- start start 2023-06-09T04:42:52.212 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:52.210+0000 7f288c3ec700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f28840cc600 0x7f288415c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:52.212 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:52.210+0000 7f288c3ec700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f28840cd600 0x7f288415ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:52.212 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:52.210+0000 7f288c3ec700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2884160660 0x7f28840ae550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:52.212 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:52.210+0000 7f288c3ec700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28840b1320 con 0x7f28840cd600 2023-06-09T04:42:52.213 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:52.210+0000 7f288c3ec700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28840b1600 con 0x7f2884160660 2023-06-09T04:42:52.213 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:52.210+0000 7f288c3ec700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f288415c7a0 con 0x7f28840cc600 2023-06-09T04:42:52.214 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:52.210+0000 7f2889987700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f28840cd600 0x7f288415ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:52.214 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:52.210+0000 7f2889987700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f28840cd600 0x7f288415ec30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:38712/0 (socket says 172.21.15.90:38712) 2023-06-09T04:42:52.214 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:52.210+0000 7f2889987700 1 -- 172.21.15.90:0/1388144736 learned_addr learned my addr 172.21.15.90:0/1388144736 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:52.214 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:52.210+0000 7f288a188700 1 --2- 172.21.15.90:0/1388144736 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f28840cc600 0x7f288415c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:52.214 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:52.210+0000 7f288a989700 1 --2- 172.21.15.90:0/1388144736 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2884160660 0x7f28840ae550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:52.214 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:52.210+0000 7f2889987700 1 -- 172.21.15.90:0/1388144736 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f28840cc600 msgr2=0x7f288415c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:52.214 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:52.210+0000 7f2889987700 1 --2- 172.21.15.90:0/1388144736 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f28840cc600 0x7f288415c260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:52.215 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:52.210+0000 7f2889987700 1 -- 172.21.15.90:0/1388144736 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2884160660 msgr2=0x7f28840ae550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:52.215 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:52.210+0000 7f2889987700 1 --2- 172.21.15.90:0/1388144736 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2884160660 0x7f28840ae550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:52.215 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:52.210+0000 7f2889987700 1 -- 172.21.15.90:0/1388144736 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2874009570 con 0x7f28840cd600 2023-06-09T04:42:52.215 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:52.210+0000 7f288a989700 1 --2- 172.21.15.90:0/1388144736 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2884160660 0x7f28840ae550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:42:52.215 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:52.210+0000 7f2889987700 1 --2- 172.21.15.90:0/1388144736 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f28840cd600 0x7f288415ec30 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f2874004000 tx=0x7f2874004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:52.216 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:52.210+0000 7f287affd700 1 -- 172.21.15.90:0/1388144736 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f287400b660 con 0x7f28840cd600 2023-06-09T04:42:52.216 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:52.210+0000 7f287affd700 1 -- 172.21.15.90:0/1388144736 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f287400b7c0 con 0x7f28840cd600 2023-06-09T04:42:52.216 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:52.210+0000 7f288c3ec700 1 -- 172.21.15.90:0/1388144736 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2884163580 con 0x7f28840cd600 2023-06-09T04:42:52.216 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:52.210+0000 7f287affd700 1 -- 172.21.15.90:0/1388144736 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f287400bb70 con 0x7f28840cd600 2023-06-09T04:42:52.216 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:52.210+0000 7f288c3ec700 1 -- 172.21.15.90:0/1388144736 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2884163b00 con 0x7f28840cd600 2023-06-09T04:42:52.217 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:52.214+0000 7f288c3ec700 1 -- 172.21.15.90:0/1388144736 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28840b1770 con 0x7f28840cd600 2023-06-09T04:42:52.218 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:52.214+0000 7f287affd700 1 -- 172.21.15.90:0/1388144736 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f287400bcd0 con 0x7f28840cd600 2023-06-09T04:42:52.220 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:52.218+0000 7f287affd700 1 --2- 172.21.15.90:0/1388144736 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f2868066320 0x7f28680687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:52.220 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:52.218+0000 7f287affd700 1 -- 172.21.15.90:0/1388144736 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f2874085030 con 0x7f28840cd600 2023-06-09T04:42:52.221 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:52.218+0000 7f288a188700 1 --2- 172.21.15.90:0/1388144736 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f2868066320 0x7f28680687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:52.222 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:52.218+0000 7f288a188700 1 --2- 172.21.15.90:0/1388144736 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f2868066320 0x7f28680687d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f2880006b40 tx=0x7f2880008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:52.223 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:52.222+0000 7f287affd700 1 -- 172.21.15.90:0/1388144736 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f28740529b0 con 0x7f28840cd600 2023-06-09T04:42:52.449 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:52.446+0000 7f288c3ec700 1 -- 172.21.15.90:0/1388144736 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f288404db30 con 0x7f28840cd600 2023-06-09T04:42:52.459 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:52.454+0000 7f287affd700 1 -- 172.21.15.90:0/1388144736 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7f2874055fd0 con 0x7f28840cd600 2023-06-09T04:42:52.462 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:52.458+0000 7f288c3ec700 1 -- 172.21.15.90:0/1388144736 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f2868066320 msgr2=0x7f28680687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:52.463 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:52.458+0000 7f288c3ec700 1 --2- 172.21.15.90:0/1388144736 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f2868066320 0x7f28680687d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f2880006b40 tx=0x7f2880008040 comp rx=0 tx=0).stop 2023-06-09T04:42:52.463 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:52.458+0000 7f288c3ec700 1 -- 172.21.15.90:0/1388144736 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f28840cd600 msgr2=0x7f288415ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:52.463 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:52.458+0000 7f288c3ec700 1 --2- 172.21.15.90:0/1388144736 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f28840cd600 0x7f288415ec30 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f2874004000 tx=0x7f2874004770 comp rx=0 tx=0).stop 2023-06-09T04:42:52.463 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:52.458+0000 7f288c3ec700 1 -- 172.21.15.90:0/1388144736 shutdown_connections 2023-06-09T04:42:52.463 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:52.458+0000 7f288c3ec700 1 --2- 172.21.15.90:0/1388144736 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f2868066320 0x7f28680687d0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:52.463 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:52.458+0000 7f288c3ec700 1 --2- 172.21.15.90:0/1388144736 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2884160660 0x7f28840ae550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:52.463 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:52.458+0000 7f288c3ec700 1 --2- 172.21.15.90:0/1388144736 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f28840cd600 0x7f288415ec30 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:52.464 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:52.458+0000 7f288c3ec700 1 --2- 172.21.15.90:0/1388144736 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f28840cc600 0x7f288415c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:52.464 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:52.458+0000 7f288c3ec700 1 -- 172.21.15.90:0/1388144736 >> 172.21.15.90:0/1388144736 conn(0x7f288406c810 msgr2=0x7f288415db30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:52.464 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:52.458+0000 7f288c3ec700 1 -- 172.21.15.90:0/1388144736 shutdown_connections 2023-06-09T04:42:52.464 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:52.458+0000 7f288c3ec700 1 -- 172.21.15.90:0/1388144736 wait complete. 2023-06-09T04:42:52.483 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-06-09T04:42:52.651 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:52.646+0000 7fc22a2c3700 1 Processor -- start 2023-06-09T04:42:52.651 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:52.650+0000 7fc22a2c3700 1 -- start start 2023-06-09T04:42:52.653 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:52.650+0000 7fc22a2c3700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc2241574c0 0x7fc2240cdb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:52.653 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:52.650+0000 7fc22a2c3700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fc2240cb050 0x7fc224069f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:52.653 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:52.650+0000 7fc22a2c3700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2241618e0 con 0x7fc2240cac00 2023-06-09T04:42:52.653 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:52.650+0000 7fc22a2c3700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc224157890 con 0x7fc2240cb050 2023-06-09T04:42:52.653 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:52.650+0000 7fc22a2c3700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2241647b0 con 0x7fc2241574c0 2023-06-09T04:42:52.654 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:52.650+0000 7fc229ac2700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fc2240cb050 0x7fc224069f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:52.654 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:52.650+0000 7fc2292c1700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc2241574c0 0x7fc2240cdb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:52.654 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:52.650+0000 7fc229ac2700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fc2240cb050 0x7fc224069f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:38728/0 (socket says 172.21.15.90:38728) 2023-06-09T04:42:52.654 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:52.650+0000 7fc229ac2700 1 -- 172.21.15.90:0/166916959 learned_addr learned my addr 172.21.15.90:0/166916959 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:52.656 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:52.650+0000 7fc229ac2700 1 -- 172.21.15.90:0/166916959 >> v2:172.21.15.174:3300/0 conn(0x7fc2241574c0 msgr2=0x7fc2240cdb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:52.656 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:52.650+0000 7fc229ac2700 1 --2- 172.21.15.90:0/166916959 >> v2:172.21.15.174:3300/0 conn(0x7fc2241574c0 0x7fc2240cdb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:52.656 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:52.650+0000 7fc21bfff700 1 -- 172.21.15.90:0/166916959 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2633178216 0 0) 0x7fc2241618e0 con 0x7fc2240cac00 2023-06-09T04:42:52.656 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:52.650+0000 7fc229ac2700 1 -- 172.21.15.90:0/166916959 >> v1:172.21.15.174:6789/0 conn(0x7fc2240cac00 legacy=0x7fc224069820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:52.656 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:52.650+0000 7fc229ac2700 1 -- 172.21.15.90:0/166916959 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2240ce040 con 0x7fc2240cb050 2023-06-09T04:42:52.656 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:52.654+0000 7fc229ac2700 1 --2- 172.21.15.90:0/166916959 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc2240cb050 0x7fc224069f30 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fc2240cbd70 tx=0x7fc21c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbf951b56ae55390 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:52.657 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:52.654+0000 7fc21bfff700 1 -- 172.21.15.90:0/166916959 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc21c00e070 con 0x7fc2240cb050 2023-06-09T04:42:52.657 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:52.654+0000 7fc21bfff700 1 -- 172.21.15.90:0/166916959 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc21c00b910 con 0x7fc2240cb050 2023-06-09T04:42:52.658 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:52.654+0000 7fc21bfff700 1 -- 172.21.15.90:0/166916959 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc21c00bcc0 con 0x7fc2240cb050 2023-06-09T04:42:52.658 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:52.654+0000 7fc22a2c3700 1 -- 172.21.15.90:0/166916959 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc2240cb050 msgr2=0x7fc224069f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:52.658 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:52.654+0000 7fc22a2c3700 1 --2- 172.21.15.90:0/166916959 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc2240cb050 0x7fc224069f30 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fc2240cbd70 tx=0x7fc21c00b330 comp rx=0 tx=0).stop 2023-06-09T04:42:52.658 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:52.654+0000 7fc22a2c3700 1 -- 172.21.15.90:0/166916959 shutdown_connections 2023-06-09T04:42:52.658 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:52.654+0000 7fc22a2c3700 1 --2- 172.21.15.90:0/166916959 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc2240cb050 0x7fc224069f30 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:52.658 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:52.654+0000 7fc22a2c3700 1 --2- 172.21.15.90:0/166916959 >> v2:172.21.15.174:3300/0 conn(0x7fc2241574c0 0x7fc2240cdb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:52.658 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:52.654+0000 7fc22a2c3700 1 -- 172.21.15.90:0/166916959 >> 172.21.15.90:0/166916959 conn(0x7fc22406c690 msgr2=0x7fc2240aff00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:52.659 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:52.654+0000 7fc22a2c3700 1 -- 172.21.15.90:0/166916959 shutdown_connections 2023-06-09T04:42:52.659 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:52.654+0000 7fc22a2c3700 1 -- 172.21.15.90:0/166916959 wait complete. 2023-06-09T04:42:52.659 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:52.658+0000 7fc22a2c3700 1 Processor -- start 2023-06-09T04:42:52.660 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:52.658+0000 7fc22a2c3700 1 -- start start 2023-06-09T04:42:52.661 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:52.658+0000 7fc22a2c3700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc2240cac00 0x7fc2241f8f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:52.661 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:52.658+0000 7fc22a2c3700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc2240cb050 0x7fc224158f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:52.661 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:52.658+0000 7fc22a2c3700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc2241574c0 0x7fc224159470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:52.661 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:52.658+0000 7fc22a2c3700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2241f9840 con 0x7fc2240cac00 2023-06-09T04:42:52.662 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:52.658+0000 7fc22a2c3700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2241f9b20 con 0x7fc2241574c0 2023-06-09T04:42:52.662 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:52.658+0000 7fc22a2c3700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2241f9e00 con 0x7fc2240cb050 2023-06-09T04:42:52.663 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:52.658+0000 7fc2292c1700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc2240cac00 0x7fc2241f8f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:52.663 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:52.658+0000 7fc2292c1700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc2240cac00 0x7fc2241f8f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:38734/0 (socket says 172.21.15.90:38734) 2023-06-09T04:42:52.663 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:52.658+0000 7fc2292c1700 1 -- 172.21.15.90:0/14035186 learned_addr learned my addr 172.21.15.90:0/14035186 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:52.663 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:52.658+0000 7fc228ac0700 1 --2- 172.21.15.90:0/14035186 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc2240cb050 0x7fc224158f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:52.663 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:52.658+0000 7fc229ac2700 1 --2- 172.21.15.90:0/14035186 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc2241574c0 0x7fc224159470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:52.664 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:52.658+0000 7fc2292c1700 1 -- 172.21.15.90:0/14035186 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc2240cb050 msgr2=0x7fc224158f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:52.664 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:52.658+0000 7fc2292c1700 1 --2- 172.21.15.90:0/14035186 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc2240cb050 0x7fc224158f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:52.664 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:52.658+0000 7fc2292c1700 1 -- 172.21.15.90:0/14035186 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc2241574c0 msgr2=0x7fc224159470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:52.664 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:52.658+0000 7fc2292c1700 1 --2- 172.21.15.90:0/14035186 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc2241574c0 0x7fc224159470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:52.664 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:52.658+0000 7fc2292c1700 1 -- 172.21.15.90:0/14035186 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc21c009b30 con 0x7fc2240cac00 2023-06-09T04:42:52.664 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:52.658+0000 7fc229ac2700 1 --2- 172.21.15.90:0/14035186 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc2241574c0 0x7fc224159470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:42:52.664 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:52.658+0000 7fc2292c1700 1 --2- 172.21.15.90:0/14035186 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc2240cac00 0x7fc2241f8f40 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fc22000e840 tx=0x7fc22000ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:52.665 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:52.662+0000 7fc219ffb700 1 -- 172.21.15.90:0/14035186 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2200095a0 con 0x7fc2240cac00 2023-06-09T04:42:52.665 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:52.662+0000 7fc219ffb700 1 -- 172.21.15.90:0/14035186 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc22000c690 con 0x7fc2240cac00 2023-06-09T04:42:52.665 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:52.662+0000 7fc22a2c3700 1 -- 172.21.15.90:0/14035186 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2241f6bb0 con 0x7fc2240cac00 2023-06-09T04:42:52.665 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:52.662+0000 7fc219ffb700 1 -- 172.21.15.90:0/14035186 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc22000ca00 con 0x7fc2240cac00 2023-06-09T04:42:52.665 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:52.662+0000 7fc22a2c3700 1 -- 172.21.15.90:0/14035186 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2241f9480 con 0x7fc2240cac00 2023-06-09T04:42:52.666 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:52.662+0000 7fc22a2c3700 1 -- 172.21.15.90:0/14035186 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc22406b390 con 0x7fc2240cac00 2023-06-09T04:42:52.667 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:52.662+0000 7fc219ffb700 1 -- 172.21.15.90:0/14035186 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc22000cb60 con 0x7fc2240cac00 2023-06-09T04:42:52.668 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:52.666+0000 7fc219ffb700 1 --2- 172.21.15.90:0/14035186 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fc2080662f0 0x7fc2080687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:52.668 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:52.666+0000 7fc219ffb700 1 -- 172.21.15.90:0/14035186 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fc220083990 con 0x7fc2240cac00 2023-06-09T04:42:52.668 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:52.666+0000 7fc228ac0700 1 --2- 172.21.15.90:0/14035186 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fc2080662f0 0x7fc2080687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:52.669 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:52.666+0000 7fc228ac0700 1 --2- 172.21.15.90:0/14035186 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fc2080662f0 0x7fc2080687a0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fc22415a380 tx=0x7fc214009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:52.674 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:52.670+0000 7fc219ffb700 1 -- 172.21.15.90:0/14035186 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc220054bf0 con 0x7fc2240cac00 2023-06-09T04:42:52.902 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:52.898+0000 7fc22a2c3700 1 -- 172.21.15.90:0/14035186 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7fc22404e380 con 0x7fc2240cac00 2023-06-09T04:42:52.909 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:52.906+0000 7fc219ffb700 1 -- 172.21.15.90:0/14035186 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7fc2200170a0 con 0x7fc2240cac00 2023-06-09T04:42:52.914 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:52.910+0000 7fc22a2c3700 1 -- 172.21.15.90:0/14035186 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fc2080662f0 msgr2=0x7fc2080687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:52.914 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:52.910+0000 7fc22a2c3700 1 --2- 172.21.15.90:0/14035186 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fc2080662f0 0x7fc2080687a0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fc22415a380 tx=0x7fc214009040 comp rx=0 tx=0).stop 2023-06-09T04:42:52.914 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:52.910+0000 7fc22a2c3700 1 -- 172.21.15.90:0/14035186 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc2240cac00 msgr2=0x7fc2241f8f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:52.914 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:52.910+0000 7fc22a2c3700 1 --2- 172.21.15.90:0/14035186 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc2240cac00 0x7fc2241f8f40 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fc22000e840 tx=0x7fc22000ec00 comp rx=0 tx=0).stop 2023-06-09T04:42:52.914 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:52.910+0000 7fc22a2c3700 1 -- 172.21.15.90:0/14035186 shutdown_connections 2023-06-09T04:42:52.914 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:52.910+0000 7fc22a2c3700 1 --2- 172.21.15.90:0/14035186 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fc2080662f0 0x7fc2080687a0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:52.915 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:52.910+0000 7fc22a2c3700 1 --2- 172.21.15.90:0/14035186 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc2241574c0 0x7fc224159470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:52.915 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:52.910+0000 7fc22a2c3700 1 --2- 172.21.15.90:0/14035186 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc2240cb050 0x7fc224158f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:52.915 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:52.910+0000 7fc22a2c3700 1 --2- 172.21.15.90:0/14035186 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc2240cac00 0x7fc2241f8f40 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:52.915 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:52.910+0000 7fc22a2c3700 1 -- 172.21.15.90:0/14035186 >> 172.21.15.90:0/14035186 conn(0x7fc22406c690 msgr2=0x7fc2240afdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:52.915 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:52.910+0000 7fc22a2c3700 1 -- 172.21.15.90:0/14035186 shutdown_connections 2023-06-09T04:42:52.915 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:52.910+0000 7fc22a2c3700 1 -- 172.21.15.90:0/14035186 wait complete. 2023-06-09T04:42:52.935 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-06-09T04:42:53.111 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:53.106+0000 7f37be219700 1 Processor -- start 2023-06-09T04:42:53.111 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:53.110+0000 7f37be219700 1 -- start start 2023-06-09T04:42:53.113 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:53.110+0000 7f37be219700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f37b80b18d0 0x7f37b8160920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:53.113 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:53.110+0000 7f37be219700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f37b80b1ca0 0x7f37b80cee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:53.113 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:53.110+0000 7f37be219700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37b815c6b0 con 0x7f37b80d2400 2023-06-09T04:42:53.113 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:53.110+0000 7f37be219700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37b80cf3d0 con 0x7f37b80b18d0 2023-06-09T04:42:53.113 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:53.110+0000 7f37be219700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37b80cf6a0 con 0x7f37b80b1ca0 2023-06-09T04:42:53.114 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:53.110+0000 7f37bda18700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f37b80d2400 0x7f37b80d28a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:39964/0 (socket says 172.21.15.90:39964) 2023-06-09T04:42:53.114 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:53.110+0000 7f37bda18700 1 -- 172.21.15.90:0/1611952727 learned_addr learned my addr 172.21.15.90:0/1611952727 (peer_addr_for_me v1:172.21.15.90:0/0) 2023-06-09T04:42:53.114 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:53.110+0000 7f37bca16700 1 --2- 172.21.15.90:0/1611952727 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f37b80b1ca0 0x7f37b80cee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:53.115 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:53.110+0000 7f37bd217700 1 --2- 172.21.15.90:0/1611952727 >> v2:172.21.15.174:3300/0 conn(0x7f37b80b18d0 0x7f37b8160920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:53.115 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:53.110+0000 7f37affff700 1 -- 172.21.15.90:0/1611952727 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2666915585 0 0) 0x7f37b815c6b0 con 0x7f37b80d2400 2023-06-09T04:42:53.115 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:53.110+0000 7f37affff700 1 -- 172.21.15.90:0/1611952727 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f37a40035d0 con 0x7f37b80d2400 2023-06-09T04:42:53.116 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:53.110+0000 7f37bca16700 1 -- 172.21.15.90:0/1611952727 >> v2:172.21.15.174:3300/0 conn(0x7f37b80b18d0 msgr2=0x7f37b8160920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:53.116 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:53.110+0000 7f37bca16700 1 --2- 172.21.15.90:0/1611952727 >> v2:172.21.15.174:3300/0 conn(0x7f37b80b18d0 0x7f37b8160920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:53.116 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:53.110+0000 7f37bca16700 1 -- 172.21.15.90:0/1611952727 >> v1:172.21.15.90:6789/0 conn(0x7f37b80d2400 legacy=0x7f37b80d28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:53.116 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:53.110+0000 7f37bca16700 1 -- 172.21.15.90:0/1611952727 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37b80cf980 con 0x7f37b80b1ca0 2023-06-09T04:42:53.116 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:53.114+0000 7f37bca16700 1 --2- 172.21.15.90:0/1611952727 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f37b80b1ca0 0x7f37b80cee90 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f37a8009880 tx=0x7f37a8009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cb499e046f275bd0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:53.117 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:53.114+0000 7f37affff700 1 -- 172.21.15.90:0/1611952727 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37a8011830 con 0x7f37b80b1ca0 2023-06-09T04:42:53.117 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:53.114+0000 7f37affff700 1 -- 172.21.15.90:0/1611952727 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37a8011990 con 0x7f37b80b1ca0 2023-06-09T04:42:53.117 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:53.114+0000 7f37affff700 1 -- 172.21.15.90:0/1611952727 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37a8011d20 con 0x7f37b80b1ca0 2023-06-09T04:42:53.117 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:53.114+0000 7f37be219700 1 -- 172.21.15.90:0/1611952727 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f37b80b1ca0 msgr2=0x7f37b80cee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:53.118 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:53.114+0000 7f37be219700 1 --2- 172.21.15.90:0/1611952727 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f37b80b1ca0 0x7f37b80cee90 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f37a8009880 tx=0x7f37a8009b90 comp rx=0 tx=0).stop 2023-06-09T04:42:53.118 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:53.114+0000 7f37be219700 1 -- 172.21.15.90:0/1611952727 shutdown_connections 2023-06-09T04:42:53.118 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:53.114+0000 7f37be219700 1 --2- 172.21.15.90:0/1611952727 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f37b80b1ca0 0x7f37b80cee90 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:53.118 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:53.114+0000 7f37be219700 1 --2- 172.21.15.90:0/1611952727 >> v2:172.21.15.174:3300/0 conn(0x7f37b80b18d0 0x7f37b8160920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:53.118 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:53.114+0000 7f37be219700 1 -- 172.21.15.90:0/1611952727 >> 172.21.15.90:0/1611952727 conn(0x7f37b809b9b0 msgr2=0x7f37b80b55d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:53.119 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:53.114+0000 7f37be219700 1 -- 172.21.15.90:0/1611952727 shutdown_connections 2023-06-09T04:42:53.119 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:53.114+0000 7f37be219700 1 -- 172.21.15.90:0/1611952727 wait complete. 2023-06-09T04:42:53.119 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:53.118+0000 7f37be219700 1 Processor -- start 2023-06-09T04:42:53.120 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:53.118+0000 7f37be219700 1 -- start start 2023-06-09T04:42:53.121 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:53.118+0000 7f37be219700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f37b80b18d0 0x7f37b806c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:53.121 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:53.118+0000 7f37be219700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f37b80b1ca0 0x7f37b80b48c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:53.121 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:53.118+0000 7f37be219700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f37b80d2400 0x7f37b81f4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:53.121 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:53.118+0000 7f37be219700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37b81598d0 con 0x7f37b80b1ca0 2023-06-09T04:42:53.121 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:53.118+0000 7f37be219700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37b81f4530 con 0x7f37b80d2400 2023-06-09T04:42:53.122 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:53.118+0000 7f37be219700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37b80cb8e0 con 0x7f37b80b18d0 2023-06-09T04:42:53.123 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:53.118+0000 7f37bca16700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f37b80b1ca0 0x7f37b80b48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:53.123 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:53.118+0000 7f37bca16700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f37b80b1ca0 0x7f37b80b48c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:38742/0 (socket says 172.21.15.90:38742) 2023-06-09T04:42:53.123 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:53.118+0000 7f37bca16700 1 -- 172.21.15.90:0/4063881130 learned_addr learned my addr 172.21.15.90:0/4063881130 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:53.123 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:53.118+0000 7f37bd217700 1 --2- 172.21.15.90:0/4063881130 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f37b80b18d0 0x7f37b806c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:53.123 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:53.118+0000 7f37bda18700 1 --2- 172.21.15.90:0/4063881130 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f37b80d2400 0x7f37b81f4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:53.124 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:53.118+0000 7f37bca16700 1 -- 172.21.15.90:0/4063881130 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f37b80b18d0 msgr2=0x7f37b806c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:53.124 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:53.118+0000 7f37bca16700 1 --2- 172.21.15.90:0/4063881130 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f37b80b18d0 0x7f37b806c1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:53.124 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:53.118+0000 7f37bca16700 1 -- 172.21.15.90:0/4063881130 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f37b80d2400 msgr2=0x7f37b81f4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:53.124 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:53.118+0000 7f37bca16700 1 --2- 172.21.15.90:0/4063881130 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f37b80d2400 0x7f37b81f4cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:53.124 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:53.118+0000 7f37bca16700 1 -- 172.21.15.90:0/4063881130 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37a80094b0 con 0x7f37b80b1ca0 2023-06-09T04:42:53.124 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:53.118+0000 7f37bda18700 1 --2- 172.21.15.90:0/4063881130 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f37b80d2400 0x7f37b81f4cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:42:53.124 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:53.118+0000 7f37bd217700 1 --2- 172.21.15.90:0/4063881130 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f37b80b18d0 0x7f37b806c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:42:53.124 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:53.118+0000 7f37bca16700 1 --2- 172.21.15.90:0/4063881130 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f37b80b1ca0 0x7f37b80b48c0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f37a80090b0 tx=0x7f37a8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:53.125 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:53.122+0000 7f37adffb700 1 -- 172.21.15.90:0/4063881130 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37a8004530 con 0x7f37b80b1ca0 2023-06-09T04:42:53.125 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:53.122+0000 7f37adffb700 1 -- 172.21.15.90:0/4063881130 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37a801f070 con 0x7f37b80b1ca0 2023-06-09T04:42:53.125 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:53.122+0000 7f37be219700 1 -- 172.21.15.90:0/4063881130 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37b80cbbc0 con 0x7f37b80b1ca0 2023-06-09T04:42:53.125 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:53.122+0000 7f37adffb700 1 -- 172.21.15.90:0/4063881130 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37a8003900 con 0x7f37b80b1ca0 2023-06-09T04:42:53.125 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:53.122+0000 7f37be219700 1 -- 172.21.15.90:0/4063881130 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37b81f47d0 con 0x7f37b80b1ca0 2023-06-09T04:42:53.126 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:53.122+0000 7f37be219700 1 -- 172.21.15.90:0/4063881130 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37b81f49f0 con 0x7f37b80b1ca0 2023-06-09T04:42:53.127 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:53.122+0000 7f37adffb700 1 -- 172.21.15.90:0/4063881130 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f37a8021030 con 0x7f37b80b1ca0 2023-06-09T04:42:53.128 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:53.126+0000 7f37adffb700 1 --2- 172.21.15.90:0/4063881130 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f379c066320 0x7f379c0687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:53.128 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:53.126+0000 7f37adffb700 1 -- 172.21.15.90:0/4063881130 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f37a8084ce0 con 0x7f37b80b1ca0 2023-06-09T04:42:53.129 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:53.126+0000 7f37bd217700 1 --2- 172.21.15.90:0/4063881130 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f379c066320 0x7f379c0687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:53.130 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:53.126+0000 7f37bd217700 1 --2- 172.21.15.90:0/4063881130 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f379c066320 0x7f379c0687d0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f37b80d1d80 tx=0x7f37b4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:53.135 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:53.130+0000 7f37adffb700 1 -- 172.21.15.90:0/4063881130 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f37a8052660 con 0x7f37b80b1ca0 2023-06-09T04:42:53.365 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:53.362+0000 7f37be219700 1 -- 172.21.15.90:0/4063881130 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f37b804e380 con 0x7f37b80b1ca0 2023-06-09T04:42:53.369 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:53.366+0000 7f37adffb700 1 -- 172.21.15.90:0/4063881130 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v9) v1 ==== 97+0+0 (secure 0 0 0) 0x7f37a8055c80 con 0x7f37b80b1ca0 2023-06-09T04:42:53.373 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:53.370+0000 7f37be219700 1 -- 172.21.15.90:0/4063881130 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f379c066320 msgr2=0x7f379c0687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:53.373 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:53.370+0000 7f37be219700 1 --2- 172.21.15.90:0/4063881130 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f379c066320 0x7f379c0687d0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f37b80d1d80 tx=0x7f37b4008040 comp rx=0 tx=0).stop 2023-06-09T04:42:53.373 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:53.370+0000 7f37be219700 1 -- 172.21.15.90:0/4063881130 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f37b80b1ca0 msgr2=0x7f37b80b48c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:53.373 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:53.370+0000 7f37be219700 1 --2- 172.21.15.90:0/4063881130 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f37b80b1ca0 0x7f37b80b48c0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f37a80090b0 tx=0x7f37a8004770 comp rx=0 tx=0).stop 2023-06-09T04:42:53.373 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:53.370+0000 7f37be219700 1 -- 172.21.15.90:0/4063881130 shutdown_connections 2023-06-09T04:42:53.373 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:53.370+0000 7f37be219700 1 --2- 172.21.15.90:0/4063881130 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f379c066320 0x7f379c0687d0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:53.373 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:53.370+0000 7f37be219700 1 --2- 172.21.15.90:0/4063881130 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f37b80d2400 0x7f37b81f4cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:53.374 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:53.370+0000 7f37be219700 1 --2- 172.21.15.90:0/4063881130 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f37b80b1ca0 0x7f37b80b48c0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:53.374 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:53.370+0000 7f37be219700 1 --2- 172.21.15.90:0/4063881130 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f37b80b18d0 0x7f37b806c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:53.374 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:53.370+0000 7f37be219700 1 -- 172.21.15.90:0/4063881130 >> 172.21.15.90:0/4063881130 conn(0x7f37b809b9b0 msgr2=0x7f37b815e870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:53.374 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:53.370+0000 7f37be219700 1 -- 172.21.15.90:0/4063881130 shutdown_connections 2023-06-09T04:42:53.374 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:53.370+0000 7f37be219700 1 -- 172.21.15.90:0/4063881130 wait complete. 2023-06-09T04:42:53.394 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-06-09T04:42:53.573 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:53.570+0000 7fc2fcd56700 1 Processor -- start 2023-06-09T04:42:53.573 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:53.570+0000 7fc2fcd56700 1 -- start start 2023-06-09T04:42:53.574 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:53.570+0000 7fc2fcd56700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc2f815f6e0 0x7fc2f80cde80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:53.575 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:53.570+0000 7fc2fcd56700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fc2f80ca630 0x7fc2f80cc0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:53.575 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:53.570+0000 7fc2fcd56700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2f8069820 con 0x7fc2f80cc600 2023-06-09T04:42:53.575 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:53.570+0000 7fc2fcd56700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2f80cca80 con 0x7fc2f80ca630 2023-06-09T04:42:53.575 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:53.570+0000 7fc2fcd56700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f80cae30 con 0x7fc2f815f6e0 2023-06-09T04:42:53.576 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:53.574+0000 7fc2effff700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fc2f80ca630 0x7fc2f80cc0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:53.576 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:53.574+0000 7fc2f6d9d700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7fc2f80cc600 0x7fc2f815fda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:39970/0 (socket says 172.21.15.90:39970) 2023-06-09T04:42:53.576 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:53.574+0000 7fc2f6d9d700 1 -- 172.21.15.90:0/2408948518 learned_addr learned my addr 172.21.15.90:0/2408948518 (peer_addr_for_me v1:172.21.15.90:0/0) 2023-06-09T04:42:53.576 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:53.574+0000 7fc2effff700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fc2f80ca630 0x7fc2f80cc0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:38746/0 (socket says 172.21.15.90:38746) 2023-06-09T04:42:53.577 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:53.574+0000 7fc2f659c700 1 --2- 172.21.15.90:0/2408948518 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc2f815f6e0 0x7fc2f80cde80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:53.577 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:53.574+0000 7fc2effff700 1 -- 172.21.15.90:0/2408948518 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc2f815f6e0 msgr2=0x7fc2f80cde80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:53.577 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:53.574+0000 7fc2effff700 1 --2- 172.21.15.90:0/2408948518 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc2f815f6e0 0x7fc2f80cde80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:53.577 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:53.574+0000 7fc2effff700 1 -- 172.21.15.90:0/2408948518 >> v1:172.21.15.90:6789/0 conn(0x7fc2f80cc600 legacy=0x7fc2f815fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:53.577 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:53.574+0000 7fc2effff700 1 -- 172.21.15.90:0/2408948518 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2f80cb110 con 0x7fc2f80ca630 2023-06-09T04:42:53.577 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:53.574+0000 7fc2effff700 1 --2- 172.21.15.90:0/2408948518 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc2f80ca630 0x7fc2f80cc0c0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fc2e0009850 tx=0x7fc2e0009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4345238053280e99 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:53.578 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:53.574+0000 7fc2f5d9b700 1 -- 172.21.15.90:0/2408948518 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2e0011830 con 0x7fc2f80ca630 2023-06-09T04:42:53.578 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:53.574+0000 7fc2f5d9b700 1 -- 172.21.15.90:0/2408948518 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2e0011990 con 0x7fc2f80ca630 2023-06-09T04:42:53.578 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:53.574+0000 7fc2f5d9b700 1 -- 172.21.15.90:0/2408948518 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2e0011d40 con 0x7fc2f80ca630 2023-06-09T04:42:53.578 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:53.574+0000 7fc2fcd56700 1 -- 172.21.15.90:0/2408948518 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc2f80ca630 msgr2=0x7fc2f80cc0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:53.579 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:53.574+0000 7fc2fcd56700 1 --2- 172.21.15.90:0/2408948518 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc2f80ca630 0x7fc2f80cc0c0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fc2e0009850 tx=0x7fc2e0009b60 comp rx=0 tx=0).stop 2023-06-09T04:42:53.579 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:53.574+0000 7fc2fcd56700 1 -- 172.21.15.90:0/2408948518 shutdown_connections 2023-06-09T04:42:53.579 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:53.574+0000 7fc2fcd56700 1 --2- 172.21.15.90:0/2408948518 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc2f80ca630 0x7fc2f80cc0c0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:53.579 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:53.574+0000 7fc2fcd56700 1 --2- 172.21.15.90:0/2408948518 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc2f815f6e0 0x7fc2f80cde80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:53.579 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:53.574+0000 7fc2fcd56700 1 -- 172.21.15.90:0/2408948518 >> 172.21.15.90:0/2408948518 conn(0x7fc2f806c810 msgr2=0x7fc2f80b0000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:53.579 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:53.574+0000 7fc2fcd56700 1 -- 172.21.15.90:0/2408948518 shutdown_connections 2023-06-09T04:42:53.579 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:53.574+0000 7fc2fcd56700 1 -- 172.21.15.90:0/2408948518 wait complete. 2023-06-09T04:42:53.580 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:53.578+0000 7fc2fcd56700 1 Processor -- start 2023-06-09T04:42:53.580 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:53.578+0000 7fc2fcd56700 1 -- start start 2023-06-09T04:42:53.582 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:53.578+0000 7fc2fcd56700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc2f80ca630 0x7fc2f81f5000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:53.582 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:53.578+0000 7fc2fcd56700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc2f80cc600 0x7fc2f814eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:53.582 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:53.578+0000 7fc2fcd56700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc2f815f6e0 0x7fc2f814f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:53.583 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:53.578+0000 7fc2fcd56700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f814c840 con 0x7fc2f80cc600 2023-06-09T04:42:53.583 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:53.578+0000 7fc2fcd56700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f814c210 con 0x7fc2f815f6e0 2023-06-09T04:42:53.583 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:53.578+0000 7fc2fcd56700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f81f5830 con 0x7fc2f80ca630 2023-06-09T04:42:53.584 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:53.578+0000 7fc2effff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc2f80cc600 0x7fc2f814eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:53.584 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:53.578+0000 7fc2effff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc2f80cc600 0x7fc2f814eb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:38752/0 (socket says 172.21.15.90:38752) 2023-06-09T04:42:53.584 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:53.578+0000 7fc2effff700 1 -- 172.21.15.90:0/1729584500 learned_addr learned my addr 172.21.15.90:0/1729584500 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:53.584 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:53.578+0000 7fc2f659c700 1 --2- 172.21.15.90:0/1729584500 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc2f80ca630 0x7fc2f81f5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:53.584 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:53.578+0000 7fc2f6d9d700 1 --2- 172.21.15.90:0/1729584500 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc2f815f6e0 0x7fc2f814f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:53.585 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:53.582+0000 7fc2effff700 1 -- 172.21.15.90:0/1729584500 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc2f80ca630 msgr2=0x7fc2f81f5000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:53.585 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:53.582+0000 7fc2effff700 1 --2- 172.21.15.90:0/1729584500 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc2f80ca630 0x7fc2f81f5000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:53.585 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:53.582+0000 7fc2effff700 1 -- 172.21.15.90:0/1729584500 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc2f815f6e0 msgr2=0x7fc2f814f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:53.585 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:53.582+0000 7fc2effff700 1 --2- 172.21.15.90:0/1729584500 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc2f815f6e0 0x7fc2f814f0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:53.585 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:53.582+0000 7fc2effff700 1 -- 172.21.15.90:0/1729584500 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2e00094b0 con 0x7fc2f80cc600 2023-06-09T04:42:53.585 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:53.582+0000 7fc2f6d9d700 1 --2- 172.21.15.90:0/1729584500 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc2f815f6e0 0x7fc2f814f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:42:53.585 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:53.582+0000 7fc2effff700 1 --2- 172.21.15.90:0/1729584500 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc2f80cc600 0x7fc2f814eb90 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fc2e0014040 tx=0x7fc2e0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:53.586 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:53.582+0000 7fc2eeffd700 1 -- 172.21.15.90:0/1729584500 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2e00036c0 con 0x7fc2f80cc600 2023-06-09T04:42:53.586 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:53.582+0000 7fc2eeffd700 1 -- 172.21.15.90:0/1729584500 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2e001e070 con 0x7fc2f80cc600 2023-06-09T04:42:53.586 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:53.582+0000 7fc2eeffd700 1 -- 172.21.15.90:0/1729584500 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2e0003a80 con 0x7fc2f80cc600 2023-06-09T04:42:53.587 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:53.582+0000 7fc2fcd56700 1 -- 172.21.15.90:0/1729584500 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2f81f5b10 con 0x7fc2f80cc600 2023-06-09T04:42:53.587 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:53.582+0000 7fc2fcd56700 1 -- 172.21.15.90:0/1729584500 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2f814c4d0 con 0x7fc2f80cc600 2023-06-09T04:42:53.587 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:53.582+0000 7fc2fcd56700 1 -- 172.21.15.90:0/1729584500 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2f804db30 con 0x7fc2f80cc600 2023-06-09T04:42:53.588 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:53.586+0000 7fc2eeffd700 1 -- 172.21.15.90:0/1729584500 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc2e0003be0 con 0x7fc2f80cc600 2023-06-09T04:42:53.589 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:53.586+0000 7fc2eeffd700 1 --2- 172.21.15.90:0/1729584500 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fc2d80662f0 0x7fc2d80687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:53.590 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:53.586+0000 7fc2eeffd700 1 -- 172.21.15.90:0/1729584500 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fc2e0020070 con 0x7fc2f80cc600 2023-06-09T04:42:53.590 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:53.586+0000 7fc2f659c700 1 --2- 172.21.15.90:0/1729584500 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fc2d80662f0 0x7fc2d80687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:53.591 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:53.590+0000 7fc2f659c700 1 --2- 172.21.15.90:0/1729584500 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fc2d80662f0 0x7fc2d80687a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fc2f80c5020 tx=0x7fc2e8009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:53.593 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:53.590+0000 7fc2eeffd700 1 -- 172.21.15.90:0/1729584500 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc2e0052680 con 0x7fc2f80cc600 2023-06-09T04:42:53.820 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:53.818+0000 7fc2fcd56700 1 -- 172.21.15.90:0/1729584500 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7fc2f814c980 con 0x7fc2f80cc600 2023-06-09T04:42:53.828 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:53.826+0000 7fc2eeffd700 1 -- 172.21.15.90:0/1729584500 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7fc2e00150a0 con 0x7fc2f80cc600 2023-06-09T04:42:53.831 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:53.830+0000 7fc2fcd56700 1 -- 172.21.15.90:0/1729584500 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fc2d80662f0 msgr2=0x7fc2d80687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:53.831 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:53.830+0000 7fc2fcd56700 1 --2- 172.21.15.90:0/1729584500 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fc2d80662f0 0x7fc2d80687a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fc2f80c5020 tx=0x7fc2e8009240 comp rx=0 tx=0).stop 2023-06-09T04:42:53.831 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:53.830+0000 7fc2fcd56700 1 -- 172.21.15.90:0/1729584500 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc2f80cc600 msgr2=0x7fc2f814eb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:53.832 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:53.830+0000 7fc2fcd56700 1 --2- 172.21.15.90:0/1729584500 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc2f80cc600 0x7fc2f814eb90 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fc2e0014040 tx=0x7fc2e0004770 comp rx=0 tx=0).stop 2023-06-09T04:42:53.832 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:53.830+0000 7fc2fcd56700 1 -- 172.21.15.90:0/1729584500 shutdown_connections 2023-06-09T04:42:53.832 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:53.830+0000 7fc2fcd56700 1 --2- 172.21.15.90:0/1729584500 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fc2d80662f0 0x7fc2d80687a0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:53.832 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:53.830+0000 7fc2fcd56700 1 --2- 172.21.15.90:0/1729584500 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc2f815f6e0 0x7fc2f814f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:53.832 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:53.830+0000 7fc2fcd56700 1 --2- 172.21.15.90:0/1729584500 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc2f80cc600 0x7fc2f814eb90 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:53.832 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:53.830+0000 7fc2fcd56700 1 --2- 172.21.15.90:0/1729584500 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc2f80ca630 0x7fc2f81f5000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:53.832 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:53.830+0000 7fc2fcd56700 1 -- 172.21.15.90:0/1729584500 >> 172.21.15.90:0/1729584500 conn(0x7fc2f806c810 msgr2=0x7fc2f80adf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:53.833 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:53.830+0000 7fc2fcd56700 1 -- 172.21.15.90:0/1729584500 shutdown_connections 2023-06-09T04:42:53.833 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:53.830+0000 7fc2fcd56700 1 -- 172.21.15.90:0/1729584500 wait complete. 2023-06-09T04:42:53.853 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T04:42:54.026 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.022+0000 7f8fb8ed8700 1 Processor -- start 2023-06-09T04:42:54.027 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.022+0000 7f8fb8ed8700 1 -- start start 2023-06-09T04:42:54.028 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.026+0000 7f8fb8ed8700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f8fb41574c0 0x7f8fb40cdb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:54.029 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.026+0000 7f8fb8ed8700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8fb40cb050 0x7f8fb4069f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:54.029 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.026+0000 7f8fb8ed8700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fb41618e0 con 0x7f8fb40cac00 2023-06-09T04:42:54.029 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.026+0000 7f8fb8ed8700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fb4157890 con 0x7f8fb41574c0 2023-06-09T04:42:54.029 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.026+0000 7f8fb8ed8700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb41647b0 con 0x7f8fb40cb050 2023-06-09T04:42:54.030 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.026+0000 7f8faaffd700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f8fb40cac00 0x7f8fb4069820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:39984/0 (socket says 172.21.15.90:39984) 2023-06-09T04:42:54.030 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.026+0000 7f8faaffd700 1 -- 172.21.15.90:0/1054103153 learned_addr learned my addr 172.21.15.90:0/1054103153 (peer_addr_for_me v1:172.21.15.90:0/0) 2023-06-09T04:42:54.030 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.026+0000 7f8fb37fe700 1 --2- 172.21.15.90:0/1054103153 >> v2:172.21.15.90:3300/0 conn(0x7f8fb41574c0 0x7f8fb40cdb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:54.031 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.026+0000 7f8fb3fff700 1 --2- 172.21.15.90:0/1054103153 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8fb40cb050 0x7f8fb4069f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:54.031 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.026+0000 7f8fb2ffd700 1 -- 172.21.15.90:0/1054103153 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1313905187 0 0) 0x7f8fb41618e0 con 0x7f8fb40cac00 2023-06-09T04:42:54.031 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.026+0000 7f8fb2ffd700 1 -- 172.21.15.90:0/1054103153 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8fa00035d0 con 0x7f8fb40cac00 2023-06-09T04:42:54.031 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.026+0000 7f8fb37fe700 1 -- 172.21.15.90:0/1054103153 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8fb40cb050 msgr2=0x7f8fb4069f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:54.031 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.026+0000 7f8fb37fe700 1 --2- 172.21.15.90:0/1054103153 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8fb40cb050 0x7f8fb4069f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:54.031 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.026+0000 7f8fb37fe700 1 -- 172.21.15.90:0/1054103153 >> v1:172.21.15.90:6789/0 conn(0x7f8fb40cac00 legacy=0x7f8fb4069820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:54.031 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.026+0000 7f8fb37fe700 1 -- 172.21.15.90:0/1054103153 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fb40ce040 con 0x7f8fb41574c0 2023-06-09T04:42:54.032 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.030+0000 7f8fb37fe700 1 --2- 172.21.15.90:0/1054103153 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8fb41574c0 0x7f8fb40cdb00 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f8fa4009850 tx=0x7f8fa4009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e379422acdf1bc4 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:54.032 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.030+0000 7f8fb2ffd700 1 -- 172.21.15.90:0/1054103153 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa4011830 con 0x7f8fb41574c0 2023-06-09T04:42:54.032 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.030+0000 7f8fb2ffd700 1 -- 172.21.15.90:0/1054103153 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fa4011990 con 0x7f8fb41574c0 2023-06-09T04:42:54.033 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.030+0000 7f8fb2ffd700 1 -- 172.21.15.90:0/1054103153 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa4011d40 con 0x7f8fb41574c0 2023-06-09T04:42:54.033 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.030+0000 7f8fb8ed8700 1 -- 172.21.15.90:0/1054103153 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8fb41574c0 msgr2=0x7f8fb40cdb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:54.033 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.030+0000 7f8fb8ed8700 1 --2- 172.21.15.90:0/1054103153 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8fb41574c0 0x7f8fb40cdb00 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f8fa4009850 tx=0x7f8fa4009b60 comp rx=0 tx=0).stop 2023-06-09T04:42:54.034 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.030+0000 7f8fb8ed8700 1 -- 172.21.15.90:0/1054103153 shutdown_connections 2023-06-09T04:42:54.034 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.030+0000 7f8fb8ed8700 1 --2- 172.21.15.90:0/1054103153 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8fb40cb050 0x7f8fb4069f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:54.034 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.030+0000 7f8fb8ed8700 1 --2- 172.21.15.90:0/1054103153 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8fb41574c0 0x7f8fb40cdb00 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:54.034 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.030+0000 7f8fb8ed8700 1 -- 172.21.15.90:0/1054103153 >> 172.21.15.90:0/1054103153 conn(0x7f8fb406c690 msgr2=0x7f8fb40aff00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:54.034 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.030+0000 7f8fb8ed8700 1 -- 172.21.15.90:0/1054103153 shutdown_connections 2023-06-09T04:42:54.034 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.030+0000 7f8fb8ed8700 1 -- 172.21.15.90:0/1054103153 wait complete. 2023-06-09T04:42:54.035 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.034+0000 7f8fb8ed8700 1 Processor -- start 2023-06-09T04:42:54.036 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.034+0000 7f8fb8ed8700 1 -- start start 2023-06-09T04:42:54.037 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.034+0000 7f8fb8ed8700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8fb40cac00 0x7f8fb4150530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:54.037 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.034+0000 7f8fb8ed8700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8fb40cb050 0x7f8fb415c960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:54.037 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.034+0000 7f8fb8ed8700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8fb41574c0 0x7f8fb4151750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:54.038 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.034+0000 7f8fb8ed8700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb415d540 con 0x7f8fb41574c0 2023-06-09T04:42:54.038 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.034+0000 7f8fb8ed8700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb415d260 con 0x7f8fb40cac00 2023-06-09T04:42:54.038 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.034+0000 7f8fb8ed8700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb415b130 con 0x7f8fb40cb050 2023-06-09T04:42:54.039 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.034+0000 7f8fb3fff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8fb41574c0 0x7f8fb4151750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:54.039 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.034+0000 7f8fb3fff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8fb41574c0 0x7f8fb4151750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:38770/0 (socket says 172.21.15.90:38770) 2023-06-09T04:42:54.039 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.034+0000 7f8fb3fff700 1 -- 172.21.15.90:0/81936739 learned_addr learned my addr 172.21.15.90:0/81936739 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:54.039 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.034+0000 7f8fb37fe700 1 --2- 172.21.15.90:0/81936739 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8fb40cac00 0x7f8fb4150530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:54.039 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.034+0000 7f8faaffd700 1 --2- 172.21.15.90:0/81936739 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8fb40cb050 0x7f8fb415c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:54.039 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.034+0000 7f8fb3fff700 1 -- 172.21.15.90:0/81936739 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8fb40cb050 msgr2=0x7f8fb415c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:54.040 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.034+0000 7f8fb3fff700 1 --2- 172.21.15.90:0/81936739 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8fb40cb050 0x7f8fb415c960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:54.040 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.034+0000 7f8fb3fff700 1 -- 172.21.15.90:0/81936739 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8fb40cac00 msgr2=0x7f8fb4150530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:54.040 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.034+0000 7f8fb3fff700 1 --2- 172.21.15.90:0/81936739 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8fb40cac00 0x7f8fb4150530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:54.040 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.034+0000 7f8fb3fff700 1 -- 172.21.15.90:0/81936739 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fa40094b0 con 0x7f8fb41574c0 2023-06-09T04:42:54.040 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.034+0000 7f8faaffd700 1 --2- 172.21.15.90:0/81936739 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8fb40cb050 0x7f8fb415c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:42:54.040 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.034+0000 7f8fb3fff700 1 --2- 172.21.15.90:0/81936739 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8fb41574c0 0x7f8fb4151750 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f8fac00efc0 tx=0x7f8fac00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:54.041 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.038+0000 7f8fb0ff9700 1 -- 172.21.15.90:0/81936739 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fac009ea0 con 0x7f8fb41574c0 2023-06-09T04:42:54.041 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.038+0000 7f8fb0ff9700 1 -- 172.21.15.90:0/81936739 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fac00f040 con 0x7f8fb41574c0 2023-06-09T04:42:54.041 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.038+0000 7f8fb8ed8700 1 -- 172.21.15.90:0/81936739 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fb415b410 con 0x7f8fb41574c0 2023-06-09T04:42:54.041 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.038+0000 7f8fb0ff9700 1 -- 172.21.15.90:0/81936739 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fac014480 con 0x7f8fb41574c0 2023-06-09T04:42:54.042 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.038+0000 7f8fb8ed8700 1 -- 172.21.15.90:0/81936739 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fb4150a70 con 0x7f8fb41574c0 2023-06-09T04:42:54.042 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.038+0000 7f8fb8ed8700 1 -- 172.21.15.90:0/81936739 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fb406b390 con 0x7f8fb41574c0 2023-06-09T04:42:54.042 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.038+0000 7f8fb0ff9700 1 -- 172.21.15.90:0/81936739 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8fac0145e0 con 0x7f8fb41574c0 2023-06-09T04:42:54.044 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.042+0000 7f8fb0ff9700 1 --2- 172.21.15.90:0/81936739 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f8f940662f0 0x7f8f940687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:54.044 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.042+0000 7f8fb0ff9700 1 -- 172.21.15.90:0/81936739 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f8fac084260 con 0x7f8fb41574c0 2023-06-09T04:42:54.045 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.042+0000 7f8fb37fe700 1 --2- 172.21.15.90:0/81936739 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f8f940662f0 0x7f8f940687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:54.046 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.042+0000 7f8fb37fe700 1 --2- 172.21.15.90:0/81936739 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f8f940662f0 0x7f8f940687a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f8fa40090b0 tx=0x7f8fa401c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:54.049 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.046+0000 7f8fb0ff9700 1 -- 172.21.15.90:0/81936739 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8fac051a20 con 0x7f8fb41574c0 2023-06-09T04:42:54.219 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.214+0000 7f8fb8ed8700 1 -- 172.21.15.90:0/81936739 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8fb415af70 con 0x7f8fb41574c0 2023-06-09T04:42:54.220 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.218+0000 7f8fb0ff9700 1 -- 172.21.15.90:0/81936739 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+14639 (secure 0 0 0) 0x7f8fac055040 con 0x7f8fb41574c0 2023-06-09T04:42:54.221 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:42:54.221 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":34,"fsid":"700369c0-a111-43b4-9415-844ad1742b70","created":"2023-06-09T04:41:28.180311+0000","modified":"2023-06-09T04:42:50.601880+0000","last_up_change":"2023-06-09T04:41:40.746475+0000","last_in_change":"2023-06-09T04:41:31.262765+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-09T04:41:42.402564+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-09T04:41:47.607323+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"46a4a7c5-babd-4ef3-9830-51487cff5eb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":2780271267},{"type":"v1","addr":"172.21.15.90:6809","nonce":2780271267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2780271267},{"type":"v1","addr":"172.21.15.90:6811","nonce":2780271267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2780271267},{"type":"v1","addr":"172.21.15.90:6815","nonce":2780271267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2780271267},{"type":"v1","addr":"172.21.15.90:6813","nonce":2780271267}]},"public_addr":"172.21.15.90:6809/2780271267","cluster_addr":"172.21.15.90:6811/2780271267","heartbeat_back_addr":"172.21.15.90:6815/2780271267","heartbeat_front_addr":"172.21.15.90:6813/2780271267","state":["exists","up"]},{"osd":1,"uuid":"1543988f-c498-494a-a6f9-fac8413db6ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":3064028136},{"type":"v1","addr":"172.21.15.90:6801","nonce":3064028136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":3064028136},{"type":"v1","addr":"172.21.15.90:6803","nonce":3064028136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":3064028136},{"type":"v1","addr":"172.21.15.90:6807","nonce":3064028136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":3064028136},{"type":"v1","addr":"172.21.15.90:6805","nonce":3064028136}]},"public_addr":"172.21.15.90:6801/3064028136","cluster_addr":"172.21.15.90:6803/3064028136","heartbeat_back_addr":"172.21.15.90:6807/3064028136","heartbeat_front_addr":"172.21.15.90:6805/3064028136","state":["exists","up"]},{"osd":2,"uuid":"79669dd6-ffc8-4197-b9f7-b3b372b2b9b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":3713146326},{"type":"v1","addr":"172.21.15.90:6825","nonce":3713146326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":3713146326},{"type":"v1","addr":"172.21.15.90:6827","nonce":3713146326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":3713146326},{"type":"v1","addr":"172.21.15.90:6831","nonce":3713146326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":3713146326},{"type":"v1","addr":"172.21.15.90:6829","nonce":3713146326}]},"public_addr":"172.21.15.90:6825/3713146326","cluster_addr":"172.21.15.90:6827/3713146326","heartbeat_back_addr":"172.21.15.90:6831/3713146326","heartbeat_front_addr":"172.21.15.90:6829/3713146326","state":["exists","up"]},{"osd":3,"uuid":"4062ab6f-ce40-450a-aa17-b10098766c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":3499839122},{"type":"v1","addr":"172.21.15.90:6817","nonce":3499839122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":3499839122},{"type":"v1","addr":"172.21.15.90:6819","nonce":3499839122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":3499839122},{"type":"v1","addr":"172.21.15.90:6823","nonce":3499839122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":3499839122},{"type":"v1","addr":"172.21.15.90:6821","nonce":3499839122}]},"public_addr":"172.21.15.90:6817/3499839122","cluster_addr":"172.21.15.90:6819/3499839122","heartbeat_back_addr":"172.21.15.90:6823/3499839122","heartbeat_front_addr":"172.21.15.90:6821/3499839122","state":["exists","up"]},{"osd":4,"uuid":"a10820e4-b348-4d92-9796-3b01484ace1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6817","nonce":1138565854},{"type":"v1","addr":"172.21.15.174:6819","nonce":1138565854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6821","nonce":1138565854},{"type":"v1","addr":"172.21.15.174:6823","nonce":1138565854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":1138565854},{"type":"v1","addr":"172.21.15.174:6831","nonce":1138565854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":1138565854},{"type":"v1","addr":"172.21.15.174:6829","nonce":1138565854}]},"public_addr":"172.21.15.174:6819/1138565854","cluster_addr":"172.21.15.174:6823/1138565854","heartbeat_back_addr":"172.21.15.174:6831/1138565854","heartbeat_front_addr":"172.21.15.174:6829/1138565854","state":["exists","up"]},{"osd":5,"uuid":"b4da1c32-be05-420b-9346-90d91aa70569","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":1707702879},{"type":"v1","addr":"172.21.15.174:6818","nonce":1707702879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":1707702879},{"type":"v1","addr":"172.21.15.174:6822","nonce":1707702879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6827","nonce":1707702879},{"type":"v1","addr":"172.21.15.174:6828","nonce":1707702879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":1707702879},{"type":"v1","addr":"172.21.15.174:6825","nonce":1707702879}]},"public_addr":"172.21.15.174:6818/1707702879","cluster_addr":"172.21.15.174:6822/1707702879","heartbeat_back_addr":"172.21.15.174:6828/1707702879","heartbeat_front_addr":"172.21.15.174:6825/1707702879","state":["exists","up"]},{"osd":6,"uuid":"d1b98041-d243-4355-bd0a-e22cf9875b32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":864450534},{"type":"v1","addr":"172.21.15.174:6801","nonce":864450534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":864450534},{"type":"v1","addr":"172.21.15.174:6803","nonce":864450534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":864450534},{"type":"v1","addr":"172.21.15.174:6807","nonce":864450534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":864450534},{"type":"v1","addr":"172.21.15.174:6805","nonce":864450534}]},"public_addr":"172.21.15.174:6801/864450534","cluster_addr":"172.21.15.174:6803/864450534","heartbeat_back_addr":"172.21.15.174:6807/864450534","heartbeat_front_addr":"172.21.15.174:6805/864450534","state":["exists","up"]},{"osd":7,"uuid":"5a207936-f89f-416b-b79b-34ec96f77c8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":2527640659},{"type":"v1","addr":"172.21.15.174:6809","nonce":2527640659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":2527640659},{"type":"v1","addr":"172.21.15.174:6811","nonce":2527640659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":2527640659},{"type":"v1","addr":"172.21.15.174:6815","nonce":2527640659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":2527640659},{"type":"v1","addr":"172.21.15.174:6813","nonce":2527640659}]},"public_addr":"172.21.15.174:6809/2527640659","cluster_addr":"172.21.15.174:6811/2527640659","heartbeat_back_addr":"172.21.15.174:6815/2527640659","heartbeat_front_addr":"172.21.15.174:6813/2527640659","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:36.972152+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:36.984561+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:36.998817+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:37.054944+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:37.085014+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:37.115125+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:36.854608+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:36.971685+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:42:54.223 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.222+0000 7f8fb8ed8700 1 -- 172.21.15.90:0/81936739 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f8f940662f0 msgr2=0x7f8f940687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:54.223 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.222+0000 7f8fb8ed8700 1 --2- 172.21.15.90:0/81936739 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f8f940662f0 0x7f8f940687a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f8fa40090b0 tx=0x7f8fa401c040 comp rx=0 tx=0).stop 2023-06-09T04:42:54.224 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.222+0000 7f8fb8ed8700 1 -- 172.21.15.90:0/81936739 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8fb41574c0 msgr2=0x7f8fb4151750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:54.224 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.222+0000 7f8fb8ed8700 1 --2- 172.21.15.90:0/81936739 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8fb41574c0 0x7f8fb4151750 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f8fac00efc0 tx=0x7f8fac00c3a0 comp rx=0 tx=0).stop 2023-06-09T04:42:54.224 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.222+0000 7f8fb8ed8700 1 -- 172.21.15.90:0/81936739 shutdown_connections 2023-06-09T04:42:54.224 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.222+0000 7f8fb8ed8700 1 --2- 172.21.15.90:0/81936739 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f8f940662f0 0x7f8f940687a0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:54.224 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.222+0000 7f8fb8ed8700 1 --2- 172.21.15.90:0/81936739 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8fb41574c0 0x7f8fb4151750 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:54.224 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.222+0000 7f8fb8ed8700 1 --2- 172.21.15.90:0/81936739 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8fb40cb050 0x7f8fb415c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:54.224 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.222+0000 7f8fb8ed8700 1 --2- 172.21.15.90:0/81936739 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8fb40cac00 0x7f8fb4150530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:54.225 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.222+0000 7f8fb8ed8700 1 -- 172.21.15.90:0/81936739 >> 172.21.15.90:0/81936739 conn(0x7f8fb406c690 msgr2=0x7f8fb4069820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:54.225 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.222+0000 7f8fb8ed8700 1 -- 172.21.15.90:0/81936739 shutdown_connections 2023-06-09T04:42:54.225 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.222+0000 7f8fb8ed8700 1 -- 172.21.15.90:0/81936739 wait complete. 2023-06-09T04:42:54.245 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-09T04:41:42.402564+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-09T04:41:47.607323+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-09T04:42:54.246 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-09T04:42:54.420 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.418+0000 7f6c323ef700 1 Processor -- start 2023-06-09T04:42:54.421 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.418+0000 7f6c323ef700 1 -- start start 2023-06-09T04:42:54.424 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.422+0000 7f6c323ef700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6c2c0cb3d0 0x7f6c2c15a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:54.424 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.422+0000 7f6c323ef700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f6c2c0cd5a0 0x7f6c2c0cda20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:54.424 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.422+0000 7f6c323ef700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c2c0c8c90 con 0x7f6c2c06a230 2023-06-09T04:42:54.424 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.422+0000 7f6c323ef700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c2c0cdf60 con 0x7f6c2c0cd5a0 2023-06-09T04:42:54.425 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.422+0000 7f6c323ef700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c2c15d9a0 con 0x7f6c2c0cb3d0 2023-06-09T04:42:54.425 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.422+0000 7f6c30bec700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f6c2c06a230 0x7f6c2c0ca2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:40000/0 (socket says 172.21.15.90:40000) 2023-06-09T04:42:54.425 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.422+0000 7f6c30bec700 1 -- 172.21.15.90:0/1102340722 learned_addr learned my addr 172.21.15.90:0/1102340722 (peer_addr_for_me v1:172.21.15.90:0/0) 2023-06-09T04:42:54.425 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.422+0000 7f6c313ed700 1 --2- 172.21.15.90:0/1102340722 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6c2c0cb3d0 0x7f6c2c15a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:54.426 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.422+0000 7f6c31bee700 1 --2- 172.21.15.90:0/1102340722 >> v2:172.21.15.90:3300/0 conn(0x7f6c2c0cd5a0 0x7f6c2c0cda20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:54.426 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.422+0000 7f6c313ed700 1 -- 172.21.15.90:0/1102340722 >> v2:172.21.15.90:3300/0 conn(0x7f6c2c0cd5a0 msgr2=0x7f6c2c0cda20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:54.426 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.422+0000 7f6c313ed700 1 --2- 172.21.15.90:0/1102340722 >> v2:172.21.15.90:3300/0 conn(0x7f6c2c0cd5a0 0x7f6c2c0cda20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:54.427 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.422+0000 7f6c313ed700 1 -- 172.21.15.90:0/1102340722 >> v1:172.21.15.90:6789/0 conn(0x7f6c2c06a230 legacy=0x7f6c2c0ca2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:54.427 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.422+0000 7f6c313ed700 1 -- 172.21.15.90:0/1102340722 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c2c15a990 con 0x7f6c2c0cb3d0 2023-06-09T04:42:54.427 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.422+0000 7f6c31bee700 1 --2- 172.21.15.90:0/1102340722 >> v2:172.21.15.90:3300/0 conn(0x7f6c2c0cd5a0 0x7f6c2c0cda20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:42:54.427 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.422+0000 7f6c313ed700 1 --2- 172.21.15.90:0/1102340722 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6c2c0cb3d0 0x7f6c2c15a3b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6c28009850 tx=0x7f6c28009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=761228fd6c3b5322 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:54.427 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.426+0000 7f6c23fff700 1 -- 172.21.15.90:0/1102340722 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c28011830 con 0x7f6c2c0cb3d0 2023-06-09T04:42:54.428 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.426+0000 7f6c23fff700 1 -- 172.21.15.90:0/1102340722 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c28011990 con 0x7f6c2c0cb3d0 2023-06-09T04:42:54.428 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.426+0000 7f6c23fff700 1 -- 172.21.15.90:0/1102340722 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c28011d40 con 0x7f6c2c0cb3d0 2023-06-09T04:42:54.428 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.426+0000 7f6c323ef700 1 -- 172.21.15.90:0/1102340722 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6c2c0cb3d0 msgr2=0x7f6c2c15a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:54.429 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.426+0000 7f6c323ef700 1 --2- 172.21.15.90:0/1102340722 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6c2c0cb3d0 0x7f6c2c15a3b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6c28009850 tx=0x7f6c28009b60 comp rx=0 tx=0).stop 2023-06-09T04:42:54.429 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.426+0000 7f6c323ef700 1 -- 172.21.15.90:0/1102340722 shutdown_connections 2023-06-09T04:42:54.429 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.426+0000 7f6c323ef700 1 --2- 172.21.15.90:0/1102340722 >> v2:172.21.15.90:3300/0 conn(0x7f6c2c0cd5a0 0x7f6c2c0cda20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:54.429 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.426+0000 7f6c323ef700 1 --2- 172.21.15.90:0/1102340722 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6c2c0cb3d0 0x7f6c2c15a3b0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:54.429 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.426+0000 7f6c323ef700 1 -- 172.21.15.90:0/1102340722 >> 172.21.15.90:0/1102340722 conn(0x7f6c2c0aff00 msgr2=0x7f6c2c0b0300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:54.429 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.426+0000 7f6c323ef700 1 -- 172.21.15.90:0/1102340722 shutdown_connections 2023-06-09T04:42:54.430 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.426+0000 7f6c323ef700 1 -- 172.21.15.90:0/1102340722 wait complete. 2023-06-09T04:42:54.431 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.430+0000 7f6c323ef700 1 Processor -- start 2023-06-09T04:42:54.431 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.430+0000 7f6c323ef700 1 -- start start 2023-06-09T04:42:54.432 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.430+0000 7f6c323ef700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6c2c06a230 0x7f6c2c14d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:54.432 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.430+0000 7f6c323ef700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6c2c0cb3d0 0x7f6c2c0c3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:54.433 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.430+0000 7f6c323ef700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6c2c0cd5a0 0x7f6c2c0c5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:54.433 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.430+0000 7f6c323ef700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c2c14dbd0 con 0x7f6c2c0cd5a0 2023-06-09T04:42:54.433 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.430+0000 7f6c323ef700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c2c0c45d0 con 0x7f6c2c0cb3d0 2023-06-09T04:42:54.433 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.430+0000 7f6c323ef700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c2c0c48b0 con 0x7f6c2c06a230 2023-06-09T04:42:54.434 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.430+0000 7f6c31bee700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6c2c0cd5a0 0x7f6c2c0c5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:54.434 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.430+0000 7f6c31bee700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6c2c0cd5a0 0x7f6c2c0c5cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:38792/0 (socket says 172.21.15.90:38792) 2023-06-09T04:42:54.434 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.430+0000 7f6c31bee700 1 -- 172.21.15.90:0/4089463664 learned_addr learned my addr 172.21.15.90:0/4089463664 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:54.434 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.430+0000 7f6c313ed700 1 --2- 172.21.15.90:0/4089463664 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6c2c06a230 0x7f6c2c14d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:54.434 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.430+0000 7f6c30bec700 1 --2- 172.21.15.90:0/4089463664 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6c2c0cb3d0 0x7f6c2c0c3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:54.435 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.430+0000 7f6c31bee700 1 -- 172.21.15.90:0/4089463664 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6c2c06a230 msgr2=0x7f6c2c14d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:54.435 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.430+0000 7f6c31bee700 1 --2- 172.21.15.90:0/4089463664 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6c2c06a230 0x7f6c2c14d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:54.435 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.430+0000 7f6c31bee700 1 -- 172.21.15.90:0/4089463664 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6c2c0cb3d0 msgr2=0x7f6c2c0c3b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:54.435 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.430+0000 7f6c31bee700 1 --2- 172.21.15.90:0/4089463664 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6c2c0cb3d0 0x7f6c2c0c3b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:54.435 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.430+0000 7f6c31bee700 1 -- 172.21.15.90:0/4089463664 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c24009a70 con 0x7f6c2c0cd5a0 2023-06-09T04:42:54.436 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.430+0000 7f6c31bee700 1 --2- 172.21.15.90:0/4089463664 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6c2c0cd5a0 0x7f6c2c0c5cb0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f6c2400efc0 tx=0x7f6c2400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:54.436 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.430+0000 7f6c21ffb700 1 -- 172.21.15.90:0/4089463664 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c2400ca90 con 0x7f6c2c0cd5a0 2023-06-09T04:42:54.436 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.430+0000 7f6c21ffb700 1 -- 172.21.15.90:0/4089463664 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c2400f040 con 0x7f6c2c0cd5a0 2023-06-09T04:42:54.436 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.430+0000 7f6c21ffb700 1 -- 172.21.15.90:0/4089463664 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c2400ce10 con 0x7f6c2c0cd5a0 2023-06-09T04:42:54.436 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.434+0000 7f6c323ef700 1 -- 172.21.15.90:0/4089463664 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c280094b0 con 0x7f6c2c0cd5a0 2023-06-09T04:42:54.437 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.434+0000 7f6c323ef700 1 -- 172.21.15.90:0/4089463664 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c2c070040 con 0x7f6c2c0cd5a0 2023-06-09T04:42:54.437 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.434+0000 7f6c323ef700 1 -- 172.21.15.90:0/4089463664 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c2c070260 con 0x7f6c2c0cd5a0 2023-06-09T04:42:54.438 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.434+0000 7f6c21ffb700 1 -- 172.21.15.90:0/4089463664 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6c24014480 con 0x7f6c2c0cd5a0 2023-06-09T04:42:54.439 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.438+0000 7f6c21ffb700 1 --2- 172.21.15.90:0/4089463664 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f6c100662f0 0x7f6c100687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:54.439 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.438+0000 7f6c21ffb700 1 -- 172.21.15.90:0/4089463664 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f6c24083fe0 con 0x7f6c2c0cd5a0 2023-06-09T04:42:54.440 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.438+0000 7f6c313ed700 1 --2- 172.21.15.90:0/4089463664 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f6c100662f0 0x7f6c100687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:54.441 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.438+0000 7f6c313ed700 1 --2- 172.21.15.90:0/4089463664 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f6c100662f0 0x7f6c100687a0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f6c280090b0 tx=0x7f6c28008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:54.446 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.442+0000 7f6c21ffb700 1 -- 172.21.15.90:0/4089463664 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6c24055270 con 0x7f6c2c0cd5a0 2023-06-09T04:42:54.620 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.618+0000 7f6c323ef700 1 -- 172.21.15.90:0/4089463664 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6c2c04e380 con 0x7f6c2c0cd5a0 2023-06-09T04:42:54.621 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.618+0000 7f6c21ffb700 1 -- 172.21.15.90:0/4089463664 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v34) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6c24009d70 con 0x7f6c2c0cd5a0 2023-06-09T04:42:54.621 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 1 2023-06-09T04:42:54.623 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.622+0000 7f6c323ef700 1 -- 172.21.15.90:0/4089463664 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f6c100662f0 msgr2=0x7f6c100687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:54.624 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.622+0000 7f6c323ef700 1 --2- 172.21.15.90:0/4089463664 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f6c100662f0 0x7f6c100687a0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f6c280090b0 tx=0x7f6c28008030 comp rx=0 tx=0).stop 2023-06-09T04:42:54.624 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.622+0000 7f6c323ef700 1 -- 172.21.15.90:0/4089463664 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6c2c0cd5a0 msgr2=0x7f6c2c0c5cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:54.624 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.622+0000 7f6c323ef700 1 --2- 172.21.15.90:0/4089463664 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6c2c0cd5a0 0x7f6c2c0c5cb0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f6c2400efc0 tx=0x7f6c2400c3a0 comp rx=0 tx=0).stop 2023-06-09T04:42:54.624 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.622+0000 7f6c323ef700 1 -- 172.21.15.90:0/4089463664 shutdown_connections 2023-06-09T04:42:54.625 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.622+0000 7f6c323ef700 1 --2- 172.21.15.90:0/4089463664 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f6c100662f0 0x7f6c100687a0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:54.625 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.622+0000 7f6c323ef700 1 --2- 172.21.15.90:0/4089463664 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6c2c0cd5a0 0x7f6c2c0c5cb0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:54.625 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.622+0000 7f6c323ef700 1 --2- 172.21.15.90:0/4089463664 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6c2c0cb3d0 0x7f6c2c0c3b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:54.625 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.622+0000 7f6c323ef700 1 --2- 172.21.15.90:0/4089463664 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6c2c06a230 0x7f6c2c14d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:54.625 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.622+0000 7f6c323ef700 1 -- 172.21.15.90:0/4089463664 >> 172.21.15.90:0/4089463664 conn(0x7f6c2c0aff00 msgr2=0x7f6c2c0add70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:54.625 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.622+0000 7f6c323ef700 1 -- 172.21.15.90:0/4089463664 shutdown_connections 2023-06-09T04:42:54.626 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.622+0000 7f6c323ef700 1 -- 172.21.15.90:0/4089463664 wait complete. 2023-06-09T04:42:54.643 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-09T04:42:54.810 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.806+0000 7f724b59e700 1 Processor -- start 2023-06-09T04:42:54.810 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.806+0000 7f724b59e700 1 -- start start 2023-06-09T04:42:54.813 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.810+0000 7f724b59e700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f724c0cb3d0 0x7f724c15a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:54.813 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.810+0000 7f724b59e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f724c06a230 0x7f724c0ca2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:54.813 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.810+0000 7f724b59e700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f724c0c8c90 con 0x7f724c0ca7e0 2023-06-09T04:42:54.814 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.810+0000 7f724b59e700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f724c15d9a0 con 0x7f724c0cb3d0 2023-06-09T04:42:54.814 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.810+0000 7f724b59e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f724c15a990 con 0x7f724c06a230 2023-06-09T04:42:54.814 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.810+0000 7f724a59c700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f724c0cb3d0 0x7f724c15a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:54.814 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.810+0000 7f724a59c700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f724c0cb3d0 0x7f724c15a3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:38800/0 (socket says 172.21.15.90:38800) 2023-06-09T04:42:54.814 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.810+0000 7f724a59c700 1 -- 172.21.15.90:0/587679710 learned_addr learned my addr 172.21.15.90:0/587679710 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:54.814 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.810+0000 7f7241d9b700 1 --2- 172.21.15.90:0/587679710 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f724c06a230 0x7f724c0ca2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:54.815 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.810+0000 7f724a59c700 1 -- 172.21.15.90:0/587679710 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f724c06a230 msgr2=0x7f724c0ca2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:54.815 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.810+0000 7f724a59c700 1 --2- 172.21.15.90:0/587679710 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f724c06a230 0x7f724c0ca2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:54.815 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.810+0000 7f724a59c700 1 -- 172.21.15.90:0/587679710 >> v1:172.21.15.174:6789/0 conn(0x7f724c0ca7e0 legacy=0x7f724c0cd5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:54.815 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.810+0000 7f724a59c700 1 -- 172.21.15.90:0/587679710 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f724c15ac70 con 0x7f724c0cb3d0 2023-06-09T04:42:54.816 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.810+0000 7f724a59c700 1 --2- 172.21.15.90:0/587679710 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f724c0cb3d0 0x7f724c15a3b0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f723c009910 tx=0x7f723c009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e683b22d8642883d server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:54.816 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.814+0000 7f7249d9b700 1 -- 172.21.15.90:0/587679710 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f723c011830 con 0x7f724c0cb3d0 2023-06-09T04:42:54.816 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.814+0000 7f7249d9b700 1 -- 172.21.15.90:0/587679710 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f723c011990 con 0x7f724c0cb3d0 2023-06-09T04:42:54.816 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.814+0000 7f7249d9b700 1 -- 172.21.15.90:0/587679710 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f723c011d40 con 0x7f724c0cb3d0 2023-06-09T04:42:54.817 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.814+0000 7f724b59e700 1 -- 172.21.15.90:0/587679710 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f724c0cb3d0 msgr2=0x7f724c15a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:54.817 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.814+0000 7f724b59e700 1 --2- 172.21.15.90:0/587679710 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f724c0cb3d0 0x7f724c15a3b0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f723c009910 tx=0x7f723c009c20 comp rx=0 tx=0).stop 2023-06-09T04:42:54.817 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.814+0000 7f724b59e700 1 -- 172.21.15.90:0/587679710 shutdown_connections 2023-06-09T04:42:54.817 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.814+0000 7f724b59e700 1 --2- 172.21.15.90:0/587679710 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f724c06a230 0x7f724c0ca2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:54.818 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.814+0000 7f724b59e700 1 --2- 172.21.15.90:0/587679710 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f724c0cb3d0 0x7f724c15a3b0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:54.818 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.814+0000 7f724b59e700 1 -- 172.21.15.90:0/587679710 >> 172.21.15.90:0/587679710 conn(0x7f724c0aff00 msgr2=0x7f724c0b0300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:54.818 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.814+0000 7f724b59e700 1 -- 172.21.15.90:0/587679710 shutdown_connections 2023-06-09T04:42:54.818 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.814+0000 7f724b59e700 1 -- 172.21.15.90:0/587679710 wait complete. 2023-06-09T04:42:54.821 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.818+0000 7f724b59e700 1 Processor -- start 2023-06-09T04:42:54.821 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.818+0000 7f724b59e700 1 -- start start 2023-06-09T04:42:54.822 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.818+0000 7f724b59e700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f724c06a230 0x7f724c070c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:54.823 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.818+0000 7f724b59e700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f724c0ca7e0 0x7f724c0c3610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:54.823 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.818+0000 7f724b59e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f724c0cb3d0 0x7f724c149dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:54.823 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.818+0000 7f724b59e700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f724c0c3b50 con 0x7f724c0ca7e0 2023-06-09T04:42:54.823 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.818+0000 7f724b59e700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f724c0c3dd0 con 0x7f724c06a230 2023-06-09T04:42:54.823 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.818+0000 7f724b59e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f724c0c40b0 con 0x7f724c0cb3d0 2023-06-09T04:42:54.824 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.822+0000 7f7241d9b700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f724c0ca7e0 0x7f724c0c3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:54.824 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.822+0000 7f724a59c700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f724c06a230 0x7f724c070c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:54.824 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.822+0000 7f7241d9b700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f724c0ca7e0 0x7f724c0c3610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:38812/0 (socket says 172.21.15.90:38812) 2023-06-09T04:42:54.825 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.822+0000 7f7241d9b700 1 -- 172.21.15.90:0/1764342057 learned_addr learned my addr 172.21.15.90:0/1764342057 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:54.825 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.822+0000 7f724ad9d700 1 --2- 172.21.15.90:0/1764342057 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f724c0cb3d0 0x7f724c149dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:54.825 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.822+0000 7f7241d9b700 1 -- 172.21.15.90:0/1764342057 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f724c0cb3d0 msgr2=0x7f724c149dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:54.825 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.822+0000 7f7241d9b700 1 --2- 172.21.15.90:0/1764342057 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f724c0cb3d0 0x7f724c149dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:54.825 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.822+0000 7f7241d9b700 1 -- 172.21.15.90:0/1764342057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f724c06a230 msgr2=0x7f724c070c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:54.825 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.822+0000 7f7241d9b700 1 --2- 172.21.15.90:0/1764342057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f724c06a230 0x7f724c070c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:54.825 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.822+0000 7f7241d9b700 1 -- 172.21.15.90:0/1764342057 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f723c009570 con 0x7f724c0ca7e0 2023-06-09T04:42:54.826 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.822+0000 7f724ad9d700 1 --2- 172.21.15.90:0/1764342057 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f724c0cb3d0 0x7f724c149dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:42:54.826 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.822+0000 7f7241d9b700 1 --2- 172.21.15.90:0/1764342057 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f724c0ca7e0 0x7f724c0c3610 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f723400e840 tx=0x7f723400eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:54.826 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.822+0000 7f72437fe700 1 -- 172.21.15.90:0/1764342057 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72340095a0 con 0x7f724c0ca7e0 2023-06-09T04:42:54.827 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.822+0000 7f72437fe700 1 -- 172.21.15.90:0/1764342057 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7234013680 con 0x7f724c0ca7e0 2023-06-09T04:42:54.827 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.822+0000 7f72437fe700 1 -- 172.21.15.90:0/1764342057 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72340139f0 con 0x7f724c0ca7e0 2023-06-09T04:42:54.827 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.822+0000 7f724b59e700 1 -- 172.21.15.90:0/1764342057 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f724c0c4390 con 0x7f724c0ca7e0 2023-06-09T04:42:54.827 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.822+0000 7f724b59e700 1 -- 172.21.15.90:0/1764342057 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f724c0c4950 con 0x7f724c0ca7e0 2023-06-09T04:42:54.827 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.822+0000 7f724b59e700 1 -- 172.21.15.90:0/1764342057 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f724c0adbe0 con 0x7f724c0ca7e0 2023-06-09T04:42:54.828 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.826+0000 7f72437fe700 1 -- 172.21.15.90:0/1764342057 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7234013b50 con 0x7f724c0ca7e0 2023-06-09T04:42:54.829 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.826+0000 7f72437fe700 1 --2- 172.21.15.90:0/1764342057 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f722c0662f0 0x7f722c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:54.830 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.826+0000 7f72437fe700 1 -- 172.21.15.90:0/1764342057 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f72340594c0 con 0x7f724c0ca7e0 2023-06-09T04:42:54.830 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.826+0000 7f724a59c700 1 --2- 172.21.15.90:0/1764342057 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f722c0662f0 0x7f722c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:54.831 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.830+0000 7f724a59c700 1 --2- 172.21.15.90:0/1764342057 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f722c0662f0 0x7f722c0687a0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f723c000c00 tx=0x7f723c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:54.837 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.834+0000 7f72437fe700 1 -- 172.21.15.90:0/1764342057 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f72340552d0 con 0x7f724c0ca7e0 2023-06-09T04:42:55.002 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.998+0000 7f724b59e700 1 -- 172.21.15.90:0/1764342057 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f724c04e380 con 0x7f724c0ca7e0 2023-06-09T04:42:55.003 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:54.998+0000 7f72437fe700 1 -- 172.21.15.90:0/1764342057 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v34) v1 ==== 92+0+10 (secure 0 0 0) 0x7f7234021020 con 0x7f724c0ca7e0 2023-06-09T04:42:55.003 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 8 2023-06-09T04:42:55.005 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:55.002+0000 7f724b59e700 1 -- 172.21.15.90:0/1764342057 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f722c0662f0 msgr2=0x7f722c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:55.005 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:55.002+0000 7f724b59e700 1 --2- 172.21.15.90:0/1764342057 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f722c0662f0 0x7f722c0687a0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f723c000c00 tx=0x7f723c008030 comp rx=0 tx=0).stop 2023-06-09T04:42:55.005 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:55.002+0000 7f724b59e700 1 -- 172.21.15.90:0/1764342057 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f724c0ca7e0 msgr2=0x7f724c0c3610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:55.006 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:55.002+0000 7f724b59e700 1 --2- 172.21.15.90:0/1764342057 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f724c0ca7e0 0x7f724c0c3610 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f723400e840 tx=0x7f723400eb50 comp rx=0 tx=0).stop 2023-06-09T04:42:55.006 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:55.002+0000 7f724b59e700 1 -- 172.21.15.90:0/1764342057 shutdown_connections 2023-06-09T04:42:55.006 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:55.002+0000 7f724b59e700 1 --2- 172.21.15.90:0/1764342057 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f722c0662f0 0x7f722c0687a0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:55.006 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:55.002+0000 7f724b59e700 1 --2- 172.21.15.90:0/1764342057 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f724c0cb3d0 0x7f724c149dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:55.006 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:55.002+0000 7f724b59e700 1 --2- 172.21.15.90:0/1764342057 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f724c0ca7e0 0x7f724c0c3610 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:55.006 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:55.002+0000 7f724b59e700 1 --2- 172.21.15.90:0/1764342057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f724c06a230 0x7f724c070c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:55.006 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:55.002+0000 7f724b59e700 1 -- 172.21.15.90:0/1764342057 >> 172.21.15.90:0/1764342057 conn(0x7f724c0aff00 msgr2=0x7f724c0adf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:55.006 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:55.002+0000 7f724b59e700 1 -- 172.21.15.90:0/1764342057 shutdown_connections 2023-06-09T04:42:55.007 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:55.002+0000 7f724b59e700 1 -- 172.21.15.90:0/1764342057 wait complete. 2023-06-09T04:42:55.027 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-06-09T04:42:55.195 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:55.190+0000 7f8796b34700 1 Processor -- start 2023-06-09T04:42:55.195 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:55.194+0000 7f8796b34700 1 -- start start 2023-06-09T04:42:55.197 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:55.194+0000 7f8796b34700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8790154370 0x7f87900c8b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:55.197 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:55.194+0000 7f8796b34700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f87900ca7a0 0x7f87900ad920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:55.197 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:55.194+0000 7f8796b34700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87900cae10 con 0x7f879015da10 2023-06-09T04:42:55.198 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:55.194+0000 7f8796b34700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87900cabf0 con 0x7f87900ca7a0 2023-06-09T04:42:55.198 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:55.194+0000 7f8796b34700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87900cb0f0 con 0x7f8790154370 2023-06-09T04:42:55.198 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:55.194+0000 7f8787fff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f87900ca7a0 0x7f87900ad920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:55.198 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:55.194+0000 7f87948d0700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8790154370 0x7f87900c8b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:55.198 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:55.194+0000 7f8787fff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f87900ca7a0 0x7f87900ad920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.90:46238/0 (socket says 172.21.15.90:46238) 2023-06-09T04:42:55.199 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:55.194+0000 7f87950d1700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f879015da10 0x7f87900b3340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.90:58136/0 (socket says 172.21.15.90:58136) 2023-06-09T04:42:55.199 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:55.194+0000 7f8787fff700 1 -- 172.21.15.90:0/3223773339 learned_addr learned my addr 172.21.15.90:0/3223773339 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:55.199 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:55.198+0000 7f8787fff700 1 -- 172.21.15.90:0/3223773339 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8790154370 msgr2=0x7f87900c8b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:55.199 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:55.198+0000 7f8787fff700 1 --2- 172.21.15.90:0/3223773339 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8790154370 0x7f87900c8b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:55.200 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:55.198+0000 7f8787fff700 1 -- 172.21.15.90:0/3223773339 >> v1:172.21.15.174:6789/0 conn(0x7f879015da10 legacy=0x7f87900b3340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:55.200 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:55.198+0000 7f8787fff700 1 -- 172.21.15.90:0/3223773339 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87900cb3d0 con 0x7f87900ca7a0 2023-06-09T04:42:55.200 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:55.198+0000 7f87877fe700 1 -- 172.21.15.90:0/3223773339 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1679835064 0 0) 0x7f87900cae10 con 0x7f879015da10 2023-06-09T04:42:55.200 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:55.198+0000 7f87948d0700 1 --2- 172.21.15.90:0/3223773339 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8790154370 0x7f87900c8b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:42:55.201 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:55.198+0000 7f8787fff700 1 --2- 172.21.15.90:0/3223773339 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f87900ca7a0 0x7f87900ad920 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f8780009910 tx=0x7f8780009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3520a0d58dbc7802 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:55.201 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:55.198+0000 7f87877fe700 1 -- 172.21.15.90:0/3223773339 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8780011830 con 0x7f87900ca7a0 2023-06-09T04:42:55.201 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:55.198+0000 7f87877fe700 1 -- 172.21.15.90:0/3223773339 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8780011990 con 0x7f87900ca7a0 2023-06-09T04:42:55.201 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:55.198+0000 7f87877fe700 1 -- 172.21.15.90:0/3223773339 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8780011d40 con 0x7f87900ca7a0 2023-06-09T04:42:55.202 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:55.198+0000 7f8796b34700 1 -- 172.21.15.90:0/3223773339 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f87900ca7a0 msgr2=0x7f87900ad920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:55.202 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:55.198+0000 7f8796b34700 1 --2- 172.21.15.90:0/3223773339 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f87900ca7a0 0x7f87900ad920 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f8780009910 tx=0x7f8780009c20 comp rx=0 tx=0).stop 2023-06-09T04:42:55.202 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:55.198+0000 7f8796b34700 1 -- 172.21.15.90:0/3223773339 shutdown_connections 2023-06-09T04:42:55.202 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:55.198+0000 7f8796b34700 1 --2- 172.21.15.90:0/3223773339 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f87900ca7a0 0x7f87900ad920 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:55.202 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:55.198+0000 7f8796b34700 1 --2- 172.21.15.90:0/3223773339 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8790154370 0x7f87900c8b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:55.203 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:55.198+0000 7f8796b34700 1 -- 172.21.15.90:0/3223773339 >> 172.21.15.90:0/3223773339 conn(0x7f879006c810 msgr2=0x7f87900b0000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:55.203 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:55.198+0000 7f8796b34700 1 -- 172.21.15.90:0/3223773339 shutdown_connections 2023-06-09T04:42:55.203 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:55.198+0000 7f8796b34700 1 -- 172.21.15.90:0/3223773339 wait complete. 2023-06-09T04:42:55.203 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:55.202+0000 7f8796b34700 1 Processor -- start 2023-06-09T04:42:55.204 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:55.202+0000 7f8796b34700 1 -- start start 2023-06-09T04:42:55.205 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:55.202+0000 7f8796b34700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f87900ca7a0 0x7f87900b1400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:55.205 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:55.202+0000 7f8796b34700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8790154370 0x7f87901500c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:55.205 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:55.202+0000 7f8796b34700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f879015da10 0x7f879015b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:55.205 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:55.202+0000 7f8796b34700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87900b4200 con 0x7f879015da10 2023-06-09T04:42:55.206 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:55.202+0000 7f8796b34700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87900b1fe0 con 0x7f8790154370 2023-06-09T04:42:55.206 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:55.202+0000 7f8796b34700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87900b3d70 con 0x7f87900ca7a0 2023-06-09T04:42:55.207 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:55.202+0000 7f87950d1700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f879015da10 0x7f879015b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:55.207 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:55.202+0000 7f87950d1700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f879015da10 0x7f879015b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:38824/0 (socket says 172.21.15.90:38824) 2023-06-09T04:42:55.207 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:55.202+0000 7f87950d1700 1 -- 172.21.15.90:0/3074314429 learned_addr learned my addr 172.21.15.90:0/3074314429 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:55.207 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:55.202+0000 7f87948d0700 1 --2- 172.21.15.90:0/3074314429 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f87900ca7a0 0x7f87900b1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:55.208 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:55.202+0000 7f8787fff700 1 --2- 172.21.15.90:0/3074314429 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8790154370 0x7f87901500c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:55.208 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:55.202+0000 7f87950d1700 1 -- 172.21.15.90:0/3074314429 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f87900ca7a0 msgr2=0x7f87900b1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:55.208 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:55.202+0000 7f87950d1700 1 --2- 172.21.15.90:0/3074314429 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f87900ca7a0 0x7f87900b1400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:55.208 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:55.202+0000 7f87950d1700 1 -- 172.21.15.90:0/3074314429 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8790154370 msgr2=0x7f87901500c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:55.208 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:55.202+0000 7f87950d1700 1 --2- 172.21.15.90:0/3074314429 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8790154370 0x7f87901500c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:55.208 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:55.202+0000 7f87950d1700 1 -- 172.21.15.90:0/3074314429 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f878c0094b0 con 0x7f879015da10 2023-06-09T04:42:55.208 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:55.202+0000 7f87950d1700 1 --2- 172.21.15.90:0/3074314429 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f879015da10 0x7f879015b550 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f878800cba0 tx=0x7f878800ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:55.209 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:55.206+0000 7f87857fa700 1 -- 172.21.15.90:0/3074314429 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f878800aaa0 con 0x7f879015da10 2023-06-09T04:42:55.209 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:55.206+0000 7f87857fa700 1 -- 172.21.15.90:0/3074314429 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f878800ac20 con 0x7f879015da10 2023-06-09T04:42:55.209 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:55.206+0000 7f8796b34700 1 -- 172.21.15.90:0/3074314429 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8780009570 con 0x7f879015da10 2023-06-09T04:42:55.209 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:55.206+0000 7f87857fa700 1 -- 172.21.15.90:0/3074314429 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87880070d0 con 0x7f879015da10 2023-06-09T04:42:55.209 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:55.206+0000 7f8796b34700 1 -- 172.21.15.90:0/3074314429 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87901548c0 con 0x7f879015da10 2023-06-09T04:42:55.209 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:55.206+0000 7f8796b34700 1 -- 172.21.15.90:0/3074314429 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f879004db30 con 0x7f879015da10 2023-06-09T04:42:55.210 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:55.206+0000 7f87857fa700 1 -- 172.21.15.90:0/3074314429 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8788007230 con 0x7f879015da10 2023-06-09T04:42:55.212 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:55.210+0000 7f87857fa700 1 --2- 172.21.15.90:0/3074314429 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f877c0662f0 0x7f877c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:55.212 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:55.210+0000 7f87857fa700 1 -- 172.21.15.90:0/3074314429 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f87880836c0 con 0x7f879015da10 2023-06-09T04:42:55.212 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:55.210+0000 7f87948d0700 1 --2- 172.21.15.90:0/3074314429 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f877c0662f0 0x7f877c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:55.214 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:55.210+0000 7f87948d0700 1 --2- 172.21.15.90:0/3074314429 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f877c0662f0 0x7f877c0687a0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f878c009d80 tx=0x7f878c009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:55.220 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:55.214+0000 7f87857fa700 1 -- 172.21.15.90:0/3074314429 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8788050e90 con 0x7f879015da10 2023-06-09T04:42:55.389 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:55.386+0000 7f8796b34700 1 -- 172.21.15.90:0/3074314429 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f87900b3ac0 con 0x7f879015da10 2023-06-09T04:42:55.390 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:55.386+0000 7f87857fa700 1 -- 172.21.15.90:0/3074314429 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v34) v1 ==== 84+0+126 (secure 0 0 0) 0x7f8788018090 con 0x7f879015da10 2023-06-09T04:42:55.391 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:42:55.391 INFO:teuthology.orchestra.run.smithi090.stdout:[ 2023-06-09T04:42:55.391 INFO:teuthology.orchestra.run.smithi090.stdout: { 2023-06-09T04:42:55.391 INFO:teuthology.orchestra.run.smithi090.stdout: "poolnum": 1, 2023-06-09T04:42:55.391 INFO:teuthology.orchestra.run.smithi090.stdout: "poolname": ".mgr" 2023-06-09T04:42:55.392 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2023-06-09T04:42:55.392 INFO:teuthology.orchestra.run.smithi090.stdout: { 2023-06-09T04:42:55.392 INFO:teuthology.orchestra.run.smithi090.stdout: "poolnum": 2, 2023-06-09T04:42:55.392 INFO:teuthology.orchestra.run.smithi090.stdout: "poolname": "rbd" 2023-06-09T04:42:55.392 INFO:teuthology.orchestra.run.smithi090.stdout: } 2023-06-09T04:42:55.392 INFO:teuthology.orchestra.run.smithi090.stdout:] 2023-06-09T04:42:55.394 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:55.390+0000 7f8796b34700 1 -- 172.21.15.90:0/3074314429 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f877c0662f0 msgr2=0x7f877c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:55.394 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:55.390+0000 7f8796b34700 1 --2- 172.21.15.90:0/3074314429 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f877c0662f0 0x7f877c0687a0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f878c009d80 tx=0x7f878c009240 comp rx=0 tx=0).stop 2023-06-09T04:42:55.394 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:55.390+0000 7f8796b34700 1 -- 172.21.15.90:0/3074314429 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f879015da10 msgr2=0x7f879015b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:55.395 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:55.390+0000 7f8796b34700 1 --2- 172.21.15.90:0/3074314429 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f879015da10 0x7f879015b550 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f878800cba0 tx=0x7f878800ceb0 comp rx=0 tx=0).stop 2023-06-09T04:42:55.395 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:55.390+0000 7f8796b34700 1 -- 172.21.15.90:0/3074314429 shutdown_connections 2023-06-09T04:42:55.395 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:55.390+0000 7f8796b34700 1 --2- 172.21.15.90:0/3074314429 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f877c0662f0 0x7f877c0687a0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:55.395 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:55.390+0000 7f8796b34700 1 --2- 172.21.15.90:0/3074314429 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f879015da10 0x7f879015b550 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:55.396 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:55.390+0000 7f8796b34700 1 --2- 172.21.15.90:0/3074314429 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8790154370 0x7f87901500c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:55.396 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:55.390+0000 7f8796b34700 1 --2- 172.21.15.90:0/3074314429 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f87900ca7a0 0x7f87900b1400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:55.396 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:55.390+0000 7f8796b34700 1 -- 172.21.15.90:0/3074314429 >> 172.21.15.90:0/3074314429 conn(0x7f879006c810 msgr2=0x7f8790153960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:55.397 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:55.390+0000 7f8796b34700 1 -- 172.21.15.90:0/3074314429 shutdown_connections 2023-06-09T04:42:55.397 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:55.390+0000 7f8796b34700 1 -- 172.21.15.90:0/3074314429 wait complete. 2023-06-09T04:42:55.414 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-06-09T04:42:55.414 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-06-09T04:42:55.593 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:55.590+0000 7f338266d700 1 Processor -- start 2023-06-09T04:42:55.593 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:55.590+0000 7f338266d700 1 -- start start 2023-06-09T04:42:55.597 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:55.594+0000 7f338266d700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f337c0b17c0 0x7f337c1606d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:55.597 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:55.594+0000 7f338266d700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f337c0cd3d0 0x7f337c0d2520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:55.597 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:55.594+0000 7f338266d700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f337c160c10 con 0x7f337c0b1b90 2023-06-09T04:42:55.598 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:55.594+0000 7f338266d700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f337c0d0110 con 0x7f337c0b17c0 2023-06-09T04:42:55.598 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:55.594+0000 7f338266d700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f337c0d0be0 con 0x7f337c0cd3d0 2023-06-09T04:42:55.598 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:55.594+0000 7f338166b700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f337c0b17c0 0x7f337c1606d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:55.598 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:55.594+0000 7f338166b700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f337c0b17c0 0x7f337c1606d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:38830/0 (socket says 172.21.15.90:38830) 2023-06-09T04:42:55.598 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:55.594+0000 7f338166b700 1 -- 172.21.15.90:0/2853641430 learned_addr learned my addr 172.21.15.90:0/2853641430 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:55.599 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:55.594+0000 7f3380e6a700 1 --2- 172.21.15.90:0/2853641430 >> v2:172.21.15.174:3300/0 conn(0x7f337c0cd3d0 0x7f337c0d2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:55.599 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:55.594+0000 7f338166b700 1 -- 172.21.15.90:0/2853641430 >> v2:172.21.15.174:3300/0 conn(0x7f337c0cd3d0 msgr2=0x7f337c0d2520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:55.599 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:55.594+0000 7f338166b700 1 --2- 172.21.15.90:0/2853641430 >> v2:172.21.15.174:3300/0 conn(0x7f337c0cd3d0 0x7f337c0d2520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:55.600 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:55.594+0000 7f338166b700 1 -- 172.21.15.90:0/2853641430 >> v1:172.21.15.174:6789/0 conn(0x7f337c0b1b90 legacy=0x7f337c0b76c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:55.600 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:55.594+0000 7f338166b700 1 -- 172.21.15.90:0/2853641430 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f337c0d0ec0 con 0x7f337c0b17c0 2023-06-09T04:42:55.600 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:55.598+0000 7f338166b700 1 --2- 172.21.15.90:0/2853641430 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f337c0b17c0 0x7f337c1606d0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f337c08b5f0 tx=0x7f3378009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1399f43af27b1fd0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:55.600 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:55.598+0000 7f3373fff700 1 -- 172.21.15.90:0/2853641430 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3378011830 con 0x7f337c0b17c0 2023-06-09T04:42:55.600 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:55.598+0000 7f3373fff700 1 -- 172.21.15.90:0/2853641430 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3378011990 con 0x7f337c0b17c0 2023-06-09T04:42:55.600 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:55.598+0000 7f3373fff700 1 -- 172.21.15.90:0/2853641430 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3378011d20 con 0x7f337c0b17c0 2023-06-09T04:42:55.601 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:55.598+0000 7f338266d700 1 -- 172.21.15.90:0/2853641430 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f337c0b17c0 msgr2=0x7f337c1606d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:55.601 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:55.598+0000 7f338266d700 1 --2- 172.21.15.90:0/2853641430 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f337c0b17c0 0x7f337c1606d0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f337c08b5f0 tx=0x7f3378009bf0 comp rx=0 tx=0).stop 2023-06-09T04:42:55.601 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:55.598+0000 7f338266d700 1 -- 172.21.15.90:0/2853641430 shutdown_connections 2023-06-09T04:42:55.601 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:55.598+0000 7f338266d700 1 --2- 172.21.15.90:0/2853641430 >> v2:172.21.15.174:3300/0 conn(0x7f337c0cd3d0 0x7f337c0d2520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:55.602 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:55.598+0000 7f338266d700 1 --2- 172.21.15.90:0/2853641430 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f337c0b17c0 0x7f337c1606d0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:55.602 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:55.598+0000 7f338266d700 1 -- 172.21.15.90:0/2853641430 >> 172.21.15.90:0/2853641430 conn(0x7f337c08c080 msgr2=0x7f337c09b9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:55.602 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:55.598+0000 7f338266d700 1 -- 172.21.15.90:0/2853641430 shutdown_connections 2023-06-09T04:42:55.602 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:55.598+0000 7f338266d700 1 -- 172.21.15.90:0/2853641430 wait complete. 2023-06-09T04:42:55.602 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:55.598+0000 7f338266d700 1 Processor -- start 2023-06-09T04:42:55.603 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:55.602+0000 7f338266d700 1 -- start start 2023-06-09T04:42:55.604 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:55.602+0000 7f338266d700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f337c0b17c0 0x7f337c1f26b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:55.604 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:55.602+0000 7f338266d700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f337c0b1b90 0x7f337c15eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:55.604 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:55.602+0000 7f338266d700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f337c0cd3d0 0x7f337c1eeb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:55.604 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:55.602+0000 7f338266d700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f337c1f2bf0 con 0x7f337c0b1b90 2023-06-09T04:42:55.605 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:55.602+0000 7f338266d700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f337c0c9f90 con 0x7f337c0cd3d0 2023-06-09T04:42:55.605 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:55.602+0000 7f338266d700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f337c0ca270 con 0x7f337c0b17c0 2023-06-09T04:42:55.605 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:55.602+0000 7f3380e6a700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f337c0b1b90 0x7f337c15eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:55.606 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:55.602+0000 7f3380e6a700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f337c0b1b90 0x7f337c15eb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:38836/0 (socket says 172.21.15.90:38836) 2023-06-09T04:42:55.606 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:55.602+0000 7f3380e6a700 1 -- 172.21.15.90:0/3983599575 learned_addr learned my addr 172.21.15.90:0/3983599575 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:55.606 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:55.602+0000 7f3381e6c700 1 --2- 172.21.15.90:0/3983599575 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f337c0cd3d0 0x7f337c1eeb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:55.606 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:55.602+0000 7f338166b700 1 --2- 172.21.15.90:0/3983599575 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f337c0b17c0 0x7f337c1f26b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:55.606 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:55.602+0000 7f3380e6a700 1 -- 172.21.15.90:0/3983599575 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f337c0b17c0 msgr2=0x7f337c1f26b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:55.606 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:55.602+0000 7f3380e6a700 1 --2- 172.21.15.90:0/3983599575 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f337c0b17c0 0x7f337c1f26b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:55.607 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:55.602+0000 7f3380e6a700 1 -- 172.21.15.90:0/3983599575 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f337c0cd3d0 msgr2=0x7f337c1eeb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:55.607 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:55.602+0000 7f3380e6a700 1 --2- 172.21.15.90:0/3983599575 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f337c0cd3d0 0x7f337c1eeb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:55.607 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:55.602+0000 7f3380e6a700 1 -- 172.21.15.90:0/3983599575 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3378009570 con 0x7f337c0b1b90 2023-06-09T04:42:55.607 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:55.602+0000 7f338166b700 1 --2- 172.21.15.90:0/3983599575 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f337c0b17c0 0x7f337c1f26b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:42:55.607 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:55.602+0000 7f3380e6a700 1 --2- 172.21.15.90:0/3983599575 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f337c0b1b90 0x7f337c15eb70 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f336c00e840 tx=0x7f336c00ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:55.608 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:55.602+0000 7f3371ffb700 1 -- 172.21.15.90:0/3983599575 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f336c0095a0 con 0x7f337c0b1b90 2023-06-09T04:42:55.608 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:55.602+0000 7f338266d700 1 -- 172.21.15.90:0/3983599575 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f337c0ca550 con 0x7f337c0b1b90 2023-06-09T04:42:55.608 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:55.602+0000 7f338266d700 1 -- 172.21.15.90:0/3983599575 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f337c0cab10 con 0x7f337c0b1b90 2023-06-09T04:42:55.608 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:55.602+0000 7f3371ffb700 1 -- 172.21.15.90:0/3983599575 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f336c005a40 con 0x7f337c0b1b90 2023-06-09T04:42:55.608 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:55.602+0000 7f3371ffb700 1 -- 172.21.15.90:0/3983599575 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f336c005db0 con 0x7f337c0b1b90 2023-06-09T04:42:55.609 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:55.606+0000 7f338266d700 1 -- 172.21.15.90:0/3983599575 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f335c005310 con 0x7f337c0b1b90 2023-06-09T04:42:55.609 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:55.606+0000 7f3371ffb700 1 -- 172.21.15.90:0/3983599575 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f336c00c690 con 0x7f337c0b1b90 2023-06-09T04:42:55.610 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:55.606+0000 7f3371ffb700 1 --2- 172.21.15.90:0/3983599575 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f33600662f0 0x7f33600687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:55.610 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:55.606+0000 7f3371ffb700 1 -- 172.21.15.90:0/3983599575 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f336c0838c0 con 0x7f337c0b1b90 2023-06-09T04:42:55.611 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:55.610+0000 7f338166b700 1 --2- 172.21.15.90:0/3983599575 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f33600662f0 0x7f33600687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:55.612 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:55.610+0000 7f338166b700 1 --2- 172.21.15.90:0/3983599575 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f33600662f0 0x7f33600687a0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f3378000c00 tx=0x7f3378008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:55.617 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:55.614+0000 7f3371ffb700 1 -- 172.21.15.90:0/3983599575 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f336c051030 con 0x7f337c0b1b90 2023-06-09T04:42:55.789 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:55.786+0000 7f338266d700 1 -- 172.21.15.90:0/3983599575 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f335c005180 con 0x7f337c0b1b90 2023-06-09T04:42:56.380 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:56.378+0000 7f3371ffb700 1 -- 172.21.15.90:0/3983599575 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v35) v1 ==== 138+0+0 (secure 0 0 0) 0x7f336c054650 con 0x7f337c0b1b90 2023-06-09T04:42:56.387 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:56.382+0000 7f338266d700 1 -- 172.21.15.90:0/3983599575 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f33600662f0 msgr2=0x7f33600687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:56.387 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:56.382+0000 7f338266d700 1 --2- 172.21.15.90:0/3983599575 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f33600662f0 0x7f33600687a0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f3378000c00 tx=0x7f3378008030 comp rx=0 tx=0).stop 2023-06-09T04:42:56.388 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:56.382+0000 7f338266d700 1 -- 172.21.15.90:0/3983599575 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f337c0b1b90 msgr2=0x7f337c15eb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:56.388 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:56.382+0000 7f338266d700 1 --2- 172.21.15.90:0/3983599575 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f337c0b1b90 0x7f337c15eb70 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f336c00e840 tx=0x7f336c00ec00 comp rx=0 tx=0).stop 2023-06-09T04:42:56.388 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:56.382+0000 7f338266d700 1 -- 172.21.15.90:0/3983599575 shutdown_connections 2023-06-09T04:42:56.388 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:56.386+0000 7f338266d700 1 --2- 172.21.15.90:0/3983599575 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f33600662f0 0x7f33600687a0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:56.388 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:56.386+0000 7f338266d700 1 --2- 172.21.15.90:0/3983599575 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f337c0cd3d0 0x7f337c1eeb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:56.388 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:56.386+0000 7f338266d700 1 --2- 172.21.15.90:0/3983599575 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f337c0b1b90 0x7f337c15eb70 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:56.389 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:56.386+0000 7f338266d700 1 --2- 172.21.15.90:0/3983599575 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f337c0b17c0 0x7f337c1f26b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:56.389 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:56.386+0000 7f338266d700 1 -- 172.21.15.90:0/3983599575 >> 172.21.15.90:0/3983599575 conn(0x7f337c08c080 msgr2=0x7f337c0ce450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:56.391 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:56.386+0000 7f338266d700 1 -- 172.21.15.90:0/3983599575 shutdown_connections 2023-06-09T04:42:56.391 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:56.386+0000 7f338266d700 1 -- 172.21.15.90:0/3983599575 wait complete. 2023-06-09T04:42:56.393 INFO:teuthology.orchestra.run.smithi090.stderr:pool 'cephfs_metadata' created 2023-06-09T04:42:56.411 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-06-09T04:42:56.593 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:56.590+0000 7fde24a16700 1 Processor -- start 2023-06-09T04:42:56.594 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:56.590+0000 7fde24a16700 1 -- start start 2023-06-09T04:42:56.596 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:56.594+0000 7fde24a16700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fde200b18d0 0x7fde20160920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:56.597 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:56.594+0000 7fde24a16700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fde200d2400 0x7fde200d28a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:56.597 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:56.594+0000 7fde24a16700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde2015c6b0 con 0x7fde200b1ca0 2023-06-09T04:42:56.597 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:56.594+0000 7fde24a16700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde200d2de0 con 0x7fde200d2400 2023-06-09T04:42:56.597 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:56.594+0000 7fde24a16700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde200cf6a0 con 0x7fde200b18d0 2023-06-09T04:42:56.598 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:56.594+0000 7fde1effd700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7fde200b1ca0 0x7fde200cee90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:54380/0 (socket says 172.21.15.90:54380) 2023-06-09T04:42:56.598 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:56.594+0000 7fde1effd700 1 -- 172.21.15.90:0/3912204730 learned_addr learned my addr 172.21.15.90:0/3912204730 (peer_addr_for_me v1:172.21.15.90:0/0) 2023-06-09T04:42:56.598 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:56.594+0000 7fde1ffff700 1 --2- 172.21.15.90:0/3912204730 >> v2:172.21.15.90:3300/0 conn(0x7fde200d2400 0x7fde200d28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:56.599 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:56.594+0000 7fde1f7fe700 1 --2- 172.21.15.90:0/3912204730 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fde200b18d0 0x7fde20160920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:56.599 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:56.594+0000 7fde1e7fc700 1 -- 172.21.15.90:0/3912204730 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1368831084 0 0) 0x7fde2015c6b0 con 0x7fde200b1ca0 2023-06-09T04:42:56.599 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:56.594+0000 7fde1e7fc700 1 -- 172.21.15.90:0/3912204730 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde080035d0 con 0x7fde200b1ca0 2023-06-09T04:42:56.599 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:56.594+0000 7fde1f7fe700 1 -- 172.21.15.90:0/3912204730 >> v2:172.21.15.90:3300/0 conn(0x7fde200d2400 msgr2=0x7fde200d28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:56.599 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:56.594+0000 7fde1f7fe700 1 --2- 172.21.15.90:0/3912204730 >> v2:172.21.15.90:3300/0 conn(0x7fde200d2400 0x7fde200d28a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:56.599 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:56.594+0000 7fde1f7fe700 1 -- 172.21.15.90:0/3912204730 >> v1:172.21.15.90:6789/0 conn(0x7fde200b1ca0 legacy=0x7fde200cee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:56.600 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:56.594+0000 7fde1f7fe700 1 -- 172.21.15.90:0/3912204730 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde200cf980 con 0x7fde200b18d0 2023-06-09T04:42:56.600 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:56.594+0000 7fde1ffff700 1 --2- 172.21.15.90:0/3912204730 >> v2:172.21.15.90:3300/0 conn(0x7fde200d2400 0x7fde200d28a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:42:56.601 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:56.594+0000 7fde1f7fe700 1 --2- 172.21.15.90:0/3912204730 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fde200b18d0 0x7fde20160920 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fde10009840 tx=0x7fde10009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3fd8b8995b1cada9 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:56.601 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:56.598+0000 7fde1e7fc700 1 -- 172.21.15.90:0/3912204730 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde10005e50 con 0x7fde200b18d0 2023-06-09T04:42:56.601 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:56.598+0000 7fde1e7fc700 1 -- 172.21.15.90:0/3912204730 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde10006030 con 0x7fde200b18d0 2023-06-09T04:42:56.602 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:56.598+0000 7fde1e7fc700 1 -- 172.21.15.90:0/3912204730 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde100063c0 con 0x7fde200b18d0 2023-06-09T04:42:56.602 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:56.598+0000 7fde24a16700 1 -- 172.21.15.90:0/3912204730 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fde200b18d0 msgr2=0x7fde20160920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:56.602 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:56.598+0000 7fde24a16700 1 --2- 172.21.15.90:0/3912204730 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fde200b18d0 0x7fde20160920 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fde10009840 tx=0x7fde10009b50 comp rx=0 tx=0).stop 2023-06-09T04:42:56.602 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:56.598+0000 7fde24a16700 1 -- 172.21.15.90:0/3912204730 shutdown_connections 2023-06-09T04:42:56.602 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:56.598+0000 7fde24a16700 1 --2- 172.21.15.90:0/3912204730 >> v2:172.21.15.90:3300/0 conn(0x7fde200d2400 0x7fde200d28a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:56.602 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:56.598+0000 7fde24a16700 1 --2- 172.21.15.90:0/3912204730 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fde200b18d0 0x7fde20160920 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:56.602 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:56.598+0000 7fde24a16700 1 -- 172.21.15.90:0/3912204730 >> 172.21.15.90:0/3912204730 conn(0x7fde2009b9b0 msgr2=0x7fde200b55d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:56.603 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:56.598+0000 7fde24a16700 1 -- 172.21.15.90:0/3912204730 shutdown_connections 2023-06-09T04:42:56.603 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:56.598+0000 7fde24a16700 1 -- 172.21.15.90:0/3912204730 wait complete. 2023-06-09T04:42:56.603 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:56.598+0000 7fde24a16700 1 Processor -- start 2023-06-09T04:42:56.603 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:56.598+0000 7fde24a16700 1 -- start start 2023-06-09T04:42:56.604 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:56.602+0000 7fde24a16700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fde200b18d0 0x7fde200ca160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:56.604 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:56.602+0000 7fde24a16700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fde200b1ca0 0x7fde2006ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:56.604 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:56.602+0000 7fde24a16700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fde200d2400 0x7fde201598f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:56.604 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:56.602+0000 7fde24a16700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde200b20e0 con 0x7fde200d2400 2023-06-09T04:42:56.605 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:56.602+0000 7fde24a16700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde200b2980 con 0x7fde200b18d0 2023-06-09T04:42:56.605 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:56.602+0000 7fde24a16700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde200ca6a0 con 0x7fde200b1ca0 2023-06-09T04:42:56.606 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:56.602+0000 7fde1ffff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fde200d2400 0x7fde201598f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:56.606 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:56.602+0000 7fde1ffff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fde200d2400 0x7fde201598f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:44310/0 (socket says 172.21.15.90:44310) 2023-06-09T04:42:56.606 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:56.602+0000 7fde1ffff700 1 -- 172.21.15.90:0/2609935063 learned_addr learned my addr 172.21.15.90:0/2609935063 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:56.606 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:56.602+0000 7fde1effd700 1 --2- 172.21.15.90:0/2609935063 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fde200b1ca0 0x7fde2006ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:56.606 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:56.602+0000 7fde1f7fe700 1 --2- 172.21.15.90:0/2609935063 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fde200b18d0 0x7fde200ca160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:56.606 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:56.602+0000 7fde1ffff700 1 -- 172.21.15.90:0/2609935063 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fde200b1ca0 msgr2=0x7fde2006ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:56.606 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:56.602+0000 7fde1ffff700 1 --2- 172.21.15.90:0/2609935063 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fde200b1ca0 0x7fde2006ac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:56.607 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:56.602+0000 7fde1ffff700 1 -- 172.21.15.90:0/2609935063 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fde200b18d0 msgr2=0x7fde200ca160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:56.607 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:56.602+0000 7fde1ffff700 1 --2- 172.21.15.90:0/2609935063 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fde200b18d0 0x7fde200ca160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:56.607 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:56.602+0000 7fde1ffff700 1 -- 172.21.15.90:0/2609935063 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde18009a70 con 0x7fde200d2400 2023-06-09T04:42:56.607 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:56.602+0000 7fde1effd700 1 --2- 172.21.15.90:0/2609935063 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fde200b1ca0 0x7fde2006ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:42:56.607 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:56.602+0000 7fde1ffff700 1 --2- 172.21.15.90:0/2609935063 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fde200d2400 0x7fde201598f0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fde18009e60 tx=0x7fde1800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:56.608 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:56.602+0000 7fde07fff700 1 -- 172.21.15.90:0/2609935063 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde18009cd0 con 0x7fde200d2400 2023-06-09T04:42:56.608 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:56.602+0000 7fde07fff700 1 -- 172.21.15.90:0/2609935063 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde1800f040 con 0x7fde200d2400 2023-06-09T04:42:56.608 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:56.602+0000 7fde07fff700 1 -- 172.21.15.90:0/2609935063 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde1800ccb0 con 0x7fde200d2400 2023-06-09T04:42:56.608 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:56.602+0000 7fde24a16700 1 -- 172.21.15.90:0/2609935063 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde10009450 con 0x7fde200d2400 2023-06-09T04:42:56.608 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:56.602+0000 7fde24a16700 1 -- 172.21.15.90:0/2609935063 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde200b2330 con 0x7fde200d2400 2023-06-09T04:42:56.609 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:56.606+0000 7fde24a16700 1 -- 172.21.15.90:0/2609935063 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde200b2b10 con 0x7fde200d2400 2023-06-09T04:42:56.609 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:56.606+0000 7fde07fff700 1 -- 172.21.15.90:0/2609935063 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fde18014480 con 0x7fde200d2400 2023-06-09T04:42:56.610 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:56.606+0000 7fde07fff700 1 --2- 172.21.15.90:0/2609935063 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fde0c0662f0 0x7fde0c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:56.611 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:56.610+0000 7fde07fff700 1 -- 172.21.15.90:0/2609935063 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5580+0+0 (secure 0 0 0) 0x7fde18084090 con 0x7fde200d2400 2023-06-09T04:42:56.611 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:56.610+0000 7fde1f7fe700 1 --2- 172.21.15.90:0/2609935063 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fde0c0662f0 0x7fde0c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:56.613 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:56.610+0000 7fde1f7fe700 1 --2- 172.21.15.90:0/2609935063 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fde0c0662f0 0x7fde0c0687a0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fde10009b90 tx=0x7fde10008070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:56.618 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:56.614+0000 7fde07fff700 1 -- 172.21.15.90:0/2609935063 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fde18055170 con 0x7fde200d2400 2023-06-09T04:42:56.788 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:56.786+0000 7fde24a16700 1 -- 172.21.15.90:0/2609935063 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fde2004e380 con 0x7fde200d2400 2023-06-09T04:42:57.394 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:57.390+0000 7fde07fff700 1 -- 172.21.15.90:0/2609935063 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v36) v1 ==== 170+0+0 (secure 0 0 0) 0x7fde18054d00 con 0x7fde200d2400 2023-06-09T04:42:57.401 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:57.398+0000 7fde24a16700 1 -- 172.21.15.90:0/2609935063 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fde0c0662f0 msgr2=0x7fde0c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:57.401 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:57.398+0000 7fde24a16700 1 --2- 172.21.15.90:0/2609935063 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fde0c0662f0 0x7fde0c0687a0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fde10009b90 tx=0x7fde10008070 comp rx=0 tx=0).stop 2023-06-09T04:42:57.401 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:57.398+0000 7fde24a16700 1 -- 172.21.15.90:0/2609935063 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fde200d2400 msgr2=0x7fde201598f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:57.402 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:57.398+0000 7fde24a16700 1 --2- 172.21.15.90:0/2609935063 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fde200d2400 0x7fde201598f0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fde18009e60 tx=0x7fde1800c3a0 comp rx=0 tx=0).stop 2023-06-09T04:42:57.403 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:57.398+0000 7fde24a16700 1 -- 172.21.15.90:0/2609935063 shutdown_connections 2023-06-09T04:42:57.403 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:57.398+0000 7fde24a16700 1 --2- 172.21.15.90:0/2609935063 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fde0c0662f0 0x7fde0c0687a0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:57.403 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:57.398+0000 7fde24a16700 1 --2- 172.21.15.90:0/2609935063 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fde200d2400 0x7fde201598f0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:57.403 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:57.398+0000 7fde24a16700 1 --2- 172.21.15.90:0/2609935063 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fde200b1ca0 0x7fde2006ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:57.403 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:57.398+0000 7fde24a16700 1 --2- 172.21.15.90:0/2609935063 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fde200b18d0 0x7fde200ca160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:57.403 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:57.398+0000 7fde24a16700 1 -- 172.21.15.90:0/2609935063 >> 172.21.15.90:0/2609935063 conn(0x7fde2009b9b0 msgr2=0x7fde2015bbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:57.404 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:57.398+0000 7fde24a16700 1 -- 172.21.15.90:0/2609935063 shutdown_connections 2023-06-09T04:42:57.404 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:57.402+0000 7fde24a16700 1 -- 172.21.15.90:0/2609935063 wait complete. 2023-06-09T04:42:57.411 INFO:teuthology.orchestra.run.smithi090.stderr:pool 'cephfs_data' created 2023-06-09T04:42:57.435 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-06-09T04:42:57.604 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:57.602+0000 7fec058df700 1 Processor -- start 2023-06-09T04:42:57.604 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:57.602+0000 7fec058df700 1 -- start start 2023-06-09T04:42:57.607 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:57.602+0000 7fec058df700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fec0015c2a0 0x7fec0006a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:57.607 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:57.602+0000 7fec058df700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fec0015fc70 0x7fec001600d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:57.607 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:57.602+0000 7fec058df700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fec00160610 0x7fec0015c670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:57.607 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:57.602+0000 7fec058df700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec0006a9f0 con 0x7fec0015c2a0 2023-06-09T04:42:57.607 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:57.602+0000 7fec058df700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec000ce060 con 0x7fec0015fc70 2023-06-09T04:42:57.607 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:57.602+0000 7fec058df700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec00160a90 con 0x7fec00160610 2023-06-09T04:42:57.608 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:57.606+0000 7febff7fe700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fec00160610 0x7fec0015c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:57.608 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:57.606+0000 7febfeffd700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fec0015c2a0 0x7fec0006a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:57.609 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:57.606+0000 7febff7fe700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fec00160610 0x7fec0015c670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.90:46832/0 (socket says 172.21.15.90:46832) 2023-06-09T04:42:57.609 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:57.606+0000 7febff7fe700 1 -- 172.21.15.90:0/3247945310 learned_addr learned my addr 172.21.15.90:0/3247945310 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:57.609 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:57.606+0000 7febfe7fc700 1 --2- 172.21.15.90:0/3247945310 >> v2:172.21.15.174:3300/0 conn(0x7fec0015fc70 0x7fec001600d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:57.609 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:57.606+0000 7febff7fe700 1 -- 172.21.15.90:0/3247945310 >> v2:172.21.15.174:3300/0 conn(0x7fec0015fc70 msgr2=0x7fec001600d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:57.609 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:57.606+0000 7febff7fe700 1 --2- 172.21.15.90:0/3247945310 >> v2:172.21.15.174:3300/0 conn(0x7fec0015fc70 0x7fec001600d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:57.609 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:57.606+0000 7febff7fe700 1 -- 172.21.15.90:0/3247945310 >> v2:172.21.15.90:3300/0 conn(0x7fec0015c2a0 msgr2=0x7fec0006a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:57.609 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:57.606+0000 7febff7fe700 1 --2- 172.21.15.90:0/3247945310 >> v2:172.21.15.90:3300/0 conn(0x7fec0015c2a0 0x7fec0006a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:57.609 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:57.606+0000 7febff7fe700 1 -- 172.21.15.90:0/3247945310 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec000ce270 con 0x7fec00160610 2023-06-09T04:42:57.610 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:57.606+0000 7febfe7fc700 1 --2- 172.21.15.90:0/3247945310 >> v2:172.21.15.174:3300/0 conn(0x7fec0015fc70 0x7fec001600d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:42:57.611 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:57.606+0000 7febff7fe700 1 --2- 172.21.15.90:0/3247945310 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fec00160610 0x7fec0015c670 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fec000cd370 tx=0x7febf800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5307633e47ed0755 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:57.611 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:57.606+0000 7febfdffb700 1 -- 172.21.15.90:0/3247945310 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febf800e070 con 0x7fec00160610 2023-06-09T04:42:57.611 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:57.606+0000 7febfdffb700 1 -- 172.21.15.90:0/3247945310 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febf800b910 con 0x7fec00160610 2023-06-09T04:42:57.611 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:57.606+0000 7febfdffb700 1 -- 172.21.15.90:0/3247945310 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febf800bcc0 con 0x7fec00160610 2023-06-09T04:42:57.611 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:57.606+0000 7fec058df700 1 -- 172.21.15.90:0/3247945310 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fec00160610 msgr2=0x7fec0015c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:57.612 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:57.606+0000 7fec058df700 1 --2- 172.21.15.90:0/3247945310 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fec00160610 0x7fec0015c670 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fec000cd370 tx=0x7febf800b330 comp rx=0 tx=0).stop 2023-06-09T04:42:57.612 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:57.606+0000 7fec058df700 1 -- 172.21.15.90:0/3247945310 shutdown_connections 2023-06-09T04:42:57.612 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:57.606+0000 7fec058df700 1 --2- 172.21.15.90:0/3247945310 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fec00160610 0x7fec0015c670 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:57.612 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:57.606+0000 7fec058df700 1 --2- 172.21.15.90:0/3247945310 >> v2:172.21.15.174:3300/0 conn(0x7fec0015fc70 0x7fec001600d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:57.612 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:57.606+0000 7fec058df700 1 --2- 172.21.15.90:0/3247945310 >> v2:172.21.15.90:3300/0 conn(0x7fec0015c2a0 0x7fec0006a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:57.612 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:57.606+0000 7fec058df700 1 -- 172.21.15.90:0/3247945310 >> 172.21.15.90:0/3247945310 conn(0x7fec000b4ee0 msgr2=0x7fec000d2720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:57.613 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:57.606+0000 7fec058df700 1 -- 172.21.15.90:0/3247945310 shutdown_connections 2023-06-09T04:42:57.613 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:57.606+0000 7fec058df700 1 -- 172.21.15.90:0/3247945310 wait complete. 2023-06-09T04:42:57.614 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:57.610+0000 7fec058df700 1 Processor -- start 2023-06-09T04:42:57.615 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:57.614+0000 7fec058df700 1 -- start start 2023-06-09T04:42:57.616 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:57.614+0000 7fec058df700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fec0015c2a0 0x7fec00154510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:57.616 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:57.614+0000 7fec058df700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fec0015fc70 0x7fec0015d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:57.616 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:57.614+0000 7fec058df700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fec00160610 0x7fec000cac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:57.616 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:57.614+0000 7fec058df700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec000ca7e0 con 0x7fec00160610 2023-06-09T04:42:57.617 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:57.614+0000 7fec058df700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec001542b0 con 0x7fec0015c2a0 2023-06-09T04:42:57.617 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:57.614+0000 7fec058df700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec000c9bd0 con 0x7fec0015fc70 2023-06-09T04:42:57.618 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:57.614+0000 7febff7fe700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fec00160610 0x7fec000cac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:57.618 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:57.614+0000 7febff7fe700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fec00160610 0x7fec000cac70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:44324/0 (socket says 172.21.15.90:44324) 2023-06-09T04:42:57.618 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:57.614+0000 7febff7fe700 1 -- 172.21.15.90:0/1022652864 learned_addr learned my addr 172.21.15.90:0/1022652864 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:57.618 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:57.614+0000 7febfe7fc700 1 --2- 172.21.15.90:0/1022652864 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fec0015fc70 0x7fec0015d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:57.618 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:57.614+0000 7febfeffd700 1 --2- 172.21.15.90:0/1022652864 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fec0015c2a0 0x7fec00154510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:57.618 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:57.614+0000 7febff7fe700 1 -- 172.21.15.90:0/1022652864 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fec0015fc70 msgr2=0x7fec0015d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:57.619 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:57.614+0000 7febff7fe700 1 --2- 172.21.15.90:0/1022652864 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fec0015fc70 0x7fec0015d020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:57.619 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:57.614+0000 7febff7fe700 1 -- 172.21.15.90:0/1022652864 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fec0015c2a0 msgr2=0x7fec00154510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:57.619 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:57.614+0000 7febff7fe700 1 --2- 172.21.15.90:0/1022652864 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fec0015c2a0 0x7fec00154510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:57.619 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:57.614+0000 7febff7fe700 1 -- 172.21.15.90:0/1022652864 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febf8009b30 con 0x7fec00160610 2023-06-09T04:42:57.619 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:57.614+0000 7febfeffd700 1 --2- 172.21.15.90:0/1022652864 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fec0015c2a0 0x7fec00154510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:42:57.620 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:57.614+0000 7febff7fe700 1 --2- 172.21.15.90:0/1022652864 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fec00160610 0x7fec000cac70 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fec00160bd0 tx=0x7febf8004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:57.620 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:57.614+0000 7febe7fff700 1 -- 172.21.15.90:0/1022652864 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febf80099b0 con 0x7fec00160610 2023-06-09T04:42:57.620 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:57.614+0000 7febe7fff700 1 -- 172.21.15.90:0/1022652864 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febf8004250 con 0x7fec00160610 2023-06-09T04:42:57.620 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:57.614+0000 7febe7fff700 1 -- 172.21.15.90:0/1022652864 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febf8004600 con 0x7fec00160610 2023-06-09T04:42:57.620 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:57.614+0000 7fec058df700 1 -- 172.21.15.90:0/1022652864 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec000c9eb0 con 0x7fec00160610 2023-06-09T04:42:57.621 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:57.618+0000 7fec058df700 1 -- 172.21.15.90:0/1022652864 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec000ca470 con 0x7fec00160610 2023-06-09T04:42:57.621 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:57.618+0000 7fec058df700 1 -- 172.21.15.90:0/1022652864 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec0004e380 con 0x7fec00160610 2023-06-09T04:42:57.622 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:57.618+0000 7febe7fff700 1 -- 172.21.15.90:0/1022652864 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7febf8004760 con 0x7fec00160610 2023-06-09T04:42:57.624 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:57.622+0000 7febe7fff700 1 --2- 172.21.15.90:0/1022652864 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7febec066320 0x7febec0687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:57.624 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:57.622+0000 7febe7fff700 1 -- 172.21.15.90:0/1022652864 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5962+0+0 (secure 0 0 0) 0x7febf80854d0 con 0x7fec00160610 2023-06-09T04:42:57.625 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:57.622+0000 7febfeffd700 1 --2- 172.21.15.90:0/1022652864 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7febec066320 0x7febec0687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:57.626 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:57.622+0000 7febfeffd700 1 --2- 172.21.15.90:0/1022652864 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7febec066320 0x7febec0687d0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7febf0009bc0 tx=0x7febf0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:57.630 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:57.626+0000 7febe7fff700 1 -- 172.21.15.90:0/1022652864 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7febf80529c0 con 0x7fec00160610 2023-06-09T04:42:57.838 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:57.834+0000 7fec058df700 1 -- 172.21.15.90:0/1022652864 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fec000ccf20 con 0x7fec00160610 2023-06-09T04:42:57.850 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:57.846+0000 7febe7fff700 1 -- 172.21.15.90:0/1022652864 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v12) v1 ==== 172+0+0 (secure 0 0 0) 0x7febf8055fe0 con 0x7fec00160610 2023-06-09T04:42:57.857 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:57.854+0000 7fec058df700 1 -- 172.21.15.90:0/1022652864 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7febec066320 msgr2=0x7febec0687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:57.857 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:57.854+0000 7fec058df700 1 --2- 172.21.15.90:0/1022652864 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7febec066320 0x7febec0687d0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7febf0009bc0 tx=0x7febf0008040 comp rx=0 tx=0).stop 2023-06-09T04:42:57.857 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:57.854+0000 7fec058df700 1 -- 172.21.15.90:0/1022652864 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fec00160610 msgr2=0x7fec000cac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:57.858 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:57.854+0000 7fec058df700 1 --2- 172.21.15.90:0/1022652864 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fec00160610 0x7fec000cac70 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fec00160bd0 tx=0x7febf8004af0 comp rx=0 tx=0).stop 2023-06-09T04:42:57.859 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:57.854+0000 7fec058df700 1 -- 172.21.15.90:0/1022652864 shutdown_connections 2023-06-09T04:42:57.859 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:57.854+0000 7fec058df700 1 --2- 172.21.15.90:0/1022652864 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7febec066320 0x7febec0687d0 secure :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7febf0009bc0 tx=0x7febf0008040 comp rx=0 tx=0).stop 2023-06-09T04:42:57.859 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:57.854+0000 7fec058df700 1 --2- 172.21.15.90:0/1022652864 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fec00160610 0x7fec000cac70 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:57.859 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:57.854+0000 7fec058df700 1 --2- 172.21.15.90:0/1022652864 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fec0015fc70 0x7fec0015d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:57.859 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:57.854+0000 7fec058df700 1 --2- 172.21.15.90:0/1022652864 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fec0015c2a0 0x7fec00154510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:57.859 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:57.854+0000 7fec058df700 1 -- 172.21.15.90:0/1022652864 >> 172.21.15.90:0/1022652864 conn(0x7fec000b4ee0 msgr2=0x7fec000b5550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:57.860 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:57.858+0000 7fec058df700 1 -- 172.21.15.90:0/1022652864 shutdown_connections 2023-06-09T04:42:57.860 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:57.858+0000 7fec058df700 1 -- 172.21.15.90:0/1022652864 wait complete. 2023-06-09T04:42:57.877 INFO:teuthology.orchestra.run.smithi090.stderr:new fs with metadata pool 5 and data pool 6 2023-06-09T04:42:57.897 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T04:42:58.061 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.058+0000 7faa4a977700 1 Processor -- start 2023-06-09T04:42:58.062 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.058+0000 7faa4a977700 1 -- start start 2023-06-09T04:42:58.064 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.062+0000 7faa4a977700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faa4415c2a0 0x7faa4406a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:58.065 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.062+0000 7faa4a977700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7faa441607b0 0x7faa440d06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:58.065 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.062+0000 7faa4a977700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa440ce270 con 0x7faa4415fc70 2023-06-09T04:42:58.065 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.062+0000 7faa4a977700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa4406a9f0 con 0x7faa441607b0 2023-06-09T04:42:58.065 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.062+0000 7faa4a977700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa440ce060 con 0x7faa4415c2a0 2023-06-09T04:42:58.066 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.062+0000 7faa4a176700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7faa441607b0 0x7faa440d06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:58.066 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.062+0000 7faa49174700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7faa4415fc70 0x7faa441600a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:54390/0 (socket says 172.21.15.90:54390) 2023-06-09T04:42:58.066 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.062+0000 7faa49174700 1 -- 172.21.15.90:0/515568084 learned_addr learned my addr 172.21.15.90:0/515568084 (peer_addr_for_me v1:172.21.15.90:0/0) 2023-06-09T04:42:58.066 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.062+0000 7faa4a176700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7faa441607b0 0x7faa440d06d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:44332/0 (socket says 172.21.15.90:44332) 2023-06-09T04:42:58.066 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.062+0000 7faa49975700 1 --2- 172.21.15.90:0/515568084 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faa4415c2a0 0x7faa4406a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:58.067 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.062+0000 7faa4a176700 1 -- 172.21.15.90:0/515568084 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faa4415c2a0 msgr2=0x7faa4406a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:58.067 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.062+0000 7faa4a176700 1 --2- 172.21.15.90:0/515568084 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faa4415c2a0 0x7faa4406a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:58.067 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.062+0000 7faa4a176700 1 -- 172.21.15.90:0/515568084 >> v1:172.21.15.90:6789/0 conn(0x7faa4415fc70 legacy=0x7faa441600a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:58.067 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.062+0000 7faa4a176700 1 -- 172.21.15.90:0/515568084 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa440ce550 con 0x7faa441607b0 2023-06-09T04:42:58.068 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.062+0000 7faa4a176700 1 --2- 172.21.15.90:0/515568084 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faa441607b0 0x7faa440d06d0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7faa3c009d90 tx=0x7faa3c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3565c6ab0415a880 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:58.068 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.062+0000 7faa48973700 1 -- 172.21.15.90:0/515568084 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa3c00e070 con 0x7faa441607b0 2023-06-09T04:42:58.068 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.062+0000 7faa48973700 1 -- 172.21.15.90:0/515568084 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa3c00bb20 con 0x7faa441607b0 2023-06-09T04:42:58.068 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.062+0000 7faa48973700 1 -- 172.21.15.90:0/515568084 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa3c012430 con 0x7faa441607b0 2023-06-09T04:42:58.068 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.066+0000 7faa4a977700 1 -- 172.21.15.90:0/515568084 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faa441607b0 msgr2=0x7faa440d06d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:58.068 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.066+0000 7faa4a977700 1 --2- 172.21.15.90:0/515568084 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faa441607b0 0x7faa440d06d0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7faa3c009d90 tx=0x7faa3c00b330 comp rx=0 tx=0).stop 2023-06-09T04:42:58.069 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.066+0000 7faa4a977700 1 -- 172.21.15.90:0/515568084 shutdown_connections 2023-06-09T04:42:58.069 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.066+0000 7faa4a977700 1 --2- 172.21.15.90:0/515568084 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faa441607b0 0x7faa440d06d0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:58.069 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.066+0000 7faa4a977700 1 --2- 172.21.15.90:0/515568084 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faa4415c2a0 0x7faa4406a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:58.069 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.066+0000 7faa4a977700 1 -- 172.21.15.90:0/515568084 >> 172.21.15.90:0/515568084 conn(0x7faa440b4ee0 msgr2=0x7faa440d2720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:58.069 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.066+0000 7faa4a977700 1 -- 172.21.15.90:0/515568084 shutdown_connections 2023-06-09T04:42:58.070 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.066+0000 7faa4a977700 1 -- 172.21.15.90:0/515568084 wait complete. 2023-06-09T04:42:58.071 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.070+0000 7faa4a977700 1 Processor -- start 2023-06-09T04:42:58.071 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.070+0000 7faa4a977700 1 -- start start 2023-06-09T04:42:58.072 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.070+0000 7faa4a977700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faa4415c2a0 0x7faa44158100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:58.073 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.070+0000 7faa4a977700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faa4415fc70 0x7faa44153b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:58.073 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.070+0000 7faa4a977700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faa441607b0 0x7faa440b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:58.073 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.070+0000 7faa4a977700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa440c6e30 con 0x7faa4415c2a0 2023-06-09T04:42:58.073 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.070+0000 7faa4a977700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa440c61f0 con 0x7faa4415fc70 2023-06-09T04:42:58.073 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.070+0000 7faa4a977700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa440c6490 con 0x7faa441607b0 2023-06-09T04:42:58.074 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.070+0000 7faa49975700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faa4415c2a0 0x7faa44158100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:58.074 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.070+0000 7faa49975700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faa4415c2a0 0x7faa44158100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:44336/0 (socket says 172.21.15.90:44336) 2023-06-09T04:42:58.075 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.070+0000 7faa49975700 1 -- 172.21.15.90:0/3582523997 learned_addr learned my addr 172.21.15.90:0/3582523997 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:58.075 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.070+0000 7faa49174700 1 --2- 172.21.15.90:0/3582523997 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faa4415fc70 0x7faa44153b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:58.075 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.070+0000 7faa4a176700 1 --2- 172.21.15.90:0/3582523997 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faa441607b0 0x7faa440b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:58.075 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.070+0000 7faa49975700 1 -- 172.21.15.90:0/3582523997 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faa441607b0 msgr2=0x7faa440b7040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:58.075 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.070+0000 7faa49975700 1 --2- 172.21.15.90:0/3582523997 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faa441607b0 0x7faa440b7040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:58.075 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.070+0000 7faa49975700 1 -- 172.21.15.90:0/3582523997 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faa4415fc70 msgr2=0x7faa44153b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:58.075 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.070+0000 7faa49975700 1 --2- 172.21.15.90:0/3582523997 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faa4415fc70 0x7faa44153b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:58.076 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.070+0000 7faa49975700 1 -- 172.21.15.90:0/3582523997 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa3c009a70 con 0x7faa4415c2a0 2023-06-09T04:42:58.076 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.070+0000 7faa49975700 1 --2- 172.21.15.90:0/3582523997 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faa4415c2a0 0x7faa44158100 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7faa4000e9d0 tx=0x7faa4000ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:58.076 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.070+0000 7faa3a7fc700 1 -- 172.21.15.90:0/3582523997 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa40009720 con 0x7faa4415c2a0 2023-06-09T04:42:58.077 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.070+0000 7faa3a7fc700 1 -- 172.21.15.90:0/3582523997 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa4000ee70 con 0x7faa4415c2a0 2023-06-09T04:42:58.077 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.070+0000 7faa3a7fc700 1 -- 172.21.15.90:0/3582523997 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa4000ca50 con 0x7faa4415c2a0 2023-06-09T04:42:58.077 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.070+0000 7faa4a977700 1 -- 172.21.15.90:0/3582523997 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa440c6770 con 0x7faa4415c2a0 2023-06-09T04:42:58.077 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.074+0000 7faa4a977700 1 -- 172.21.15.90:0/3582523997 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa44154080 con 0x7faa4415c2a0 2023-06-09T04:42:58.078 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.074+0000 7faa4a977700 1 -- 172.21.15.90:0/3582523997 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa440c70a0 con 0x7faa4415c2a0 2023-06-09T04:42:58.078 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.074+0000 7faa3a7fc700 1 -- 172.21.15.90:0/3582523997 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7faa4000cbb0 con 0x7faa4415c2a0 2023-06-09T04:42:58.080 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.078+0000 7faa3a7fc700 1 --2- 172.21.15.90:0/3582523997 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7faa28066320 0x7faa280687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:58.080 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.078+0000 7faa3a7fc700 1 -- 172.21.15.90:0/3582523997 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7faa40083ce0 con 0x7faa4415c2a0 2023-06-09T04:42:58.081 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.078+0000 7faa49174700 1 --2- 172.21.15.90:0/3582523997 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7faa28066320 0x7faa280687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:58.082 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.078+0000 7faa49174700 1 --2- 172.21.15.90:0/3582523997 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7faa28066320 0x7faa280687d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7faa440b6fd0 tx=0x7faa34009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:58.086 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.082+0000 7faa3a7fc700 1 -- 172.21.15.90:0/3582523997 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7faa40054b50 con 0x7faa4415c2a0 2023-06-09T04:42:58.259 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.254+0000 7faa4a977700 1 -- 172.21.15.90:0/3582523997 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faa4404e380 con 0x7faa4415c2a0 2023-06-09T04:42:58.261 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.258+0000 7faa3a7fc700 1 -- 172.21.15.90:0/3582523997 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+18364 (secure 0 0 0) 0x7faa4000ce60 con 0x7faa4415c2a0 2023-06-09T04:42:58.262 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:42:58.262 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":37,"fsid":"700369c0-a111-43b4-9415-844ad1742b70","created":"2023-06-09T04:41:28.180311+0000","modified":"2023-06-09T04:42:57.839265+0000","last_up_change":"2023-06-09T04:41:40.746475+0000","last_in_change":"2023-06-09T04:41:31.262765+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-09T04:41:42.402564+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-09T04:41:47.607323+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-06-09T04:42:55.855674+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-06-09T04:42:56.846984+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"46a4a7c5-babd-4ef3-9830-51487cff5eb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":2780271267},{"type":"v1","addr":"172.21.15.90:6809","nonce":2780271267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2780271267},{"type":"v1","addr":"172.21.15.90:6811","nonce":2780271267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2780271267},{"type":"v1","addr":"172.21.15.90:6815","nonce":2780271267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2780271267},{"type":"v1","addr":"172.21.15.90:6813","nonce":2780271267}]},"public_addr":"172.21.15.90:6809/2780271267","cluster_addr":"172.21.15.90:6811/2780271267","heartbeat_back_addr":"172.21.15.90:6815/2780271267","heartbeat_front_addr":"172.21.15.90:6813/2780271267","state":["exists","up"]},{"osd":1,"uuid":"1543988f-c498-494a-a6f9-fac8413db6ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":3064028136},{"type":"v1","addr":"172.21.15.90:6801","nonce":3064028136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":3064028136},{"type":"v1","addr":"172.21.15.90:6803","nonce":3064028136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":3064028136},{"type":"v1","addr":"172.21.15.90:6807","nonce":3064028136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":3064028136},{"type":"v1","addr":"172.21.15.90:6805","nonce":3064028136}]},"public_addr":"172.21.15.90:6801/3064028136","cluster_addr":"172.21.15.90:6803/3064028136","heartbeat_back_addr":"172.21.15.90:6807/3064028136","heartbeat_front_addr":"172.21.15.90:6805/3064028136","state":["exists","up"]},{"osd":2,"uuid":"79669dd6-ffc8-4197-b9f7-b3b372b2b9b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":3713146326},{"type":"v1","addr":"172.21.15.90:6825","nonce":3713146326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":3713146326},{"type":"v1","addr":"172.21.15.90:6827","nonce":3713146326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":3713146326},{"type":"v1","addr":"172.21.15.90:6831","nonce":3713146326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":3713146326},{"type":"v1","addr":"172.21.15.90:6829","nonce":3713146326}]},"public_addr":"172.21.15.90:6825/3713146326","cluster_addr":"172.21.15.90:6827/3713146326","heartbeat_back_addr":"172.21.15.90:6831/3713146326","heartbeat_front_addr":"172.21.15.90:6829/3713146326","state":["exists","up"]},{"osd":3,"uuid":"4062ab6f-ce40-450a-aa17-b10098766c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":3499839122},{"type":"v1","addr":"172.21.15.90:6817","nonce":3499839122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":3499839122},{"type":"v1","addr":"172.21.15.90:6819","nonce":3499839122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":3499839122},{"type":"v1","addr":"172.21.15.90:6823","nonce":3499839122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":3499839122},{"type":"v1","addr":"172.21.15.90:6821","nonce":3499839122}]},"public_addr":"172.21.15.90:6817/3499839122","cluster_addr":"172.21.15.90:6819/3499839122","heartbeat_back_addr":"172.21.15.90:6823/3499839122","heartbeat_front_addr":"172.21.15.90:6821/3499839122","state":["exists","up"]},{"osd":4,"uuid":"a10820e4-b348-4d92-9796-3b01484ace1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6817","nonce":1138565854},{"type":"v1","addr":"172.21.15.174:6819","nonce":1138565854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6821","nonce":1138565854},{"type":"v1","addr":"172.21.15.174:6823","nonce":1138565854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":1138565854},{"type":"v1","addr":"172.21.15.174:6831","nonce":1138565854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":1138565854},{"type":"v1","addr":"172.21.15.174:6829","nonce":1138565854}]},"public_addr":"172.21.15.174:6819/1138565854","cluster_addr":"172.21.15.174:6823/1138565854","heartbeat_back_addr":"172.21.15.174:6831/1138565854","heartbeat_front_addr":"172.21.15.174:6829/1138565854","state":["exists","up"]},{"osd":5,"uuid":"b4da1c32-be05-420b-9346-90d91aa70569","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":1707702879},{"type":"v1","addr":"172.21.15.174:6818","nonce":1707702879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":1707702879},{"type":"v1","addr":"172.21.15.174:6822","nonce":1707702879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6827","nonce":1707702879},{"type":"v1","addr":"172.21.15.174:6828","nonce":1707702879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":1707702879},{"type":"v1","addr":"172.21.15.174:6825","nonce":1707702879}]},"public_addr":"172.21.15.174:6818/1707702879","cluster_addr":"172.21.15.174:6822/1707702879","heartbeat_back_addr":"172.21.15.174:6828/1707702879","heartbeat_front_addr":"172.21.15.174:6825/1707702879","state":["exists","up"]},{"osd":6,"uuid":"d1b98041-d243-4355-bd0a-e22cf9875b32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":864450534},{"type":"v1","addr":"172.21.15.174:6801","nonce":864450534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":864450534},{"type":"v1","addr":"172.21.15.174:6803","nonce":864450534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":864450534},{"type":"v1","addr":"172.21.15.174:6807","nonce":864450534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":864450534},{"type":"v1","addr":"172.21.15.174:6805","nonce":864450534}]},"public_addr":"172.21.15.174:6801/864450534","cluster_addr":"172.21.15.174:6803/864450534","heartbeat_back_addr":"172.21.15.174:6807/864450534","heartbeat_front_addr":"172.21.15.174:6805/864450534","state":["exists","up"]},{"osd":7,"uuid":"5a207936-f89f-416b-b79b-34ec96f77c8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":2527640659},{"type":"v1","addr":"172.21.15.174:6809","nonce":2527640659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":2527640659},{"type":"v1","addr":"172.21.15.174:6811","nonce":2527640659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":2527640659},{"type":"v1","addr":"172.21.15.174:6815","nonce":2527640659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":2527640659},{"type":"v1","addr":"172.21.15.174:6813","nonce":2527640659}]},"public_addr":"172.21.15.174:6809/2527640659","cluster_addr":"172.21.15.174:6811/2527640659","heartbeat_back_addr":"172.21.15.174:6815/2527640659","heartbeat_front_addr":"172.21.15.174:6813/2527640659","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:36.972152+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:36.984561+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:36.998817+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:37.054944+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:37.085014+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:37.115125+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:36.854608+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:36.971685+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:42:58.264 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.262+0000 7faa4a977700 1 -- 172.21.15.90:0/3582523997 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7faa28066320 msgr2=0x7faa280687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:58.265 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.262+0000 7faa4a977700 1 --2- 172.21.15.90:0/3582523997 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7faa28066320 0x7faa280687d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7faa440b6fd0 tx=0x7faa34009040 comp rx=0 tx=0).stop 2023-06-09T04:42:58.265 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.262+0000 7faa4a977700 1 -- 172.21.15.90:0/3582523997 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faa4415c2a0 msgr2=0x7faa44158100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:58.265 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.262+0000 7faa4a977700 1 --2- 172.21.15.90:0/3582523997 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faa4415c2a0 0x7faa44158100 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7faa4000e9d0 tx=0x7faa4000ece0 comp rx=0 tx=0).stop 2023-06-09T04:42:58.265 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.262+0000 7faa4a977700 1 -- 172.21.15.90:0/3582523997 shutdown_connections 2023-06-09T04:42:58.265 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.262+0000 7faa4a977700 1 --2- 172.21.15.90:0/3582523997 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7faa28066320 0x7faa280687d0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:58.265 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.262+0000 7faa4a977700 1 --2- 172.21.15.90:0/3582523997 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faa441607b0 0x7faa440b7040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:58.266 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.262+0000 7faa4a977700 1 --2- 172.21.15.90:0/3582523997 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faa4415fc70 0x7faa44153b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:58.266 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.262+0000 7faa4a977700 1 --2- 172.21.15.90:0/3582523997 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faa4415c2a0 0x7faa44158100 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:58.266 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.262+0000 7faa4a977700 1 -- 172.21.15.90:0/3582523997 >> 172.21.15.90:0/3582523997 conn(0x7faa440b4ee0 msgr2=0x7faa44156fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:58.266 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.262+0000 7faa4a977700 1 -- 172.21.15.90:0/3582523997 shutdown_connections 2023-06-09T04:42:58.266 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.262+0000 7faa4a977700 1 -- 172.21.15.90:0/3582523997 wait complete. 2023-06-09T04:42:58.285 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T04:42:58.454 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.450+0000 7ff27b4df700 1 Processor -- start 2023-06-09T04:42:58.455 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.450+0000 7ff27b4df700 1 -- start start 2023-06-09T04:42:58.457 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.454+0000 7ff27b4df700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ff2740cd600 0x7ff2740cc0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:58.457 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.454+0000 7ff27b4df700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2740cca60 con 0x7ff2740cc600 2023-06-09T04:42:58.457 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.454+0000 7ff27b4df700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2740cb140 con 0x7ff274160660 2023-06-09T04:42:58.457 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.454+0000 7ff27b4df700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2740c9250 con 0x7ff2740cd600 2023-06-09T04:42:58.458 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.454+0000 7ff278a7a700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ff2740cd600 0x7ff2740cc0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:58.458 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.454+0000 7ff279a7c700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7ff2740cc600 0x7ff274069c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:54404/0 (socket says 172.21.15.90:54404) 2023-06-09T04:42:58.458 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.454+0000 7ff279a7c700 1 -- 172.21.15.90:0/2553886981 learned_addr learned my addr 172.21.15.90:0/2553886981 (peer_addr_for_me v1:172.21.15.90:0/0) 2023-06-09T04:42:58.458 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.454+0000 7ff27927b700 1 --1- 172.21.15.90:0/2553886981 >> v1:172.21.15.174:6789/0 conn(0x7ff274160660 0x7ff2740c8b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.90:58936/0 (socket says 172.21.15.90:58936) 2023-06-09T04:42:58.459 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.454+0000 7ff26bfff700 1 -- 172.21.15.90:0/2553886981 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2505611116 0 0) 0x7ff2740cca60 con 0x7ff2740cc600 2023-06-09T04:42:58.459 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.454+0000 7ff26bfff700 1 -- 172.21.15.90:0/2553886981 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff2600035d0 con 0x7ff2740cc600 2023-06-09T04:42:58.459 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.454+0000 7ff278a7a700 1 -- 172.21.15.90:0/2553886981 >> v1:172.21.15.174:6789/0 conn(0x7ff274160660 legacy=0x7ff2740c8b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:58.459 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.454+0000 7ff26bfff700 1 -- 172.21.15.90:0/2553886981 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 993156602 0 0) 0x7ff2740cb140 con 0x7ff274160660 2023-06-09T04:42:58.460 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.454+0000 7ff278a7a700 1 -- 172.21.15.90:0/2553886981 >> v1:172.21.15.90:6789/0 conn(0x7ff2740cc600 legacy=0x7ff274069c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:58.460 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.454+0000 7ff278a7a700 1 -- 172.21.15.90:0/2553886981 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff27406fb00 con 0x7ff2740cd600 2023-06-09T04:42:58.460 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.458+0000 7ff278a7a700 1 --2- 172.21.15.90:0/2553886981 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff2740cd600 0x7ff2740cc0c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7ff264009850 tx=0x7ff264009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3727f51063f50425 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:58.460 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.458+0000 7ff26bfff700 1 -- 172.21.15.90:0/2553886981 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff264011830 con 0x7ff2740cd600 2023-06-09T04:42:58.461 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.458+0000 7ff26bfff700 1 -- 172.21.15.90:0/2553886981 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff264011990 con 0x7ff2740cd600 2023-06-09T04:42:58.461 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.458+0000 7ff26bfff700 1 -- 172.21.15.90:0/2553886981 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff264011d40 con 0x7ff2740cd600 2023-06-09T04:42:58.461 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.458+0000 7ff27b4df700 1 -- 172.21.15.90:0/2553886981 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff2740cd600 msgr2=0x7ff2740cc0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:58.462 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.458+0000 7ff27b4df700 1 --2- 172.21.15.90:0/2553886981 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff2740cd600 0x7ff2740cc0c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7ff264009850 tx=0x7ff264009b60 comp rx=0 tx=0).stop 2023-06-09T04:42:58.462 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.458+0000 7ff27b4df700 1 -- 172.21.15.90:0/2553886981 shutdown_connections 2023-06-09T04:42:58.462 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.458+0000 7ff27b4df700 1 --2- 172.21.15.90:0/2553886981 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff2740cd600 0x7ff2740cc0c0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:58.462 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.458+0000 7ff27b4df700 1 -- 172.21.15.90:0/2553886981 >> 172.21.15.90:0/2553886981 conn(0x7ff27406c810 msgr2=0x7ff2740b0000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:58.462 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.458+0000 7ff27b4df700 1 -- 172.21.15.90:0/2553886981 shutdown_connections 2023-06-09T04:42:58.462 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.458+0000 7ff27b4df700 1 -- 172.21.15.90:0/2553886981 wait complete. 2023-06-09T04:42:58.464 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.462+0000 7ff27b4df700 1 Processor -- start 2023-06-09T04:42:58.464 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.462+0000 7ff27b4df700 1 -- start start 2023-06-09T04:42:58.465 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.462+0000 7ff27b4df700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff2740cc600 0x7ff2740c55c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:58.465 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.462+0000 7ff27b4df700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff2740cd600 0x7ff2740c1d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:58.466 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.462+0000 7ff27b4df700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff274160660 0x7ff2740c46a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:58.466 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.462+0000 7ff27b4df700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2740c2e80 con 0x7ff2740cc600 2023-06-09T04:42:58.466 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.462+0000 7ff27b4df700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2740b4090 con 0x7ff274160660 2023-06-09T04:42:58.466 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.462+0000 7ff27b4df700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2740c2830 con 0x7ff2740cd600 2023-06-09T04:42:58.467 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.462+0000 7ff27927b700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff2740cc600 0x7ff2740c55c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:58.467 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.462+0000 7ff27927b700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff2740cc600 0x7ff2740c55c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:44350/0 (socket says 172.21.15.90:44350) 2023-06-09T04:42:58.467 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.462+0000 7ff27927b700 1 -- 172.21.15.90:0/3424321096 learned_addr learned my addr 172.21.15.90:0/3424321096 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:58.468 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.462+0000 7ff278a7a700 1 --2- 172.21.15.90:0/3424321096 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff2740cd600 0x7ff2740c1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:58.468 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.462+0000 7ff279a7c700 1 --2- 172.21.15.90:0/3424321096 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff274160660 0x7ff2740c46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:58.468 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.462+0000 7ff27927b700 1 -- 172.21.15.90:0/3424321096 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff2740cd600 msgr2=0x7ff2740c1d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:58.468 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.462+0000 7ff27927b700 1 --2- 172.21.15.90:0/3424321096 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff2740cd600 0x7ff2740c1d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:58.468 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.462+0000 7ff27927b700 1 -- 172.21.15.90:0/3424321096 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff274160660 msgr2=0x7ff2740c46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:58.468 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.462+0000 7ff27927b700 1 --2- 172.21.15.90:0/3424321096 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff274160660 0x7ff2740c46a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:58.468 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.462+0000 7ff27927b700 1 -- 172.21.15.90:0/3424321096 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2640094b0 con 0x7ff2740cc600 2023-06-09T04:42:58.469 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.466+0000 7ff27927b700 1 --2- 172.21.15.90:0/3424321096 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff2740cc600 0x7ff2740c55c0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7ff27000cc20 tx=0x7ff27000cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:58.470 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.466+0000 7ff269ffb700 1 -- 172.21.15.90:0/3424321096 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff27000aaa0 con 0x7ff2740cc600 2023-06-09T04:42:58.470 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.466+0000 7ff269ffb700 1 -- 172.21.15.90:0/3424321096 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff27000ac20 con 0x7ff2740cc600 2023-06-09T04:42:58.470 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.466+0000 7ff27b4df700 1 -- 172.21.15.90:0/3424321096 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2740c2b10 con 0x7ff2740cc600 2023-06-09T04:42:58.471 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.466+0000 7ff269ffb700 1 -- 172.21.15.90:0/3424321096 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2700070d0 con 0x7ff2740cc600 2023-06-09T04:42:58.471 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.466+0000 7ff27b4df700 1 -- 172.21.15.90:0/3424321096 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2740c4be0 con 0x7ff2740cc600 2023-06-09T04:42:58.471 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.466+0000 7ff27b4df700 1 -- 172.21.15.90:0/3424321096 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff27404db30 con 0x7ff2740cc600 2023-06-09T04:42:58.472 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.470+0000 7ff269ffb700 1 -- 172.21.15.90:0/3424321096 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff270007230 con 0x7ff2740cc600 2023-06-09T04:42:58.474 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.470+0000 7ff269ffb700 1 --2- 172.21.15.90:0/3424321096 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7ff2580662f0 0x7ff2580687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:58.474 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.470+0000 7ff269ffb700 1 -- 172.21.15.90:0/3424321096 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff2700838a0 con 0x7ff2740cc600 2023-06-09T04:42:58.475 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.470+0000 7ff278a7a700 1 --2- 172.21.15.90:0/3424321096 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7ff2580662f0 0x7ff2580687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:58.476 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.474+0000 7ff278a7a700 1 --2- 172.21.15.90:0/3424321096 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7ff2580662f0 0x7ff2580687a0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7ff2640090b0 tx=0x7ff264008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:58.478 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.474+0000 7ff269ffb700 1 -- 172.21.15.90:0/3424321096 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff270050c80 con 0x7ff2740cc600 2023-06-09T04:42:58.649 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.646+0000 7ff27b4df700 1 -- 172.21.15.90:0/3424321096 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff2740ca140 con 0x7ff2740cc600 2023-06-09T04:42:58.652 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.650+0000 7ff269ffb700 1 -- 172.21.15.90:0/3424321096 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+18364 (secure 0 0 0) 0x7ff270018020 con 0x7ff2740cc600 2023-06-09T04:42:58.652 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:42:58.653 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":37,"fsid":"700369c0-a111-43b4-9415-844ad1742b70","created":"2023-06-09T04:41:28.180311+0000","modified":"2023-06-09T04:42:57.839265+0000","last_up_change":"2023-06-09T04:41:40.746475+0000","last_in_change":"2023-06-09T04:41:31.262765+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-09T04:41:42.402564+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-09T04:41:47.607323+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-06-09T04:42:55.855674+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-06-09T04:42:56.846984+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"46a4a7c5-babd-4ef3-9830-51487cff5eb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":2780271267},{"type":"v1","addr":"172.21.15.90:6809","nonce":2780271267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2780271267},{"type":"v1","addr":"172.21.15.90:6811","nonce":2780271267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2780271267},{"type":"v1","addr":"172.21.15.90:6815","nonce":2780271267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2780271267},{"type":"v1","addr":"172.21.15.90:6813","nonce":2780271267}]},"public_addr":"172.21.15.90:6809/2780271267","cluster_addr":"172.21.15.90:6811/2780271267","heartbeat_back_addr":"172.21.15.90:6815/2780271267","heartbeat_front_addr":"172.21.15.90:6813/2780271267","state":["exists","up"]},{"osd":1,"uuid":"1543988f-c498-494a-a6f9-fac8413db6ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":3064028136},{"type":"v1","addr":"172.21.15.90:6801","nonce":3064028136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":3064028136},{"type":"v1","addr":"172.21.15.90:6803","nonce":3064028136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":3064028136},{"type":"v1","addr":"172.21.15.90:6807","nonce":3064028136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":3064028136},{"type":"v1","addr":"172.21.15.90:6805","nonce":3064028136}]},"public_addr":"172.21.15.90:6801/3064028136","cluster_addr":"172.21.15.90:6803/3064028136","heartbeat_back_addr":"172.21.15.90:6807/3064028136","heartbeat_front_addr":"172.21.15.90:6805/3064028136","state":["exists","up"]},{"osd":2,"uuid":"79669dd6-ffc8-4197-b9f7-b3b372b2b9b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":3713146326},{"type":"v1","addr":"172.21.15.90:6825","nonce":3713146326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":3713146326},{"type":"v1","addr":"172.21.15.90:6827","nonce":3713146326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":3713146326},{"type":"v1","addr":"172.21.15.90:6831","nonce":3713146326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":3713146326},{"type":"v1","addr":"172.21.15.90:6829","nonce":3713146326}]},"public_addr":"172.21.15.90:6825/3713146326","cluster_addr":"172.21.15.90:6827/3713146326","heartbeat_back_addr":"172.21.15.90:6831/3713146326","heartbeat_front_addr":"172.21.15.90:6829/3713146326","state":["exists","up"]},{"osd":3,"uuid":"4062ab6f-ce40-450a-aa17-b10098766c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":3499839122},{"type":"v1","addr":"172.21.15.90:6817","nonce":3499839122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":3499839122},{"type":"v1","addr":"172.21.15.90:6819","nonce":3499839122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":3499839122},{"type":"v1","addr":"172.21.15.90:6823","nonce":3499839122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":3499839122},{"type":"v1","addr":"172.21.15.90:6821","nonce":3499839122}]},"public_addr":"172.21.15.90:6817/3499839122","cluster_addr":"172.21.15.90:6819/3499839122","heartbeat_back_addr":"172.21.15.90:6823/3499839122","heartbeat_front_addr":"172.21.15.90:6821/3499839122","state":["exists","up"]},{"osd":4,"uuid":"a10820e4-b348-4d92-9796-3b01484ace1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6817","nonce":1138565854},{"type":"v1","addr":"172.21.15.174:6819","nonce":1138565854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6821","nonce":1138565854},{"type":"v1","addr":"172.21.15.174:6823","nonce":1138565854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":1138565854},{"type":"v1","addr":"172.21.15.174:6831","nonce":1138565854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":1138565854},{"type":"v1","addr":"172.21.15.174:6829","nonce":1138565854}]},"public_addr":"172.21.15.174:6819/1138565854","cluster_addr":"172.21.15.174:6823/1138565854","heartbeat_back_addr":"172.21.15.174:6831/1138565854","heartbeat_front_addr":"172.21.15.174:6829/1138565854","state":["exists","up"]},{"osd":5,"uuid":"b4da1c32-be05-420b-9346-90d91aa70569","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":1707702879},{"type":"v1","addr":"172.21.15.174:6818","nonce":1707702879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":1707702879},{"type":"v1","addr":"172.21.15.174:6822","nonce":1707702879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6827","nonce":1707702879},{"type":"v1","addr":"172.21.15.174:6828","nonce":1707702879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":1707702879},{"type":"v1","addr":"172.21.15.174:6825","nonce":1707702879}]},"public_addr":"172.21.15.174:6818/1707702879","cluster_addr":"172.21.15.174:6822/1707702879","heartbeat_back_addr":"172.21.15.174:6828/1707702879","heartbeat_front_addr":"172.21.15.174:6825/1707702879","state":["exists","up"]},{"osd":6,"uuid":"d1b98041-d243-4355-bd0a-e22cf9875b32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":864450534},{"type":"v1","addr":"172.21.15.174:6801","nonce":864450534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":864450534},{"type":"v1","addr":"172.21.15.174:6803","nonce":864450534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":864450534},{"type":"v1","addr":"172.21.15.174:6807","nonce":864450534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":864450534},{"type":"v1","addr":"172.21.15.174:6805","nonce":864450534}]},"public_addr":"172.21.15.174:6801/864450534","cluster_addr":"172.21.15.174:6803/864450534","heartbeat_back_addr":"172.21.15.174:6807/864450534","heartbeat_front_addr":"172.21.15.174:6805/864450534","state":["exists","up"]},{"osd":7,"uuid":"5a207936-f89f-416b-b79b-34ec96f77c8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":2527640659},{"type":"v1","addr":"172.21.15.174:6809","nonce":2527640659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":2527640659},{"type":"v1","addr":"172.21.15.174:6811","nonce":2527640659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":2527640659},{"type":"v1","addr":"172.21.15.174:6815","nonce":2527640659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":2527640659},{"type":"v1","addr":"172.21.15.174:6813","nonce":2527640659}]},"public_addr":"172.21.15.174:6809/2527640659","cluster_addr":"172.21.15.174:6811/2527640659","heartbeat_back_addr":"172.21.15.174:6815/2527640659","heartbeat_front_addr":"172.21.15.174:6813/2527640659","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:36.972152+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:36.984561+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:36.998817+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:37.054944+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:37.085014+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:37.115125+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:36.854608+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:36.971685+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:42:58.655 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.650+0000 7ff27b4df700 1 -- 172.21.15.90:0/3424321096 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7ff2580662f0 msgr2=0x7ff2580687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:58.655 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.650+0000 7ff27b4df700 1 --2- 172.21.15.90:0/3424321096 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7ff2580662f0 0x7ff2580687a0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7ff2640090b0 tx=0x7ff264008030 comp rx=0 tx=0).stop 2023-06-09T04:42:58.655 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.650+0000 7ff27b4df700 1 -- 172.21.15.90:0/3424321096 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff2740cc600 msgr2=0x7ff2740c55c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:58.655 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.650+0000 7ff27b4df700 1 --2- 172.21.15.90:0/3424321096 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff2740cc600 0x7ff2740c55c0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7ff27000cc20 tx=0x7ff27000cf30 comp rx=0 tx=0).stop 2023-06-09T04:42:58.655 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.650+0000 7ff27b4df700 1 -- 172.21.15.90:0/3424321096 shutdown_connections 2023-06-09T04:42:58.655 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.650+0000 7ff27b4df700 1 --2- 172.21.15.90:0/3424321096 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7ff2580662f0 0x7ff2580687a0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:58.656 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.650+0000 7ff27b4df700 1 --2- 172.21.15.90:0/3424321096 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff274160660 0x7ff2740c46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:58.656 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.650+0000 7ff27b4df700 1 --2- 172.21.15.90:0/3424321096 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff2740cd600 0x7ff2740c1d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:58.656 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.650+0000 7ff27b4df700 1 --2- 172.21.15.90:0/3424321096 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff2740cc600 0x7ff2740c55c0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:58.656 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.650+0000 7ff27b4df700 1 -- 172.21.15.90:0/3424321096 >> 172.21.15.90:0/3424321096 conn(0x7ff27406c810 msgr2=0x7ff27415edf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:58.656 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.654+0000 7ff27b4df700 1 -- 172.21.15.90:0/3424321096 shutdown_connections 2023-06-09T04:42:58.657 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.654+0000 7ff27b4df700 1 -- 172.21.15.90:0/3424321096 wait complete. 2023-06-09T04:42:58.678 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-06-09T04:42:58.853 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.850+0000 7f150d8aa700 1 Processor -- start 2023-06-09T04:42:58.854 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.850+0000 7f150d8aa700 1 -- start start 2023-06-09T04:42:58.857 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.854+0000 7f150d8aa700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f15080b1a90 0x7f150815a260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:58.857 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.854+0000 7f150d8aa700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15080af720 con 0x7f15081579c0 2023-06-09T04:42:58.858 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.854+0000 7f150d8aa700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f150815a890 con 0x7f150806fd10 2023-06-09T04:42:58.858 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.854+0000 7f150d8aa700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1508157d90 con 0x7f15080b1a90 2023-06-09T04:42:58.859 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.854+0000 7f1506ffd700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f15081579c0 0x7f150806f600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:54416/0 (socket says 172.21.15.90:54416) 2023-06-09T04:42:58.859 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.854+0000 7f1506ffd700 1 -- 172.21.15.90:0/1369367114 learned_addr learned my addr 172.21.15.90:0/1369367114 (peer_addr_for_me v1:172.21.15.90:0/0) 2023-06-09T04:42:58.859 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.854+0000 7f15077fe700 1 --2- 172.21.15.90:0/1369367114 >> v2:172.21.15.90:3300/0 conn(0x7f15080b1a90 0x7f150815a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:58.859 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.854+0000 7f15067fc700 1 -- 172.21.15.90:0/1369367114 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4166645831 0 0) 0x7f15080af720 con 0x7f15081579c0 2023-06-09T04:42:58.859 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.854+0000 7f15067fc700 1 -- 172.21.15.90:0/1369367114 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f14f40035d0 con 0x7f15081579c0 2023-06-09T04:42:58.859 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.854+0000 7f15077fe700 1 -- 172.21.15.90:0/1369367114 >> v1:172.21.15.174:6789/0 conn(0x7f150806fd10 legacy=0x7f15080afc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:58.860 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.854+0000 7f15077fe700 1 -- 172.21.15.90:0/1369367114 >> v1:172.21.15.90:6789/0 conn(0x7f15081579c0 legacy=0x7f150806f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:58.860 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.854+0000 7f15077fe700 1 -- 172.21.15.90:0/1369367114 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f150815ab70 con 0x7f15080b1a90 2023-06-09T04:42:58.860 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.854+0000 7f15077fe700 1 --2- 172.21.15.90:0/1369367114 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f15080b1a90 0x7f150815a260 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f1500009dc0 tx=0x7f150000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77201b09dd1fb154 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:58.861 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.858+0000 7f15067fc700 1 -- 172.21.15.90:0/1369367114 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f150000e070 con 0x7f15080b1a90 2023-06-09T04:42:58.861 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.858+0000 7f15067fc700 1 -- 172.21.15.90:0/1369367114 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f150000baa0 con 0x7f15080b1a90 2023-06-09T04:42:58.861 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.858+0000 7f15067fc700 1 -- 172.21.15.90:0/1369367114 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f150000be50 con 0x7f15080b1a90 2023-06-09T04:42:58.861 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.858+0000 7f150d8aa700 1 -- 172.21.15.90:0/1369367114 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f15080b1a90 msgr2=0x7f150815a260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:58.862 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.858+0000 7f150d8aa700 1 --2- 172.21.15.90:0/1369367114 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f15080b1a90 0x7f150815a260 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f1500009dc0 tx=0x7f150000b330 comp rx=0 tx=0).stop 2023-06-09T04:42:58.862 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.858+0000 7f150d8aa700 1 -- 172.21.15.90:0/1369367114 shutdown_connections 2023-06-09T04:42:58.862 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.858+0000 7f150d8aa700 1 --2- 172.21.15.90:0/1369367114 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f15080b1a90 0x7f150815a260 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:58.862 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.858+0000 7f150d8aa700 1 -- 172.21.15.90:0/1369367114 >> 172.21.15.90:0/1369367114 conn(0x7f15080d05e0 msgr2=0x7f15080d09e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:58.862 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.858+0000 7f150d8aa700 1 -- 172.21.15.90:0/1369367114 shutdown_connections 2023-06-09T04:42:58.862 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.858+0000 7f150d8aa700 1 -- 172.21.15.90:0/1369367114 wait complete. 2023-06-09T04:42:58.863 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.858+0000 7f150d8aa700 1 Processor -- start 2023-06-09T04:42:58.863 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.862+0000 7f150d8aa700 1 -- start start 2023-06-09T04:42:58.865 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.862+0000 7f150d8aa700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f150806fd10 0x7f15080afed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:58.865 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.862+0000 7f150d8aa700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f15080b1a90 0x7f15080aeae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:58.865 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.862+0000 7f150d8aa700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f15081579c0 0x7f15080af020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:58.865 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.862+0000 7f150d8aa700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15080b3410 con 0x7f150806fd10 2023-06-09T04:42:58.865 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.862+0000 7f150d8aa700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15080ca670 con 0x7f15080b1a90 2023-06-09T04:42:58.865 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.862+0000 7f150d8aa700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15080af6f0 con 0x7f15081579c0 2023-06-09T04:42:58.866 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.862+0000 7f1506ffd700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f150806fd10 0x7f15080afed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:58.866 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.862+0000 7f1506ffd700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f150806fd10 0x7f15080afed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:44378/0 (socket says 172.21.15.90:44378) 2023-06-09T04:42:58.866 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.862+0000 7f1506ffd700 1 -- 172.21.15.90:0/92713237 learned_addr learned my addr 172.21.15.90:0/92713237 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:42:58.867 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.862+0000 7f15077fe700 1 --2- 172.21.15.90:0/92713237 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f15081579c0 0x7f15080af020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:58.867 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.862+0000 7f14fffff700 1 --2- 172.21.15.90:0/92713237 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f15080b1a90 0x7f15080aeae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:58.867 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.862+0000 7f1506ffd700 1 -- 172.21.15.90:0/92713237 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f15081579c0 msgr2=0x7f15080af020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:58.867 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.862+0000 7f1506ffd700 1 --2- 172.21.15.90:0/92713237 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f15081579c0 0x7f15080af020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:58.868 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.862+0000 7f1506ffd700 1 -- 172.21.15.90:0/92713237 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f15080b1a90 msgr2=0x7f15080aeae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:58.868 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.862+0000 7f1506ffd700 1 --2- 172.21.15.90:0/92713237 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f15080b1a90 0x7f15080aeae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:58.868 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.862+0000 7f1506ffd700 1 -- 172.21.15.90:0/92713237 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1500009a70 con 0x7f150806fd10 2023-06-09T04:42:58.868 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.862+0000 7f1506ffd700 1 --2- 172.21.15.90:0/92713237 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f150806fd10 0x7f15080afed0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f14f800c4d0 tx=0x7f14f800c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:58.868 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.862+0000 7f1504ff9700 1 -- 172.21.15.90:0/92713237 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14f8005d90 con 0x7f150806fd10 2023-06-09T04:42:58.868 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.862+0000 7f1504ff9700 1 -- 172.21.15.90:0/92713237 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14f80070d0 con 0x7f150806fd10 2023-06-09T04:42:58.868 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.862+0000 7f150d8aa700 1 -- 172.21.15.90:0/92713237 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f150806c090 con 0x7f150806fd10 2023-06-09T04:42:58.869 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.862+0000 7f1504ff9700 1 -- 172.21.15.90:0/92713237 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14f8007440 con 0x7f150806fd10 2023-06-09T04:42:58.869 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.862+0000 7f150d8aa700 1 -- 172.21.15.90:0/92713237 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f150806b5d0 con 0x7f150806fd10 2023-06-09T04:42:58.869 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.866+0000 7f150d8aa700 1 -- 172.21.15.90:0/92713237 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f150804db30 con 0x7f150806fd10 2023-06-09T04:42:58.870 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.866+0000 7f1504ff9700 1 -- 172.21.15.90:0/92713237 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f14f80075a0 con 0x7f150806fd10 2023-06-09T04:42:58.872 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.870+0000 7f1504ff9700 1 --2- 172.21.15.90:0/92713237 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f14e80662f0 0x7f14e80687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:58.872 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.870+0000 7f1504ff9700 1 -- 172.21.15.90:0/92713237 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f14f8082f40 con 0x7f150806fd10 2023-06-09T04:42:58.872 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.870+0000 7f14fffff700 1 --2- 172.21.15.90:0/92713237 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f14e80662f0 0x7f14e80687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:58.874 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.870+0000 7f14fffff700 1 --2- 172.21.15.90:0/92713237 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f14e80662f0 0x7f14e80687a0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f15080cba20 tx=0x7f14f0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:58.878 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:58.874+0000 7f1504ff9700 1 -- 172.21.15.90:0/92713237 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f14f8050500 con 0x7f150806fd10 2023-06-09T04:42:59.084 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:42:59.082+0000 7f150d8aa700 1 -- 172.21.15.90:0/92713237 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f15080b5ef0 con 0x7f150806fd10 2023-06-09T04:43:00.031 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:00.026+0000 7f1504ff9700 1 -- 172.21.15.90:0/92713237 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v14) v1 ==== 118+0+0 (secure 0 0 0) 0x7f14f8017020 con 0x7f150806fd10 2023-06-09T04:43:00.036 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:00.034+0000 7f150d8aa700 1 -- 172.21.15.90:0/92713237 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f14e80662f0 msgr2=0x7f14e80687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:43:00.036 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:00.034+0000 7f150d8aa700 1 --2- 172.21.15.90:0/92713237 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f14e80662f0 0x7f14e80687a0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f15080cba20 tx=0x7f14f0009040 comp rx=0 tx=0).stop 2023-06-09T04:43:00.036 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:00.034+0000 7f150d8aa700 1 -- 172.21.15.90:0/92713237 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f150806fd10 msgr2=0x7f15080afed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:43:00.037 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:00.034+0000 7f150d8aa700 1 --2- 172.21.15.90:0/92713237 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f150806fd10 0x7f15080afed0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f14f800c4d0 tx=0x7f14f800c7e0 comp rx=0 tx=0).stop 2023-06-09T04:43:00.037 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:00.034+0000 7f150d8aa700 1 -- 172.21.15.90:0/92713237 shutdown_connections 2023-06-09T04:43:00.037 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:00.034+0000 7f150d8aa700 1 --2- 172.21.15.90:0/92713237 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f14e80662f0 0x7f14e80687a0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:43:00.037 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:00.034+0000 7f150d8aa700 1 --2- 172.21.15.90:0/92713237 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f15081579c0 0x7f15080af020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:43:00.038 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:00.034+0000 7f150d8aa700 1 --2- 172.21.15.90:0/92713237 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f15080b1a90 0x7f15080aeae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:43:00.038 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:00.034+0000 7f150d8aa700 1 --2- 172.21.15.90:0/92713237 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f150806fd10 0x7f15080afed0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:43:00.038 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:00.034+0000 7f150d8aa700 1 -- 172.21.15.90:0/92713237 >> 172.21.15.90:0/92713237 conn(0x7f15080d05e0 msgr2=0x7f1508156bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:43:00.038 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:00.034+0000 7f150d8aa700 1 -- 172.21.15.90:0/92713237 shutdown_connections 2023-06-09T04:43:00.039 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:00.034+0000 7f150d8aa700 1 -- 172.21.15.90:0/92713237 wait complete. 2023-06-09T04:43:00.062 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-06-09T04:43:00.063 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-06-09T04:43:00.247 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:00.242+0000 7fca11777700 1 Processor -- start 2023-06-09T04:43:00.248 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:00.246+0000 7fca11777700 1 -- start start 2023-06-09T04:43:00.251 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:00.246+0000 7fca11777700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fca0c070b80 0x7fca0c070f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:43:00.251 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:00.246+0000 7fca11777700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fca0c15db50 0x7fca0c15dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:43:00.251 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:00.246+0000 7fca11777700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca0c0cdce0 con 0x7fca0c0b2ed0 2023-06-09T04:43:00.251 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:00.246+0000 7fca11777700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca0c0cf180 con 0x7fca0c15db50 2023-06-09T04:43:00.252 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:00.246+0000 7fca11777700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca0c15a200 con 0x7fca0c070b80 2023-06-09T04:43:00.253 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:00.250+0000 7fca037fe700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fca0c15db50 0x7fca0c15dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:43:00.253 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:00.250+0000 7fca0bfff700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fca0c070b80 0x7fca0c070f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:43:00.253 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:00.250+0000 7fca037fe700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fca0c15db50 0x7fca0c15dfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:44386/0 (socket says 172.21.15.90:44386) 2023-06-09T04:43:00.253 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:00.250+0000 7fca037fe700 1 -- 172.21.15.90:0/2348659116 learned_addr learned my addr 172.21.15.90:0/2348659116 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:43:00.254 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:00.250+0000 7fca10f76700 1 --1- 172.21.15.90:0/2348659116 >> v1:172.21.15.174:6789/0 conn(0x7fca0c0b2ed0 0x7fca0c0b3330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.90:58960/0 (socket says 172.21.15.90:58960) 2023-06-09T04:43:00.254 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:00.250+0000 7fca037fe700 1 -- 172.21.15.90:0/2348659116 >> v2:172.21.15.174:3300/0 conn(0x7fca0c070b80 msgr2=0x7fca0c070f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:43:00.254 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:00.250+0000 7fca037fe700 1 --2- 172.21.15.90:0/2348659116 >> v2:172.21.15.174:3300/0 conn(0x7fca0c070b80 0x7fca0c070f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:43:00.254 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:00.250+0000 7fca037fe700 1 -- 172.21.15.90:0/2348659116 >> v1:172.21.15.174:6789/0 conn(0x7fca0c0b2ed0 legacy=0x7fca0c0b3330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:43:00.255 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:00.250+0000 7fca037fe700 1 -- 172.21.15.90:0/2348659116 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca0c15e8c0 con 0x7fca0c15db50 2023-06-09T04:43:00.256 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:00.250+0000 7fca037fe700 1 --2- 172.21.15.90:0/2348659116 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fca0c15db50 0x7fca0c15dfd0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fca0c070630 tx=0x7fc9f4009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65f459db829efcc6 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:43:00.257 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:00.250+0000 7fca0b7fe700 1 -- 172.21.15.90:0/2348659116 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9f4011830 con 0x7fca0c15db50 2023-06-09T04:43:00.257 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:00.250+0000 7fca0b7fe700 1 -- 172.21.15.90:0/2348659116 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9f4011990 con 0x7fca0c15db50 2023-06-09T04:43:00.257 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:00.250+0000 7fca0b7fe700 1 -- 172.21.15.90:0/2348659116 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9f4011d20 con 0x7fca0c15db50 2023-06-09T04:43:00.257 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:00.250+0000 7fca11777700 1 -- 172.21.15.90:0/2348659116 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fca0c15db50 msgr2=0x7fca0c15dfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:43:00.258 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:00.250+0000 7fca11777700 1 --2- 172.21.15.90:0/2348659116 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fca0c15db50 0x7fca0c15dfd0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fca0c070630 tx=0x7fc9f4009bf0 comp rx=0 tx=0).stop 2023-06-09T04:43:00.258 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:00.250+0000 7fca11777700 1 -- 172.21.15.90:0/2348659116 shutdown_connections 2023-06-09T04:43:00.258 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:00.250+0000 7fca11777700 1 --2- 172.21.15.90:0/2348659116 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fca0c15db50 0x7fca0c15dfd0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:43:00.258 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:00.250+0000 7fca11777700 1 --2- 172.21.15.90:0/2348659116 >> v2:172.21.15.174:3300/0 conn(0x7fca0c070b80 0x7fca0c070f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:43:00.259 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:00.250+0000 7fca11777700 1 -- 172.21.15.90:0/2348659116 >> 172.21.15.90:0/2348659116 conn(0x7fca0c0b1c30 msgr2=0x7fca0c0cf410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:43:00.259 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:00.250+0000 7fca11777700 1 -- 172.21.15.90:0/2348659116 shutdown_connections 2023-06-09T04:43:00.259 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:00.250+0000 7fca11777700 1 -- 172.21.15.90:0/2348659116 wait complete. 2023-06-09T04:43:00.261 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:00.254+0000 7fca11777700 1 Processor -- start 2023-06-09T04:43:00.261 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:00.254+0000 7fca11777700 1 -- start start 2023-06-09T04:43:00.262 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:00.258+0000 7fca11777700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fca0c070b80 0x7fca0c15ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:43:00.262 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:00.258+0000 7fca11777700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fca0c0b2ed0 0x7fca0c151480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:43:00.262 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:00.258+0000 7fca11777700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fca0c15db50 0x7fca0c1f13f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:43:00.262 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:00.258+0000 7fca11777700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca0c15a340 con 0x7fca0c0b2ed0 2023-06-09T04:43:00.263 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:00.258+0000 7fca11777700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca0c15a8c0 con 0x7fca0c15db50 2023-06-09T04:43:00.263 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:00.258+0000 7fca11777700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca0c15b290 con 0x7fca0c070b80 2023-06-09T04:43:00.263 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:00.258+0000 7fca037fe700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fca0c0b2ed0 0x7fca0c151480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:43:00.263 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:00.258+0000 7fca037fe700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fca0c0b2ed0 0x7fca0c151480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:44396/0 (socket says 172.21.15.90:44396) 2023-06-09T04:43:00.264 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:00.258+0000 7fca037fe700 1 -- 172.21.15.90:0/1728006976 learned_addr learned my addr 172.21.15.90:0/1728006976 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:43:00.264 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:00.258+0000 7fca10f76700 1 --2- 172.21.15.90:0/1728006976 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fca0c15db50 0x7fca0c1f13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:43:00.264 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:00.258+0000 7fca0bfff700 1 --2- 172.21.15.90:0/1728006976 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fca0c070b80 0x7fca0c15ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:43:00.264 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:00.258+0000 7fca037fe700 1 -- 172.21.15.90:0/1728006976 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fca0c070b80 msgr2=0x7fca0c15ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:43:00.265 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:00.258+0000 7fca037fe700 1 --2- 172.21.15.90:0/1728006976 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fca0c070b80 0x7fca0c15ad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:43:00.265 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:00.258+0000 7fca037fe700 1 -- 172.21.15.90:0/1728006976 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fca0c15db50 msgr2=0x7fca0c1f13f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:43:00.265 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:00.258+0000 7fca037fe700 1 --2- 172.21.15.90:0/1728006976 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fca0c15db50 0x7fca0c1f13f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:43:00.266 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:00.258+0000 7fca037fe700 1 -- 172.21.15.90:0/1728006976 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9f4009570 con 0x7fca0c0b2ed0 2023-06-09T04:43:00.266 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:00.258+0000 7fca037fe700 1 --2- 172.21.15.90:0/1728006976 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fca0c0b2ed0 0x7fca0c151480 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fc9f4000c00 tx=0x7fc9f4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:43:00.268 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:00.258+0000 7fca097fa700 1 -- 172.21.15.90:0/1728006976 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9f4004520 con 0x7fca0c0b2ed0 2023-06-09T04:43:00.268 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:00.258+0000 7fca097fa700 1 -- 172.21.15.90:0/1728006976 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9f401e070 con 0x7fca0c0b2ed0 2023-06-09T04:43:00.268 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:00.258+0000 7fca097fa700 1 -- 172.21.15.90:0/1728006976 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9f40038e0 con 0x7fca0c0b2ed0 2023-06-09T04:43:00.268 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:00.258+0000 7fca11777700 1 -- 172.21.15.90:0/1728006976 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca0c1519c0 con 0x7fca0c0b2ed0 2023-06-09T04:43:00.269 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:00.258+0000 7fca11777700 1 -- 172.21.15.90:0/1728006976 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca0c1f21e0 con 0x7fca0c0b2ed0 2023-06-09T04:43:00.269 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:00.262+0000 7fca11777700 1 -- 172.21.15.90:0/1728006976 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca0c067380 con 0x7fca0c0b2ed0 2023-06-09T04:43:00.269 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:00.262+0000 7fca097fa700 1 -- 172.21.15.90:0/1728006976 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc9f4003a40 con 0x7fca0c0b2ed0 2023-06-09T04:43:00.269 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:00.262+0000 7fca097fa700 1 --2- 172.21.15.90:0/1728006976 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fc9f00662f0 0x7fc9f00687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:43:00.270 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:00.262+0000 7fca097fa700 1 -- 172.21.15.90:0/1728006976 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc9f4020070 con 0x7fca0c0b2ed0 2023-06-09T04:43:00.270 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:00.266+0000 7fca0bfff700 1 --2- 172.21.15.90:0/1728006976 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fc9f00662f0 0x7fc9f00687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:43:00.270 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:00.266+0000 7fca0bfff700 1 --2- 172.21.15.90:0/1728006976 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fc9f00662f0 0x7fc9f00687a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fca0c15d8d0 tx=0x7fc9fc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:43:00.273 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:00.270+0000 7fca097fa700 1 -- 172.21.15.90:0/1728006976 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc9f4052340 con 0x7fca0c0b2ed0 2023-06-09T04:43:00.350 INFO:tasks.ceph.mds.c.smithi090.stderr:2023-06-09T04:43:00.346+0000 7f45785cd700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-06-09T04:43:00.480 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:00.478+0000 7fca11777700 1 -- 172.21.15.90:0/1728006976 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fca0c0cd3b0 con 0x7fca0c0b2ed0 2023-06-09T04:43:01.042 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:01.038+0000 7fca097fa700 1 -- 172.21.15.90:0/1728006976 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v15) v1 ==== 122+0+0 (secure 0 0 0) 0x7fc9f4015020 con 0x7fca0c0b2ed0 2023-06-09T04:43:01.047 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:01.042+0000 7fca11777700 1 -- 172.21.15.90:0/1728006976 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fc9f00662f0 msgr2=0x7fc9f00687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:43:01.047 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:01.042+0000 7fca11777700 1 --2- 172.21.15.90:0/1728006976 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fc9f00662f0 0x7fc9f00687a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fca0c15d8d0 tx=0x7fc9fc008040 comp rx=0 tx=0).stop 2023-06-09T04:43:01.047 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:01.042+0000 7fca11777700 1 -- 172.21.15.90:0/1728006976 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fca0c0b2ed0 msgr2=0x7fca0c151480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:43:01.048 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:01.042+0000 7fca11777700 1 --2- 172.21.15.90:0/1728006976 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fca0c0b2ed0 0x7fca0c151480 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fc9f4000c00 tx=0x7fc9f4004770 comp rx=0 tx=0).stop 2023-06-09T04:43:01.048 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:01.042+0000 7fca11777700 1 -- 172.21.15.90:0/1728006976 shutdown_connections 2023-06-09T04:43:01.048 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:01.042+0000 7fca11777700 1 --2- 172.21.15.90:0/1728006976 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fc9f00662f0 0x7fc9f00687a0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:43:01.048 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:01.042+0000 7fca11777700 1 --2- 172.21.15.90:0/1728006976 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fca0c15db50 0x7fca0c1f13f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:43:01.049 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:01.042+0000 7fca11777700 1 --2- 172.21.15.90:0/1728006976 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fca0c0b2ed0 0x7fca0c151480 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:43:01.049 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:01.042+0000 7fca11777700 1 --2- 172.21.15.90:0/1728006976 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fca0c070b80 0x7fca0c15ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:43:01.049 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:01.042+0000 7fca11777700 1 -- 172.21.15.90:0/1728006976 >> 172.21.15.90:0/1728006976 conn(0x7fca0c0b1c30 msgr2=0x7fca0c159970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:43:01.049 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:01.042+0000 7fca11777700 1 -- 172.21.15.90:0/1728006976 shutdown_connections 2023-06-09T04:43:01.050 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:01.042+0000 7fca11777700 1 -- 172.21.15.90:0/1728006976 wait complete. 2023-06-09T04:43:01.071 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-06-09T04:43:01.072 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-09T04:43:01.246 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:01.242+0000 7ffb9d1d5700 1 Processor -- start 2023-06-09T04:43:01.246 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:01.242+0000 7ffb9d1d5700 1 -- start start 2023-06-09T04:43:01.249 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:01.246+0000 7ffb9d1d5700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffb980cafb0 0x7ffb980cc0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:43:01.249 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:01.246+0000 7ffb9d1d5700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb980cd8a0 con 0x7ffb98154350 2023-06-09T04:43:01.249 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:01.246+0000 7ffb9d1d5700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb980cb420 con 0x7ffb9815deb0 2023-06-09T04:43:01.250 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:01.246+0000 7ffb9d1d5700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb98154720 con 0x7ffb980cafb0 2023-06-09T04:43:01.250 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:01.246+0000 7ffb97fff700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7ffb98154350 0x7ffb9815d7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:54432/0 (socket says 172.21.15.90:54432) 2023-06-09T04:43:01.250 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:01.246+0000 7ffb97fff700 1 -- 172.21.15.90:0/1443217344 learned_addr learned my addr 172.21.15.90:0/1443217344 (peer_addr_for_me v1:172.21.15.90:0/0) 2023-06-09T04:43:01.251 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:01.246+0000 7ffb977fe700 1 --2- 172.21.15.90:0/1443217344 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffb980cafb0 0x7ffb980cc0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:43:01.251 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:01.246+0000 7ffb96ffd700 1 -- 172.21.15.90:0/1443217344 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2083046467 0 0) 0x7ffb980cd8a0 con 0x7ffb98154350 2023-06-09T04:43:01.251 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:01.246+0000 7ffb96ffd700 1 -- 172.21.15.90:0/1443217344 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb800035d0 con 0x7ffb98154350 2023-06-09T04:43:01.252 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:01.246+0000 7ffb96ffd700 1 -- 172.21.15.90:0/1443217344 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1239219752 0 0) 0x7ffb980cb420 con 0x7ffb9815deb0 2023-06-09T04:43:01.252 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:01.246+0000 7ffb96ffd700 1 -- 172.21.15.90:0/1443217344 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb980cd8a0 con 0x7ffb9815deb0 2023-06-09T04:43:01.252 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:01.246+0000 7ffb96ffd700 1 -- 172.21.15.90:0/1443217344 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 619808888 0 0) 0x7ffb800035d0 con 0x7ffb98154350 2023-06-09T04:43:01.252 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:01.246+0000 7ffb977fe700 1 -- 172.21.15.90:0/1443217344 >> v1:172.21.15.174:6789/0 conn(0x7ffb9815deb0 legacy=0x7ffb98069c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:43:01.252 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:01.246+0000 7ffb977fe700 1 -- 172.21.15.90:0/1443217344 >> v1:172.21.15.90:6789/0 conn(0x7ffb98154350 legacy=0x7ffb9815d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:43:01.252 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:01.246+0000 7ffb977fe700 1 -- 172.21.15.90:0/1443217344 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb980cdaf0 con 0x7ffb980cafb0 2023-06-09T04:43:01.253 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:01.250+0000 7ffb977fe700 1 --2- 172.21.15.90:0/1443217344 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffb980cafb0 0x7ffb980cc0f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ffb8c009880 tx=0x7ffb8c009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f4bc90883c7b6e22 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:43:01.253 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:01.250+0000 7ffb96ffd700 1 -- 172.21.15.90:0/1443217344 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb880019f0 con 0x7ffb980cafb0 2023-06-09T04:43:01.253 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:01.250+0000 7ffb96ffd700 1 -- 172.21.15.90:0/1443217344 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb8c004030 con 0x7ffb980cafb0 2023-06-09T04:43:01.254 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:01.250+0000 7ffb96ffd700 1 -- 172.21.15.90:0/1443217344 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb8c0043c0 con 0x7ffb980cafb0 2023-06-09T04:43:01.254 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:01.250+0000 7ffb9d1d5700 1 -- 172.21.15.90:0/1443217344 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffb980cafb0 msgr2=0x7ffb980cc0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:43:01.254 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:01.250+0000 7ffb9d1d5700 1 --2- 172.21.15.90:0/1443217344 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffb980cafb0 0x7ffb980cc0f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ffb8c009880 tx=0x7ffb8c009b90 comp rx=0 tx=0).stop 2023-06-09T04:43:01.254 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:01.250+0000 7ffb9d1d5700 1 -- 172.21.15.90:0/1443217344 shutdown_connections 2023-06-09T04:43:01.254 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:01.250+0000 7ffb9d1d5700 1 --2- 172.21.15.90:0/1443217344 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffb980cafb0 0x7ffb980cc0f0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:43:01.254 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:01.250+0000 7ffb9d1d5700 1 -- 172.21.15.90:0/1443217344 >> 172.21.15.90:0/1443217344 conn(0x7ffb9806c690 msgr2=0x7ffb980aff00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:43:01.255 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:01.250+0000 7ffb9d1d5700 1 -- 172.21.15.90:0/1443217344 shutdown_connections 2023-06-09T04:43:01.255 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:01.250+0000 7ffb9d1d5700 1 -- 172.21.15.90:0/1443217344 wait complete. 2023-06-09T04:43:01.255 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:01.254+0000 7ffb9d1d5700 1 Processor -- start 2023-06-09T04:43:01.255 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:01.254+0000 7ffb9d1d5700 1 -- start start 2023-06-09T04:43:01.256 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:01.254+0000 7ffb9d1d5700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffb980cafb0 0x7ffb98142ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:43:01.257 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:01.254+0000 7ffb9d1d5700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffb98154350 0x7ffb9814eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:43:01.257 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:01.254+0000 7ffb9d1d5700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffb9815deb0 0x7ffb9814f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:43:01.257 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:01.254+0000 7ffb9d1d5700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb980709f0 con 0x7ffb980cafb0 2023-06-09T04:43:01.257 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:01.254+0000 7ffb9d1d5700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb9814ccf0 con 0x7ffb9815deb0 2023-06-09T04:43:01.257 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:01.254+0000 7ffb9d1d5700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb9814ca10 con 0x7ffb98154350 2023-06-09T04:43:01.258 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:01.254+0000 7ffb97fff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffb980cafb0 0x7ffb98142ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:43:01.258 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:01.254+0000 7ffb97fff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffb980cafb0 0x7ffb98142ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:44398/0 (socket says 172.21.15.90:44398) 2023-06-09T04:43:01.258 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:01.254+0000 7ffb97fff700 1 -- 172.21.15.90:0/2383947024 learned_addr learned my addr 172.21.15.90:0/2383947024 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:43:01.259 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:01.254+0000 7ffb977fe700 1 --2- 172.21.15.90:0/2383947024 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffb98154350 0x7ffb9814eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:43:01.259 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:01.254+0000 7ffb9c9d4700 1 --2- 172.21.15.90:0/2383947024 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffb9815deb0 0x7ffb9814f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:43:01.259 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:01.254+0000 7ffb97fff700 1 -- 172.21.15.90:0/2383947024 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffb98154350 msgr2=0x7ffb9814eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:43:01.259 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:01.254+0000 7ffb97fff700 1 --2- 172.21.15.90:0/2383947024 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffb98154350 0x7ffb9814eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:43:01.259 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:01.254+0000 7ffb97fff700 1 -- 172.21.15.90:0/2383947024 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffb9815deb0 msgr2=0x7ffb9814f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:43:01.259 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:01.254+0000 7ffb97fff700 1 --2- 172.21.15.90:0/2383947024 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffb9815deb0 0x7ffb9814f090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:43:01.259 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:01.254+0000 7ffb97fff700 1 -- 172.21.15.90:0/2383947024 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb8c0094b0 con 0x7ffb980cafb0 2023-06-09T04:43:01.260 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:01.254+0000 7ffb97fff700 1 --2- 172.21.15.90:0/2383947024 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffb980cafb0 0x7ffb98142ef0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7ffb88001870 tx=0x7ffb8800a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:43:01.260 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:01.254+0000 7ffb94ff9700 1 -- 172.21.15.90:0/2383947024 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb8800ad30 con 0x7ffb980cafb0 2023-06-09T04:43:01.260 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:01.254+0000 7ffb94ff9700 1 -- 172.21.15.90:0/2383947024 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb8800ae90 con 0x7ffb980cafb0 2023-06-09T04:43:01.261 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:01.254+0000 7ffb9d1d5700 1 -- 172.21.15.90:0/2383947024 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb980703a0 con 0x7ffb980cafb0 2023-06-09T04:43:01.261 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:01.254+0000 7ffb94ff9700 1 -- 172.21.15.90:0/2383947024 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb88007310 con 0x7ffb980cafb0 2023-06-09T04:43:01.261 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:01.258+0000 7ffb9d1d5700 1 -- 172.21.15.90:0/2383947024 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb98143430 con 0x7ffb980cafb0 2023-06-09T04:43:01.261 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:01.258+0000 7ffb9d1d5700 1 -- 172.21.15.90:0/2383947024 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb9806b390 con 0x7ffb980cafb0 2023-06-09T04:43:01.263 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:01.262+0000 7ffb94ff9700 1 -- 172.21.15.90:0/2383947024 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ffb88007470 con 0x7ffb980cafb0 2023-06-09T04:43:01.264 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:01.262+0000 7ffb94ff9700 1 --2- 172.21.15.90:0/2383947024 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7ffb84066320 0x7ffb840687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:43:01.264 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:01.262+0000 7ffb94ff9700 1 -- 172.21.15.90:0/2383947024 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ffb88083860 con 0x7ffb980cafb0 2023-06-09T04:43:01.268 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:01.262+0000 7ffb977fe700 1 --2- 172.21.15.90:0/2383947024 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7ffb84066320 0x7ffb840687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:43:01.268 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:01.262+0000 7ffb977fe700 1 --2- 172.21.15.90:0/2383947024 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7ffb84066320 0x7ffb840687d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7ffb8c0090b0 tx=0x7ffb8c010000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:43:01.269 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:01.266+0000 7ffb94ff9700 1 -- 172.21.15.90:0/2383947024 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ffb88050cf0 con 0x7ffb980cafb0 2023-06-09T04:43:01.477 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:01.474+0000 7ffb9d1d5700 1 -- 172.21.15.90:0/2383947024 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ffb9804e380 con 0x7ffb980cafb0 2023-06-09T04:43:01.478 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:01.474+0000 7ffb94ff9700 1 -- 172.21.15.90:0/2383947024 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4677 (secure 0 0 0) 0x7ffb88054310 con 0x7ffb980cafb0 2023-06-09T04:43:01.478 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:43:01.478 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4823,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6836/3809357484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":3809357484},{"type":"v1","addr":"172.21.15.174:6836","nonce":3809357484}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4826,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6837/3671460411","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6835","nonce":3671460411},{"type":"v1","addr":"172.21.15.174:6837","nonce":3671460411}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5121,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6833/3057926440","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3057926440},{"type":"v1","addr":"172.21.15.90:6833","nonce":3057926440}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-09T04:42:57.840003+0000","modified":"2023-06-09T04:43:01.026947+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5124},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5124":{"gid":5124,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.90:6835/1290764843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1290764843},{"type":"v1","addr":"172.21.15.90:6835","nonce":1290764843}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-06-09T04:43:01.480 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:01.478+0000 7ffb9d1d5700 1 -- 172.21.15.90:0/2383947024 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7ffb84066320 msgr2=0x7ffb840687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:43:01.481 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:01.478+0000 7ffb9d1d5700 1 --2- 172.21.15.90:0/2383947024 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7ffb84066320 0x7ffb840687d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7ffb8c0090b0 tx=0x7ffb8c010000 comp rx=0 tx=0).stop 2023-06-09T04:43:01.481 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:01.478+0000 7ffb9d1d5700 1 -- 172.21.15.90:0/2383947024 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffb980cafb0 msgr2=0x7ffb98142ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:43:01.481 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:01.478+0000 7ffb9d1d5700 1 --2- 172.21.15.90:0/2383947024 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffb980cafb0 0x7ffb98142ef0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7ffb88001870 tx=0x7ffb8800a340 comp rx=0 tx=0).stop 2023-06-09T04:43:01.482 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:01.478+0000 7ffb9d1d5700 1 -- 172.21.15.90:0/2383947024 shutdown_connections 2023-06-09T04:43:01.482 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:01.478+0000 7ffb9d1d5700 1 --2- 172.21.15.90:0/2383947024 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7ffb84066320 0x7ffb840687d0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:43:01.482 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:01.478+0000 7ffb9d1d5700 1 --2- 172.21.15.90:0/2383947024 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffb9815deb0 0x7ffb9814f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:43:01.482 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:01.478+0000 7ffb9d1d5700 1 --2- 172.21.15.90:0/2383947024 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffb98154350 0x7ffb9814eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:43:01.482 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:01.478+0000 7ffb9d1d5700 1 --2- 172.21.15.90:0/2383947024 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffb980cafb0 0x7ffb98142ef0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:43:01.482 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:01.478+0000 7ffb9d1d5700 1 -- 172.21.15.90:0/2383947024 >> 172.21.15.90:0/2383947024 conn(0x7ffb9806c690 msgr2=0x7ffb980cc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:43:01.482 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:01.478+0000 7ffb9d1d5700 1 -- 172.21.15.90:0/2383947024 shutdown_connections 2023-06-09T04:43:01.483 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:01.478+0000 7ffb9d1d5700 1 -- 172.21.15.90:0/2383947024 wait complete. 2023-06-09T04:43:01.483 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 15 2023-06-09T04:43:01.504 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T04:43:01.674 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:01.670+0000 7fd5b09bb700 1 Processor -- start 2023-06-09T04:43:01.674 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:01.670+0000 7fd5b09bb700 1 -- start start 2023-06-09T04:43:01.677 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:01.674+0000 7fd5b09bb700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fd5ac06acf0 0x7fd5ac15d850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:43:01.678 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:01.674+0000 7fd5b09bb700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5ac15e1f0 con 0x7fd5ac15dd90 2023-06-09T04:43:01.678 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:01.674+0000 7fd5b09bb700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5ac0cad00 con 0x7fd5ac0cdbf0 2023-06-09T04:43:01.678 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:01.674+0000 7fd5b09bb700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5ac0cdfc0 con 0x7fd5ac06acf0 2023-06-09T04:43:01.678 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:01.674+0000 7fd5a2ffd700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fd5ac06acf0 0x7fd5ac15d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:43:01.679 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:01.674+0000 7fd5a2ffd700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fd5ac06acf0 0x7fd5ac15d850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:44414/0 (socket says 172.21.15.90:44414) 2023-06-09T04:43:01.679 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:01.674+0000 7fd5a2ffd700 1 -- 172.21.15.90:0/4123083100 learned_addr learned my addr 172.21.15.90:0/4123083100 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:43:01.680 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:01.674+0000 7fd5a2ffd700 1 -- 172.21.15.90:0/4123083100 >> v1:172.21.15.174:6789/0 conn(0x7fd5ac0cdbf0 legacy=0x7fd5ac0cb190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:43:01.680 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:01.674+0000 7fd5a2ffd700 1 -- 172.21.15.90:0/4123083100 >> v1:172.21.15.90:6789/0 conn(0x7fd5ac15dd90 legacy=0x7fd5ac0b29e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:43:01.681 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:01.674+0000 7fd5a2ffd700 1 -- 172.21.15.90:0/4123083100 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5ac06a8b0 con 0x7fd5ac06acf0 2023-06-09T04:43:01.681 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:01.678+0000 7fd5a2ffd700 1 --2- 172.21.15.90:0/4123083100 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd5ac06acf0 0x7fd5ac15d850 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fd594009910 tx=0x7fd594009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1a11b88e9ac260f server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:43:01.681 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:01.678+0000 7fd5aaffd700 1 -- 172.21.15.90:0/4123083100 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd59400ba60 con 0x7fd5ac06acf0 2023-06-09T04:43:01.681 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:01.678+0000 7fd5aaffd700 1 -- 172.21.15.90:0/4123083100 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd59400bbc0 con 0x7fd5ac06acf0 2023-06-09T04:43:01.682 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:01.678+0000 7fd5aaffd700 1 -- 172.21.15.90:0/4123083100 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd594009e60 con 0x7fd5ac06acf0 2023-06-09T04:43:01.683 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:01.678+0000 7fd5b09bb700 1 -- 172.21.15.90:0/4123083100 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd5ac06acf0 msgr2=0x7fd5ac15d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:43:01.683 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:01.678+0000 7fd5b09bb700 1 --2- 172.21.15.90:0/4123083100 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd5ac06acf0 0x7fd5ac15d850 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fd594009910 tx=0x7fd594009c20 comp rx=0 tx=0).stop 2023-06-09T04:43:01.684 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:01.678+0000 7fd5b09bb700 1 -- 172.21.15.90:0/4123083100 shutdown_connections 2023-06-09T04:43:01.684 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:01.678+0000 7fd5b09bb700 1 --2- 172.21.15.90:0/4123083100 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd5ac06acf0 0x7fd5ac15d850 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:43:01.684 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:01.678+0000 7fd5b09bb700 1 -- 172.21.15.90:0/4123083100 >> 172.21.15.90:0/4123083100 conn(0x7fd5ac06c690 msgr2=0x7fd5ac0aff00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:43:01.684 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:01.678+0000 7fd5b09bb700 1 -- 172.21.15.90:0/4123083100 shutdown_connections 2023-06-09T04:43:01.685 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:01.678+0000 7fd5b09bb700 1 -- 172.21.15.90:0/4123083100 wait complete. 2023-06-09T04:43:01.687 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:01.682+0000 7fd5b09bb700 1 Processor -- start 2023-06-09T04:43:01.687 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:01.682+0000 7fd5b09bb700 1 -- start start 2023-06-09T04:43:01.688 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:01.682+0000 7fd5b09bb700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd5ac06acf0 0x7fd5ac14e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:43:01.688 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:01.682+0000 7fd5b09bb700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd5ac0cdbf0 0x7fd5ac1f1800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:43:01.688 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:01.682+0000 7fd5b09bb700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd5ac15dd90 0x7fd5ac150510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:43:01.689 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:01.682+0000 7fd5b09bb700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5ac070830 con 0x7fd5ac06acf0 2023-06-09T04:43:01.689 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:01.682+0000 7fd5b09bb700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5ac150270 con 0x7fd5ac0cdbf0 2023-06-09T04:43:01.689 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:01.682+0000 7fd5b09bb700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5ac06fcb0 con 0x7fd5ac15dd90 2023-06-09T04:43:01.689 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:01.682+0000 7fd5ab7fe700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd5ac06acf0 0x7fd5ac14e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:43:01.689 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:01.682+0000 7fd5ab7fe700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd5ac06acf0 0x7fd5ac14e030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:44422/0 (socket says 172.21.15.90:44422) 2023-06-09T04:43:01.689 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:01.682+0000 7fd5ab7fe700 1 -- 172.21.15.90:0/359819109 learned_addr learned my addr 172.21.15.90:0/359819109 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:43:01.689 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:01.682+0000 7fd5a2ffd700 1 --2- 172.21.15.90:0/359819109 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd5ac0cdbf0 0x7fd5ac1f1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:43:01.689 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:01.682+0000 7fd5abfff700 1 --2- 172.21.15.90:0/359819109 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd5ac15dd90 0x7fd5ac150510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:43:01.690 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:01.682+0000 7fd5ab7fe700 1 -- 172.21.15.90:0/359819109 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd5ac15dd90 msgr2=0x7fd5ac150510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:43:01.690 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:01.682+0000 7fd5ab7fe700 1 --2- 172.21.15.90:0/359819109 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd5ac15dd90 0x7fd5ac150510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:43:01.690 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:01.682+0000 7fd5ab7fe700 1 -- 172.21.15.90:0/359819109 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd5ac0cdbf0 msgr2=0x7fd5ac1f1800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:43:01.690 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:01.682+0000 7fd5ab7fe700 1 --2- 172.21.15.90:0/359819109 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd5ac0cdbf0 0x7fd5ac1f1800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:43:01.690 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:01.682+0000 7fd5ab7fe700 1 -- 172.21.15.90:0/359819109 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd594009570 con 0x7fd5ac06acf0 2023-06-09T04:43:01.690 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:01.682+0000 7fd5abfff700 1 --2- 172.21.15.90:0/359819109 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd5ac15dd90 0x7fd5ac150510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:43:01.690 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:01.686+0000 7fd5ab7fe700 1 --2- 172.21.15.90:0/359819109 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd5ac06acf0 0x7fd5ac14e030 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fd59c00c500 tx=0x7fd59c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:43:01.691 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:01.686+0000 7fd5a8ff9700 1 -- 172.21.15.90:0/359819109 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd59c0052d0 con 0x7fd5ac06acf0 2023-06-09T04:43:01.691 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:01.686+0000 7fd5a8ff9700 1 -- 172.21.15.90:0/359819109 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd59c005430 con 0x7fd5ac06acf0 2023-06-09T04:43:01.692 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:01.686+0000 7fd5a8ff9700 1 -- 172.21.15.90:0/359819109 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd59c0055a0 con 0x7fd5ac06acf0 2023-06-09T04:43:01.692 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:01.686+0000 7fd5b09bb700 1 -- 172.21.15.90:0/359819109 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5ac06ff90 con 0x7fd5ac06acf0 2023-06-09T04:43:01.692 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:01.686+0000 7fd5b09bb700 1 -- 172.21.15.90:0/359819109 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5ac070550 con 0x7fd5ac06acf0 2023-06-09T04:43:01.692 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:01.686+0000 7fd5b09bb700 1 -- 172.21.15.90:0/359819109 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5ac06b390 con 0x7fd5ac06acf0 2023-06-09T04:43:01.692 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:01.690+0000 7fd5a8ff9700 1 -- 172.21.15.90:0/359819109 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd59c0038e0 con 0x7fd5ac06acf0 2023-06-09T04:43:01.693 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:01.690+0000 7fd5a8ff9700 1 --2- 172.21.15.90:0/359819109 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fd58c0662f0 0x7fd58c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:43:01.693 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:01.690+0000 7fd5a8ff9700 1 -- 172.21.15.90:0/359819109 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd59c083220 con 0x7fd5ac06acf0 2023-06-09T04:43:01.694 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:01.690+0000 7fd5a2ffd700 1 --2- 172.21.15.90:0/359819109 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fd58c0662f0 0x7fd58c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:43:01.695 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:01.694+0000 7fd5a2ffd700 1 --2- 172.21.15.90:0/359819109 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fd58c0662f0 0x7fd58c0687a0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fd594006f80 tx=0x7fd594008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:43:01.699 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:01.698+0000 7fd5a8ff9700 1 -- 172.21.15.90:0/359819109 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd59c050690 con 0x7fd5ac06acf0 2023-06-09T04:43:01.869 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:01.866+0000 7fd5b09bb700 1 -- 172.21.15.90:0/359819109 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd5ac1f4e50 con 0x7fd5ac06acf0 2023-06-09T04:43:01.871 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:01.866+0000 7fd5a8ff9700 1 -- 172.21.15.90:0/359819109 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+18351 (secure 0 0 0) 0x7fd5ac1f4e50 con 0x7fd5ac06acf0 2023-06-09T04:43:01.871 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:43:01.872 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":38,"fsid":"700369c0-a111-43b4-9415-844ad1742b70","created":"2023-06-09T04:41:28.180311+0000","modified":"2023-06-09T04:42:58.844927+0000","last_up_change":"2023-06-09T04:41:40.746475+0000","last_in_change":"2023-06-09T04:41:31.262765+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-09T04:41:42.402564+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-09T04:41:47.607323+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-06-09T04:42:55.855674+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-06-09T04:42:56.846984+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"46a4a7c5-babd-4ef3-9830-51487cff5eb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":2780271267},{"type":"v1","addr":"172.21.15.90:6809","nonce":2780271267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2780271267},{"type":"v1","addr":"172.21.15.90:6811","nonce":2780271267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2780271267},{"type":"v1","addr":"172.21.15.90:6815","nonce":2780271267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2780271267},{"type":"v1","addr":"172.21.15.90:6813","nonce":2780271267}]},"public_addr":"172.21.15.90:6809/2780271267","cluster_addr":"172.21.15.90:6811/2780271267","heartbeat_back_addr":"172.21.15.90:6815/2780271267","heartbeat_front_addr":"172.21.15.90:6813/2780271267","state":["exists","up"]},{"osd":1,"uuid":"1543988f-c498-494a-a6f9-fac8413db6ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":3064028136},{"type":"v1","addr":"172.21.15.90:6801","nonce":3064028136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":3064028136},{"type":"v1","addr":"172.21.15.90:6803","nonce":3064028136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":3064028136},{"type":"v1","addr":"172.21.15.90:6807","nonce":3064028136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":3064028136},{"type":"v1","addr":"172.21.15.90:6805","nonce":3064028136}]},"public_addr":"172.21.15.90:6801/3064028136","cluster_addr":"172.21.15.90:6803/3064028136","heartbeat_back_addr":"172.21.15.90:6807/3064028136","heartbeat_front_addr":"172.21.15.90:6805/3064028136","state":["exists","up"]},{"osd":2,"uuid":"79669dd6-ffc8-4197-b9f7-b3b372b2b9b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":3713146326},{"type":"v1","addr":"172.21.15.90:6825","nonce":3713146326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":3713146326},{"type":"v1","addr":"172.21.15.90:6827","nonce":3713146326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":3713146326},{"type":"v1","addr":"172.21.15.90:6831","nonce":3713146326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":3713146326},{"type":"v1","addr":"172.21.15.90:6829","nonce":3713146326}]},"public_addr":"172.21.15.90:6825/3713146326","cluster_addr":"172.21.15.90:6827/3713146326","heartbeat_back_addr":"172.21.15.90:6831/3713146326","heartbeat_front_addr":"172.21.15.90:6829/3713146326","state":["exists","up"]},{"osd":3,"uuid":"4062ab6f-ce40-450a-aa17-b10098766c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":3499839122},{"type":"v1","addr":"172.21.15.90:6817","nonce":3499839122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":3499839122},{"type":"v1","addr":"172.21.15.90:6819","nonce":3499839122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":3499839122},{"type":"v1","addr":"172.21.15.90:6823","nonce":3499839122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":3499839122},{"type":"v1","addr":"172.21.15.90:6821","nonce":3499839122}]},"public_addr":"172.21.15.90:6817/3499839122","cluster_addr":"172.21.15.90:6819/3499839122","heartbeat_back_addr":"172.21.15.90:6823/3499839122","heartbeat_front_addr":"172.21.15.90:6821/3499839122","state":["exists","up"]},{"osd":4,"uuid":"a10820e4-b348-4d92-9796-3b01484ace1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6817","nonce":1138565854},{"type":"v1","addr":"172.21.15.174:6819","nonce":1138565854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6821","nonce":1138565854},{"type":"v1","addr":"172.21.15.174:6823","nonce":1138565854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":1138565854},{"type":"v1","addr":"172.21.15.174:6831","nonce":1138565854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":1138565854},{"type":"v1","addr":"172.21.15.174:6829","nonce":1138565854}]},"public_addr":"172.21.15.174:6819/1138565854","cluster_addr":"172.21.15.174:6823/1138565854","heartbeat_back_addr":"172.21.15.174:6831/1138565854","heartbeat_front_addr":"172.21.15.174:6829/1138565854","state":["exists","up"]},{"osd":5,"uuid":"b4da1c32-be05-420b-9346-90d91aa70569","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":1707702879},{"type":"v1","addr":"172.21.15.174:6818","nonce":1707702879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":1707702879},{"type":"v1","addr":"172.21.15.174:6822","nonce":1707702879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6827","nonce":1707702879},{"type":"v1","addr":"172.21.15.174:6828","nonce":1707702879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":1707702879},{"type":"v1","addr":"172.21.15.174:6825","nonce":1707702879}]},"public_addr":"172.21.15.174:6818/1707702879","cluster_addr":"172.21.15.174:6822/1707702879","heartbeat_back_addr":"172.21.15.174:6828/1707702879","heartbeat_front_addr":"172.21.15.174:6825/1707702879","state":["exists","up"]},{"osd":6,"uuid":"d1b98041-d243-4355-bd0a-e22cf9875b32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":864450534},{"type":"v1","addr":"172.21.15.174:6801","nonce":864450534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":864450534},{"type":"v1","addr":"172.21.15.174:6803","nonce":864450534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":864450534},{"type":"v1","addr":"172.21.15.174:6807","nonce":864450534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":864450534},{"type":"v1","addr":"172.21.15.174:6805","nonce":864450534}]},"public_addr":"172.21.15.174:6801/864450534","cluster_addr":"172.21.15.174:6803/864450534","heartbeat_back_addr":"172.21.15.174:6807/864450534","heartbeat_front_addr":"172.21.15.174:6805/864450534","state":["exists","up"]},{"osd":7,"uuid":"5a207936-f89f-416b-b79b-34ec96f77c8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":2527640659},{"type":"v1","addr":"172.21.15.174:6809","nonce":2527640659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":2527640659},{"type":"v1","addr":"172.21.15.174:6811","nonce":2527640659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":2527640659},{"type":"v1","addr":"172.21.15.174:6815","nonce":2527640659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":2527640659},{"type":"v1","addr":"172.21.15.174:6813","nonce":2527640659}]},"public_addr":"172.21.15.174:6809/2527640659","cluster_addr":"172.21.15.174:6811/2527640659","heartbeat_back_addr":"172.21.15.174:6815/2527640659","heartbeat_front_addr":"172.21.15.174:6813/2527640659","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:36.972152+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:36.984561+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:36.998817+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:37.054944+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:37.085014+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:37.115125+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:36.854608+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:36.971685+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:43:01.874 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:01.870+0000 7fd5b09bb700 1 -- 172.21.15.90:0/359819109 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fd58c0662f0 msgr2=0x7fd58c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:43:01.874 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:01.870+0000 7fd5b09bb700 1 --2- 172.21.15.90:0/359819109 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fd58c0662f0 0x7fd58c0687a0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fd594006f80 tx=0x7fd594008030 comp rx=0 tx=0).stop 2023-06-09T04:43:01.874 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:01.870+0000 7fd5b09bb700 1 -- 172.21.15.90:0/359819109 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd5ac06acf0 msgr2=0x7fd5ac14e030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:43:01.874 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:01.870+0000 7fd5b09bb700 1 --2- 172.21.15.90:0/359819109 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd5ac06acf0 0x7fd5ac14e030 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fd59c00c500 tx=0x7fd59c00c8c0 comp rx=0 tx=0).stop 2023-06-09T04:43:01.874 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:01.870+0000 7fd5b09bb700 1 -- 172.21.15.90:0/359819109 shutdown_connections 2023-06-09T04:43:01.875 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:01.870+0000 7fd5b09bb700 1 --2- 172.21.15.90:0/359819109 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fd58c0662f0 0x7fd58c0687a0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:43:01.875 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:01.870+0000 7fd5b09bb700 1 --2- 172.21.15.90:0/359819109 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd5ac15dd90 0x7fd5ac150510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:43:01.875 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:01.870+0000 7fd5b09bb700 1 --2- 172.21.15.90:0/359819109 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd5ac0cdbf0 0x7fd5ac1f1800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:43:01.875 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:01.870+0000 7fd5b09bb700 1 --2- 172.21.15.90:0/359819109 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd5ac06acf0 0x7fd5ac14e030 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:43:01.875 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:01.870+0000 7fd5b09bb700 1 -- 172.21.15.90:0/359819109 >> 172.21.15.90:0/359819109 conn(0x7fd5ac06c690 msgr2=0x7fd5ac0b3b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:43:01.875 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:01.870+0000 7fd5b09bb700 1 -- 172.21.15.90:0/359819109 shutdown_connections 2023-06-09T04:43:01.876 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:01.870+0000 7fd5b09bb700 1 -- 172.21.15.90:0/359819109 wait complete. 2023-06-09T04:43:01.895 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-06-09T04:43:01.896 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-09T04:43:02.063 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.058+0000 7f8119f37700 1 Processor -- start 2023-06-09T04:43:02.063 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.062+0000 7f8119f37700 1 -- start start 2023-06-09T04:43:02.064 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.062+0000 7f8119f37700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f81141574c0 0x7f81140cdb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:43:02.065 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.062+0000 7f8119f37700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f81140cac00 0x7f81140cb050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:43:02.065 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.062+0000 7f8119f37700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81141618e0 con 0x7f8114069820 2023-06-09T04:43:02.065 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.062+0000 7f8119f37700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8114157890 con 0x7f81141574c0 2023-06-09T04:43:02.065 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.062+0000 7f8119f37700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81140cb590 con 0x7f81140cac00 2023-06-09T04:43:02.066 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.062+0000 7f8119736700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f8114069820 0x7f8114069ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:54448/0 (socket says 172.21.15.90:54448) 2023-06-09T04:43:02.066 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.062+0000 7f8119736700 1 -- 172.21.15.90:0/1934813422 learned_addr learned my addr 172.21.15.90:0/1934813422 (peer_addr_for_me v1:172.21.15.90:0/0) 2023-06-09T04:43:02.066 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.062+0000 7f810bfff700 1 --2- 172.21.15.90:0/1934813422 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f81140cac00 0x7f81140cb050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:43:02.066 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.062+0000 7f8118f35700 1 --2- 172.21.15.90:0/1934813422 >> v2:172.21.15.174:3300/0 conn(0x7f81141574c0 0x7f81140cdb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:43:02.067 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.062+0000 7f810b7fe700 1 -- 172.21.15.90:0/1934813422 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3822698579 0 0) 0x7f81141618e0 con 0x7f8114069820 2023-06-09T04:43:02.067 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.062+0000 7f810b7fe700 1 -- 172.21.15.90:0/1934813422 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f80fc0035d0 con 0x7f8114069820 2023-06-09T04:43:02.067 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.062+0000 7f810bfff700 1 -- 172.21.15.90:0/1934813422 >> v2:172.21.15.174:3300/0 conn(0x7f81141574c0 msgr2=0x7f81140cdb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:43:02.067 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.062+0000 7f810bfff700 1 --2- 172.21.15.90:0/1934813422 >> v2:172.21.15.174:3300/0 conn(0x7f81141574c0 0x7f81140cdb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:43:02.067 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.062+0000 7f810bfff700 1 -- 172.21.15.90:0/1934813422 >> v1:172.21.15.90:6789/0 conn(0x7f8114069820 legacy=0x7f8114069ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:43:02.067 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.062+0000 7f810bfff700 1 -- 172.21.15.90:0/1934813422 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81141647b0 con 0x7f81140cac00 2023-06-09T04:43:02.068 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.062+0000 7f8118f35700 1 --2- 172.21.15.90:0/1934813422 >> v2:172.21.15.174:3300/0 conn(0x7f81141574c0 0x7f81140cdb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:43:02.068 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.066+0000 7f810bfff700 1 --2- 172.21.15.90:0/1934813422 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f81140cac00 0x7f81140cb050 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8104009880 tx=0x7f8104009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a396ce07f5085b4e server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:43:02.068 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.066+0000 7f810b7fe700 1 -- 172.21.15.90:0/1934813422 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8104011830 con 0x7f81140cac00 2023-06-09T04:43:02.068 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.066+0000 7f810b7fe700 1 -- 172.21.15.90:0/1934813422 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8104011990 con 0x7f81140cac00 2023-06-09T04:43:02.069 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.066+0000 7f810b7fe700 1 -- 172.21.15.90:0/1934813422 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8104011d20 con 0x7f81140cac00 2023-06-09T04:43:02.069 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.066+0000 7f8119f37700 1 -- 172.21.15.90:0/1934813422 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f81140cac00 msgr2=0x7f81140cb050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:43:02.070 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.066+0000 7f8119f37700 1 --2- 172.21.15.90:0/1934813422 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f81140cac00 0x7f81140cb050 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8104009880 tx=0x7f8104009b90 comp rx=0 tx=0).stop 2023-06-09T04:43:02.070 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.066+0000 7f8119f37700 1 -- 172.21.15.90:0/1934813422 shutdown_connections 2023-06-09T04:43:02.070 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.066+0000 7f8119f37700 1 --2- 172.21.15.90:0/1934813422 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f81140cac00 0x7f81140cb050 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:43:02.070 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.066+0000 7f8119f37700 1 --2- 172.21.15.90:0/1934813422 >> v2:172.21.15.174:3300/0 conn(0x7f81141574c0 0x7f81140cdb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:43:02.070 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.066+0000 7f8119f37700 1 -- 172.21.15.90:0/1934813422 >> 172.21.15.90:0/1934813422 conn(0x7f811406c690 msgr2=0x7f81140aff00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:43:02.070 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.066+0000 7f8119f37700 1 -- 172.21.15.90:0/1934813422 shutdown_connections 2023-06-09T04:43:02.070 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.066+0000 7f8119f37700 1 -- 172.21.15.90:0/1934813422 wait complete. 2023-06-09T04:43:02.071 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.070+0000 7f8119f37700 1 Processor -- start 2023-06-09T04:43:02.072 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.070+0000 7f8119f37700 1 -- start start 2023-06-09T04:43:02.073 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.070+0000 7f8119f37700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8114069820 0x7f811415a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:43:02.074 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.070+0000 7f8119f37700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f81140cac00 0x7f81141f8c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:43:02.074 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.070+0000 7f8119f37700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f81141574c0 0x7f811414fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:43:02.074 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.070+0000 7f8119f37700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81141579d0 con 0x7f8114069820 2023-06-09T04:43:02.074 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.070+0000 7f8119f37700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81141f91d0 con 0x7f81140cac00 2023-06-09T04:43:02.074 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.070+0000 7f8119f37700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81141f9450 con 0x7f81141574c0 2023-06-09T04:43:02.075 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.070+0000 7f8118f35700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8114069820 0x7f811415a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:43:02.076 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.070+0000 7f8118f35700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8114069820 0x7f811415a910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:44428/0 (socket says 172.21.15.90:44428) 2023-06-09T04:43:02.076 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.070+0000 7f8118f35700 1 -- 172.21.15.90:0/1205879870 learned_addr learned my addr 172.21.15.90:0/1205879870 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:43:02.076 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.070+0000 7f810bfff700 1 --2- 172.21.15.90:0/1205879870 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f81140cac00 0x7f81141f8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:43:02.076 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.070+0000 7f8119736700 1 --2- 172.21.15.90:0/1205879870 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f81141574c0 0x7f811414fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:43:02.076 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.070+0000 7f8118f35700 1 -- 172.21.15.90:0/1205879870 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f81141574c0 msgr2=0x7f811414fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:43:02.076 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.070+0000 7f8118f35700 1 --2- 172.21.15.90:0/1205879870 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f81141574c0 0x7f811414fbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:43:02.076 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.070+0000 7f8118f35700 1 -- 172.21.15.90:0/1205879870 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f81140cac00 msgr2=0x7f81141f8c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:43:02.077 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.070+0000 7f8118f35700 1 --2- 172.21.15.90:0/1205879870 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f81140cac00 0x7f81141f8c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:43:02.077 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.070+0000 7f8118f35700 1 -- 172.21.15.90:0/1205879870 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81100094b0 con 0x7f8114069820 2023-06-09T04:43:02.077 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.074+0000 7f8118f35700 1 --2- 172.21.15.90:0/1205879870 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8114069820 0x7f811415a910 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f811000ebe0 tx=0x7f811000eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:43:02.077 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.074+0000 7f81097fa700 1 -- 172.21.15.90:0/1205879870 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8110009770 con 0x7f8114069820 2023-06-09T04:43:02.078 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.074+0000 7f81097fa700 1 -- 172.21.15.90:0/1205879870 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f811000c850 con 0x7f8114069820 2023-06-09T04:43:02.078 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.074+0000 7f8119f37700 1 -- 172.21.15.90:0/1205879870 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81040094b0 con 0x7f8114069820 2023-06-09T04:43:02.078 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.074+0000 7f81097fa700 1 -- 172.21.15.90:0/1205879870 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f811000cbe0 con 0x7f8114069820 2023-06-09T04:43:02.078 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.074+0000 7f8119f37700 1 -- 172.21.15.90:0/1205879870 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81141f9a10 con 0x7f8114069820 2023-06-09T04:43:02.079 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.074+0000 7f8119f37700 1 -- 172.21.15.90:0/1205879870 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f811406b390 con 0x7f8114069820 2023-06-09T04:43:02.079 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.074+0000 7f81097fa700 1 -- 172.21.15.90:0/1205879870 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f811000cd40 con 0x7f8114069820 2023-06-09T04:43:02.080 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.078+0000 7f81097fa700 1 --2- 172.21.15.90:0/1205879870 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f81000662f0 0x7f81000687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:43:02.080 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.078+0000 7f81097fa700 1 -- 172.21.15.90:0/1205879870 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8110083e00 con 0x7f8114069820 2023-06-09T04:43:02.080 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.078+0000 7f810bfff700 1 --2- 172.21.15.90:0/1205879870 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f81000662f0 0x7f81000687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:43:02.082 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.078+0000 7f810bfff700 1 --2- 172.21.15.90:0/1205879870 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f81000662f0 0x7f81000687a0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f8104009bd0 tx=0x7f8104008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:43:02.087 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.082+0000 7f81097fa700 1 -- 172.21.15.90:0/1205879870 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8110051160 con 0x7f8114069820 2023-06-09T04:43:02.252 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.250+0000 7f8119f37700 1 -- 172.21.15.90:0/1205879870 --> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8114163ec0 con 0x7f81000662f0 2023-06-09T04:43:02.270 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.266+0000 7f81097fa700 1 -- 172.21.15.90:0/1205879870 <== mgr.4104 v2:172.21.15.174:6832/1389974754 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+296597 (secure 0 0 0) 0x7f8104006c80 con 0x7f81000662f0 2023-06-09T04:43:02.276 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:43:02.279 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.278+0000 7f8119f37700 1 -- 172.21.15.90:0/1205879870 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f81000662f0 msgr2=0x7f81000687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:43:02.279 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.278+0000 7f8119f37700 1 --2- 172.21.15.90:0/1205879870 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f81000662f0 0x7f81000687a0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f8104009bd0 tx=0x7f8104008030 comp rx=0 tx=0).stop 2023-06-09T04:43:02.280 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.278+0000 7f8119f37700 1 -- 172.21.15.90:0/1205879870 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8114069820 msgr2=0x7f811415a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:43:02.280 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.278+0000 7f8119f37700 1 --2- 172.21.15.90:0/1205879870 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8114069820 0x7f811415a910 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f811000ebe0 tx=0x7f811000eef0 comp rx=0 tx=0).stop 2023-06-09T04:43:02.280 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.278+0000 7f8119f37700 1 -- 172.21.15.90:0/1205879870 shutdown_connections 2023-06-09T04:43:02.281 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.278+0000 7f8119f37700 1 --2- 172.21.15.90:0/1205879870 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f81000662f0 0x7f81000687a0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:43:02.281 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.278+0000 7f8119f37700 1 --2- 172.21.15.90:0/1205879870 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f81141574c0 0x7f811414fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:43:02.281 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.278+0000 7f8119f37700 1 --2- 172.21.15.90:0/1205879870 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f81140cac00 0x7f81141f8c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:43:02.281 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.278+0000 7f8119f37700 1 --2- 172.21.15.90:0/1205879870 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8114069820 0x7f811415a910 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:43:02.281 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.278+0000 7f8119f37700 1 -- 172.21.15.90:0/1205879870 >> 172.21.15.90:0/1205879870 conn(0x7f811406c690 msgr2=0x7f81140affa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:43:02.281 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.278+0000 7f8119f37700 1 -- 172.21.15.90:0/1205879870 shutdown_connections 2023-06-09T04:43:02.281 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.278+0000 7f8119f37700 1 -- 172.21.15.90:0/1205879870 wait complete. 2023-06-09T04:43:02.282 INFO:teuthology.orchestra.run.smithi090.stderr:dumped all 2023-06-09T04:43:02.300 INFO:teuthology.orchestra.run.smithi090.stdout:{"pg_ready":true,"pg_map":{"version":71,"stamp":"2023-06-09T04:43:00.334246+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":23,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219784,"kb_used_data":4168,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754754936,"statfs":{"total":773094113280,"available":772869054464,"internally_reserved":0,"allocated":4268032,"data_stored":2408576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000999"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:42:57.378828+0000","last_change":"2023-06-09T04:42:57.378828+0000","last_active":"2023-06-09T04:42:57.378828+0000","last_peered":"2023-06-09T04:42:57.378828+0000","last_clean":"2023-06-09T04:42:57.378828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:42:57.378828+0000","last_undegraded":"2023-06-09T04:42:57.378828+0000","last_fullsized":"2023-06-09T04:42:57.378828+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_clean_scrub_stamp":"2023-06-09T04:42:57.378828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:42:57.378828+0000","last_change":"2023-06-09T04:42:57.378828+0000","last_active":"2023-06-09T04:42:57.378828+0000","last_peered":"2023-06-09T04:42:57.378828+0000","last_clean":"2023-06-09T04:42:57.378828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:42:57.378828+0000","last_undegraded":"2023-06-09T04:42:57.378828+0000","last_fullsized":"2023-06-09T04:42:57.378828+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_clean_scrub_stamp":"2023-06-09T04:42:57.378828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:42:57.378828+0000","last_change":"2023-06-09T04:42:57.378828+0000","last_active":"2023-06-09T04:42:57.378828+0000","last_peered":"2023-06-09T04:42:57.378828+0000","last_clean":"2023-06-09T04:42:57.378828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:42:57.378828+0000","last_undegraded":"2023-06-09T04:42:57.378828+0000","last_fullsized":"2023-06-09T04:42:57.378828+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_clean_scrub_stamp":"2023-06-09T04:42:57.378828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:42:57.378828+0000","last_change":"2023-06-09T04:42:57.378828+0000","last_active":"2023-06-09T04:42:57.378828+0000","last_peered":"2023-06-09T04:42:57.378828+0000","last_clean":"2023-06-09T04:42:57.378828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:42:57.378828+0000","last_undegraded":"2023-06-09T04:42:57.378828+0000","last_fullsized":"2023-06-09T04:42:57.378828+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_clean_scrub_stamp":"2023-06-09T04:42:57.378828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:42:57.378828+0000","last_change":"2023-06-09T04:42:57.378828+0000","last_active":"2023-06-09T04:42:57.378828+0000","last_peered":"2023-06-09T04:42:57.378828+0000","last_clean":"2023-06-09T04:42:57.378828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:42:57.378828+0000","last_undegraded":"2023-06-09T04:42:57.378828+0000","last_fullsized":"2023-06-09T04:42:57.378828+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_clean_scrub_stamp":"2023-06-09T04:42:57.378828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:42:57.378828+0000","last_change":"2023-06-09T04:42:57.378828+0000","last_active":"2023-06-09T04:42:57.378828+0000","last_peered":"2023-06-09T04:42:57.378828+0000","last_clean":"2023-06-09T04:42:57.378828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:42:57.378828+0000","last_undegraded":"2023-06-09T04:42:57.378828+0000","last_fullsized":"2023-06-09T04:42:57.378828+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_clean_scrub_stamp":"2023-06-09T04:42:57.378828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:42:57.378828+0000","last_change":"2023-06-09T04:42:57.378828+0000","last_active":"2023-06-09T04:42:57.378828+0000","last_peered":"2023-06-09T04:42:57.378828+0000","last_clean":"2023-06-09T04:42:57.378828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:42:57.378828+0000","last_undegraded":"2023-06-09T04:42:57.378828+0000","last_fullsized":"2023-06-09T04:42:57.378828+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_clean_scrub_stamp":"2023-06-09T04:42:57.378828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:42:57.378828+0000","last_change":"2023-06-09T04:42:57.378828+0000","last_active":"2023-06-09T04:42:57.378828+0000","last_peered":"2023-06-09T04:42:57.378828+0000","last_clean":"2023-06-09T04:42:57.378828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:42:57.378828+0000","last_undegraded":"2023-06-09T04:42:57.378828+0000","last_fullsized":"2023-06-09T04:42:57.378828+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_clean_scrub_stamp":"2023-06-09T04:42:57.378828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:42:57.378828+0000","last_change":"2023-06-09T04:42:57.378828+0000","last_active":"2023-06-09T04:42:57.378828+0000","last_peered":"2023-06-09T04:42:57.378828+0000","last_clean":"2023-06-09T04:42:57.378828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:42:57.378828+0000","last_undegraded":"2023-06-09T04:42:57.378828+0000","last_fullsized":"2023-06-09T04:42:57.378828+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_clean_scrub_stamp":"2023-06-09T04:42:57.378828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:42:57.378828+0000","last_change":"2023-06-09T04:42:57.378828+0000","last_active":"2023-06-09T04:42:57.378828+0000","last_peered":"2023-06-09T04:42:57.378828+0000","last_clean":"2023-06-09T04:42:57.378828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:42:57.378828+0000","last_undegraded":"2023-06-09T04:42:57.378828+0000","last_fullsized":"2023-06-09T04:42:57.378828+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_clean_scrub_stamp":"2023-06-09T04:42:57.378828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:42:57.378828+0000","last_change":"2023-06-09T04:42:57.378828+0000","last_active":"2023-06-09T04:42:57.378828+0000","last_peered":"2023-06-09T04:42:57.378828+0000","last_clean":"2023-06-09T04:42:57.378828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:42:57.378828+0000","last_undegraded":"2023-06-09T04:42:57.378828+0000","last_fullsized":"2023-06-09T04:42:57.378828+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_clean_scrub_stamp":"2023-06-09T04:42:57.378828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:42:57.378828+0000","last_change":"2023-06-09T04:42:57.378828+0000","last_active":"2023-06-09T04:42:57.378828+0000","last_peered":"2023-06-09T04:42:57.378828+0000","last_clean":"2023-06-09T04:42:57.378828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:42:57.378828+0000","last_undegraded":"2023-06-09T04:42:57.378828+0000","last_fullsized":"2023-06-09T04:42:57.378828+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_clean_scrub_stamp":"2023-06-09T04:42:57.378828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:42:57.378828+0000","last_change":"2023-06-09T04:42:57.378828+0000","last_active":"2023-06-09T04:42:57.378828+0000","last_peered":"2023-06-09T04:42:57.378828+0000","last_clean":"2023-06-09T04:42:57.378828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:42:57.378828+0000","last_undegraded":"2023-06-09T04:42:57.378828+0000","last_fullsized":"2023-06-09T04:42:57.378828+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_clean_scrub_stamp":"2023-06-09T04:42:57.378828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:42:57.378828+0000","last_change":"2023-06-09T04:42:57.378828+0000","last_active":"2023-06-09T04:42:57.378828+0000","last_peered":"2023-06-09T04:42:57.378828+0000","last_clean":"2023-06-09T04:42:57.378828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:42:57.378828+0000","last_undegraded":"2023-06-09T04:42:57.378828+0000","last_fullsized":"2023-06-09T04:42:57.378828+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_clean_scrub_stamp":"2023-06-09T04:42:57.378828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:42:57.378828+0000","last_change":"2023-06-09T04:42:57.378828+0000","last_active":"2023-06-09T04:42:57.378828+0000","last_peered":"2023-06-09T04:42:57.378828+0000","last_clean":"2023-06-09T04:42:57.378828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:42:57.378828+0000","last_undegraded":"2023-06-09T04:42:57.378828+0000","last_fullsized":"2023-06-09T04:42:57.378828+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_clean_scrub_stamp":"2023-06-09T04:42:57.378828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:42:57.378828+0000","last_change":"2023-06-09T04:42:57.378828+0000","last_active":"2023-06-09T04:42:57.378828+0000","last_peered":"2023-06-09T04:42:57.378828+0000","last_clean":"2023-06-09T04:42:57.378828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:42:57.378828+0000","last_undegraded":"2023-06-09T04:42:57.378828+0000","last_fullsized":"2023-06-09T04:42:57.378828+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_clean_scrub_stamp":"2023-06-09T04:42:57.378828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:42:57.378828+0000","last_change":"2023-06-09T04:42:57.378828+0000","last_active":"2023-06-09T04:42:57.378828+0000","last_peered":"2023-06-09T04:42:57.378828+0000","last_clean":"2023-06-09T04:42:57.378828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:42:57.378828+0000","last_undegraded":"2023-06-09T04:42:57.378828+0000","last_fullsized":"2023-06-09T04:42:57.378828+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_clean_scrub_stamp":"2023-06-09T04:42:57.378828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:42:57.378828+0000","last_change":"2023-06-09T04:42:57.378828+0000","last_active":"2023-06-09T04:42:57.378828+0000","last_peered":"2023-06-09T04:42:57.378828+0000","last_clean":"2023-06-09T04:42:57.378828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:42:57.378828+0000","last_undegraded":"2023-06-09T04:42:57.378828+0000","last_fullsized":"2023-06-09T04:42:57.378828+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_clean_scrub_stamp":"2023-06-09T04:42:57.378828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:42:57.378828+0000","last_change":"2023-06-09T04:42:57.378828+0000","last_active":"2023-06-09T04:42:57.378828+0000","last_peered":"2023-06-09T04:42:57.378828+0000","last_clean":"2023-06-09T04:42:57.378828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:42:57.378828+0000","last_undegraded":"2023-06-09T04:42:57.378828+0000","last_fullsized":"2023-06-09T04:42:57.378828+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_clean_scrub_stamp":"2023-06-09T04:42:57.378828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:42:57.378828+0000","last_change":"2023-06-09T04:42:57.378828+0000","last_active":"2023-06-09T04:42:57.378828+0000","last_peered":"2023-06-09T04:42:57.378828+0000","last_clean":"2023-06-09T04:42:57.378828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:42:57.378828+0000","last_undegraded":"2023-06-09T04:42:57.378828+0000","last_fullsized":"2023-06-09T04:42:57.378828+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_clean_scrub_stamp":"2023-06-09T04:42:57.378828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:42:57.378828+0000","last_change":"2023-06-09T04:42:57.378828+0000","last_active":"2023-06-09T04:42:57.378828+0000","last_peered":"2023-06-09T04:42:57.378828+0000","last_clean":"2023-06-09T04:42:57.378828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:42:57.378828+0000","last_undegraded":"2023-06-09T04:42:57.378828+0000","last_fullsized":"2023-06-09T04:42:57.378828+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_clean_scrub_stamp":"2023-06-09T04:42:57.378828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:42:57.378828+0000","last_change":"2023-06-09T04:42:57.378828+0000","last_active":"2023-06-09T04:42:57.378828+0000","last_peered":"2023-06-09T04:42:57.378828+0000","last_clean":"2023-06-09T04:42:57.378828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:42:57.378828+0000","last_undegraded":"2023-06-09T04:42:57.378828+0000","last_fullsized":"2023-06-09T04:42:57.378828+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_clean_scrub_stamp":"2023-06-09T04:42:57.378828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:42:57.378828+0000","last_change":"2023-06-09T04:42:57.378828+0000","last_active":"2023-06-09T04:42:57.378828+0000","last_peered":"2023-06-09T04:42:57.378828+0000","last_clean":"2023-06-09T04:42:57.378828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:42:57.378828+0000","last_undegraded":"2023-06-09T04:42:57.378828+0000","last_fullsized":"2023-06-09T04:42:57.378828+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_clean_scrub_stamp":"2023-06-09T04:42:57.378828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:42:57.378828+0000","last_change":"2023-06-09T04:42:57.378828+0000","last_active":"2023-06-09T04:42:57.378828+0000","last_peered":"2023-06-09T04:42:57.378828+0000","last_clean":"2023-06-09T04:42:57.378828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:42:57.378828+0000","last_undegraded":"2023-06-09T04:42:57.378828+0000","last_fullsized":"2023-06-09T04:42:57.378828+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_clean_scrub_stamp":"2023-06-09T04:42:57.378828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:42:57.378828+0000","last_change":"2023-06-09T04:42:57.378828+0000","last_active":"2023-06-09T04:42:57.378828+0000","last_peered":"2023-06-09T04:42:57.378828+0000","last_clean":"2023-06-09T04:42:57.378828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:42:57.378828+0000","last_undegraded":"2023-06-09T04:42:57.378828+0000","last_fullsized":"2023-06-09T04:42:57.378828+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_clean_scrub_stamp":"2023-06-09T04:42:57.378828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:42:57.378828+0000","last_change":"2023-06-09T04:42:57.378828+0000","last_active":"2023-06-09T04:42:57.378828+0000","last_peered":"2023-06-09T04:42:57.378828+0000","last_clean":"2023-06-09T04:42:57.378828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:42:57.378828+0000","last_undegraded":"2023-06-09T04:42:57.378828+0000","last_fullsized":"2023-06-09T04:42:57.378828+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_clean_scrub_stamp":"2023-06-09T04:42:57.378828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:42:57.378828+0000","last_change":"2023-06-09T04:42:57.378828+0000","last_active":"2023-06-09T04:42:57.378828+0000","last_peered":"2023-06-09T04:42:57.378828+0000","last_clean":"2023-06-09T04:42:57.378828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:42:57.378828+0000","last_undegraded":"2023-06-09T04:42:57.378828+0000","last_fullsized":"2023-06-09T04:42:57.378828+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_clean_scrub_stamp":"2023-06-09T04:42:57.378828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:42:57.378828+0000","last_change":"2023-06-09T04:42:57.378828+0000","last_active":"2023-06-09T04:42:57.378828+0000","last_peered":"2023-06-09T04:42:57.378828+0000","last_clean":"2023-06-09T04:42:57.378828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:42:57.378828+0000","last_undegraded":"2023-06-09T04:42:57.378828+0000","last_fullsized":"2023-06-09T04:42:57.378828+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_clean_scrub_stamp":"2023-06-09T04:42:57.378828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:42:57.378828+0000","last_change":"2023-06-09T04:42:57.378828+0000","last_active":"2023-06-09T04:42:57.378828+0000","last_peered":"2023-06-09T04:42:57.378828+0000","last_clean":"2023-06-09T04:42:57.378828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:42:57.378828+0000","last_undegraded":"2023-06-09T04:42:57.378828+0000","last_fullsized":"2023-06-09T04:42:57.378828+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_clean_scrub_stamp":"2023-06-09T04:42:57.378828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:42:57.378828+0000","last_change":"2023-06-09T04:42:57.378828+0000","last_active":"2023-06-09T04:42:57.378828+0000","last_peered":"2023-06-09T04:42:57.378828+0000","last_clean":"2023-06-09T04:42:57.378828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:42:57.378828+0000","last_undegraded":"2023-06-09T04:42:57.378828+0000","last_fullsized":"2023-06-09T04:42:57.378828+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_clean_scrub_stamp":"2023-06-09T04:42:57.378828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:42:57.378828+0000","last_change":"2023-06-09T04:42:57.378828+0000","last_active":"2023-06-09T04:42:57.378828+0000","last_peered":"2023-06-09T04:42:57.378828+0000","last_clean":"2023-06-09T04:42:57.378828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:42:57.378828+0000","last_undegraded":"2023-06-09T04:42:57.378828+0000","last_fullsized":"2023-06-09T04:42:57.378828+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_clean_scrub_stamp":"2023-06-09T04:42:57.378828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:42:57.378828+0000","last_change":"2023-06-09T04:42:57.378828+0000","last_active":"2023-06-09T04:42:57.378828+0000","last_peered":"2023-06-09T04:42:57.378828+0000","last_clean":"2023-06-09T04:42:57.378828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:42:57.378828+0000","last_undegraded":"2023-06-09T04:42:57.378828+0000","last_fullsized":"2023-06-09T04:42:57.378828+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_clean_scrub_stamp":"2023-06-09T04:42:57.378828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:42:57.378828+0000","last_change":"2023-06-09T04:42:57.378828+0000","last_active":"2023-06-09T04:42:57.378828+0000","last_peered":"2023-06-09T04:42:57.378828+0000","last_clean":"2023-06-09T04:42:57.378828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:42:57.378828+0000","last_undegraded":"2023-06-09T04:42:57.378828+0000","last_fullsized":"2023-06-09T04:42:57.378828+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_clean_scrub_stamp":"2023-06-09T04:42:57.378828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-06-09T04:42:56.387668+0000","last_change":"2023-06-09T04:42:56.387668+0000","last_active":"2023-06-09T04:42:56.365243+0000","last_peered":"2023-06-09T04:42:56.365243+0000","last_clean":"2023-06-09T04:42:56.365243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:42:56.387668+0000","last_undegraded":"2023-06-09T04:42:56.387668+0000","last_fullsized":"2023-06-09T04:42:56.387668+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:56.365243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:56.365243+0000","last_clean_scrub_stamp":"2023-06-09T04:42:56.365243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:42:57.378828+0000","last_change":"2023-06-09T04:42:57.378828+0000","last_active":"2023-06-09T04:42:57.378828+0000","last_peered":"2023-06-09T04:42:57.378828+0000","last_clean":"2023-06-09T04:42:57.378828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:42:57.378828+0000","last_undegraded":"2023-06-09T04:42:57.378828+0000","last_fullsized":"2023-06-09T04:42:57.378828+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_clean_scrub_stamp":"2023-06-09T04:42:57.378828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-06-09T04:42:56.386849+0000","last_change":"2023-06-09T04:42:56.386849+0000","last_active":"2023-06-09T04:42:56.365243+0000","last_peered":"2023-06-09T04:42:56.365243+0000","last_clean":"2023-06-09T04:42:56.365243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:42:56.386849+0000","last_undegraded":"2023-06-09T04:42:56.386849+0000","last_fullsized":"2023-06-09T04:42:56.386849+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:56.365243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:56.365243+0000","last_clean_scrub_stamp":"2023-06-09T04:42:56.365243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:42:57.378828+0000","last_change":"2023-06-09T04:42:57.378828+0000","last_active":"2023-06-09T04:42:57.378828+0000","last_peered":"2023-06-09T04:42:57.378828+0000","last_clean":"2023-06-09T04:42:57.378828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:42:57.378828+0000","last_undegraded":"2023-06-09T04:42:57.378828+0000","last_fullsized":"2023-06-09T04:42:57.378828+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_clean_scrub_stamp":"2023-06-09T04:42:57.378828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-06-09T04:42:56.382521+0000","last_change":"2023-06-09T04:42:56.382521+0000","last_active":"2023-06-09T04:42:56.365243+0000","last_peered":"2023-06-09T04:42:56.365243+0000","last_clean":"2023-06-09T04:42:56.365243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:42:56.382521+0000","last_undegraded":"2023-06-09T04:42:56.382521+0000","last_fullsized":"2023-06-09T04:42:56.382521+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:56.365243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:56.365243+0000","last_clean_scrub_stamp":"2023-06-09T04:42:56.365243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:42:57.378828+0000","last_change":"2023-06-09T04:42:57.378828+0000","last_active":"2023-06-09T04:42:57.378828+0000","last_peered":"2023-06-09T04:42:57.378828+0000","last_clean":"2023-06-09T04:42:57.378828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:42:57.378828+0000","last_undegraded":"2023-06-09T04:42:57.378828+0000","last_fullsized":"2023-06-09T04:42:57.378828+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_clean_scrub_stamp":"2023-06-09T04:42:57.378828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-06-09T04:42:56.386987+0000","last_change":"2023-06-09T04:42:56.386987+0000","last_active":"2023-06-09T04:42:56.365243+0000","last_peered":"2023-06-09T04:42:56.365243+0000","last_clean":"2023-06-09T04:42:56.365243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:42:56.386987+0000","last_undegraded":"2023-06-09T04:42:56.386987+0000","last_fullsized":"2023-06-09T04:42:56.386987+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:56.365243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:56.365243+0000","last_clean_scrub_stamp":"2023-06-09T04:42:56.365243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:42:57.378828+0000","last_change":"2023-06-09T04:42:57.378828+0000","last_active":"2023-06-09T04:42:57.378828+0000","last_peered":"2023-06-09T04:42:57.378828+0000","last_clean":"2023-06-09T04:42:57.378828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:42:57.378828+0000","last_undegraded":"2023-06-09T04:42:57.378828+0000","last_fullsized":"2023-06-09T04:42:57.378828+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_clean_scrub_stamp":"2023-06-09T04:42:57.378828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-06-09T04:42:56.383173+0000","last_change":"2023-06-09T04:42:56.383173+0000","last_active":"2023-06-09T04:42:56.365243+0000","last_peered":"2023-06-09T04:42:56.365243+0000","last_clean":"2023-06-09T04:42:56.365243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:42:56.383173+0000","last_undegraded":"2023-06-09T04:42:56.383173+0000","last_fullsized":"2023-06-09T04:42:56.383173+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:56.365243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:56.365243+0000","last_clean_scrub_stamp":"2023-06-09T04:42:56.365243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:42:57.378828+0000","last_change":"2023-06-09T04:42:57.378828+0000","last_active":"2023-06-09T04:42:57.378828+0000","last_peered":"2023-06-09T04:42:57.378828+0000","last_clean":"2023-06-09T04:42:57.378828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:42:57.378828+0000","last_undegraded":"2023-06-09T04:42:57.378828+0000","last_fullsized":"2023-06-09T04:42:57.378828+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_clean_scrub_stamp":"2023-06-09T04:42:57.378828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-06-09T04:42:56.381610+0000","last_change":"2023-06-09T04:42:56.381610+0000","last_active":"2023-06-09T04:42:56.365243+0000","last_peered":"2023-06-09T04:42:56.365243+0000","last_clean":"2023-06-09T04:42:56.365243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:42:56.381610+0000","last_undegraded":"2023-06-09T04:42:56.381610+0000","last_fullsized":"2023-06-09T04:42:56.381610+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:56.365243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:56.365243+0000","last_clean_scrub_stamp":"2023-06-09T04:42:56.365243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:42:57.378828+0000","last_change":"2023-06-09T04:42:57.378828+0000","last_active":"2023-06-09T04:42:57.378828+0000","last_peered":"2023-06-09T04:42:57.378828+0000","last_clean":"2023-06-09T04:42:57.378828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:42:57.378828+0000","last_undegraded":"2023-06-09T04:42:57.378828+0000","last_fullsized":"2023-06-09T04:42:57.378828+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_clean_scrub_stamp":"2023-06-09T04:42:57.378828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-06-09T04:42:56.383113+0000","last_change":"2023-06-09T04:42:56.383113+0000","last_active":"2023-06-09T04:42:56.365243+0000","last_peered":"2023-06-09T04:42:56.365243+0000","last_clean":"2023-06-09T04:42:56.365243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:42:56.383113+0000","last_undegraded":"2023-06-09T04:42:56.383113+0000","last_fullsized":"2023-06-09T04:42:56.383113+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:56.365243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:56.365243+0000","last_clean_scrub_stamp":"2023-06-09T04:42:56.365243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:42:57.378828+0000","last_change":"2023-06-09T04:42:57.378828+0000","last_active":"2023-06-09T04:42:57.378828+0000","last_peered":"2023-06-09T04:42:57.378828+0000","last_clean":"2023-06-09T04:42:57.378828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:42:57.378828+0000","last_undegraded":"2023-06-09T04:42:57.378828+0000","last_fullsized":"2023-06-09T04:42:57.378828+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_clean_scrub_stamp":"2023-06-09T04:42:57.378828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-06-09T04:42:56.386842+0000","last_change":"2023-06-09T04:42:56.386842+0000","last_active":"2023-06-09T04:42:56.365243+0000","last_peered":"2023-06-09T04:42:56.365243+0000","last_clean":"2023-06-09T04:42:56.365243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:42:56.386842+0000","last_undegraded":"2023-06-09T04:42:56.386842+0000","last_fullsized":"2023-06-09T04:42:56.386842+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:56.365243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:56.365243+0000","last_clean_scrub_stamp":"2023-06-09T04:42:56.365243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:42:57.378828+0000","last_change":"2023-06-09T04:42:57.378828+0000","last_active":"2023-06-09T04:42:57.378828+0000","last_peered":"2023-06-09T04:42:57.378828+0000","last_clean":"2023-06-09T04:42:57.378828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:42:57.378828+0000","last_undegraded":"2023-06-09T04:42:57.378828+0000","last_fullsized":"2023-06-09T04:42:57.378828+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_clean_scrub_stamp":"2023-06-09T04:42:57.378828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-06-09T04:42:56.389733+0000","last_change":"2023-06-09T04:42:56.389733+0000","last_active":"2023-06-09T04:42:56.365243+0000","last_peered":"2023-06-09T04:42:56.365243+0000","last_clean":"2023-06-09T04:42:56.365243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:42:56.389733+0000","last_undegraded":"2023-06-09T04:42:56.389733+0000","last_fullsized":"2023-06-09T04:42:56.389733+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:56.365243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:56.365243+0000","last_clean_scrub_stamp":"2023-06-09T04:42:56.365243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:42:57.378828+0000","last_change":"2023-06-09T04:42:57.378828+0000","last_active":"2023-06-09T04:42:57.378828+0000","last_peered":"2023-06-09T04:42:57.378828+0000","last_clean":"2023-06-09T04:42:57.378828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:42:57.378828+0000","last_undegraded":"2023-06-09T04:42:57.378828+0000","last_fullsized":"2023-06-09T04:42:57.378828+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_clean_scrub_stamp":"2023-06-09T04:42:57.378828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-06-09T04:42:56.384340+0000","last_change":"2023-06-09T04:42:56.384340+0000","last_active":"2023-06-09T04:42:56.365243+0000","last_peered":"2023-06-09T04:42:56.365243+0000","last_clean":"2023-06-09T04:42:56.365243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:42:56.384340+0000","last_undegraded":"2023-06-09T04:42:56.384340+0000","last_fullsized":"2023-06-09T04:42:56.384340+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:56.365243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:56.365243+0000","last_clean_scrub_stamp":"2023-06-09T04:42:56.365243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:42:57.378828+0000","last_change":"2023-06-09T04:42:57.378828+0000","last_active":"2023-06-09T04:42:57.378828+0000","last_peered":"2023-06-09T04:42:57.378828+0000","last_clean":"2023-06-09T04:42:57.378828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:42:57.378828+0000","last_undegraded":"2023-06-09T04:42:57.378828+0000","last_fullsized":"2023-06-09T04:42:57.378828+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_clean_scrub_stamp":"2023-06-09T04:42:57.378828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-06-09T04:42:56.382998+0000","last_change":"2023-06-09T04:42:56.382998+0000","last_active":"2023-06-09T04:42:56.365243+0000","last_peered":"2023-06-09T04:42:56.365243+0000","last_clean":"2023-06-09T04:42:56.365243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:42:56.382998+0000","last_undegraded":"2023-06-09T04:42:56.382998+0000","last_fullsized":"2023-06-09T04:42:56.382998+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:56.365243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:56.365243+0000","last_clean_scrub_stamp":"2023-06-09T04:42:56.365243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:42:57.378828+0000","last_change":"2023-06-09T04:42:57.378828+0000","last_active":"2023-06-09T04:42:57.378828+0000","last_peered":"2023-06-09T04:42:57.378828+0000","last_clean":"2023-06-09T04:42:57.378828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:42:57.378828+0000","last_undegraded":"2023-06-09T04:42:57.378828+0000","last_fullsized":"2023-06-09T04:42:57.378828+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_clean_scrub_stamp":"2023-06-09T04:42:57.378828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-06-09T04:42:56.390378+0000","last_change":"2023-06-09T04:42:56.390378+0000","last_active":"2023-06-09T04:42:56.365243+0000","last_peered":"2023-06-09T04:42:56.365243+0000","last_clean":"2023-06-09T04:42:56.365243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:42:56.390378+0000","last_undegraded":"2023-06-09T04:42:56.390378+0000","last_fullsized":"2023-06-09T04:42:56.390378+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:56.365243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:56.365243+0000","last_clean_scrub_stamp":"2023-06-09T04:42:56.365243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:42:57.378828+0000","last_change":"2023-06-09T04:42:57.378828+0000","last_active":"2023-06-09T04:42:57.378828+0000","last_peered":"2023-06-09T04:42:57.378828+0000","last_clean":"2023-06-09T04:42:57.378828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:42:57.378828+0000","last_undegraded":"2023-06-09T04:42:57.378828+0000","last_fullsized":"2023-06-09T04:42:57.378828+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_clean_scrub_stamp":"2023-06-09T04:42:57.378828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-06-09T04:42:56.388898+0000","last_change":"2023-06-09T04:42:56.388898+0000","last_active":"2023-06-09T04:42:56.365243+0000","last_peered":"2023-06-09T04:42:56.365243+0000","last_clean":"2023-06-09T04:42:56.365243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:42:56.388898+0000","last_undegraded":"2023-06-09T04:42:56.388898+0000","last_fullsized":"2023-06-09T04:42:56.388898+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:56.365243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:56.365243+0000","last_clean_scrub_stamp":"2023-06-09T04:42:56.365243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:42:57.378828+0000","last_change":"2023-06-09T04:42:57.378828+0000","last_active":"2023-06-09T04:42:57.378828+0000","last_peered":"2023-06-09T04:42:57.378828+0000","last_clean":"2023-06-09T04:42:57.378828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:42:57.378828+0000","last_undegraded":"2023-06-09T04:42:57.378828+0000","last_fullsized":"2023-06-09T04:42:57.378828+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_clean_scrub_stamp":"2023-06-09T04:42:57.378828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-06-09T04:42:56.382307+0000","last_change":"2023-06-09T04:42:56.382307+0000","last_active":"2023-06-09T04:42:56.365243+0000","last_peered":"2023-06-09T04:42:56.365243+0000","last_clean":"2023-06-09T04:42:56.365243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:42:56.382307+0000","last_undegraded":"2023-06-09T04:42:56.382307+0000","last_fullsized":"2023-06-09T04:42:56.382307+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:56.365243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:56.365243+0000","last_clean_scrub_stamp":"2023-06-09T04:42:56.365243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:42:57.378828+0000","last_change":"2023-06-09T04:42:57.378828+0000","last_active":"2023-06-09T04:42:57.378828+0000","last_peered":"2023-06-09T04:42:57.378828+0000","last_clean":"2023-06-09T04:42:57.378828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:42:57.378828+0000","last_undegraded":"2023-06-09T04:42:57.378828+0000","last_fullsized":"2023-06-09T04:42:57.378828+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_clean_scrub_stamp":"2023-06-09T04:42:57.378828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-06-09T04:42:56.387012+0000","last_change":"2023-06-09T04:42:56.387012+0000","last_active":"2023-06-09T04:42:56.365243+0000","last_peered":"2023-06-09T04:42:56.365243+0000","last_clean":"2023-06-09T04:42:56.365243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:42:56.387012+0000","last_undegraded":"2023-06-09T04:42:56.387012+0000","last_fullsized":"2023-06-09T04:42:56.387012+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:56.365243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:56.365243+0000","last_clean_scrub_stamp":"2023-06-09T04:42:56.365243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:42:57.378828+0000","last_change":"2023-06-09T04:42:57.378828+0000","last_active":"2023-06-09T04:42:57.378828+0000","last_peered":"2023-06-09T04:42:57.378828+0000","last_clean":"2023-06-09T04:42:57.378828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:42:57.378828+0000","last_undegraded":"2023-06-09T04:42:57.378828+0000","last_fullsized":"2023-06-09T04:42:57.378828+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_clean_scrub_stamp":"2023-06-09T04:42:57.378828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-06-09T04:42:56.381683+0000","last_change":"2023-06-09T04:42:56.381683+0000","last_active":"2023-06-09T04:42:56.365243+0000","last_peered":"2023-06-09T04:42:56.365243+0000","last_clean":"2023-06-09T04:42:56.365243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:42:56.381683+0000","last_undegraded":"2023-06-09T04:42:56.381683+0000","last_fullsized":"2023-06-09T04:42:56.381683+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:56.365243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:56.365243+0000","last_clean_scrub_stamp":"2023-06-09T04:42:56.365243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:42:57.378828+0000","last_change":"2023-06-09T04:42:57.378828+0000","last_active":"2023-06-09T04:42:57.378828+0000","last_peered":"2023-06-09T04:42:57.378828+0000","last_clean":"2023-06-09T04:42:57.378828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:42:57.378828+0000","last_undegraded":"2023-06-09T04:42:57.378828+0000","last_fullsized":"2023-06-09T04:42:57.378828+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_clean_scrub_stamp":"2023-06-09T04:42:57.378828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-06-09T04:42:56.384299+0000","last_change":"2023-06-09T04:42:56.384299+0000","last_active":"2023-06-09T04:42:56.365243+0000","last_peered":"2023-06-09T04:42:56.365243+0000","last_clean":"2023-06-09T04:42:56.365243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:42:56.384299+0000","last_undegraded":"2023-06-09T04:42:56.384299+0000","last_fullsized":"2023-06-09T04:42:56.384299+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:56.365243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:56.365243+0000","last_clean_scrub_stamp":"2023-06-09T04:42:56.365243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:42:57.378828+0000","last_change":"2023-06-09T04:42:57.378828+0000","last_active":"2023-06-09T04:42:57.378828+0000","last_peered":"2023-06-09T04:42:57.378828+0000","last_clean":"2023-06-09T04:42:57.378828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:42:57.378828+0000","last_undegraded":"2023-06-09T04:42:57.378828+0000","last_fullsized":"2023-06-09T04:42:57.378828+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_clean_scrub_stamp":"2023-06-09T04:42:57.378828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-06-09T04:42:56.387670+0000","last_change":"2023-06-09T04:42:56.387670+0000","last_active":"2023-06-09T04:42:56.365243+0000","last_peered":"2023-06-09T04:42:56.365243+0000","last_clean":"2023-06-09T04:42:56.365243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:42:56.387670+0000","last_undegraded":"2023-06-09T04:42:56.387670+0000","last_fullsized":"2023-06-09T04:42:56.387670+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:56.365243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:56.365243+0000","last_clean_scrub_stamp":"2023-06-09T04:42:56.365243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:42:57.378828+0000","last_change":"2023-06-09T04:42:57.378828+0000","last_active":"2023-06-09T04:42:57.378828+0000","last_peered":"2023-06-09T04:42:57.378828+0000","last_clean":"2023-06-09T04:42:57.378828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:42:57.378828+0000","last_undegraded":"2023-06-09T04:42:57.378828+0000","last_fullsized":"2023-06-09T04:42:57.378828+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_clean_scrub_stamp":"2023-06-09T04:42:57.378828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-06-09T04:42:56.389137+0000","last_change":"2023-06-09T04:42:56.389137+0000","last_active":"2023-06-09T04:42:56.365243+0000","last_peered":"2023-06-09T04:42:56.365243+0000","last_clean":"2023-06-09T04:42:56.365243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:42:56.389137+0000","last_undegraded":"2023-06-09T04:42:56.389137+0000","last_fullsized":"2023-06-09T04:42:56.389137+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:56.365243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:56.365243+0000","last_clean_scrub_stamp":"2023-06-09T04:42:56.365243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:42:57.378828+0000","last_change":"2023-06-09T04:42:57.378828+0000","last_active":"2023-06-09T04:42:57.378828+0000","last_peered":"2023-06-09T04:42:57.378828+0000","last_clean":"2023-06-09T04:42:57.378828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:42:57.378828+0000","last_undegraded":"2023-06-09T04:42:57.378828+0000","last_fullsized":"2023-06-09T04:42:57.378828+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_clean_scrub_stamp":"2023-06-09T04:42:57.378828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-06-09T04:42:56.382412+0000","last_change":"2023-06-09T04:42:56.382412+0000","last_active":"2023-06-09T04:42:56.365243+0000","last_peered":"2023-06-09T04:42:56.365243+0000","last_clean":"2023-06-09T04:42:56.365243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:42:56.382412+0000","last_undegraded":"2023-06-09T04:42:56.382412+0000","last_fullsized":"2023-06-09T04:42:56.382412+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:56.365243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:56.365243+0000","last_clean_scrub_stamp":"2023-06-09T04:42:56.365243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:42:57.378828+0000","last_change":"2023-06-09T04:42:57.378828+0000","last_active":"2023-06-09T04:42:57.378828+0000","last_peered":"2023-06-09T04:42:57.378828+0000","last_clean":"2023-06-09T04:42:57.378828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:42:57.378828+0000","last_undegraded":"2023-06-09T04:42:57.378828+0000","last_fullsized":"2023-06-09T04:42:57.378828+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_clean_scrub_stamp":"2023-06-09T04:42:57.378828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-06-09T04:42:56.388624+0000","last_change":"2023-06-09T04:42:56.388624+0000","last_active":"2023-06-09T04:42:56.365243+0000","last_peered":"2023-06-09T04:42:56.365243+0000","last_clean":"2023-06-09T04:42:56.365243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:42:56.388624+0000","last_undegraded":"2023-06-09T04:42:56.388624+0000","last_fullsized":"2023-06-09T04:42:56.388624+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:56.365243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:56.365243+0000","last_clean_scrub_stamp":"2023-06-09T04:42:56.365243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:42:57.378828+0000","last_change":"2023-06-09T04:42:57.378828+0000","last_active":"2023-06-09T04:42:57.378828+0000","last_peered":"2023-06-09T04:42:57.378828+0000","last_clean":"2023-06-09T04:42:57.378828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:42:57.378828+0000","last_undegraded":"2023-06-09T04:42:57.378828+0000","last_fullsized":"2023-06-09T04:42:57.378828+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_clean_scrub_stamp":"2023-06-09T04:42:57.378828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-06-09T04:42:56.389841+0000","last_change":"2023-06-09T04:42:56.389841+0000","last_active":"2023-06-09T04:42:56.365243+0000","last_peered":"2023-06-09T04:42:56.365243+0000","last_clean":"2023-06-09T04:42:56.365243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:42:56.389841+0000","last_undegraded":"2023-06-09T04:42:56.389841+0000","last_fullsized":"2023-06-09T04:42:56.389841+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:56.365243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:56.365243+0000","last_clean_scrub_stamp":"2023-06-09T04:42:56.365243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:42:57.378828+0000","last_change":"2023-06-09T04:42:57.378828+0000","last_active":"2023-06-09T04:42:57.378828+0000","last_peered":"2023-06-09T04:42:57.378828+0000","last_clean":"2023-06-09T04:42:57.378828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:42:57.378828+0000","last_undegraded":"2023-06-09T04:42:57.378828+0000","last_fullsized":"2023-06-09T04:42:57.378828+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_clean_scrub_stamp":"2023-06-09T04:42:57.378828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-06-09T04:42:56.381706+0000","last_change":"2023-06-09T04:42:56.381706+0000","last_active":"2023-06-09T04:42:56.365243+0000","last_peered":"2023-06-09T04:42:56.365243+0000","last_clean":"2023-06-09T04:42:56.365243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:42:56.381706+0000","last_undegraded":"2023-06-09T04:42:56.381706+0000","last_fullsized":"2023-06-09T04:42:56.381706+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:56.365243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:56.365243+0000","last_clean_scrub_stamp":"2023-06-09T04:42:56.365243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:42:57.378828+0000","last_change":"2023-06-09T04:42:57.378828+0000","last_active":"2023-06-09T04:42:57.378828+0000","last_peered":"2023-06-09T04:42:57.378828+0000","last_clean":"2023-06-09T04:42:57.378828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:42:57.378828+0000","last_undegraded":"2023-06-09T04:42:57.378828+0000","last_fullsized":"2023-06-09T04:42:57.378828+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_clean_scrub_stamp":"2023-06-09T04:42:57.378828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-06-09T04:42:56.388125+0000","last_change":"2023-06-09T04:42:56.388125+0000","last_active":"2023-06-09T04:42:56.365243+0000","last_peered":"2023-06-09T04:42:56.365243+0000","last_clean":"2023-06-09T04:42:56.365243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:42:56.388125+0000","last_undegraded":"2023-06-09T04:42:56.388125+0000","last_fullsized":"2023-06-09T04:42:56.388125+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:56.365243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:56.365243+0000","last_clean_scrub_stamp":"2023-06-09T04:42:56.365243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:42:57.378828+0000","last_change":"2023-06-09T04:42:57.378828+0000","last_active":"2023-06-09T04:42:57.378828+0000","last_peered":"2023-06-09T04:42:57.378828+0000","last_clean":"2023-06-09T04:42:57.378828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:42:57.378828+0000","last_undegraded":"2023-06-09T04:42:57.378828+0000","last_fullsized":"2023-06-09T04:42:57.378828+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_clean_scrub_stamp":"2023-06-09T04:42:57.378828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-06-09T04:42:56.381589+0000","last_change":"2023-06-09T04:42:56.381589+0000","last_active":"2023-06-09T04:42:56.365243+0000","last_peered":"2023-06-09T04:42:56.365243+0000","last_clean":"2023-06-09T04:42:56.365243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:42:56.381589+0000","last_undegraded":"2023-06-09T04:42:56.381589+0000","last_fullsized":"2023-06-09T04:42:56.381589+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:56.365243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:56.365243+0000","last_clean_scrub_stamp":"2023-06-09T04:42:56.365243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":189,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-09T04:42:56.384418+0000","last_change":"2023-06-09T04:41:43.997052+0000","last_active":"2023-06-09T04:42:56.384418+0000","last_peered":"2023-06-09T04:42:56.384418+0000","last_clean":"2023-06-09T04:42:56.384418+0000","last_became_active":"2023-06-09T04:41:43.993827+0000","last_became_peered":"2023-06-09T04:41:43.993827+0000","last_unstale":"2023-06-09T04:42:56.384418+0000","last_undegraded":"2023-06-09T04:42:56.384418+0000","last_fullsized":"2023-06-09T04:42:56.384418+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:42.777858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:42.777858+0000","last_clean_scrub_stamp":"2023-06-09T04:41:42.777858+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:02:58.914429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-09T04:42:56.384890+0000","last_change":"2023-06-09T04:41:48.873288+0000","last_active":"2023-06-09T04:42:56.384890+0000","last_peered":"2023-06-09T04:42:56.384890+0000","last_clean":"2023-06-09T04:42:56.384890+0000","last_became_active":"2023-06-09T04:41:48.872659+0000","last_became_peered":"2023-06-09T04:41:48.872659+0000","last_unstale":"2023-06-09T04:42:56.384890+0000","last_undegraded":"2023-06-09T04:42:56.384890+0000","last_fullsized":"2023-06-09T04:42:56.384890+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:47.838489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:47.838489+0000","last_clean_scrub_stamp":"2023-06-09T04:41:47.838489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:18:14.979240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:42:57.378828+0000","last_change":"2023-06-09T04:42:57.378828+0000","last_active":"2023-06-09T04:42:57.378828+0000","last_peered":"2023-06-09T04:42:57.378828+0000","last_clean":"2023-06-09T04:42:57.378828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:42:57.378828+0000","last_undegraded":"2023-06-09T04:42:57.378828+0000","last_fullsized":"2023-06-09T04:42:57.378828+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_clean_scrub_stamp":"2023-06-09T04:42:57.378828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-06-09T04:42:56.383763+0000","last_change":"2023-06-09T04:42:56.383763+0000","last_active":"2023-06-09T04:42:56.365243+0000","last_peered":"2023-06-09T04:42:56.365243+0000","last_clean":"2023-06-09T04:42:56.365243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:42:56.383763+0000","last_undegraded":"2023-06-09T04:42:56.383763+0000","last_fullsized":"2023-06-09T04:42:56.383763+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:56.365243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:56.365243+0000","last_clean_scrub_stamp":"2023-06-09T04:42:56.365243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-09T04:42:56.384382+0000","last_change":"2023-06-09T04:41:48.880106+0000","last_active":"2023-06-09T04:42:56.384382+0000","last_peered":"2023-06-09T04:42:56.384382+0000","last_clean":"2023-06-09T04:42:56.384382+0000","last_became_active":"2023-06-09T04:41:48.879669+0000","last_became_peered":"2023-06-09T04:41:48.879669+0000","last_unstale":"2023-06-09T04:42:56.384382+0000","last_undegraded":"2023-06-09T04:42:56.384382+0000","last_fullsized":"2023-06-09T04:42:56.384382+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:47.838489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:47.838489+0000","last_clean_scrub_stamp":"2023-06-09T04:41:47.838489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T04:52:40.381440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:42:57.378828+0000","last_change":"2023-06-09T04:42:57.378828+0000","last_active":"2023-06-09T04:42:57.378828+0000","last_peered":"2023-06-09T04:42:57.378828+0000","last_clean":"2023-06-09T04:42:57.378828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:42:57.378828+0000","last_undegraded":"2023-06-09T04:42:57.378828+0000","last_fullsized":"2023-06-09T04:42:57.378828+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_clean_scrub_stamp":"2023-06-09T04:42:57.378828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-06-09T04:42:56.388368+0000","last_change":"2023-06-09T04:42:56.388368+0000","last_active":"2023-06-09T04:42:56.365243+0000","last_peered":"2023-06-09T04:42:56.365243+0000","last_clean":"2023-06-09T04:42:56.365243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:42:56.388368+0000","last_undegraded":"2023-06-09T04:42:56.388368+0000","last_fullsized":"2023-06-09T04:42:56.388368+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:56.365243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:56.365243+0000","last_clean_scrub_stamp":"2023-06-09T04:42:56.365243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":37,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-09T04:42:56.390666+0000","last_change":"2023-06-09T04:41:48.966313+0000","last_active":"2023-06-09T04:42:56.390666+0000","last_peered":"2023-06-09T04:42:56.390666+0000","last_clean":"2023-06-09T04:42:56.390666+0000","last_became_active":"2023-06-09T04:41:48.965659+0000","last_became_peered":"2023-06-09T04:41:48.965659+0000","last_unstale":"2023-06-09T04:42:56.390666+0000","last_undegraded":"2023-06-09T04:42:56.390666+0000","last_fullsized":"2023-06-09T04:42:56.390666+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:47.838489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:47.838489+0000","last_clean_scrub_stamp":"2023-06-09T04:41:47.838489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:47:57.975602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:42:57.378828+0000","last_change":"2023-06-09T04:42:57.378828+0000","last_active":"2023-06-09T04:42:57.378828+0000","last_peered":"2023-06-09T04:42:57.378828+0000","last_clean":"2023-06-09T04:42:57.378828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:42:57.378828+0000","last_undegraded":"2023-06-09T04:42:57.378828+0000","last_fullsized":"2023-06-09T04:42:57.378828+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_clean_scrub_stamp":"2023-06-09T04:42:57.378828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-06-09T04:42:56.386825+0000","last_change":"2023-06-09T04:42:56.386825+0000","last_active":"2023-06-09T04:42:56.365243+0000","last_peered":"2023-06-09T04:42:56.365243+0000","last_clean":"2023-06-09T04:42:56.365243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:42:56.386825+0000","last_undegraded":"2023-06-09T04:42:56.386825+0000","last_fullsized":"2023-06-09T04:42:56.386825+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:56.365243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:56.365243+0000","last_clean_scrub_stamp":"2023-06-09T04:42:56.365243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-09T04:42:56.384824+0000","last_change":"2023-06-09T04:41:48.873002+0000","last_active":"2023-06-09T04:42:56.384824+0000","last_peered":"2023-06-09T04:42:56.384824+0000","last_clean":"2023-06-09T04:42:56.384824+0000","last_became_active":"2023-06-09T04:41:48.872455+0000","last_became_peered":"2023-06-09T04:41:48.872455+0000","last_unstale":"2023-06-09T04:42:56.384824+0000","last_undegraded":"2023-06-09T04:42:56.384824+0000","last_fullsized":"2023-06-09T04:42:56.384824+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:47.838489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:47.838489+0000","last_clean_scrub_stamp":"2023-06-09T04:41:47.838489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:16:41.231085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:42:57.378828+0000","last_change":"2023-06-09T04:42:57.378828+0000","last_active":"2023-06-09T04:42:57.378828+0000","last_peered":"2023-06-09T04:42:57.378828+0000","last_clean":"2023-06-09T04:42:57.378828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:42:57.378828+0000","last_undegraded":"2023-06-09T04:42:57.378828+0000","last_fullsized":"2023-06-09T04:42:57.378828+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_clean_scrub_stamp":"2023-06-09T04:42:57.378828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-06-09T04:42:56.386750+0000","last_change":"2023-06-09T04:42:56.386750+0000","last_active":"2023-06-09T04:42:56.365243+0000","last_peered":"2023-06-09T04:42:56.365243+0000","last_clean":"2023-06-09T04:42:56.365243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:42:56.386750+0000","last_undegraded":"2023-06-09T04:42:56.386750+0000","last_fullsized":"2023-06-09T04:42:56.386750+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:56.365243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:56.365243+0000","last_clean_scrub_stamp":"2023-06-09T04:42:56.365243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-09T04:42:56.382933+0000","last_change":"2023-06-09T04:41:48.978389+0000","last_active":"2023-06-09T04:42:56.382933+0000","last_peered":"2023-06-09T04:42:56.382933+0000","last_clean":"2023-06-09T04:42:56.382933+0000","last_became_active":"2023-06-09T04:41:48.978021+0000","last_became_peered":"2023-06-09T04:41:48.978021+0000","last_unstale":"2023-06-09T04:42:56.382933+0000","last_undegraded":"2023-06-09T04:42:56.382933+0000","last_fullsized":"2023-06-09T04:42:56.382933+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:47.838489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:47.838489+0000","last_clean_scrub_stamp":"2023-06-09T04:41:47.838489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:00:09.918097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:42:57.378828+0000","last_change":"2023-06-09T04:42:57.378828+0000","last_active":"2023-06-09T04:42:57.378828+0000","last_peered":"2023-06-09T04:42:57.378828+0000","last_clean":"2023-06-09T04:42:57.378828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:42:57.378828+0000","last_undegraded":"2023-06-09T04:42:57.378828+0000","last_fullsized":"2023-06-09T04:42:57.378828+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_clean_scrub_stamp":"2023-06-09T04:42:57.378828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-06-09T04:42:56.387007+0000","last_change":"2023-06-09T04:42:56.387007+0000","last_active":"2023-06-09T04:42:56.365243+0000","last_peered":"2023-06-09T04:42:56.365243+0000","last_clean":"2023-06-09T04:42:56.365243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:42:56.387007+0000","last_undegraded":"2023-06-09T04:42:56.387007+0000","last_fullsized":"2023-06-09T04:42:56.387007+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:56.365243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:56.365243+0000","last_clean_scrub_stamp":"2023-06-09T04:42:56.365243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-09T04:42:56.385900+0000","last_change":"2023-06-09T04:41:48.978235+0000","last_active":"2023-06-09T04:42:56.385900+0000","last_peered":"2023-06-09T04:42:56.385900+0000","last_clean":"2023-06-09T04:42:56.385900+0000","last_became_active":"2023-06-09T04:41:48.977568+0000","last_became_peered":"2023-06-09T04:41:48.977568+0000","last_unstale":"2023-06-09T04:42:56.385900+0000","last_undegraded":"2023-06-09T04:42:56.385900+0000","last_fullsized":"2023-06-09T04:42:56.385900+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:47.838489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:47.838489+0000","last_clean_scrub_stamp":"2023-06-09T04:41:47.838489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:41:27.662687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:42:57.378828+0000","last_change":"2023-06-09T04:42:57.378828+0000","last_active":"2023-06-09T04:42:57.378828+0000","last_peered":"2023-06-09T04:42:57.378828+0000","last_clean":"2023-06-09T04:42:57.378828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:42:57.378828+0000","last_undegraded":"2023-06-09T04:42:57.378828+0000","last_fullsized":"2023-06-09T04:42:57.378828+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_clean_scrub_stamp":"2023-06-09T04:42:57.378828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-06-09T04:42:56.387296+0000","last_change":"2023-06-09T04:42:56.387296+0000","last_active":"2023-06-09T04:42:56.365243+0000","last_peered":"2023-06-09T04:42:56.365243+0000","last_clean":"2023-06-09T04:42:56.365243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:42:56.387296+0000","last_undegraded":"2023-06-09T04:42:56.387296+0000","last_fullsized":"2023-06-09T04:42:56.387296+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:56.365243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:56.365243+0000","last_clean_scrub_stamp":"2023-06-09T04:42:56.365243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-09T04:42:56.382001+0000","last_change":"2023-06-09T04:41:48.877786+0000","last_active":"2023-06-09T04:42:56.382001+0000","last_peered":"2023-06-09T04:42:56.382001+0000","last_clean":"2023-06-09T04:42:56.382001+0000","last_became_active":"2023-06-09T04:41:48.877370+0000","last_became_peered":"2023-06-09T04:41:48.877370+0000","last_unstale":"2023-06-09T04:42:56.382001+0000","last_undegraded":"2023-06-09T04:42:56.382001+0000","last_fullsized":"2023-06-09T04:42:56.382001+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:47.838489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:47.838489+0000","last_clean_scrub_stamp":"2023-06-09T04:41:47.838489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:30:09.840318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:42:57.378828+0000","last_change":"2023-06-09T04:42:57.378828+0000","last_active":"2023-06-09T04:42:57.378828+0000","last_peered":"2023-06-09T04:42:57.378828+0000","last_clean":"2023-06-09T04:42:57.378828+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:42:57.378828+0000","last_undegraded":"2023-06-09T04:42:57.378828+0000","last_fullsized":"2023-06-09T04:42:57.378828+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_clean_scrub_stamp":"2023-06-09T04:42:57.378828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-06-09T04:42:56.388969+0000","last_change":"2023-06-09T04:42:56.388969+0000","last_active":"2023-06-09T04:42:56.365243+0000","last_peered":"2023-06-09T04:42:56.365243+0000","last_clean":"2023-06-09T04:42:56.365243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:42:56.388969+0000","last_undegraded":"2023-06-09T04:42:56.388969+0000","last_fullsized":"2023-06-09T04:42:56.388969+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:56.365243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:56.365243+0000","last_clean_scrub_stamp":"2023-06-09T04:42:56.365243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-09T04:42:56.389307+0000","last_change":"2023-06-09T04:41:48.880094+0000","last_active":"2023-06-09T04:42:56.389307+0000","last_peered":"2023-06-09T04:42:56.389307+0000","last_clean":"2023-06-09T04:42:56.389307+0000","last_became_active":"2023-06-09T04:41:48.879506+0000","last_became_peered":"2023-06-09T04:41:48.879506+0000","last_unstale":"2023-06-09T04:42:56.389307+0000","last_undegraded":"2023-06-09T04:42:56.389307+0000","last_fullsized":"2023-06-09T04:42:56.389307+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:47.838489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:47.838489+0000","last_clean_scrub_stamp":"2023-06-09T04:41:47.838489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:03:24.210770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574866,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27908,"kb_used_data":956,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343932,"statfs":{"total":96636764160,"available":96608186368,"internally_reserved":0,"allocated":978944,"data_stored":743848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 9 04:42:42 2023","interfaces":[{"interface":"back","average":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"min":{"1min":0.745,"5min":0.745,"15min":0.745},"max":{"1min":2.6680000000000001,"5min":2.6680000000000001,"15min":2.6680000000000001},"last":1.3540000000000001},{"interface":"front","average":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":2.278,"5min":2.278,"15min":2.278},"last":1.123}]},{"osd":1,"last update":"Fri Jun 9 04:42:42 2023","interfaces":[{"interface":"back","average":{"1min":1.181,"5min":1.181,"15min":1.181},"min":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":1.4830000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":1.093},{"interface":"front","average":{"1min":1.202,"5min":1.202,"15min":1.202},"min":{"1min":0.998,"5min":0.998,"15min":0.998},"max":{"1min":1.8100000000000001,"5min":1.8100000000000001,"15min":1.8100000000000001},"last":0.91000000000000003}]},{"osd":2,"last update":"Fri Jun 9 04:42:42 2023","interfaces":[{"interface":"back","average":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"min":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"max":{"1min":1.6379999999999999,"5min":1.6379999999999999,"15min":1.6379999999999999},"last":1.4350000000000001},{"interface":"front","average":{"1min":1.389,"5min":1.389,"15min":1.389},"min":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"max":{"1min":2.4449999999999998,"5min":2.4449999999999998,"15min":2.4449999999999998},"last":1.3069999999999999}]},{"osd":3,"last update":"Fri Jun 9 04:42:42 2023","interfaces":[{"interface":"back","average":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"min":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"max":{"1min":2.1789999999999998,"5min":2.1789999999999998,"15min":2.1789999999999998},"last":1.27},{"interface":"front","average":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"min":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"max":{"1min":2.351,"5min":2.351,"15min":2.351},"last":1.2030000000000001}]},{"osd":4,"last update":"Fri Jun 9 04:42:42 2023","interfaces":[{"interface":"back","average":{"1min":1.365,"5min":1.365,"15min":1.365},"min":{"1min":0.748,"5min":0.748,"15min":0.748},"max":{"1min":3.5139999999999998,"5min":3.5139999999999998,"15min":3.5139999999999998},"last":1.0069999999999999},{"interface":"front","average":{"1min":1.3740000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"min":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"max":{"1min":2.3300000000000001,"5min":2.3300000000000001,"15min":2.3300000000000001},"last":1.046}]},{"osd":5,"last update":"Fri Jun 9 04:42:42 2023","interfaces":[{"interface":"back","average":{"1min":1.524,"5min":1.524,"15min":1.524},"min":{"1min":1.034,"5min":1.034,"15min":1.034},"max":{"1min":3.1659999999999999,"5min":3.1659999999999999,"15min":3.1659999999999999},"last":1.379},{"interface":"front","average":{"1min":1.615,"5min":1.615,"15min":1.615},"min":{"1min":1.077,"5min":1.077,"15min":1.077},"max":{"1min":3.6030000000000002,"5min":3.6030000000000002,"15min":3.6030000000000002},"last":1.1759999999999999}]},{"osd":6,"last update":"Fri Jun 9 04:42:42 2023","interfaces":[{"interface":"back","average":{"1min":1.6000000000000001,"5min":1.6000000000000001,"15min":1.6000000000000001},"min":{"1min":1.093,"5min":1.093,"15min":1.093},"max":{"1min":3.4119999999999999,"5min":3.4119999999999999,"15min":3.4119999999999999},"last":1.23},{"interface":"front","average":{"1min":1.573,"5min":1.573,"15min":1.573},"min":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"max":{"1min":2.8050000000000002,"5min":2.8050000000000002,"15min":2.8050000000000002},"last":1.1499999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574867,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":376,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":385024,"data_stored":153480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 9 04:42:40 2023","interfaces":[{"interface":"back","average":{"1min":1.093,"5min":1.093,"15min":1.093},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.956,"5min":1.956,"15min":1.956},"last":1.2350000000000001},{"interface":"front","average":{"1min":1.131,"5min":1.131,"15min":1.131},"min":{"1min":0.745,"5min":0.745,"15min":0.745},"max":{"1min":2.2850000000000001,"5min":2.2850000000000001,"15min":2.2850000000000001},"last":1.034}]},{"osd":1,"last update":"Fri Jun 9 04:42:40 2023","interfaces":[{"interface":"back","average":{"1min":1.139,"5min":1.139,"15min":1.139},"min":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.651,"5min":1.651,"15min":1.651},"last":1.103},{"interface":"front","average":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"min":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"max":{"1min":3.0419999999999998,"5min":3.0419999999999998,"15min":3.0419999999999998},"last":1.1459999999999999}]},{"osd":2,"last update":"Fri Jun 9 04:42:40 2023","interfaces":[{"interface":"back","average":{"1min":1.286,"5min":1.286,"15min":1.286},"min":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"max":{"1min":2.0750000000000002,"5min":2.0750000000000002,"15min":2.0750000000000002},"last":1.5629999999999999},{"interface":"front","average":{"1min":1.224,"5min":1.224,"15min":1.224},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.827,"5min":1.827,"15min":1.827},"last":1.506}]},{"osd":3,"last update":"Fri Jun 9 04:42:40 2023","interfaces":[{"interface":"back","average":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"min":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"max":{"1min":3.1160000000000001,"5min":3.1160000000000001,"15min":3.1160000000000001},"last":1.5309999999999999},{"interface":"front","average":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":2.3679999999999999,"5min":2.3679999999999999,"15min":2.3679999999999999},"last":1.7030000000000001}]},{"osd":4,"last update":"Fri Jun 9 04:42:40 2023","interfaces":[{"interface":"back","average":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":3.4279999999999999,"5min":3.4279999999999999,"15min":3.4279999999999999},"last":1.671},{"interface":"front","average":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.954,"5min":1.954,"15min":1.954},"last":1.758}]},{"osd":5,"last update":"Fri Jun 9 04:42:40 2023","interfaces":[{"interface":"back","average":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"min":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":1.919,"5min":1.919,"15min":1.919},"last":1.617},{"interface":"front","average":{"1min":1.532,"5min":1.532,"15min":1.532},"min":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"max":{"1min":3.2389999999999999,"5min":3.2389999999999999,"15min":3.2389999999999999},"last":1.837}]},{"osd":7,"last update":"Fri Jun 9 04:42:40 2023","interfaces":[{"interface":"back","average":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"min":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"max":{"1min":2.2250000000000001,"5min":2.2250000000000001,"15min":2.2250000000000001},"last":1.8069999999999999},{"interface":"front","average":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"min":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"max":{"1min":1.8009999999999999,"5min":1.8009999999999999,"15min":1.8009999999999999},"last":1.7290000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574866,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":376,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":385024,"data_stored":153480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 9 04:42:41 2023","interfaces":[{"interface":"back","average":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"min":{"1min":0.752,"5min":0.752,"15min":0.752},"max":{"1min":2.4929999999999999,"5min":2.4929999999999999,"15min":2.4929999999999999},"last":0.72699999999999998},{"interface":"front","average":{"1min":1.258,"5min":1.258,"15min":1.258},"min":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"max":{"1min":2.323,"5min":2.323,"15min":2.323},"last":1.6220000000000001}]},{"osd":1,"last update":"Fri Jun 9 04:42:41 2023","interfaces":[{"interface":"back","average":{"1min":1.236,"5min":1.236,"15min":1.236},"min":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":2.4220000000000002,"5min":2.4220000000000002,"15min":2.4220000000000002},"last":1.804},{"interface":"front","average":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"min":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"max":{"1min":2.0009999999999999,"5min":2.0009999999999999,"15min":2.0009999999999999},"last":3.6840000000000002}]},{"osd":2,"last update":"Fri Jun 9 04:42:41 2023","interfaces":[{"interface":"back","average":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"min":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":1.53,"5min":1.53,"15min":1.53},"last":1.079},{"interface":"front","average":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":3.605,"5min":3.605,"15min":3.605},"last":2.2149999999999999}]},{"osd":3,"last update":"Fri Jun 9 04:42:41 2023","interfaces":[{"interface":"back","average":{"1min":1.252,"5min":1.252,"15min":1.252},"min":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":1.74,"5min":1.74,"15min":1.74},"last":1.883},{"interface":"front","average":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"min":{"1min":0.88,"5min":0.88,"15min":0.88},"max":{"1min":2.036,"5min":2.036,"15min":2.036},"last":1.7150000000000001}]},{"osd":4,"last update":"Fri Jun 9 04:42:41 2023","interfaces":[{"interface":"back","average":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"min":{"1min":0.876,"5min":0.876,"15min":0.876},"max":{"1min":1.956,"5min":1.956,"15min":1.956},"last":2.3759999999999999},{"interface":"front","average":{"1min":1.494,"5min":1.494,"15min":1.494},"min":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"max":{"1min":2.5249999999999999,"5min":2.5249999999999999,"15min":2.5249999999999999},"last":2.9319999999999999}]},{"osd":6,"last update":"Fri Jun 9 04:42:41 2023","interfaces":[{"interface":"back","average":{"1min":1.5389999999999999,"5min":1.5389999999999999,"15min":1.5389999999999999},"min":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"max":{"1min":3.4470000000000001,"5min":3.4470000000000001,"15min":3.4470000000000001},"last":1.645},{"interface":"front","average":{"1min":1.492,"5min":1.492,"15min":1.492},"min":{"1min":1.135,"5min":1.135,"15min":1.135},"max":{"1min":2.1480000000000001,"5min":2.1480000000000001,"15min":2.1480000000000001},"last":0.78000000000000003}]},{"osd":7,"last update":"Fri Jun 9 04:42:41 2023","interfaces":[{"interface":"back","average":{"1min":1.3520000000000001,"5min":1.3520000000000001,"15min":1.3520000000000001},"min":{"1min":1.014,"5min":1.014,"15min":1.014},"max":{"1min":1.895,"5min":1.895,"15min":1.895},"last":1.532},{"interface":"front","average":{"1min":1.6439999999999999,"5min":1.6439999999999999,"15min":1.6439999999999999},"min":{"1min":1.091,"5min":1.091,"15min":1.091},"max":{"1min":3.738,"5min":3.738,"15min":3.738},"last":1.76}]}]},{"osd":4,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":376,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":385024,"data_stored":153480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 9 04:42:44 2023","interfaces":[{"interface":"back","average":{"1min":1.204,"5min":1.204,"15min":1.204},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":2.0670000000000002,"5min":2.0670000000000002,"15min":2.0670000000000002},"last":1.296},{"interface":"front","average":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"min":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":2.6160000000000001,"5min":2.6160000000000001,"15min":2.6160000000000001},"last":1.1579999999999999}]},{"osd":1,"last update":"Fri Jun 9 04:42:44 2023","interfaces":[{"interface":"back","average":{"1min":1.135,"5min":1.135,"15min":1.135},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.569,"5min":1.569,"15min":1.569},"last":1.2669999999999999},{"interface":"front","average":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.532,"5min":1.532,"15min":1.532},"last":1.016}]},{"osd":2,"last update":"Fri Jun 9 04:42:44 2023","interfaces":[{"interface":"back","average":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"min":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"max":{"1min":1.7190000000000001,"5min":1.7190000000000001,"15min":1.7190000000000001},"last":1.345},{"interface":"front","average":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.873,"5min":1.873,"15min":1.873},"last":1.379}]},{"osd":3,"last update":"Fri Jun 9 04:42:44 2023","interfaces":[{"interface":"back","average":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"min":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"max":{"1min":1.4059999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":1.321},{"interface":"front","average":{"1min":1.363,"5min":1.363,"15min":1.363},"min":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":1.7789999999999999,"5min":1.7789999999999999,"15min":1.7789999999999999},"last":1.46}]},{"osd":5,"last update":"Fri Jun 9 04:42:44 2023","interfaces":[{"interface":"back","average":{"1min":1.2889999999999999,"5min":1.2889999999999999,"15min":1.2889999999999999},"min":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.8200000000000001,"5min":1.8200000000000001,"15min":1.8200000000000001},"last":1.1970000000000001},{"interface":"front","average":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"min":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"max":{"1min":2.0099999999999998,"5min":2.0099999999999998,"15min":2.0099999999999998},"last":0.96499999999999997}]},{"osd":6,"last update":"Fri Jun 9 04:42:44 2023","interfaces":[{"interface":"back","average":{"1min":1.413,"5min":1.413,"15min":1.413},"min":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"max":{"1min":1.897,"5min":1.897,"15min":1.897},"last":1.095},{"interface":"front","average":{"1min":1.5249999999999999,"5min":1.5249999999999999,"15min":1.5249999999999999},"min":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":2.0289999999999999,"5min":2.0289999999999999,"15min":2.0289999999999999},"last":1.4350000000000001}]},{"osd":7,"last update":"Fri Jun 9 04:42:44 2023","interfaces":[{"interface":"back","average":{"1min":1.323,"5min":1.323,"15min":1.323},"min":{"1min":1.02,"5min":1.02,"15min":1.02},"max":{"1min":1.774,"5min":1.774,"15min":1.774},"last":1.2390000000000001},{"interface":"front","average":{"1min":1.4890000000000001,"5min":1.4890000000000001,"15min":1.4890000000000001},"min":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":1.988,"5min":1.988,"15min":1.988},"last":1.409}]}]},{"osd":3,"up_from":13,"seq":55834574865,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":376,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":385024,"data_stored":153480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 9 04:42:44 2023","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.3959999999999999,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":1.008}]},{"osd":1,"last update":"Fri Jun 9 04:42:44 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.857,"5min":1.857,"15min":1.857},"last":0.66600000000000004},{"interface":"front","average":{"1min":1.036,"5min":1.036,"15min":1.036},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":2.3090000000000002,"5min":2.3090000000000002,"15min":2.3090000000000002},"last":0.92400000000000004}]},{"osd":2,"last update":"Fri Jun 9 04:42:44 2023","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.405,"5min":1.405,"15min":1.405},"last":1.0760000000000001},{"interface":"front","average":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.87}]},{"osd":4,"last update":"Fri Jun 9 04:42:44 2023","interfaces":[{"interface":"back","average":{"1min":1.407,"5min":1.407,"15min":1.407},"min":{"1min":0.878,"5min":0.878,"15min":0.878},"max":{"1min":4.6859999999999999,"5min":4.6859999999999999,"15min":4.6859999999999999},"last":1.4810000000000001},{"interface":"front","average":{"1min":1.5009999999999999,"5min":1.5009999999999999,"15min":1.5009999999999999},"min":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":4.7839999999999998,"5min":4.7839999999999998,"15min":4.7839999999999998},"last":1.46}]},{"osd":5,"last update":"Fri Jun 9 04:42:44 2023","interfaces":[{"interface":"back","average":{"1min":1.371,"5min":1.371,"15min":1.371},"min":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":3.3159999999999998,"5min":3.3159999999999998,"15min":3.3159999999999998},"last":1.151},{"interface":"front","average":{"1min":1.528,"5min":1.528,"15min":1.528},"min":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"max":{"1min":4.3700000000000001,"5min":4.3700000000000001,"15min":4.3700000000000001},"last":1.321}]},{"osd":6,"last update":"Fri Jun 9 04:42:44 2023","interfaces":[{"interface":"back","average":{"1min":1.478,"5min":1.478,"15min":1.478},"min":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"max":{"1min":4.109,"5min":4.109,"15min":4.109},"last":1.286},{"interface":"front","average":{"1min":1.427,"5min":1.427,"15min":1.427},"min":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"max":{"1min":2.4140000000000001,"5min":2.4140000000000001,"15min":2.4140000000000001},"last":1.355}]},{"osd":7,"last update":"Fri Jun 9 04:42:44 2023","interfaces":[{"interface":"back","average":{"1min":1.5,"5min":1.5,"15min":1.5},"min":{"1min":0.877,"5min":0.877,"15min":0.877},"max":{"1min":3.0649999999999999,"5min":3.0649999999999999,"15min":3.0649999999999999},"last":1.3939999999999999},{"interface":"front","average":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"min":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"max":{"1min":4.2919999999999998,"5min":4.2919999999999998,"15min":4.2919999999999998},"last":1.423}]}]},{"osd":2,"up_from":13,"seq":55834574867,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":376,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":385024,"data_stored":153480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 9 04:42:41 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.81100000000000005}]},{"osd":1,"last update":"Fri Jun 9 04:42:41 2023","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.286,"5min":1.286,"15min":1.286},"last":0.77400000000000002},{"interface":"front","average":{"1min":1.036,"5min":1.036,"15min":1.036},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.4870000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":1.395}]},{"osd":3,"last update":"Fri Jun 9 04:42:41 2023","interfaces":[{"interface":"back","average":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.5920000000000001,"5min":1.5920000000000001,"15min":1.5920000000000001},"last":1.2030000000000001},{"interface":"front","average":{"1min":1.151,"5min":1.151,"15min":1.151},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.6339999999999999,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":1.272}]},{"osd":4,"last update":"Fri Jun 9 04:42:41 2023","interfaces":[{"interface":"back","average":{"1min":1.391,"5min":1.391,"15min":1.391},"min":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"max":{"1min":1.9590000000000001,"5min":1.9590000000000001,"15min":1.9590000000000001},"last":1.5209999999999999},{"interface":"front","average":{"1min":1.23,"5min":1.23,"15min":1.23},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":2.1059999999999999,"5min":2.1059999999999999,"15min":2.1059999999999999},"last":1.079}]},{"osd":5,"last update":"Fri Jun 9 04:42:41 2023","interfaces":[{"interface":"back","average":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"min":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"max":{"1min":1.7430000000000001,"5min":1.7430000000000001,"15min":1.7430000000000001},"last":1.2969999999999999},{"interface":"front","average":{"1min":1.4430000000000001,"5min":1.4430000000000001,"15min":1.4430000000000001},"min":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"max":{"1min":1.9079999999999999,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":1.4710000000000001}]},{"osd":6,"last update":"Fri Jun 9 04:42:41 2023","interfaces":[{"interface":"back","average":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"min":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"max":{"1min":1.8839999999999999,"5min":1.8839999999999999,"15min":1.8839999999999999},"last":1.3300000000000001},{"interface":"front","average":{"1min":1.399,"5min":1.399,"15min":1.399},"min":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"max":{"1min":1.974,"5min":1.974,"15min":1.974},"last":1.026}]},{"osd":7,"last update":"Fri Jun 9 04:42:41 2023","interfaces":[{"interface":"back","average":{"1min":1.4119999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"min":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"max":{"1min":2.0350000000000001,"5min":2.0350000000000001,"15min":2.0350000000000001},"last":0.98099999999999998},{"interface":"front","average":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"min":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"max":{"1min":2.048,"5min":2.048,"15min":2.048},"last":1.365}]}]},{"osd":1,"up_from":13,"seq":55834574866,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":376,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":385024,"data_stored":153480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 9 04:42:43 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.377,"5min":1.377,"15min":1.377},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":2.3300000000000001,"5min":2.3300000000000001,"15min":2.3300000000000001},"last":1.581}]},{"osd":2,"last update":"Fri Jun 9 04:42:43 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.444,"5min":1.444,"15min":1.444},"last":0.74099999999999999},{"interface":"front","average":{"1min":1.01,"5min":1.01,"15min":1.01},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":2.379,"5min":2.379,"15min":2.379},"last":1.129}]},{"osd":3,"last update":"Fri Jun 9 04:42:43 2023","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":2.3220000000000001,"5min":2.3220000000000001,"15min":2.3220000000000001},"last":1.3080000000000001},{"interface":"front","average":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.744,"5min":1.744,"15min":1.744},"last":1.004}]},{"osd":4,"last update":"Fri Jun 9 04:42:43 2023","interfaces":[{"interface":"back","average":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"min":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":1.8400000000000001,"5min":1.8400000000000001,"15min":1.8400000000000001},"last":1.4219999999999999},{"interface":"front","average":{"1min":1.262,"5min":1.262,"15min":1.262},"min":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"max":{"1min":2.2709999999999999,"5min":2.2709999999999999,"15min":2.2709999999999999},"last":1.4970000000000001}]},{"osd":5,"last update":"Fri Jun 9 04:42:43 2023","interfaces":[{"interface":"back","average":{"1min":1.321,"5min":1.321,"15min":1.321},"min":{"1min":0.998,"5min":0.998,"15min":0.998},"max":{"1min":2.2839999999999998,"5min":2.2839999999999998,"15min":2.2839999999999998},"last":1.621},{"interface":"front","average":{"1min":1.496,"5min":1.496,"15min":1.496},"min":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"max":{"1min":3.4390000000000001,"5min":3.4390000000000001,"15min":3.4390000000000001},"last":1.4670000000000001}]},{"osd":6,"last update":"Fri Jun 9 04:42:43 2023","interfaces":[{"interface":"back","average":{"1min":1.381,"5min":1.381,"15min":1.381},"min":{"1min":0.871,"5min":0.871,"15min":0.871},"max":{"1min":2.54,"5min":2.54,"15min":2.54},"last":1.2330000000000001},{"interface":"front","average":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"min":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"max":{"1min":3.1480000000000001,"5min":3.1480000000000001,"15min":3.1480000000000001},"last":1.696}]},{"osd":7,"last update":"Fri Jun 9 04:42:43 2023","interfaces":[{"interface":"back","average":{"1min":1.494,"5min":1.494,"15min":1.494},"min":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"max":{"1min":3.8079999999999998,"5min":3.8079999999999998,"15min":3.8079999999999998},"last":1.5449999999999999},{"interface":"front","average":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"min":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"max":{"1min":2.927,"5min":2.927,"15min":2.927},"last":1.647}]}]},{"osd":0,"up_from":13,"seq":55834574867,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27908,"kb_used_data":956,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343932,"statfs":{"total":96636764160,"available":96608186368,"internally_reserved":0,"allocated":978944,"data_stored":743848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jun 9 04:42:45 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.867,"5min":1.867,"15min":1.867},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.595,"5min":1.595,"15min":1.595},"last":1.0509999999999999}]},{"osd":2,"last update":"Fri Jun 9 04:42:45 2023","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.2889999999999999,"5min":1.2889999999999999,"15min":1.2889999999999999},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.4850000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"last":0.93799999999999994}]},{"osd":3,"last update":"Fri Jun 9 04:42:45 2023","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"min":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":1.4279999999999999},{"interface":"front","average":{"1min":1.028,"5min":1.028,"15min":1.028},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.675,"5min":1.675,"15min":1.675},"last":1.3160000000000001}]},{"osd":4,"last update":"Fri Jun 9 04:42:45 2023","interfaces":[{"interface":"back","average":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"min":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":1.863,"5min":1.863,"15min":1.863},"last":1.52},{"interface":"front","average":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"min":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"max":{"1min":1.9950000000000001,"5min":1.9950000000000001,"15min":1.9950000000000001},"last":1.3819999999999999}]},{"osd":5,"last update":"Fri Jun 9 04:42:45 2023","interfaces":[{"interface":"back","average":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"min":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":2.093,"5min":2.093,"15min":2.093},"last":1.579},{"interface":"front","average":{"1min":1.302,"5min":1.302,"15min":1.302},"min":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"max":{"1min":2.0369999999999999,"5min":2.0369999999999999,"15min":2.0369999999999999},"last":1.718}]},{"osd":6,"last update":"Fri Jun 9 04:42:45 2023","interfaces":[{"interface":"back","average":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"min":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"max":{"1min":1.9359999999999999,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":1.5509999999999999},{"interface":"front","average":{"1min":1.395,"5min":1.395,"15min":1.395},"min":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"max":{"1min":2.3650000000000002,"5min":2.3650000000000002,"15min":2.3650000000000002},"last":1.2150000000000001}]},{"osd":7,"last update":"Fri Jun 9 04:42:45 2023","interfaces":[{"interface":"back","average":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"min":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"max":{"1min":2.2879999999999998,"5min":2.2879999999999998,"15min":2.2879999999999998},"last":1.6819999999999999},{"interface":"front","average":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"min":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"max":{"1min":1.7370000000000001,"5min":1.7370000000000001,"15min":1.7370000000000001},"last":1.613}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-09T04:43:02.308 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-09T04:43:02.516 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.514+0000 7fd7d9e51700 1 Processor -- start 2023-06-09T04:43:02.516 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.514+0000 7fd7d9e51700 1 -- start start 2023-06-09T04:43:02.518 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.514+0000 7fd7d9e51700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fd7d40b6390 0x7fd7d40d27b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:43:02.518 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.514+0000 7fd7d9e51700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fd7d40d2cf0 0x7fd7d40d06c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:43:02.518 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.514+0000 7fd7d9e51700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7d40cf030 con 0x7fd7d40b7bf0 2023-06-09T04:43:02.518 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.514+0000 7fd7d9e51700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7d415c860 con 0x7fd7d40d2cf0 2023-06-09T04:43:02.519 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.514+0000 7fd7d9e51700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7d40cd4a0 con 0x7fd7d40b6390 2023-06-09T04:43:02.519 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.514+0000 7fd7d3fff700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fd7d40d2cf0 0x7fd7d40d06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:43:02.519 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.514+0000 7fd7d2ffd700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fd7d40b6390 0x7fd7d40d27b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:43:02.519 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.514+0000 7fd7d3fff700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fd7d40d2cf0 0x7fd7d40d06c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:44440/0 (socket says 172.21.15.90:44440) 2023-06-09T04:43:02.520 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.514+0000 7fd7d3fff700 1 -- 172.21.15.90:0/3264050255 learned_addr learned my addr 172.21.15.90:0/3264050255 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:43:02.520 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.518+0000 7fd7d3fff700 1 -- 172.21.15.90:0/3264050255 >> v2:172.21.15.174:3300/0 conn(0x7fd7d40b6390 msgr2=0x7fd7d40d27b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:43:02.520 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.518+0000 7fd7d3fff700 1 --2- 172.21.15.90:0/3264050255 >> v2:172.21.15.174:3300/0 conn(0x7fd7d40b6390 0x7fd7d40d27b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:43:02.520 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.518+0000 7fd7d3fff700 1 -- 172.21.15.90:0/3264050255 >> v1:172.21.15.174:6789/0 conn(0x7fd7d40b7bf0 legacy=0x7fd7d40b7fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:43:02.521 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.518+0000 7fd7d3fff700 1 -- 172.21.15.90:0/3264050255 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7d40d30f0 con 0x7fd7d40d2cf0 2023-06-09T04:43:02.521 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.518+0000 7fd7d3fff700 1 --2- 172.21.15.90:0/3264050255 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd7d40d2cf0 0x7fd7d40d06c0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fd7d40d2740 tx=0x7fd7cc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f815bee356fb68df server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:43:02.521 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.518+0000 7fd7d27fc700 1 -- 172.21.15.90:0/3264050255 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7cc00e070 con 0x7fd7d40d2cf0 2023-06-09T04:43:02.521 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.518+0000 7fd7d27fc700 1 -- 172.21.15.90:0/3264050255 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7cc00b910 con 0x7fd7d40d2cf0 2023-06-09T04:43:02.522 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.518+0000 7fd7d27fc700 1 -- 172.21.15.90:0/3264050255 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7cc00bcc0 con 0x7fd7d40d2cf0 2023-06-09T04:43:02.522 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.518+0000 7fd7d9e51700 1 -- 172.21.15.90:0/3264050255 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd7d40d2cf0 msgr2=0x7fd7d40d06c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:43:02.522 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.518+0000 7fd7d9e51700 1 --2- 172.21.15.90:0/3264050255 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd7d40d2cf0 0x7fd7d40d06c0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fd7d40d2740 tx=0x7fd7cc00b330 comp rx=0 tx=0).stop 2023-06-09T04:43:02.523 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.518+0000 7fd7d9e51700 1 -- 172.21.15.90:0/3264050255 shutdown_connections 2023-06-09T04:43:02.523 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.518+0000 7fd7d9e51700 1 --2- 172.21.15.90:0/3264050255 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd7d40d2cf0 0x7fd7d40d06c0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:43:02.523 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.518+0000 7fd7d9e51700 1 --2- 172.21.15.90:0/3264050255 >> v2:172.21.15.174:3300/0 conn(0x7fd7d40b6390 0x7fd7d40d27b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:43:02.523 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.518+0000 7fd7d9e51700 1 -- 172.21.15.90:0/3264050255 >> 172.21.15.90:0/3264050255 conn(0x7fd7d40b57a0 msgr2=0x7fd7d40b5ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:43:02.523 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.518+0000 7fd7d9e51700 1 -- 172.21.15.90:0/3264050255 shutdown_connections 2023-06-09T04:43:02.523 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.518+0000 7fd7d9e51700 1 -- 172.21.15.90:0/3264050255 wait complete. 2023-06-09T04:43:02.525 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.522+0000 7fd7d9e51700 1 Processor -- start 2023-06-09T04:43:02.525 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.522+0000 7fd7d9e51700 1 -- start start 2023-06-09T04:43:02.527 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.522+0000 7fd7d9e51700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd7d40b6390 0x7fd7d415a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:43:02.527 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.522+0000 7fd7d9e51700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd7d40b7bf0 0x7fd7d4158900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:43:02.527 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.522+0000 7fd7d9e51700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd7d40d2cf0 0x7fd7d406bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:43:02.527 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.522+0000 7fd7d9e51700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7d406b650 con 0x7fd7d40b7bf0 2023-06-09T04:43:02.527 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.522+0000 7fd7d9e51700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7d406aa40 con 0x7fd7d40d2cf0 2023-06-09T04:43:02.527 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.522+0000 7fd7d9e51700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7d406ad20 con 0x7fd7d40b6390 2023-06-09T04:43:02.529 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.526+0000 7fd7d2ffd700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd7d40b7bf0 0x7fd7d4158900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:43:02.529 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.526+0000 7fd7d2ffd700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd7d40b7bf0 0x7fd7d4158900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:44448/0 (socket says 172.21.15.90:44448) 2023-06-09T04:43:02.529 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.526+0000 7fd7d2ffd700 1 -- 172.21.15.90:0/2841634980 learned_addr learned my addr 172.21.15.90:0/2841634980 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:43:02.529 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.526+0000 7fd7d3fff700 1 --2- 172.21.15.90:0/2841634980 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd7d40d2cf0 0x7fd7d406bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:43:02.529 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.526+0000 7fd7d37fe700 1 --2- 172.21.15.90:0/2841634980 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd7d40b6390 0x7fd7d415a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:43:02.530 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.526+0000 7fd7d2ffd700 1 -- 172.21.15.90:0/2841634980 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd7d40b6390 msgr2=0x7fd7d415a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:43:02.530 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.526+0000 7fd7d2ffd700 1 --2- 172.21.15.90:0/2841634980 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd7d40b6390 0x7fd7d415a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:43:02.530 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.526+0000 7fd7d2ffd700 1 -- 172.21.15.90:0/2841634980 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd7d40d2cf0 msgr2=0x7fd7d406bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:43:02.530 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.526+0000 7fd7d2ffd700 1 --2- 172.21.15.90:0/2841634980 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd7d40d2cf0 0x7fd7d406bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:43:02.530 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.526+0000 7fd7d2ffd700 1 -- 172.21.15.90:0/2841634980 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7cc009b30 con 0x7fd7d40b7bf0 2023-06-09T04:43:02.530 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.526+0000 7fd7d37fe700 1 --2- 172.21.15.90:0/2841634980 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd7d40b6390 0x7fd7d415a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:43:02.530 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.526+0000 7fd7d2ffd700 1 --2- 172.21.15.90:0/2841634980 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd7d40b7bf0 0x7fd7d4158900 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fd7c800ebe0 tx=0x7fd7c800eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:43:02.530 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.526+0000 7fd7bbfff700 1 -- 172.21.15.90:0/2841634980 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7c8009740 con 0x7fd7d40b7bf0 2023-06-09T04:43:02.531 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.526+0000 7fd7bbfff700 1 -- 172.21.15.90:0/2841634980 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7c800c850 con 0x7fd7d40b7bf0 2023-06-09T04:43:02.531 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.526+0000 7fd7d9e51700 1 -- 172.21.15.90:0/2841634980 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7d406b000 con 0x7fd7d40b7bf0 2023-06-09T04:43:02.531 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.526+0000 7fd7bbfff700 1 -- 172.21.15.90:0/2841634980 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7c800cbe0 con 0x7fd7d40b7bf0 2023-06-09T04:43:02.531 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.526+0000 7fd7d9e51700 1 -- 172.21.15.90:0/2841634980 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7d406c020 con 0x7fd7d40b7bf0 2023-06-09T04:43:02.531 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.526+0000 7fd7d9e51700 1 -- 172.21.15.90:0/2841634980 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7d404db30 con 0x7fd7d40b7bf0 2023-06-09T04:43:02.532 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.530+0000 7fd7bbfff700 1 -- 172.21.15.90:0/2841634980 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd7c800cd40 con 0x7fd7d40b7bf0 2023-06-09T04:43:02.534 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.530+0000 7fd7bbfff700 1 --2- 172.21.15.90:0/2841634980 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fd7c0066320 0x7fd7c00687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:43:02.534 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.530+0000 7fd7bbfff700 1 -- 172.21.15.90:0/2841634980 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd7c8083d50 con 0x7fd7d40b7bf0 2023-06-09T04:43:02.535 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.530+0000 7fd7d37fe700 1 --2- 172.21.15.90:0/2841634980 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fd7c0066320 0x7fd7c00687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:43:02.536 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.534+0000 7fd7d37fe700 1 --2- 172.21.15.90:0/2841634980 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fd7c0066320 0x7fd7c00687d0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fd7c4000f60 tx=0x7fd7c4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:43:02.539 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.538+0000 7fd7bbfff700 1 -- 172.21.15.90:0/2841634980 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd7c8051200 con 0x7fd7d40b7bf0 2023-06-09T04:43:02.707 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.706+0000 7fd7d9e51700 1 -- 172.21.15.90:0/2841634980 --> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd7d40cf280 con 0x7fd7c0066320 2023-06-09T04:43:02.724 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.722+0000 7fd7bbfff700 1 -- 172.21.15.90:0/2841634980 <== mgr.4104 v2:172.21.15.174:6832/1389974754 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+308644 (secure 0 0 0) 0x7fd7c4001d70 con 0x7fd7c0066320 2023-06-09T04:43:02.730 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:43:02.733 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.730+0000 7fd7d9e51700 1 -- 172.21.15.90:0/2841634980 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fd7c0066320 msgr2=0x7fd7c00687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:43:02.733 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.730+0000 7fd7d9e51700 1 --2- 172.21.15.90:0/2841634980 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fd7c0066320 0x7fd7c00687d0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fd7c4000f60 tx=0x7fd7c4009040 comp rx=0 tx=0).stop 2023-06-09T04:43:02.733 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.730+0000 7fd7d9e51700 1 -- 172.21.15.90:0/2841634980 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd7d40b7bf0 msgr2=0x7fd7d4158900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:43:02.734 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.730+0000 7fd7d9e51700 1 --2- 172.21.15.90:0/2841634980 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd7d40b7bf0 0x7fd7d4158900 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fd7c800ebe0 tx=0x7fd7c800eef0 comp rx=0 tx=0).stop 2023-06-09T04:43:02.734 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.730+0000 7fd7d9e51700 1 -- 172.21.15.90:0/2841634980 shutdown_connections 2023-06-09T04:43:02.734 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.730+0000 7fd7d9e51700 1 --2- 172.21.15.90:0/2841634980 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fd7c0066320 0x7fd7c00687d0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:43:02.734 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.730+0000 7fd7d9e51700 1 --2- 172.21.15.90:0/2841634980 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd7d40d2cf0 0x7fd7d406bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:43:02.735 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.730+0000 7fd7d9e51700 1 --2- 172.21.15.90:0/2841634980 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd7d40b7bf0 0x7fd7d4158900 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:43:02.735 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.730+0000 7fd7d9e51700 1 --2- 172.21.15.90:0/2841634980 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd7d40b6390 0x7fd7d415a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:43:02.735 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.730+0000 7fd7d9e51700 1 -- 172.21.15.90:0/2841634980 >> 172.21.15.90:0/2841634980 conn(0x7fd7d40b57a0 msgr2=0x7fd7d415bc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:43:02.735 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.730+0000 7fd7d9e51700 1 -- 172.21.15.90:0/2841634980 shutdown_connections 2023-06-09T04:43:02.736 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.730+0000 7fd7d9e51700 1 -- 172.21.15.90:0/2841634980 wait complete. 2023-06-09T04:43:02.736 INFO:teuthology.orchestra.run.smithi090.stderr:dumped all 2023-06-09T04:43:02.753 INFO:teuthology.orchestra.run.smithi090.stdout:{"pg_ready":true,"pg_map":{"version":72,"stamp":"2023-06-09T04:43:02.334765+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":224328,"kb_used_data":4616,"kb_used_omap":0,"kb_used_meta":219648,"kb_avail":754750392,"statfs":{"total":773094113280,"available":772864401408,"internally_reserved":0,"allocated":4726784,"data_stored":2625932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":224919552},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":43,"apply_latency_ms":43,"commit_latency_ns":43000000,"apply_latency_ns":43000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.956125"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-06-09T04:42:59.088461+0000","last_change":"2023-06-09T04:42:57.868848+0000","last_active":"2023-06-09T04:42:59.088461+0000","last_peered":"2023-06-09T04:42:59.088461+0000","last_clean":"2023-06-09T04:42:59.088461+0000","last_became_active":"2023-06-09T04:42:57.868586+0000","last_became_peered":"2023-06-09T04:42:57.868586+0000","last_unstale":"2023-06-09T04:42:59.088461+0000","last_undegraded":"2023-06-09T04:42:59.088461+0000","last_fullsized":"2023-06-09T04:42:59.088461+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_clean_scrub_stamp":"2023-06-09T04:42:57.378828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:25:44.299723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-06-09T04:42:59.087986+0000","last_change":"2023-06-09T04:42:57.866669+0000","last_active":"2023-06-09T04:42:59.087986+0000","last_peered":"2023-06-09T04:42:59.087986+0000","last_clean":"2023-06-09T04:42:59.087986+0000","last_became_active":"2023-06-09T04:42:57.866388+0000","last_became_peered":"2023-06-09T04:42:57.866388+0000","last_unstale":"2023-06-09T04:42:59.087986+0000","last_undegraded":"2023-06-09T04:42:59.087986+0000","last_fullsized":"2023-06-09T04:42:59.087986+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_clean_scrub_stamp":"2023-06-09T04:42:57.378828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:11:00.720823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-06-09T04:42:59.089379+0000","last_change":"2023-06-09T04:42:57.894207+0000","last_active":"2023-06-09T04:42:59.089379+0000","last_peered":"2023-06-09T04:42:59.089379+0000","last_clean":"2023-06-09T04:42:59.089379+0000","last_became_active":"2023-06-09T04:42:57.893882+0000","last_became_peered":"2023-06-09T04:42:57.893882+0000","last_unstale":"2023-06-09T04:42:59.089379+0000","last_undegraded":"2023-06-09T04:42:59.089379+0000","last_fullsized":"2023-06-09T04:42:59.089379+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_clean_scrub_stamp":"2023-06-09T04:42:57.378828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:57:09.353283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-06-09T04:42:58.854442+0000","last_change":"2023-06-09T04:42:57.874419+0000","last_active":"2023-06-09T04:42:58.854442+0000","last_peered":"2023-06-09T04:42:58.854442+0000","last_clean":"2023-06-09T04:42:58.854442+0000","last_became_active":"2023-06-09T04:42:57.873797+0000","last_became_peered":"2023-06-09T04:42:57.873797+0000","last_unstale":"2023-06-09T04:42:58.854442+0000","last_undegraded":"2023-06-09T04:42:58.854442+0000","last_fullsized":"2023-06-09T04:42:58.854442+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_clean_scrub_stamp":"2023-06-09T04:42:57.378828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:40:51.054245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-06-09T04:42:58.854563+0000","last_change":"2023-06-09T04:42:57.864610+0000","last_active":"2023-06-09T04:42:58.854563+0000","last_peered":"2023-06-09T04:42:58.854563+0000","last_clean":"2023-06-09T04:42:58.854563+0000","last_became_active":"2023-06-09T04:42:57.864342+0000","last_became_peered":"2023-06-09T04:42:57.864342+0000","last_unstale":"2023-06-09T04:42:58.854563+0000","last_undegraded":"2023-06-09T04:42:58.854563+0000","last_fullsized":"2023-06-09T04:42:58.854563+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_clean_scrub_stamp":"2023-06-09T04:42:57.378828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:27:09.142732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-06-09T04:42:59.088353+0000","last_change":"2023-06-09T04:42:57.862212+0000","last_active":"2023-06-09T04:42:59.088353+0000","last_peered":"2023-06-09T04:42:59.088353+0000","last_clean":"2023-06-09T04:42:59.088353+0000","last_became_active":"2023-06-09T04:42:57.861947+0000","last_became_peered":"2023-06-09T04:42:57.861947+0000","last_unstale":"2023-06-09T04:42:59.088353+0000","last_undegraded":"2023-06-09T04:42:59.088353+0000","last_fullsized":"2023-06-09T04:42:59.088353+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_clean_scrub_stamp":"2023-06-09T04:42:57.378828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:47:29.571190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-06-09T04:42:58.856303+0000","last_change":"2023-06-09T04:42:57.882990+0000","last_active":"2023-06-09T04:42:58.856303+0000","last_peered":"2023-06-09T04:42:58.856303+0000","last_clean":"2023-06-09T04:42:58.856303+0000","last_became_active":"2023-06-09T04:42:57.882722+0000","last_became_peered":"2023-06-09T04:42:57.882722+0000","last_unstale":"2023-06-09T04:42:58.856303+0000","last_undegraded":"2023-06-09T04:42:58.856303+0000","last_fullsized":"2023-06-09T04:42:58.856303+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_clean_scrub_stamp":"2023-06-09T04:42:57.378828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:27:08.916754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-06-09T04:42:59.087390+0000","last_change":"2023-06-09T04:42:57.867575+0000","last_active":"2023-06-09T04:42:59.087390+0000","last_peered":"2023-06-09T04:42:59.087390+0000","last_clean":"2023-06-09T04:42:59.087390+0000","last_became_active":"2023-06-09T04:42:57.867316+0000","last_became_peered":"2023-06-09T04:42:57.867316+0000","last_unstale":"2023-06-09T04:42:59.087390+0000","last_undegraded":"2023-06-09T04:42:59.087390+0000","last_fullsized":"2023-06-09T04:42:59.087390+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_clean_scrub_stamp":"2023-06-09T04:42:57.378828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:48:33.110525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-06-09T04:42:59.089762+0000","last_change":"2023-06-09T04:42:57.894088+0000","last_active":"2023-06-09T04:42:59.089762+0000","last_peered":"2023-06-09T04:42:59.089762+0000","last_clean":"2023-06-09T04:42:59.089762+0000","last_became_active":"2023-06-09T04:42:57.893791+0000","last_became_peered":"2023-06-09T04:42:57.893791+0000","last_unstale":"2023-06-09T04:42:59.089762+0000","last_undegraded":"2023-06-09T04:42:59.089762+0000","last_fullsized":"2023-06-09T04:42:59.089762+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_clean_scrub_stamp":"2023-06-09T04:42:57.378828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:40:24.486985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-06-09T04:42:58.857952+0000","last_change":"2023-06-09T04:42:57.867847+0000","last_active":"2023-06-09T04:42:58.857952+0000","last_peered":"2023-06-09T04:42:58.857952+0000","last_clean":"2023-06-09T04:42:58.857952+0000","last_became_active":"2023-06-09T04:42:57.867531+0000","last_became_peered":"2023-06-09T04:42:57.867531+0000","last_unstale":"2023-06-09T04:42:58.857952+0000","last_undegraded":"2023-06-09T04:42:58.857952+0000","last_fullsized":"2023-06-09T04:42:58.857952+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_clean_scrub_stamp":"2023-06-09T04:42:57.378828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:40:40.623791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-06-09T04:42:58.857562+0000","last_change":"2023-06-09T04:42:57.879270+0000","last_active":"2023-06-09T04:42:58.857562+0000","last_peered":"2023-06-09T04:42:58.857562+0000","last_clean":"2023-06-09T04:42:58.857562+0000","last_became_active":"2023-06-09T04:42:57.878985+0000","last_became_peered":"2023-06-09T04:42:57.878985+0000","last_unstale":"2023-06-09T04:42:58.857562+0000","last_undegraded":"2023-06-09T04:42:58.857562+0000","last_fullsized":"2023-06-09T04:42:58.857562+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_clean_scrub_stamp":"2023-06-09T04:42:57.378828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:29:54.053534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-06-09T04:42:59.088514+0000","last_change":"2023-06-09T04:42:57.880414+0000","last_active":"2023-06-09T04:42:59.088514+0000","last_peered":"2023-06-09T04:42:59.088514+0000","last_clean":"2023-06-09T04:42:59.088514+0000","last_became_active":"2023-06-09T04:42:57.879842+0000","last_became_peered":"2023-06-09T04:42:57.879842+0000","last_unstale":"2023-06-09T04:42:59.088514+0000","last_undegraded":"2023-06-09T04:42:59.088514+0000","last_fullsized":"2023-06-09T04:42:59.088514+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_clean_scrub_stamp":"2023-06-09T04:42:57.378828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:34:50.907563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-06-09T04:42:58.857842+0000","last_change":"2023-06-09T04:42:57.883263+0000","last_active":"2023-06-09T04:42:58.857842+0000","last_peered":"2023-06-09T04:42:58.857842+0000","last_clean":"2023-06-09T04:42:58.857842+0000","last_became_active":"2023-06-09T04:42:57.882911+0000","last_became_peered":"2023-06-09T04:42:57.882911+0000","last_unstale":"2023-06-09T04:42:58.857842+0000","last_undegraded":"2023-06-09T04:42:58.857842+0000","last_fullsized":"2023-06-09T04:42:58.857842+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_clean_scrub_stamp":"2023-06-09T04:42:57.378828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:35:04.892115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-06-09T04:42:59.087828+0000","last_change":"2023-06-09T04:42:57.880132+0000","last_active":"2023-06-09T04:42:59.087828+0000","last_peered":"2023-06-09T04:42:59.087828+0000","last_clean":"2023-06-09T04:42:59.087828+0000","last_became_active":"2023-06-09T04:42:57.879842+0000","last_became_peered":"2023-06-09T04:42:57.879842+0000","last_unstale":"2023-06-09T04:42:59.087828+0000","last_undegraded":"2023-06-09T04:42:59.087828+0000","last_fullsized":"2023-06-09T04:42:59.087828+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_clean_scrub_stamp":"2023-06-09T04:42:57.378828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:14:46.508454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-06-09T04:42:58.856351+0000","last_change":"2023-06-09T04:42:57.865695+0000","last_active":"2023-06-09T04:42:58.856351+0000","last_peered":"2023-06-09T04:42:58.856351+0000","last_clean":"2023-06-09T04:42:58.856351+0000","last_became_active":"2023-06-09T04:42:57.865327+0000","last_became_peered":"2023-06-09T04:42:57.865327+0000","last_unstale":"2023-06-09T04:42:58.856351+0000","last_undegraded":"2023-06-09T04:42:58.856351+0000","last_fullsized":"2023-06-09T04:42:58.856351+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_clean_scrub_stamp":"2023-06-09T04:42:57.378828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:58:29.497943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-06-09T04:42:58.856711+0000","last_change":"2023-06-09T04:42:57.888598+0000","last_active":"2023-06-09T04:42:58.856711+0000","last_peered":"2023-06-09T04:42:58.856711+0000","last_clean":"2023-06-09T04:42:58.856711+0000","last_became_active":"2023-06-09T04:42:57.888051+0000","last_became_peered":"2023-06-09T04:42:57.888051+0000","last_unstale":"2023-06-09T04:42:58.856711+0000","last_undegraded":"2023-06-09T04:42:58.856711+0000","last_fullsized":"2023-06-09T04:42:58.856711+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_clean_scrub_stamp":"2023-06-09T04:42:57.378828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:19:45.634514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-06-09T04:42:58.858183+0000","last_change":"2023-06-09T04:42:57.888429+0000","last_active":"2023-06-09T04:42:58.858183+0000","last_peered":"2023-06-09T04:42:58.858183+0000","last_clean":"2023-06-09T04:42:58.858183+0000","last_became_active":"2023-06-09T04:42:57.888118+0000","last_became_peered":"2023-06-09T04:42:57.888118+0000","last_unstale":"2023-06-09T04:42:58.858183+0000","last_undegraded":"2023-06-09T04:42:58.858183+0000","last_fullsized":"2023-06-09T04:42:58.858183+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_clean_scrub_stamp":"2023-06-09T04:42:57.378828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:08:43.965787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-06-09T04:42:59.088587+0000","last_change":"2023-06-09T04:42:57.876713+0000","last_active":"2023-06-09T04:42:59.088587+0000","last_peered":"2023-06-09T04:42:59.088587+0000","last_clean":"2023-06-09T04:42:59.088587+0000","last_became_active":"2023-06-09T04:42:57.876248+0000","last_became_peered":"2023-06-09T04:42:57.876248+0000","last_unstale":"2023-06-09T04:42:59.088587+0000","last_undegraded":"2023-06-09T04:42:59.088587+0000","last_fullsized":"2023-06-09T04:42:59.088587+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_clean_scrub_stamp":"2023-06-09T04:42:57.378828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:37:59.798390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-06-09T04:42:58.854646+0000","last_change":"2023-06-09T04:42:57.876045+0000","last_active":"2023-06-09T04:42:58.854646+0000","last_peered":"2023-06-09T04:42:58.854646+0000","last_clean":"2023-06-09T04:42:58.854646+0000","last_became_active":"2023-06-09T04:42:57.874561+0000","last_became_peered":"2023-06-09T04:42:57.874561+0000","last_unstale":"2023-06-09T04:42:58.854646+0000","last_undegraded":"2023-06-09T04:42:58.854646+0000","last_fullsized":"2023-06-09T04:42:58.854646+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_clean_scrub_stamp":"2023-06-09T04:42:57.378828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:15:36.807056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-06-09T04:42:59.089314+0000","last_change":"2023-06-09T04:42:57.875863+0000","last_active":"2023-06-09T04:42:59.089314+0000","last_peered":"2023-06-09T04:42:59.089314+0000","last_clean":"2023-06-09T04:42:59.089314+0000","last_became_active":"2023-06-09T04:42:57.875355+0000","last_became_peered":"2023-06-09T04:42:57.875355+0000","last_unstale":"2023-06-09T04:42:59.089314+0000","last_undegraded":"2023-06-09T04:42:59.089314+0000","last_fullsized":"2023-06-09T04:42:59.089314+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_clean_scrub_stamp":"2023-06-09T04:42:57.378828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:06:13.179494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-06-09T04:42:58.857258+0000","last_change":"2023-06-09T04:42:57.879343+0000","last_active":"2023-06-09T04:42:58.857258+0000","last_peered":"2023-06-09T04:42:58.857258+0000","last_clean":"2023-06-09T04:42:58.857258+0000","last_became_active":"2023-06-09T04:42:57.878945+0000","last_became_peered":"2023-06-09T04:42:57.878945+0000","last_unstale":"2023-06-09T04:42:58.857258+0000","last_undegraded":"2023-06-09T04:42:58.857258+0000","last_fullsized":"2023-06-09T04:42:58.857258+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_clean_scrub_stamp":"2023-06-09T04:42:57.378828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:19:45.634514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-06-09T04:42:59.088529+0000","last_change":"2023-06-09T04:42:57.875004+0000","last_active":"2023-06-09T04:42:59.088529+0000","last_peered":"2023-06-09T04:42:59.088529+0000","last_clean":"2023-06-09T04:42:59.088529+0000","last_became_active":"2023-06-09T04:42:57.874654+0000","last_became_peered":"2023-06-09T04:42:57.874654+0000","last_unstale":"2023-06-09T04:42:59.088529+0000","last_undegraded":"2023-06-09T04:42:59.088529+0000","last_fullsized":"2023-06-09T04:42:59.088529+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_clean_scrub_stamp":"2023-06-09T04:42:57.378828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:10:53.077257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-06-09T04:42:58.857093+0000","last_change":"2023-06-09T04:42:57.874308+0000","last_active":"2023-06-09T04:42:58.857093+0000","last_peered":"2023-06-09T04:42:58.857093+0000","last_clean":"2023-06-09T04:42:58.857093+0000","last_became_active":"2023-06-09T04:42:57.873753+0000","last_became_peered":"2023-06-09T04:42:57.873753+0000","last_unstale":"2023-06-09T04:42:58.857093+0000","last_undegraded":"2023-06-09T04:42:58.857093+0000","last_fullsized":"2023-06-09T04:42:58.857093+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_clean_scrub_stamp":"2023-06-09T04:42:57.378828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:29:54.053534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-06-09T04:42:58.854105+0000","last_change":"2023-06-09T04:42:57.876352+0000","last_active":"2023-06-09T04:42:58.854105+0000","last_peered":"2023-06-09T04:42:58.854105+0000","last_clean":"2023-06-09T04:42:58.854105+0000","last_became_active":"2023-06-09T04:42:57.876055+0000","last_became_peered":"2023-06-09T04:42:57.876055+0000","last_unstale":"2023-06-09T04:42:58.854105+0000","last_undegraded":"2023-06-09T04:42:58.854105+0000","last_fullsized":"2023-06-09T04:42:58.854105+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_clean_scrub_stamp":"2023-06-09T04:42:57.378828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:00:17.173883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-06-09T04:42:59.089053+0000","last_change":"2023-06-09T04:42:57.875553+0000","last_active":"2023-06-09T04:42:59.089053+0000","last_peered":"2023-06-09T04:42:59.089053+0000","last_clean":"2023-06-09T04:42:59.089053+0000","last_became_active":"2023-06-09T04:42:57.875173+0000","last_became_peered":"2023-06-09T04:42:57.875173+0000","last_unstale":"2023-06-09T04:42:59.089053+0000","last_undegraded":"2023-06-09T04:42:59.089053+0000","last_fullsized":"2023-06-09T04:42:59.089053+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_clean_scrub_stamp":"2023-06-09T04:42:57.378828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:43:22.271944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-06-09T04:42:59.089517+0000","last_change":"2023-06-09T04:42:57.865852+0000","last_active":"2023-06-09T04:42:59.089517+0000","last_peered":"2023-06-09T04:42:59.089517+0000","last_clean":"2023-06-09T04:42:59.089517+0000","last_became_active":"2023-06-09T04:42:57.865056+0000","last_became_peered":"2023-06-09T04:42:57.865056+0000","last_unstale":"2023-06-09T04:42:59.089517+0000","last_undegraded":"2023-06-09T04:42:59.089517+0000","last_fullsized":"2023-06-09T04:42:59.089517+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_clean_scrub_stamp":"2023-06-09T04:42:57.378828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:59:55.806948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-06-09T04:42:59.089607+0000","last_change":"2023-06-09T04:42:57.874446+0000","last_active":"2023-06-09T04:42:59.089607+0000","last_peered":"2023-06-09T04:42:59.089607+0000","last_clean":"2023-06-09T04:42:59.089607+0000","last_became_active":"2023-06-09T04:42:57.874152+0000","last_became_peered":"2023-06-09T04:42:57.874152+0000","last_unstale":"2023-06-09T04:42:59.089607+0000","last_undegraded":"2023-06-09T04:42:59.089607+0000","last_fullsized":"2023-06-09T04:42:59.089607+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_clean_scrub_stamp":"2023-06-09T04:42:57.378828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:05:24.989126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-06-09T04:42:58.857704+0000","last_change":"2023-06-09T04:42:57.879468+0000","last_active":"2023-06-09T04:42:58.857704+0000","last_peered":"2023-06-09T04:42:58.857704+0000","last_clean":"2023-06-09T04:42:58.857704+0000","last_became_active":"2023-06-09T04:42:57.879144+0000","last_became_peered":"2023-06-09T04:42:57.879144+0000","last_unstale":"2023-06-09T04:42:58.857704+0000","last_undegraded":"2023-06-09T04:42:58.857704+0000","last_fullsized":"2023-06-09T04:42:58.857704+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_clean_scrub_stamp":"2023-06-09T04:42:57.378828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:10:53.077257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-06-09T04:42:59.088588+0000","last_change":"2023-06-09T04:42:57.881533+0000","last_active":"2023-06-09T04:42:59.088588+0000","last_peered":"2023-06-09T04:42:59.088588+0000","last_clean":"2023-06-09T04:42:59.088588+0000","last_became_active":"2023-06-09T04:42:57.881245+0000","last_became_peered":"2023-06-09T04:42:57.881245+0000","last_unstale":"2023-06-09T04:42:59.088588+0000","last_undegraded":"2023-06-09T04:42:59.088588+0000","last_fullsized":"2023-06-09T04:42:59.088588+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_clean_scrub_stamp":"2023-06-09T04:42:57.378828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:15:36.807056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-06-09T04:42:59.088824+0000","last_change":"2023-06-09T04:42:57.877023+0000","last_active":"2023-06-09T04:42:59.088824+0000","last_peered":"2023-06-09T04:42:59.088824+0000","last_clean":"2023-06-09T04:42:59.088824+0000","last_became_active":"2023-06-09T04:42:57.876496+0000","last_became_peered":"2023-06-09T04:42:57.876496+0000","last_unstale":"2023-06-09T04:42:59.088824+0000","last_undegraded":"2023-06-09T04:42:59.088824+0000","last_fullsized":"2023-06-09T04:42:59.088824+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_clean_scrub_stamp":"2023-06-09T04:42:57.378828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:26:37.635297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-06-09T04:42:58.857239+0000","last_change":"2023-06-09T04:42:57.879185+0000","last_active":"2023-06-09T04:42:58.857239+0000","last_peered":"2023-06-09T04:42:58.857239+0000","last_clean":"2023-06-09T04:42:58.857239+0000","last_became_active":"2023-06-09T04:42:57.878916+0000","last_became_peered":"2023-06-09T04:42:57.878916+0000","last_unstale":"2023-06-09T04:42:58.857239+0000","last_undegraded":"2023-06-09T04:42:58.857239+0000","last_fullsized":"2023-06-09T04:42:58.857239+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_clean_scrub_stamp":"2023-06-09T04:42:57.378828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:10:53.077257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-06-09T04:42:59.087386+0000","last_change":"2023-06-09T04:42:57.858584+0000","last_active":"2023-06-09T04:42:59.087386+0000","last_peered":"2023-06-09T04:42:59.087386+0000","last_clean":"2023-06-09T04:42:59.087386+0000","last_became_active":"2023-06-09T04:42:57.858302+0000","last_became_peered":"2023-06-09T04:42:57.858302+0000","last_unstale":"2023-06-09T04:42:59.087386+0000","last_undegraded":"2023-06-09T04:42:59.087386+0000","last_fullsized":"2023-06-09T04:42:59.087386+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_clean_scrub_stamp":"2023-06-09T04:42:57.378828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:55:04.703382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-06-09T04:42:58.857687+0000","last_change":"2023-06-09T04:42:57.888851+0000","last_active":"2023-06-09T04:42:58.857687+0000","last_peered":"2023-06-09T04:42:58.857687+0000","last_clean":"2023-06-09T04:42:58.857687+0000","last_became_active":"2023-06-09T04:42:57.888582+0000","last_became_peered":"2023-06-09T04:42:57.888582+0000","last_unstale":"2023-06-09T04:42:58.857687+0000","last_undegraded":"2023-06-09T04:42:58.857687+0000","last_fullsized":"2023-06-09T04:42:58.857687+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_clean_scrub_stamp":"2023-06-09T04:42:57.378828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:52:43.030356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"37'4","reported_seq":17,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-06-09T04:42:59.089248+0000","last_change":"2023-06-09T04:42:57.420717+0000","last_active":"2023-06-09T04:42:59.089248+0000","last_peered":"2023-06-09T04:42:59.089248+0000","last_clean":"2023-06-09T04:42:59.089248+0000","last_became_active":"2023-06-09T04:42:57.420233+0000","last_became_peered":"2023-06-09T04:42:57.420233+0000","last_unstale":"2023-06-09T04:42:59.089248+0000","last_undegraded":"2023-06-09T04:42:59.089248+0000","last_fullsized":"2023-06-09T04:42:59.089248+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:56.365243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:56.365243+0000","last_clean_scrub_stamp":"2023-06-09T04:42:56.365243+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:05:14.810963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-06-09T04:42:59.089876+0000","last_change":"2023-06-09T04:42:57.874392+0000","last_active":"2023-06-09T04:42:59.089876+0000","last_peered":"2023-06-09T04:42:59.089876+0000","last_clean":"2023-06-09T04:42:59.089876+0000","last_became_active":"2023-06-09T04:42:57.871710+0000","last_became_peered":"2023-06-09T04:42:57.871710+0000","last_unstale":"2023-06-09T04:42:59.089876+0000","last_undegraded":"2023-06-09T04:42:59.089876+0000","last_fullsized":"2023-06-09T04:42:59.089876+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_clean_scrub_stamp":"2023-06-09T04:42:57.378828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:23:36.105367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"37'1","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-06-09T04:42:59.089803+0000","last_change":"2023-06-09T04:42:57.417185+0000","last_active":"2023-06-09T04:42:59.089803+0000","last_peered":"2023-06-09T04:42:59.089803+0000","last_clean":"2023-06-09T04:42:59.089803+0000","last_became_active":"2023-06-09T04:42:57.416893+0000","last_became_peered":"2023-06-09T04:42:57.416893+0000","last_unstale":"2023-06-09T04:42:59.089803+0000","last_undegraded":"2023-06-09T04:42:59.089803+0000","last_fullsized":"2023-06-09T04:42:59.089803+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:56.365243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:56.365243+0000","last_clean_scrub_stamp":"2023-06-09T04:42:56.365243+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:06:02.310751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-06-09T04:42:59.088979+0000","last_change":"2023-06-09T04:42:57.882956+0000","last_active":"2023-06-09T04:42:59.088979+0000","last_peered":"2023-06-09T04:42:59.088979+0000","last_clean":"2023-06-09T04:42:59.088979+0000","last_became_active":"2023-06-09T04:42:57.882489+0000","last_became_peered":"2023-06-09T04:42:57.882489+0000","last_unstale":"2023-06-09T04:42:59.088979+0000","last_undegraded":"2023-06-09T04:42:59.088979+0000","last_fullsized":"2023-06-09T04:42:59.088979+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_clean_scrub_stamp":"2023-06-09T04:42:57.378828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:50:39.902528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"37'2","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-06-09T04:42:59.089947+0000","last_change":"2023-06-09T04:42:57.414778+0000","last_active":"2023-06-09T04:42:59.089947+0000","last_peered":"2023-06-09T04:42:59.089947+0000","last_clean":"2023-06-09T04:42:59.089947+0000","last_became_active":"2023-06-09T04:42:57.414507+0000","last_became_peered":"2023-06-09T04:42:57.414507+0000","last_unstale":"2023-06-09T04:42:59.089947+0000","last_undegraded":"2023-06-09T04:42:59.089947+0000","last_fullsized":"2023-06-09T04:42:59.089947+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:56.365243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:56.365243+0000","last_clean_scrub_stamp":"2023-06-09T04:42:56.365243+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:38:38.529920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-06-09T04:42:59.088341+0000","last_change":"2023-06-09T04:42:57.879362+0000","last_active":"2023-06-09T04:42:59.088341+0000","last_peered":"2023-06-09T04:42:59.088341+0000","last_clean":"2023-06-09T04:42:59.088341+0000","last_became_active":"2023-06-09T04:42:57.879118+0000","last_became_peered":"2023-06-09T04:42:57.879118+0000","last_unstale":"2023-06-09T04:42:59.088341+0000","last_undegraded":"2023-06-09T04:42:59.088341+0000","last_fullsized":"2023-06-09T04:42:59.088341+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_clean_scrub_stamp":"2023-06-09T04:42:57.378828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:47:29.571190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"37'2","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-06-09T04:42:59.088865+0000","last_change":"2023-06-09T04:42:57.421450+0000","last_active":"2023-06-09T04:42:59.088865+0000","last_peered":"2023-06-09T04:42:59.088865+0000","last_clean":"2023-06-09T04:42:59.088865+0000","last_became_active":"2023-06-09T04:42:57.419972+0000","last_became_peered":"2023-06-09T04:42:57.419972+0000","last_unstale":"2023-06-09T04:42:59.088865+0000","last_undegraded":"2023-06-09T04:42:59.088865+0000","last_fullsized":"2023-06-09T04:42:59.088865+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:56.365243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:56.365243+0000","last_clean_scrub_stamp":"2023-06-09T04:42:56.365243+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:35:03.878530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-06-09T04:42:59.087576+0000","last_change":"2023-06-09T04:42:57.880811+0000","last_active":"2023-06-09T04:42:59.087576+0000","last_peered":"2023-06-09T04:42:59.087576+0000","last_clean":"2023-06-09T04:42:59.087576+0000","last_became_active":"2023-06-09T04:42:57.880218+0000","last_became_peered":"2023-06-09T04:42:57.880218+0000","last_unstale":"2023-06-09T04:42:59.087576+0000","last_undegraded":"2023-06-09T04:42:59.087576+0000","last_fullsized":"2023-06-09T04:42:59.087576+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_clean_scrub_stamp":"2023-06-09T04:42:57.378828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:39:03.947631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"37'1","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-06-09T04:42:58.857485+0000","last_change":"2023-06-09T04:42:57.416339+0000","last_active":"2023-06-09T04:42:58.857485+0000","last_peered":"2023-06-09T04:42:58.857485+0000","last_clean":"2023-06-09T04:42:58.857485+0000","last_became_active":"2023-06-09T04:42:57.416084+0000","last_became_peered":"2023-06-09T04:42:57.416084+0000","last_unstale":"2023-06-09T04:42:58.857485+0000","last_undegraded":"2023-06-09T04:42:58.857485+0000","last_fullsized":"2023-06-09T04:42:58.857485+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:56.365243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:56.365243+0000","last_clean_scrub_stamp":"2023-06-09T04:42:56.365243+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:33:04.752974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-06-09T04:42:58.856459+0000","last_change":"2023-06-09T04:42:57.879511+0000","last_active":"2023-06-09T04:42:58.856459+0000","last_peered":"2023-06-09T04:42:58.856459+0000","last_clean":"2023-06-09T04:42:58.856459+0000","last_became_active":"2023-06-09T04:42:57.878407+0000","last_became_peered":"2023-06-09T04:42:57.878407+0000","last_unstale":"2023-06-09T04:42:58.856459+0000","last_undegraded":"2023-06-09T04:42:58.856459+0000","last_fullsized":"2023-06-09T04:42:58.856459+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_clean_scrub_stamp":"2023-06-09T04:42:57.378828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:15:06.684257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"37'1","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-06-09T04:42:58.857191+0000","last_change":"2023-06-09T04:42:57.420689+0000","last_active":"2023-06-09T04:42:58.857191+0000","last_peered":"2023-06-09T04:42:58.857191+0000","last_clean":"2023-06-09T04:42:58.857191+0000","last_became_active":"2023-06-09T04:42:57.420404+0000","last_became_peered":"2023-06-09T04:42:57.420404+0000","last_unstale":"2023-06-09T04:42:58.857191+0000","last_undegraded":"2023-06-09T04:42:58.857191+0000","last_fullsized":"2023-06-09T04:42:58.857191+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:56.365243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:56.365243+0000","last_clean_scrub_stamp":"2023-06-09T04:42:56.365243+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:00:48.488036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-06-09T04:42:59.088086+0000","last_change":"2023-06-09T04:42:57.869508+0000","last_active":"2023-06-09T04:42:59.088086+0000","last_peered":"2023-06-09T04:42:59.088086+0000","last_clean":"2023-06-09T04:42:59.088086+0000","last_became_active":"2023-06-09T04:42:57.869025+0000","last_became_peered":"2023-06-09T04:42:57.869025+0000","last_unstale":"2023-06-09T04:42:59.088086+0000","last_undegraded":"2023-06-09T04:42:59.088086+0000","last_fullsized":"2023-06-09T04:42:59.088086+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_clean_scrub_stamp":"2023-06-09T04:42:57.378828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:29:54.053534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-06-09T04:42:59.088726+0000","last_change":"2023-06-09T04:42:57.412226+0000","last_active":"2023-06-09T04:42:59.088726+0000","last_peered":"2023-06-09T04:42:59.088726+0000","last_clean":"2023-06-09T04:42:59.088726+0000","last_became_active":"2023-06-09T04:42:57.411909+0000","last_became_peered":"2023-06-09T04:42:57.411909+0000","last_unstale":"2023-06-09T04:42:59.088726+0000","last_undegraded":"2023-06-09T04:42:59.088726+0000","last_fullsized":"2023-06-09T04:42:59.088726+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:56.365243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:56.365243+0000","last_clean_scrub_stamp":"2023-06-09T04:42:56.365243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:15:36.637305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-06-09T04:42:59.088662+0000","last_change":"2023-06-09T04:42:57.874503+0000","last_active":"2023-06-09T04:42:59.088662+0000","last_peered":"2023-06-09T04:42:59.088662+0000","last_clean":"2023-06-09T04:42:59.088662+0000","last_became_active":"2023-06-09T04:42:57.874205+0000","last_became_peered":"2023-06-09T04:42:57.874205+0000","last_unstale":"2023-06-09T04:42:59.088662+0000","last_undegraded":"2023-06-09T04:42:59.088662+0000","last_fullsized":"2023-06-09T04:42:59.088662+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_clean_scrub_stamp":"2023-06-09T04:42:57.378828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:11:33.805139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-06-09T04:42:59.087647+0000","last_change":"2023-06-09T04:42:57.418126+0000","last_active":"2023-06-09T04:42:59.087647+0000","last_peered":"2023-06-09T04:42:59.087647+0000","last_clean":"2023-06-09T04:42:59.087647+0000","last_became_active":"2023-06-09T04:42:57.417767+0000","last_became_peered":"2023-06-09T04:42:57.417767+0000","last_unstale":"2023-06-09T04:42:59.087647+0000","last_undegraded":"2023-06-09T04:42:59.087647+0000","last_fullsized":"2023-06-09T04:42:59.087647+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:56.365243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:56.365243+0000","last_clean_scrub_stamp":"2023-06-09T04:42:56.365243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:38:00.446120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-06-09T04:42:58.854527+0000","last_change":"2023-06-09T04:42:57.873866+0000","last_active":"2023-06-09T04:42:58.854527+0000","last_peered":"2023-06-09T04:42:58.854527+0000","last_clean":"2023-06-09T04:42:58.854527+0000","last_became_active":"2023-06-09T04:42:57.873640+0000","last_became_peered":"2023-06-09T04:42:57.873640+0000","last_unstale":"2023-06-09T04:42:58.854527+0000","last_undegraded":"2023-06-09T04:42:58.854527+0000","last_fullsized":"2023-06-09T04:42:58.854527+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_clean_scrub_stamp":"2023-06-09T04:42:57.378828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:06:10.062274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-06-09T04:42:59.088537+0000","last_change":"2023-06-09T04:42:57.413172+0000","last_active":"2023-06-09T04:42:59.088537+0000","last_peered":"2023-06-09T04:42:59.088537+0000","last_clean":"2023-06-09T04:42:59.088537+0000","last_became_active":"2023-06-09T04:42:57.412881+0000","last_became_peered":"2023-06-09T04:42:57.412881+0000","last_unstale":"2023-06-09T04:42:59.088537+0000","last_undegraded":"2023-06-09T04:42:59.088537+0000","last_fullsized":"2023-06-09T04:42:59.088537+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:56.365243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:56.365243+0000","last_clean_scrub_stamp":"2023-06-09T04:42:56.365243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:15:36.637305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-06-09T04:42:58.857783+0000","last_change":"2023-06-09T04:42:57.878186+0000","last_active":"2023-06-09T04:42:58.857783+0000","last_peered":"2023-06-09T04:42:58.857783+0000","last_clean":"2023-06-09T04:42:58.857783+0000","last_became_active":"2023-06-09T04:42:57.877794+0000","last_became_peered":"2023-06-09T04:42:57.877794+0000","last_unstale":"2023-06-09T04:42:58.857783+0000","last_undegraded":"2023-06-09T04:42:58.857783+0000","last_fullsized":"2023-06-09T04:42:58.857783+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_clean_scrub_stamp":"2023-06-09T04:42:57.378828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:53:42.528486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-06-09T04:42:58.858169+0000","last_change":"2023-06-09T04:42:57.411707+0000","last_active":"2023-06-09T04:42:58.858169+0000","last_peered":"2023-06-09T04:42:58.858169+0000","last_clean":"2023-06-09T04:42:58.858169+0000","last_became_active":"2023-06-09T04:42:57.411409+0000","last_became_peered":"2023-06-09T04:42:57.411409+0000","last_unstale":"2023-06-09T04:42:58.858169+0000","last_undegraded":"2023-06-09T04:42:58.858169+0000","last_fullsized":"2023-06-09T04:42:58.858169+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:56.365243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:56.365243+0000","last_clean_scrub_stamp":"2023-06-09T04:42:56.365243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:08:42.952202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-06-09T04:42:59.089641+0000","last_change":"2023-06-09T04:42:57.875396+0000","last_active":"2023-06-09T04:42:59.089641+0000","last_peered":"2023-06-09T04:42:59.089641+0000","last_clean":"2023-06-09T04:42:59.089641+0000","last_became_active":"2023-06-09T04:42:57.875085+0000","last_became_peered":"2023-06-09T04:42:57.875085+0000","last_unstale":"2023-06-09T04:42:59.089641+0000","last_undegraded":"2023-06-09T04:42:59.089641+0000","last_fullsized":"2023-06-09T04:42:59.089641+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_clean_scrub_stamp":"2023-06-09T04:42:57.378828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:11:00.720823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"37'3","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-06-09T04:42:58.857842+0000","last_change":"2023-06-09T04:42:57.413886+0000","last_active":"2023-06-09T04:42:58.857842+0000","last_peered":"2023-06-09T04:42:58.857842+0000","last_clean":"2023-06-09T04:42:58.857842+0000","last_became_active":"2023-06-09T04:42:57.413582+0000","last_became_peered":"2023-06-09T04:42:57.413582+0000","last_unstale":"2023-06-09T04:42:58.857842+0000","last_undegraded":"2023-06-09T04:42:58.857842+0000","last_fullsized":"2023-06-09T04:42:58.857842+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:56.365243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:56.365243+0000","last_clean_scrub_stamp":"2023-06-09T04:42:56.365243+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:50:38.888944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-06-09T04:42:59.089122+0000","last_change":"2023-06-09T04:42:57.862483+0000","last_active":"2023-06-09T04:42:59.089122+0000","last_peered":"2023-06-09T04:42:59.089122+0000","last_clean":"2023-06-09T04:42:59.089122+0000","last_became_active":"2023-06-09T04:42:57.861943+0000","last_became_peered":"2023-06-09T04:42:57.861943+0000","last_unstale":"2023-06-09T04:42:59.089122+0000","last_undegraded":"2023-06-09T04:42:59.089122+0000","last_fullsized":"2023-06-09T04:42:59.089122+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_clean_scrub_stamp":"2023-06-09T04:42:57.378828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:52:43.030356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"37'6","reported_seq":19,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-06-09T04:42:59.087999+0000","last_change":"2023-06-09T04:42:57.412253+0000","last_active":"2023-06-09T04:42:59.087999+0000","last_peered":"2023-06-09T04:42:59.087999+0000","last_clean":"2023-06-09T04:42:59.087999+0000","last_became_active":"2023-06-09T04:42:57.411989+0000","last_became_peered":"2023-06-09T04:42:57.411989+0000","last_unstale":"2023-06-09T04:42:59.087999+0000","last_undegraded":"2023-06-09T04:42:59.087999+0000","last_fullsized":"2023-06-09T04:42:59.087999+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:56.365243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:56.365243+0000","last_clean_scrub_stamp":"2023-06-09T04:42:56.365243+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:06:02.310751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-06-09T04:42:59.087932+0000","last_change":"2023-06-09T04:42:57.894095+0000","last_active":"2023-06-09T04:42:59.087932+0000","last_peered":"2023-06-09T04:42:59.087932+0000","last_clean":"2023-06-09T04:42:59.087932+0000","last_became_active":"2023-06-09T04:42:57.893777+0000","last_became_peered":"2023-06-09T04:42:57.893777+0000","last_unstale":"2023-06-09T04:42:59.087932+0000","last_undegraded":"2023-06-09T04:42:59.087932+0000","last_fullsized":"2023-06-09T04:42:59.087932+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_clean_scrub_stamp":"2023-06-09T04:42:57.378828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:48:08.217409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"37'2","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-06-09T04:42:59.089190+0000","last_change":"2023-06-09T04:42:57.418092+0000","last_active":"2023-06-09T04:42:59.089190+0000","last_peered":"2023-06-09T04:42:59.089190+0000","last_clean":"2023-06-09T04:42:59.089190+0000","last_became_active":"2023-06-09T04:42:57.417815+0000","last_became_peered":"2023-06-09T04:42:57.417815+0000","last_unstale":"2023-06-09T04:42:59.089190+0000","last_undegraded":"2023-06-09T04:42:59.089190+0000","last_fullsized":"2023-06-09T04:42:59.089190+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:56.365243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:56.365243+0000","last_clean_scrub_stamp":"2023-06-09T04:42:56.365243+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:59:54.793363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-06-09T04:42:59.087986+0000","last_change":"2023-06-09T04:42:57.872127+0000","last_active":"2023-06-09T04:42:59.087986+0000","last_peered":"2023-06-09T04:42:59.087986+0000","last_clean":"2023-06-09T04:42:59.087986+0000","last_became_active":"2023-06-09T04:42:57.871834+0000","last_became_peered":"2023-06-09T04:42:57.871834+0000","last_unstale":"2023-06-09T04:42:59.087986+0000","last_undegraded":"2023-06-09T04:42:59.087986+0000","last_fullsized":"2023-06-09T04:42:59.087986+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_clean_scrub_stamp":"2023-06-09T04:42:57.378828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:40:24.486985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-06-09T04:42:59.088916+0000","last_change":"2023-06-09T04:42:57.415023+0000","last_active":"2023-06-09T04:42:59.088916+0000","last_peered":"2023-06-09T04:42:59.088916+0000","last_clean":"2023-06-09T04:42:59.088916+0000","last_became_active":"2023-06-09T04:42:57.414732+0000","last_became_peered":"2023-06-09T04:42:57.414732+0000","last_unstale":"2023-06-09T04:42:59.088916+0000","last_undegraded":"2023-06-09T04:42:59.088916+0000","last_fullsized":"2023-06-09T04:42:59.088916+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:56.365243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:56.365243+0000","last_clean_scrub_stamp":"2023-06-09T04:42:56.365243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:11:32.791554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-06-09T04:42:58.856428+0000","last_change":"2023-06-09T04:42:57.874185+0000","last_active":"2023-06-09T04:42:58.856428+0000","last_peered":"2023-06-09T04:42:58.856428+0000","last_clean":"2023-06-09T04:42:58.856428+0000","last_became_active":"2023-06-09T04:42:57.873825+0000","last_became_peered":"2023-06-09T04:42:57.873825+0000","last_unstale":"2023-06-09T04:42:58.856428+0000","last_undegraded":"2023-06-09T04:42:58.856428+0000","last_fullsized":"2023-06-09T04:42:58.856428+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_clean_scrub_stamp":"2023-06-09T04:42:57.378828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:58:29.497943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-06-09T04:42:59.088029+0000","last_change":"2023-06-09T04:42:57.420960+0000","last_active":"2023-06-09T04:42:59.088029+0000","last_peered":"2023-06-09T04:42:59.088029+0000","last_clean":"2023-06-09T04:42:59.088029+0000","last_became_active":"2023-06-09T04:42:57.420344+0000","last_became_peered":"2023-06-09T04:42:57.420344+0000","last_unstale":"2023-06-09T04:42:59.088029+0000","last_undegraded":"2023-06-09T04:42:59.088029+0000","last_fullsized":"2023-06-09T04:42:59.088029+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:56.365243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:56.365243+0000","last_clean_scrub_stamp":"2023-06-09T04:42:56.365243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:39:23.109849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-06-09T04:42:59.088969+0000","last_change":"2023-06-09T04:42:57.868921+0000","last_active":"2023-06-09T04:42:59.088969+0000","last_peered":"2023-06-09T04:42:59.088969+0000","last_clean":"2023-06-09T04:42:59.088969+0000","last_became_active":"2023-06-09T04:42:57.868642+0000","last_became_peered":"2023-06-09T04:42:57.868642+0000","last_unstale":"2023-06-09T04:42:59.088969+0000","last_undegraded":"2023-06-09T04:42:59.088969+0000","last_fullsized":"2023-06-09T04:42:59.088969+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_clean_scrub_stamp":"2023-06-09T04:42:57.378828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:04:49.138949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"37'8","reported_seq":21,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-06-09T04:42:58.856485+0000","last_change":"2023-06-09T04:42:57.420613+0000","last_active":"2023-06-09T04:42:58.856485+0000","last_peered":"2023-06-09T04:42:58.856485+0000","last_clean":"2023-06-09T04:42:58.856485+0000","last_became_active":"2023-06-09T04:42:57.420306+0000","last_became_peered":"2023-06-09T04:42:57.420306+0000","last_unstale":"2023-06-09T04:42:58.856485+0000","last_undegraded":"2023-06-09T04:42:58.856485+0000","last_fullsized":"2023-06-09T04:42:58.856485+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:56.365243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:56.365243+0000","last_clean_scrub_stamp":"2023-06-09T04:42:56.365243+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:15:05.670672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-06-09T04:42:59.087921+0000","last_change":"2023-06-09T04:42:57.879012+0000","last_active":"2023-06-09T04:42:59.087921+0000","last_peered":"2023-06-09T04:42:59.087921+0000","last_clean":"2023-06-09T04:42:59.087921+0000","last_became_active":"2023-06-09T04:42:57.878758+0000","last_became_peered":"2023-06-09T04:42:57.878758+0000","last_unstale":"2023-06-09T04:42:59.087921+0000","last_undegraded":"2023-06-09T04:42:59.087921+0000","last_fullsized":"2023-06-09T04:42:59.087921+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_clean_scrub_stamp":"2023-06-09T04:42:57.378828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:57:09.353283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"37'1","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-06-09T04:42:58.858085+0000","last_change":"2023-06-09T04:42:57.422096+0000","last_active":"2023-06-09T04:42:58.858085+0000","last_peered":"2023-06-09T04:42:58.858085+0000","last_clean":"2023-06-09T04:42:58.858085+0000","last_became_active":"2023-06-09T04:42:57.421789+0000","last_became_peered":"2023-06-09T04:42:57.421789+0000","last_unstale":"2023-06-09T04:42:58.858085+0000","last_undegraded":"2023-06-09T04:42:58.858085+0000","last_fullsized":"2023-06-09T04:42:58.858085+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:56.365243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:56.365243+0000","last_clean_scrub_stamp":"2023-06-09T04:42:56.365243+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:06:53.991226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-06-09T04:42:58.857766+0000","last_change":"2023-06-09T04:42:57.882448+0000","last_active":"2023-06-09T04:42:58.857766+0000","last_peered":"2023-06-09T04:42:58.857766+0000","last_clean":"2023-06-09T04:42:58.857766+0000","last_became_active":"2023-06-09T04:42:57.882180+0000","last_became_peered":"2023-06-09T04:42:57.882180+0000","last_unstale":"2023-06-09T04:42:58.857766+0000","last_undegraded":"2023-06-09T04:42:58.857766+0000","last_fullsized":"2023-06-09T04:42:58.857766+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_clean_scrub_stamp":"2023-06-09T04:42:57.378828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:00:49.501621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"37'2","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-06-09T04:42:59.089167+0000","last_change":"2023-06-09T04:42:57.419658+0000","last_active":"2023-06-09T04:42:59.089167+0000","last_peered":"2023-06-09T04:42:59.089167+0000","last_clean":"2023-06-09T04:42:59.089167+0000","last_became_active":"2023-06-09T04:42:57.419360+0000","last_became_peered":"2023-06-09T04:42:57.419360+0000","last_unstale":"2023-06-09T04:42:59.089167+0000","last_undegraded":"2023-06-09T04:42:59.089167+0000","last_fullsized":"2023-06-09T04:42:59.089167+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:56.365243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:56.365243+0000","last_clean_scrub_stamp":"2023-06-09T04:42:56.365243+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:40:39.610207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-06-09T04:42:59.088678+0000","last_change":"2023-06-09T04:42:57.865145+0000","last_active":"2023-06-09T04:42:59.088678+0000","last_peered":"2023-06-09T04:42:59.088678+0000","last_clean":"2023-06-09T04:42:59.088678+0000","last_became_active":"2023-06-09T04:42:57.864826+0000","last_became_peered":"2023-06-09T04:42:57.864826+0000","last_unstale":"2023-06-09T04:42:59.088678+0000","last_undegraded":"2023-06-09T04:42:59.088678+0000","last_fullsized":"2023-06-09T04:42:59.088678+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_clean_scrub_stamp":"2023-06-09T04:42:57.378828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:00:49.501621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"37'1","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-06-09T04:42:58.854495+0000","last_change":"2023-06-09T04:42:57.413541+0000","last_active":"2023-06-09T04:42:58.854495+0000","last_peered":"2023-06-09T04:42:58.854495+0000","last_clean":"2023-06-09T04:42:58.854495+0000","last_became_active":"2023-06-09T04:42:57.413244+0000","last_became_peered":"2023-06-09T04:42:57.413244+0000","last_unstale":"2023-06-09T04:42:58.854495+0000","last_undegraded":"2023-06-09T04:42:58.854495+0000","last_fullsized":"2023-06-09T04:42:58.854495+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:56.365243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:56.365243+0000","last_clean_scrub_stamp":"2023-06-09T04:42:56.365243+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:39:23.109849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-06-09T04:42:58.854739+0000","last_change":"2023-06-09T04:42:57.873052+0000","last_active":"2023-06-09T04:42:58.854739+0000","last_peered":"2023-06-09T04:42:58.854739+0000","last_clean":"2023-06-09T04:42:58.854739+0000","last_became_active":"2023-06-09T04:42:57.869278+0000","last_became_peered":"2023-06-09T04:42:57.869278+0000","last_unstale":"2023-06-09T04:42:58.854739+0000","last_undegraded":"2023-06-09T04:42:58.854739+0000","last_fullsized":"2023-06-09T04:42:58.854739+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_clean_scrub_stamp":"2023-06-09T04:42:57.378828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:26:37.635297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-06-09T04:42:59.089307+0000","last_change":"2023-06-09T04:42:57.421662+0000","last_active":"2023-06-09T04:42:59.089307+0000","last_peered":"2023-06-09T04:42:59.089307+0000","last_clean":"2023-06-09T04:42:59.089307+0000","last_became_active":"2023-06-09T04:42:57.421364+0000","last_became_peered":"2023-06-09T04:42:57.421364+0000","last_unstale":"2023-06-09T04:42:59.089307+0000","last_undegraded":"2023-06-09T04:42:59.089307+0000","last_fullsized":"2023-06-09T04:42:59.089307+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:56.365243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:56.365243+0000","last_clean_scrub_stamp":"2023-06-09T04:42:56.365243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:18:29.963116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-06-09T04:42:58.856859+0000","last_change":"2023-06-09T04:42:57.885674+0000","last_active":"2023-06-09T04:42:58.856859+0000","last_peered":"2023-06-09T04:42:58.856859+0000","last_clean":"2023-06-09T04:42:58.856859+0000","last_became_active":"2023-06-09T04:42:57.885341+0000","last_became_peered":"2023-06-09T04:42:57.885341+0000","last_unstale":"2023-06-09T04:42:58.856859+0000","last_undegraded":"2023-06-09T04:42:58.856859+0000","last_fullsized":"2023-06-09T04:42:58.856859+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_clean_scrub_stamp":"2023-06-09T04:42:57.378828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:33:05.766559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"37'2","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-06-09T04:42:58.854186+0000","last_change":"2023-06-09T04:42:57.417155+0000","last_active":"2023-06-09T04:42:58.854186+0000","last_peered":"2023-06-09T04:42:58.854186+0000","last_clean":"2023-06-09T04:42:58.854186+0000","last_became_active":"2023-06-09T04:42:57.416739+0000","last_became_peered":"2023-06-09T04:42:57.416739+0000","last_unstale":"2023-06-09T04:42:58.854186+0000","last_undegraded":"2023-06-09T04:42:58.854186+0000","last_fullsized":"2023-06-09T04:42:58.854186+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:56.365243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:56.365243+0000","last_clean_scrub_stamp":"2023-06-09T04:42:56.365243+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:29:19.109239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-06-09T04:42:59.087738+0000","last_change":"2023-06-09T04:42:57.875334+0000","last_active":"2023-06-09T04:42:59.087738+0000","last_peered":"2023-06-09T04:42:59.087738+0000","last_clean":"2023-06-09T04:42:59.087738+0000","last_became_active":"2023-06-09T04:42:57.875052+0000","last_became_peered":"2023-06-09T04:42:57.875052+0000","last_unstale":"2023-06-09T04:42:59.087738+0000","last_undegraded":"2023-06-09T04:42:59.087738+0000","last_fullsized":"2023-06-09T04:42:59.087738+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_clean_scrub_stamp":"2023-06-09T04:42:57.378828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:10:41.113911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-06-09T04:42:58.854187+0000","last_change":"2023-06-09T04:42:57.420446+0000","last_active":"2023-06-09T04:42:58.854187+0000","last_peered":"2023-06-09T04:42:58.854187+0000","last_clean":"2023-06-09T04:42:58.854187+0000","last_became_active":"2023-06-09T04:42:57.420116+0000","last_became_peered":"2023-06-09T04:42:57.420116+0000","last_unstale":"2023-06-09T04:42:58.854187+0000","last_undegraded":"2023-06-09T04:42:58.854187+0000","last_fullsized":"2023-06-09T04:42:58.854187+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:56.365243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:56.365243+0000","last_clean_scrub_stamp":"2023-06-09T04:42:56.365243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:03:55.181066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-06-09T04:42:58.857181+0000","last_change":"2023-06-09T04:42:57.883121+0000","last_active":"2023-06-09T04:42:58.857181+0000","last_peered":"2023-06-09T04:42:58.857181+0000","last_clean":"2023-06-09T04:42:58.857181+0000","last_became_active":"2023-06-09T04:42:57.882420+0000","last_became_peered":"2023-06-09T04:42:57.882420+0000","last_unstale":"2023-06-09T04:42:58.857181+0000","last_undegraded":"2023-06-09T04:42:58.857181+0000","last_fullsized":"2023-06-09T04:42:58.857181+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_clean_scrub_stamp":"2023-06-09T04:42:57.378828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:38:01.459705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-06-09T04:42:58.857336+0000","last_change":"2023-06-09T04:42:57.417623+0000","last_active":"2023-06-09T04:42:58.857336+0000","last_peered":"2023-06-09T04:42:58.857336+0000","last_clean":"2023-06-09T04:42:58.857336+0000","last_became_active":"2023-06-09T04:42:57.417403+0000","last_became_peered":"2023-06-09T04:42:57.417403+0000","last_unstale":"2023-06-09T04:42:58.857336+0000","last_undegraded":"2023-06-09T04:42:58.857336+0000","last_fullsized":"2023-06-09T04:42:58.857336+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:56.365243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:56.365243+0000","last_clean_scrub_stamp":"2023-06-09T04:42:56.365243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:35:03.878530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-06-09T04:42:59.089091+0000","last_change":"2023-06-09T04:42:57.874468+0000","last_active":"2023-06-09T04:42:59.089091+0000","last_peered":"2023-06-09T04:42:59.089091+0000","last_clean":"2023-06-09T04:42:59.089091+0000","last_became_active":"2023-06-09T04:42:57.874193+0000","last_became_peered":"2023-06-09T04:42:57.874193+0000","last_unstale":"2023-06-09T04:42:59.089091+0000","last_undegraded":"2023-06-09T04:42:59.089091+0000","last_fullsized":"2023-06-09T04:42:59.089091+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_clean_scrub_stamp":"2023-06-09T04:42:57.378828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:18:30.976701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-06-09T04:42:58.854140+0000","last_change":"2023-06-09T04:42:57.416981+0000","last_active":"2023-06-09T04:42:58.854140+0000","last_peered":"2023-06-09T04:42:58.854140+0000","last_clean":"2023-06-09T04:42:58.854140+0000","last_became_active":"2023-06-09T04:42:57.416713+0000","last_became_peered":"2023-06-09T04:42:57.416713+0000","last_unstale":"2023-06-09T04:42:58.854140+0000","last_undegraded":"2023-06-09T04:42:58.854140+0000","last_fullsized":"2023-06-09T04:42:58.854140+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:56.365243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:56.365243+0000","last_clean_scrub_stamp":"2023-06-09T04:42:56.365243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T04:54:09.459420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-06-09T04:42:58.857978+0000","last_change":"2023-06-09T04:42:57.878827+0000","last_active":"2023-06-09T04:42:58.857978+0000","last_peered":"2023-06-09T04:42:58.857978+0000","last_clean":"2023-06-09T04:42:58.857978+0000","last_became_active":"2023-06-09T04:42:57.878563+0000","last_became_peered":"2023-06-09T04:42:57.878563+0000","last_unstale":"2023-06-09T04:42:58.857978+0000","last_undegraded":"2023-06-09T04:42:58.857978+0000","last_fullsized":"2023-06-09T04:42:58.857978+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_clean_scrub_stamp":"2023-06-09T04:42:57.378828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:53:42.528486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-06-09T04:42:58.857647+0000","last_change":"2023-06-09T04:42:57.418090+0000","last_active":"2023-06-09T04:42:58.857647+0000","last_peered":"2023-06-09T04:42:58.857647+0000","last_clean":"2023-06-09T04:42:58.857647+0000","last_became_active":"2023-06-09T04:42:57.417757+0000","last_became_peered":"2023-06-09T04:42:57.417757+0000","last_unstale":"2023-06-09T04:42:58.857647+0000","last_undegraded":"2023-06-09T04:42:58.857647+0000","last_fullsized":"2023-06-09T04:42:58.857647+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:56.365243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:56.365243+0000","last_clean_scrub_stamp":"2023-06-09T04:42:56.365243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:40:39.610207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":195,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-06-09T04:42:58.856811+0000","last_change":"2023-06-09T04:41:43.997052+0000","last_active":"2023-06-09T04:42:58.856811+0000","last_peered":"2023-06-09T04:42:58.856811+0000","last_clean":"2023-06-09T04:42:58.856811+0000","last_became_active":"2023-06-09T04:41:43.993827+0000","last_became_peered":"2023-06-09T04:41:43.993827+0000","last_unstale":"2023-06-09T04:42:58.856811+0000","last_undegraded":"2023-06-09T04:42:58.856811+0000","last_fullsized":"2023-06-09T04:42:58.856811+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:42.777858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:42.777858+0000","last_clean_scrub_stamp":"2023-06-09T04:41:42.777858+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:13:31.907484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":47,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-06-09T04:42:58.857874+0000","last_change":"2023-06-09T04:41:48.873288+0000","last_active":"2023-06-09T04:42:58.857874+0000","last_peered":"2023-06-09T04:42:58.857874+0000","last_clean":"2023-06-09T04:42:58.857874+0000","last_became_active":"2023-06-09T04:41:48.872659+0000","last_became_peered":"2023-06-09T04:41:48.872659+0000","last_unstale":"2023-06-09T04:42:58.857874+0000","last_undegraded":"2023-06-09T04:42:58.857874+0000","last_fullsized":"2023-06-09T04:42:58.857874+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:47.838489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:47.838489+0000","last_clean_scrub_stamp":"2023-06-09T04:41:47.838489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:51:33.490017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-06-09T04:42:59.089235+0000","last_change":"2023-06-09T04:42:57.865337+0000","last_active":"2023-06-09T04:42:59.089235+0000","last_peered":"2023-06-09T04:42:59.089235+0000","last_clean":"2023-06-09T04:42:59.089235+0000","last_became_active":"2023-06-09T04:42:57.865044+0000","last_became_peered":"2023-06-09T04:42:57.865044+0000","last_unstale":"2023-06-09T04:42:59.089235+0000","last_undegraded":"2023-06-09T04:42:59.089235+0000","last_fullsized":"2023-06-09T04:42:59.089235+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_clean_scrub_stamp":"2023-06-09T04:42:57.378828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:04:49.138949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"37'2","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-06-09T04:42:58.858352+0000","last_change":"2023-06-09T04:42:57.413876+0000","last_active":"2023-06-09T04:42:58.858352+0000","last_peered":"2023-06-09T04:42:58.858352+0000","last_clean":"2023-06-09T04:42:58.858352+0000","last_became_active":"2023-06-09T04:42:57.413483+0000","last_became_peered":"2023-06-09T04:42:57.413483+0000","last_unstale":"2023-06-09T04:42:58.858352+0000","last_undegraded":"2023-06-09T04:42:58.858352+0000","last_fullsized":"2023-06-09T04:42:58.858352+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:56.365243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:56.365243+0000","last_clean_scrub_stamp":"2023-06-09T04:42:56.365243+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:51:08.623058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":39,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-06-09T04:42:58.856632+0000","last_change":"2023-06-09T04:41:48.880106+0000","last_active":"2023-06-09T04:42:58.856632+0000","last_peered":"2023-06-09T04:42:58.856632+0000","last_clean":"2023-06-09T04:42:58.856632+0000","last_became_active":"2023-06-09T04:41:48.879669+0000","last_became_peered":"2023-06-09T04:41:48.879669+0000","last_unstale":"2023-06-09T04:42:58.856632+0000","last_undegraded":"2023-06-09T04:42:58.856632+0000","last_fullsized":"2023-06-09T04:42:58.856632+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:47.838489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:47.838489+0000","last_clean_scrub_stamp":"2023-06-09T04:41:47.838489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:36:51.919365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-06-09T04:42:58.858186+0000","last_change":"2023-06-09T04:42:57.878626+0000","last_active":"2023-06-09T04:42:58.858186+0000","last_peered":"2023-06-09T04:42:58.858186+0000","last_clean":"2023-06-09T04:42:58.858186+0000","last_became_active":"2023-06-09T04:42:57.878199+0000","last_became_peered":"2023-06-09T04:42:57.878199+0000","last_unstale":"2023-06-09T04:42:58.858186+0000","last_undegraded":"2023-06-09T04:42:58.858186+0000","last_fullsized":"2023-06-09T04:42:58.858186+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_clean_scrub_stamp":"2023-06-09T04:42:57.378828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:06:55.004810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"38'1","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-06-09T04:42:58.854561+0000","last_change":"2023-06-09T04:42:57.415082+0000","last_active":"2023-06-09T04:42:58.854561+0000","last_peered":"2023-06-09T04:42:58.854561+0000","last_clean":"2023-06-09T04:42:58.854561+0000","last_became_active":"2023-06-09T04:42:57.414788+0000","last_became_peered":"2023-06-09T04:42:57.414788+0000","last_unstale":"2023-06-09T04:42:58.854561+0000","last_undegraded":"2023-06-09T04:42:58.854561+0000","last_fullsized":"2023-06-09T04:42:58.854561+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:56.365243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:56.365243+0000","last_clean_scrub_stamp":"2023-06-09T04:42:56.365243+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:31:48.647692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":43,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-06-09T04:42:58.854626+0000","last_change":"2023-06-09T04:41:48.966313+0000","last_active":"2023-06-09T04:42:58.854626+0000","last_peered":"2023-06-09T04:42:58.854626+0000","last_clean":"2023-06-09T04:42:58.854626+0000","last_became_active":"2023-06-09T04:41:48.965659+0000","last_became_peered":"2023-06-09T04:41:48.965659+0000","last_unstale":"2023-06-09T04:42:58.854626+0000","last_undegraded":"2023-06-09T04:42:58.854626+0000","last_fullsized":"2023-06-09T04:42:58.854626+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:47.838489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:47.838489+0000","last_clean_scrub_stamp":"2023-06-09T04:41:47.838489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:36:50.258050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-06-09T04:42:59.088101+0000","last_change":"2023-06-09T04:42:57.869883+0000","last_active":"2023-06-09T04:42:59.088101+0000","last_peered":"2023-06-09T04:42:59.088101+0000","last_clean":"2023-06-09T04:42:59.088101+0000","last_became_active":"2023-06-09T04:42:57.869620+0000","last_became_peered":"2023-06-09T04:42:57.869620+0000","last_unstale":"2023-06-09T04:42:59.088101+0000","last_undegraded":"2023-06-09T04:42:59.088101+0000","last_fullsized":"2023-06-09T04:42:59.088101+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_clean_scrub_stamp":"2023-06-09T04:42:57.378828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:55:04.703382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-06-09T04:42:59.089180+0000","last_change":"2023-06-09T04:42:57.416621+0000","last_active":"2023-06-09T04:42:59.089180+0000","last_peered":"2023-06-09T04:42:59.089180+0000","last_clean":"2023-06-09T04:42:59.089180+0000","last_became_active":"2023-06-09T04:42:57.416304+0000","last_became_peered":"2023-06-09T04:42:57.416304+0000","last_unstale":"2023-06-09T04:42:59.089180+0000","last_undegraded":"2023-06-09T04:42:59.089180+0000","last_fullsized":"2023-06-09T04:42:59.089180+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:56.365243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:56.365243+0000","last_clean_scrub_stamp":"2023-06-09T04:42:56.365243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:45:58.991201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":47,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-06-09T04:42:58.857294+0000","last_change":"2023-06-09T04:41:48.873002+0000","last_active":"2023-06-09T04:42:58.857294+0000","last_peered":"2023-06-09T04:42:58.857294+0000","last_clean":"2023-06-09T04:42:58.857294+0000","last_became_active":"2023-06-09T04:41:48.872455+0000","last_became_peered":"2023-06-09T04:41:48.872455+0000","last_unstale":"2023-06-09T04:42:58.857294+0000","last_undegraded":"2023-06-09T04:42:58.857294+0000","last_fullsized":"2023-06-09T04:42:58.857294+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:47.838489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:47.838489+0000","last_clean_scrub_stamp":"2023-06-09T04:41:47.838489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:13:36.968115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-06-09T04:42:59.088257+0000","last_change":"2023-06-09T04:42:57.875407+0000","last_active":"2023-06-09T04:42:59.088257+0000","last_peered":"2023-06-09T04:42:59.088257+0000","last_clean":"2023-06-09T04:42:59.088257+0000","last_became_active":"2023-06-09T04:42:57.875121+0000","last_became_peered":"2023-06-09T04:42:57.875121+0000","last_unstale":"2023-06-09T04:42:59.088257+0000","last_undegraded":"2023-06-09T04:42:59.088257+0000","last_fullsized":"2023-06-09T04:42:59.088257+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_clean_scrub_stamp":"2023-06-09T04:42:57.378828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:22:44.204120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-06-09T04:42:59.088880+0000","last_change":"2023-06-09T04:42:57.419007+0000","last_active":"2023-06-09T04:42:59.088880+0000","last_peered":"2023-06-09T04:42:59.088880+0000","last_clean":"2023-06-09T04:42:59.088880+0000","last_became_active":"2023-06-09T04:42:57.418717+0000","last_became_peered":"2023-06-09T04:42:57.418717+0000","last_unstale":"2023-06-09T04:42:59.088880+0000","last_undegraded":"2023-06-09T04:42:59.088880+0000","last_fullsized":"2023-06-09T04:42:59.088880+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:56.365243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:56.365243+0000","last_clean_scrub_stamp":"2023-06-09T04:42:56.365243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:48:32.096940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":45,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-06-09T04:42:59.089547+0000","last_change":"2023-06-09T04:41:48.978389+0000","last_active":"2023-06-09T04:42:59.089547+0000","last_peered":"2023-06-09T04:42:59.089547+0000","last_clean":"2023-06-09T04:42:59.089547+0000","last_became_active":"2023-06-09T04:41:48.978021+0000","last_became_peered":"2023-06-09T04:41:48.978021+0000","last_unstale":"2023-06-09T04:42:59.089547+0000","last_undegraded":"2023-06-09T04:42:59.089547+0000","last_fullsized":"2023-06-09T04:42:59.089547+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:47.838489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:47.838489+0000","last_clean_scrub_stamp":"2023-06-09T04:41:47.838489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:13:00.508861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-06-09T04:42:59.088592+0000","last_change":"2023-06-09T04:42:57.876518+0000","last_active":"2023-06-09T04:42:59.088592+0000","last_peered":"2023-06-09T04:42:59.088592+0000","last_clean":"2023-06-09T04:42:59.088592+0000","last_became_active":"2023-06-09T04:42:57.876305+0000","last_became_peered":"2023-06-09T04:42:57.876305+0000","last_unstale":"2023-06-09T04:42:59.088592+0000","last_undegraded":"2023-06-09T04:42:59.088592+0000","last_fullsized":"2023-06-09T04:42:59.088592+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_clean_scrub_stamp":"2023-06-09T04:42:57.378828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:25:44.299723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-06-09T04:42:59.088954+0000","last_change":"2023-06-09T04:42:57.418407+0000","last_active":"2023-06-09T04:42:59.088954+0000","last_peered":"2023-06-09T04:42:59.088954+0000","last_clean":"2023-06-09T04:42:59.088954+0000","last_became_active":"2023-06-09T04:42:57.418029+0000","last_became_peered":"2023-06-09T04:42:57.418029+0000","last_unstale":"2023-06-09T04:42:59.088954+0000","last_undegraded":"2023-06-09T04:42:59.088954+0000","last_fullsized":"2023-06-09T04:42:59.088954+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:56.365243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:56.365243+0000","last_clean_scrub_stamp":"2023-06-09T04:42:56.365243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:07:06.158916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":39,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-06-09T04:42:58.858341+0000","last_change":"2023-06-09T04:41:48.978235+0000","last_active":"2023-06-09T04:42:58.858341+0000","last_peered":"2023-06-09T04:42:58.858341+0000","last_clean":"2023-06-09T04:42:58.858341+0000","last_became_active":"2023-06-09T04:41:48.977568+0000","last_became_peered":"2023-06-09T04:41:48.977568+0000","last_unstale":"2023-06-09T04:42:58.858341+0000","last_undegraded":"2023-06-09T04:42:58.858341+0000","last_fullsized":"2023-06-09T04:42:58.858341+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:47.838489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:47.838489+0000","last_clean_scrub_stamp":"2023-06-09T04:41:47.838489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:50:00.096303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-06-09T04:42:59.088058+0000","last_change":"2023-06-09T04:42:57.865385+0000","last_active":"2023-06-09T04:42:59.088058+0000","last_peered":"2023-06-09T04:42:59.088058+0000","last_clean":"2023-06-09T04:42:59.088058+0000","last_became_active":"2023-06-09T04:42:57.864503+0000","last_became_peered":"2023-06-09T04:42:57.864503+0000","last_unstale":"2023-06-09T04:42:59.088058+0000","last_undegraded":"2023-06-09T04:42:59.088058+0000","last_fullsized":"2023-06-09T04:42:59.088058+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_clean_scrub_stamp":"2023-06-09T04:42:57.378828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:33:05.766559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-06-09T04:42:59.087703+0000","last_change":"2023-06-09T04:42:57.419825+0000","last_active":"2023-06-09T04:42:59.087703+0000","last_peered":"2023-06-09T04:42:59.087703+0000","last_clean":"2023-06-09T04:42:59.087703+0000","last_became_active":"2023-06-09T04:42:57.419495+0000","last_became_peered":"2023-06-09T04:42:57.419495+0000","last_unstale":"2023-06-09T04:42:59.087703+0000","last_undegraded":"2023-06-09T04:42:59.087703+0000","last_fullsized":"2023-06-09T04:42:59.087703+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:56.365243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:56.365243+0000","last_clean_scrub_stamp":"2023-06-09T04:42:56.365243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:19:44.620929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":45,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-06-09T04:42:59.089556+0000","last_change":"2023-06-09T04:41:48.877786+0000","last_active":"2023-06-09T04:42:59.089556+0000","last_peered":"2023-06-09T04:42:59.089556+0000","last_clean":"2023-06-09T04:42:59.089556+0000","last_became_active":"2023-06-09T04:41:48.877370+0000","last_became_peered":"2023-06-09T04:41:48.877370+0000","last_unstale":"2023-06-09T04:42:59.089556+0000","last_undegraded":"2023-06-09T04:42:59.089556+0000","last_fullsized":"2023-06-09T04:42:59.089556+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:47.838489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:47.838489+0000","last_clean_scrub_stamp":"2023-06-09T04:41:47.838489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:22:01.678217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-06-09T04:42:58.857626+0000","last_change":"2023-06-09T04:42:57.877796+0000","last_active":"2023-06-09T04:42:58.857626+0000","last_peered":"2023-06-09T04:42:58.857626+0000","last_clean":"2023-06-09T04:42:58.857626+0000","last_became_active":"2023-06-09T04:42:57.877408+0000","last_became_peered":"2023-06-09T04:42:57.877408+0000","last_unstale":"2023-06-09T04:42:58.857626+0000","last_undegraded":"2023-06-09T04:42:58.857626+0000","last_fullsized":"2023-06-09T04:42:58.857626+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:57.378828+0000","last_clean_scrub_stamp":"2023-06-09T04:42:57.378828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:50:39.902528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-06-09T04:42:59.087537+0000","last_change":"2023-06-09T04:42:57.411061+0000","last_active":"2023-06-09T04:42:59.087537+0000","last_peered":"2023-06-09T04:42:59.087537+0000","last_clean":"2023-06-09T04:42:59.087537+0000","last_became_active":"2023-06-09T04:42:57.410763+0000","last_became_peered":"2023-06-09T04:42:57.410763+0000","last_unstale":"2023-06-09T04:42:59.087537+0000","last_undegraded":"2023-06-09T04:42:59.087537+0000","last_fullsized":"2023-06-09T04:42:59.087537+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:56.365243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:56.365243+0000","last_clean_scrub_stamp":"2023-06-09T04:42:56.365243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:45:58.991201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":41,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-06-09T04:42:59.089544+0000","last_change":"2023-06-09T04:41:48.880094+0000","last_active":"2023-06-09T04:42:59.089544+0000","last_peered":"2023-06-09T04:42:59.089544+0000","last_clean":"2023-06-09T04:42:59.089544+0000","last_became_active":"2023-06-09T04:41:48.879506+0000","last_became_peered":"2023-06-09T04:41:48.879506+0000","last_unstale":"2023-06-09T04:42:59.089544+0000","last_undegraded":"2023-06-09T04:42:59.089544+0000","last_fullsized":"2023-06-09T04:42:59.089544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:41:47.838489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:41:47.838489+0000","last_clean_scrub_stamp":"2023-06-09T04:41:47.838489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:36:12.320708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574867,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32068,"kb_used_data":1020,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339772,"statfs":{"total":96636764160,"available":96603926528,"internally_reserved":0,"allocated":1044480,"data_stored":772061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 9 04:42:42 2023","interfaces":[{"interface":"back","average":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"min":{"1min":0.745,"5min":0.745,"15min":0.745},"max":{"1min":2.6680000000000001,"5min":2.6680000000000001,"15min":2.6680000000000001},"last":1.133},{"interface":"front","average":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":2.278,"5min":2.278,"15min":2.278},"last":1}]},{"osd":1,"last update":"Fri Jun 9 04:42:42 2023","interfaces":[{"interface":"back","average":{"1min":1.181,"5min":1.181,"15min":1.181},"min":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":1.4830000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.72199999999999998},{"interface":"front","average":{"1min":1.202,"5min":1.202,"15min":1.202},"min":{"1min":0.998,"5min":0.998,"15min":0.998},"max":{"1min":1.8100000000000001,"5min":1.8100000000000001,"15min":1.8100000000000001},"last":0.92900000000000005}]},{"osd":2,"last update":"Fri Jun 9 04:42:42 2023","interfaces":[{"interface":"back","average":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"min":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"max":{"1min":1.6379999999999999,"5min":1.6379999999999999,"15min":1.6379999999999999},"last":1.024},{"interface":"front","average":{"1min":1.389,"5min":1.389,"15min":1.389},"min":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"max":{"1min":2.4449999999999998,"5min":2.4449999999999998,"15min":2.4449999999999998},"last":0.90400000000000003}]},{"osd":3,"last update":"Fri Jun 9 04:42:42 2023","interfaces":[{"interface":"back","average":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"min":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"max":{"1min":2.1789999999999998,"5min":2.1789999999999998,"15min":2.1789999999999998},"last":0.871},{"interface":"front","average":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"min":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"max":{"1min":2.351,"5min":2.351,"15min":2.351},"last":0.94999999999999996}]},{"osd":4,"last update":"Fri Jun 9 04:42:42 2023","interfaces":[{"interface":"back","average":{"1min":1.365,"5min":1.365,"15min":1.365},"min":{"1min":0.748,"5min":0.748,"15min":0.748},"max":{"1min":3.5139999999999998,"5min":3.5139999999999998,"15min":3.5139999999999998},"last":0.68600000000000005},{"interface":"front","average":{"1min":1.3740000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"min":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"max":{"1min":2.3300000000000001,"5min":2.3300000000000001,"15min":2.3300000000000001},"last":0.96699999999999997}]},{"osd":5,"last update":"Fri Jun 9 04:42:42 2023","interfaces":[{"interface":"back","average":{"1min":1.524,"5min":1.524,"15min":1.524},"min":{"1min":1.034,"5min":1.034,"15min":1.034},"max":{"1min":3.1659999999999999,"5min":3.1659999999999999,"15min":3.1659999999999999},"last":0.99099999999999999},{"interface":"front","average":{"1min":1.615,"5min":1.615,"15min":1.615},"min":{"1min":1.077,"5min":1.077,"15min":1.077},"max":{"1min":3.6030000000000002,"5min":3.6030000000000002,"15min":3.6030000000000002},"last":1.0509999999999999}]},{"osd":6,"last update":"Fri Jun 9 04:42:42 2023","interfaces":[{"interface":"back","average":{"1min":1.6000000000000001,"5min":1.6000000000000001,"15min":1.6000000000000001},"min":{"1min":1.093,"5min":1.093,"15min":1.093},"max":{"1min":3.4119999999999999,"5min":3.4119999999999999,"15min":3.4119999999999999},"last":0.82399999999999995},{"interface":"front","average":{"1min":1.573,"5min":1.573,"15min":1.573},"min":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"max":{"1min":2.8050000000000002,"5min":2.8050000000000002,"15min":2.8050000000000002},"last":1.323}]}]},{"osd":6,"up_from":13,"seq":55834574868,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":428,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":438272,"data_stored":180641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 9 04:42:40 2023","interfaces":[{"interface":"back","average":{"1min":1.093,"5min":1.093,"15min":1.093},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.956,"5min":1.956,"15min":1.956},"last":1.046},{"interface":"front","average":{"1min":1.131,"5min":1.131,"15min":1.131},"min":{"1min":0.745,"5min":0.745,"15min":0.745},"max":{"1min":2.2850000000000001,"5min":2.2850000000000001,"15min":2.2850000000000001},"last":1.3280000000000001}]},{"osd":1,"last update":"Fri Jun 9 04:42:40 2023","interfaces":[{"interface":"back","average":{"1min":1.139,"5min":1.139,"15min":1.139},"min":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.651,"5min":1.651,"15min":1.651},"last":1.3740000000000001},{"interface":"front","average":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"min":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"max":{"1min":3.0419999999999998,"5min":3.0419999999999998,"15min":3.0419999999999998},"last":1.3049999999999999}]},{"osd":2,"last update":"Fri Jun 9 04:42:40 2023","interfaces":[{"interface":"back","average":{"1min":1.286,"5min":1.286,"15min":1.286},"min":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"max":{"1min":2.0750000000000002,"5min":2.0750000000000002,"15min":2.0750000000000002},"last":0.97899999999999998},{"interface":"front","average":{"1min":1.224,"5min":1.224,"15min":1.224},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.827,"5min":1.827,"15min":1.827},"last":1.1020000000000001}]},{"osd":3,"last update":"Fri Jun 9 04:42:40 2023","interfaces":[{"interface":"back","average":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"min":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"max":{"1min":3.1160000000000001,"5min":3.1160000000000001,"15min":3.1160000000000001},"last":1.22},{"interface":"front","average":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":2.3679999999999999,"5min":2.3679999999999999,"15min":2.3679999999999999},"last":1.409}]},{"osd":4,"last update":"Fri Jun 9 04:42:40 2023","interfaces":[{"interface":"back","average":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":3.4279999999999999,"5min":3.4279999999999999,"15min":3.4279999999999999},"last":1.431},{"interface":"front","average":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.954,"5min":1.954,"15min":1.954},"last":1.5640000000000001}]},{"osd":5,"last update":"Fri Jun 9 04:42:40 2023","interfaces":[{"interface":"back","average":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"min":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":1.919,"5min":1.919,"15min":1.919},"last":1.4730000000000001},{"interface":"front","average":{"1min":1.532,"5min":1.532,"15min":1.532},"min":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"max":{"1min":3.2389999999999999,"5min":3.2389999999999999,"15min":3.2389999999999999},"last":1.522}]},{"osd":7,"last update":"Fri Jun 9 04:42:40 2023","interfaces":[{"interface":"back","average":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"min":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"max":{"1min":2.2250000000000001,"5min":2.2250000000000001,"15min":2.2250000000000001},"last":1.6950000000000001},{"interface":"front","average":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"min":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"max":{"1min":1.8009999999999999,"5min":1.8009999999999999,"15min":1.8009999999999999},"last":1.732}]}]},{"osd":5,"up_from":13,"seq":55834574867,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":432,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":442368,"data_stored":180171,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 9 04:42:41 2023","interfaces":[{"interface":"back","average":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"min":{"1min":0.752,"5min":0.752,"15min":0.752},"max":{"1min":2.4929999999999999,"5min":2.4929999999999999,"15min":2.4929999999999999},"last":1.1160000000000001},{"interface":"front","average":{"1min":1.258,"5min":1.258,"15min":1.258},"min":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"max":{"1min":2.323,"5min":2.323,"15min":2.323},"last":1.226}]},{"osd":1,"last update":"Fri Jun 9 04:42:41 2023","interfaces":[{"interface":"back","average":{"1min":1.236,"5min":1.236,"15min":1.236},"min":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":2.4220000000000002,"5min":2.4220000000000002,"15min":2.4220000000000002},"last":0.83499999999999996},{"interface":"front","average":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"min":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"max":{"1min":2.0009999999999999,"5min":2.0009999999999999,"15min":2.0009999999999999},"last":1.0149999999999999}]},{"osd":2,"last update":"Fri Jun 9 04:42:41 2023","interfaces":[{"interface":"back","average":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"min":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":1.53,"5min":1.53,"15min":1.53},"last":1.268},{"interface":"front","average":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":3.605,"5min":3.605,"15min":3.605},"last":0.94299999999999995}]},{"osd":3,"last update":"Fri Jun 9 04:42:41 2023","interfaces":[{"interface":"back","average":{"1min":1.252,"5min":1.252,"15min":1.252},"min":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":1.74,"5min":1.74,"15min":1.74},"last":1.1459999999999999},{"interface":"front","average":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"min":{"1min":0.88,"5min":0.88,"15min":0.88},"max":{"1min":2.036,"5min":2.036,"15min":2.036},"last":0.99299999999999999}]},{"osd":4,"last update":"Fri Jun 9 04:42:41 2023","interfaces":[{"interface":"back","average":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"min":{"1min":0.876,"5min":0.876,"15min":0.876},"max":{"1min":1.956,"5min":1.956,"15min":1.956},"last":1.333},{"interface":"front","average":{"1min":1.494,"5min":1.494,"15min":1.494},"min":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"max":{"1min":2.5249999999999999,"5min":2.5249999999999999,"15min":2.5249999999999999},"last":1.3520000000000001}]},{"osd":6,"last update":"Fri Jun 9 04:42:41 2023","interfaces":[{"interface":"back","average":{"1min":1.5389999999999999,"5min":1.5389999999999999,"15min":1.5389999999999999},"min":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"max":{"1min":3.4470000000000001,"5min":3.4470000000000001,"15min":3.4470000000000001},"last":0.876},{"interface":"front","average":{"1min":1.492,"5min":1.492,"15min":1.492},"min":{"1min":1.135,"5min":1.135,"15min":1.135},"max":{"1min":2.1480000000000001,"5min":2.1480000000000001,"15min":2.1480000000000001},"last":1.1870000000000001}]},{"osd":7,"last update":"Fri Jun 9 04:42:41 2023","interfaces":[{"interface":"back","average":{"1min":1.3520000000000001,"5min":1.3520000000000001,"15min":1.3520000000000001},"min":{"1min":1.014,"5min":1.014,"15min":1.014},"max":{"1min":1.895,"5min":1.895,"15min":1.895},"last":1.29},{"interface":"front","average":{"1min":1.6439999999999999,"5min":1.6439999999999999,"15min":1.6439999999999999},"min":{"1min":1.091,"5min":1.091,"15min":1.091},"max":{"1min":3.738,"5min":3.738,"15min":3.738},"last":0.91300000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574868,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":432,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":442368,"data_stored":180663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 9 04:42:44 2023","interfaces":[{"interface":"back","average":{"1min":1.204,"5min":1.204,"15min":1.204},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":2.0670000000000002,"5min":2.0670000000000002,"15min":2.0670000000000002},"last":1.538},{"interface":"front","average":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"min":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":2.6160000000000001,"5min":2.6160000000000001,"15min":2.6160000000000001},"last":0.89900000000000002}]},{"osd":1,"last update":"Fri Jun 9 04:42:44 2023","interfaces":[{"interface":"back","average":{"1min":1.135,"5min":1.135,"15min":1.135},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.569,"5min":1.569,"15min":1.569},"last":0.93200000000000005},{"interface":"front","average":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.532,"5min":1.532,"15min":1.532},"last":1.2150000000000001}]},{"osd":2,"last update":"Fri Jun 9 04:42:44 2023","interfaces":[{"interface":"back","average":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"min":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"max":{"1min":1.7190000000000001,"5min":1.7190000000000001,"15min":1.7190000000000001},"last":1.1850000000000001},{"interface":"front","average":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.873,"5min":1.873,"15min":1.873},"last":1.494}]},{"osd":3,"last update":"Fri Jun 9 04:42:44 2023","interfaces":[{"interface":"back","average":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"min":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"max":{"1min":1.4059999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":1.3460000000000001},{"interface":"front","average":{"1min":1.363,"5min":1.363,"15min":1.363},"min":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":1.7789999999999999,"5min":1.7789999999999999,"15min":1.7789999999999999},"last":1.3080000000000001}]},{"osd":5,"last update":"Fri Jun 9 04:42:44 2023","interfaces":[{"interface":"back","average":{"1min":1.2889999999999999,"5min":1.2889999999999999,"15min":1.2889999999999999},"min":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.8200000000000001,"5min":1.8200000000000001,"15min":1.8200000000000001},"last":1.407},{"interface":"front","average":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"min":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"max":{"1min":2.0099999999999998,"5min":2.0099999999999998,"15min":2.0099999999999998},"last":1.2569999999999999}]},{"osd":6,"last update":"Fri Jun 9 04:42:44 2023","interfaces":[{"interface":"back","average":{"1min":1.413,"5min":1.413,"15min":1.413},"min":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"max":{"1min":1.897,"5min":1.897,"15min":1.897},"last":1.456},{"interface":"front","average":{"1min":1.5249999999999999,"5min":1.5249999999999999,"15min":1.5249999999999999},"min":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":2.0289999999999999,"5min":2.0289999999999999,"15min":2.0289999999999999},"last":1.5920000000000001}]},{"osd":7,"last update":"Fri Jun 9 04:42:44 2023","interfaces":[{"interface":"back","average":{"1min":1.323,"5min":1.323,"15min":1.323},"min":{"1min":1.02,"5min":1.02,"15min":1.02},"max":{"1min":1.774,"5min":1.774,"15min":1.774},"last":1.157},{"interface":"front","average":{"1min":1.4890000000000001,"5min":1.4890000000000001,"15min":1.4890000000000001},"min":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":1.988,"5min":1.988,"15min":1.988},"last":1.3759999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574866,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":440,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":450560,"data_stored":181657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 9 04:42:44 2023","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.3959999999999999,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.73699999999999999}]},{"osd":1,"last update":"Fri Jun 9 04:42:44 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.857,"5min":1.857,"15min":1.857},"last":0.53600000000000003},{"interface":"front","average":{"1min":1.036,"5min":1.036,"15min":1.036},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":2.3090000000000002,"5min":2.3090000000000002,"15min":2.3090000000000002},"last":0.46500000000000002}]},{"osd":2,"last update":"Fri Jun 9 04:42:44 2023","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.405,"5min":1.405,"15min":1.405},"last":0.443},{"interface":"front","average":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.624}]},{"osd":4,"last update":"Fri Jun 9 04:42:44 2023","interfaces":[{"interface":"back","average":{"1min":1.407,"5min":1.407,"15min":1.407},"min":{"1min":0.878,"5min":0.878,"15min":0.878},"max":{"1min":4.6859999999999999,"5min":4.6859999999999999,"15min":4.6859999999999999},"last":1.034},{"interface":"front","average":{"1min":1.5009999999999999,"5min":1.5009999999999999,"15min":1.5009999999999999},"min":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":4.7839999999999998,"5min":4.7839999999999998,"15min":4.7839999999999998},"last":1.1379999999999999}]},{"osd":5,"last update":"Fri Jun 9 04:42:44 2023","interfaces":[{"interface":"back","average":{"1min":1.371,"5min":1.371,"15min":1.371},"min":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":3.3159999999999998,"5min":3.3159999999999998,"15min":3.3159999999999998},"last":0.93799999999999994},{"interface":"front","average":{"1min":1.528,"5min":1.528,"15min":1.528},"min":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"max":{"1min":4.3700000000000001,"5min":4.3700000000000001,"15min":4.3700000000000001},"last":1.05}]},{"osd":6,"last update":"Fri Jun 9 04:42:44 2023","interfaces":[{"interface":"back","average":{"1min":1.478,"5min":1.478,"15min":1.478},"min":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"max":{"1min":4.109,"5min":4.109,"15min":4.109},"last":1.0800000000000001},{"interface":"front","average":{"1min":1.427,"5min":1.427,"15min":1.427},"min":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"max":{"1min":2.4140000000000001,"5min":2.4140000000000001,"15min":2.4140000000000001},"last":1.2210000000000001}]},{"osd":7,"last update":"Fri Jun 9 04:42:44 2023","interfaces":[{"interface":"back","average":{"1min":1.5,"5min":1.5,"15min":1.5},"min":{"1min":0.877,"5min":0.877,"15min":0.877},"max":{"1min":3.0649999999999999,"5min":3.0649999999999999,"15min":3.0649999999999999},"last":1.113},{"interface":"front","average":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"min":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"max":{"1min":4.2919999999999998,"5min":4.2919999999999998,"15min":4.2919999999999998},"last":0.88}]}]},{"osd":2,"up_from":13,"seq":55834574868,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":428,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":438272,"data_stored":180129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 9 04:42:41 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.749}]},{"osd":1,"last update":"Fri Jun 9 04:42:41 2023","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.286,"5min":1.286,"15min":1.286},"last":0.54800000000000004},{"interface":"front","average":{"1min":1.036,"5min":1.036,"15min":1.036},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.4870000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.69699999999999995}]},{"osd":3,"last update":"Fri Jun 9 04:42:41 2023","interfaces":[{"interface":"back","average":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.5920000000000001,"5min":1.5920000000000001,"15min":1.5920000000000001},"last":0.89100000000000001},{"interface":"front","average":{"1min":1.151,"5min":1.151,"15min":1.151},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.6339999999999999,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":1.0469999999999999}]},{"osd":4,"last update":"Fri Jun 9 04:42:41 2023","interfaces":[{"interface":"back","average":{"1min":1.391,"5min":1.391,"15min":1.391},"min":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"max":{"1min":1.9590000000000001,"5min":1.9590000000000001,"15min":1.9590000000000001},"last":1.2669999999999999},{"interface":"front","average":{"1min":1.23,"5min":1.23,"15min":1.23},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":2.1059999999999999,"5min":2.1059999999999999,"15min":2.1059999999999999},"last":1.099}]},{"osd":5,"last update":"Fri Jun 9 04:42:41 2023","interfaces":[{"interface":"back","average":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"min":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"max":{"1min":1.7430000000000001,"5min":1.7430000000000001,"15min":1.7430000000000001},"last":1.218},{"interface":"front","average":{"1min":1.4430000000000001,"5min":1.4430000000000001,"15min":1.4430000000000001},"min":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"max":{"1min":1.9079999999999999,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":1.1479999999999999}]},{"osd":6,"last update":"Fri Jun 9 04:42:41 2023","interfaces":[{"interface":"back","average":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"min":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"max":{"1min":1.8839999999999999,"5min":1.8839999999999999,"15min":1.8839999999999999},"last":1.448},{"interface":"front","average":{"1min":1.399,"5min":1.399,"15min":1.399},"min":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"max":{"1min":1.974,"5min":1.974,"15min":1.974},"last":1.3120000000000001}]},{"osd":7,"last update":"Fri Jun 9 04:42:41 2023","interfaces":[{"interface":"back","average":{"1min":1.4119999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"min":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"max":{"1min":2.0350000000000001,"5min":2.0350000000000001,"15min":2.0350000000000001},"last":1.534},{"interface":"front","average":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"min":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"max":{"1min":2.048,"5min":2.048,"15min":2.048},"last":1.5780000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574867,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":428,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":438272,"data_stored":180149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 9 04:42:43 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.377,"5min":1.377,"15min":1.377},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":2.3300000000000001,"5min":2.3300000000000001,"15min":2.3300000000000001},"last":0.78500000000000003}]},{"osd":2,"last update":"Fri Jun 9 04:42:43 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.444,"5min":1.444,"15min":1.444},"last":0.68999999999999995},{"interface":"front","average":{"1min":1.01,"5min":1.01,"15min":1.01},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":2.379,"5min":2.379,"15min":2.379},"last":0.67400000000000004}]},{"osd":3,"last update":"Fri Jun 9 04:42:43 2023","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":2.3220000000000001,"5min":2.3220000000000001,"15min":2.3220000000000001},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.744,"5min":1.744,"15min":1.744},"last":0.83799999999999997}]},{"osd":4,"last update":"Fri Jun 9 04:42:43 2023","interfaces":[{"interface":"back","average":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"min":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":1.8400000000000001,"5min":1.8400000000000001,"15min":1.8400000000000001},"last":0.89500000000000002},{"interface":"front","average":{"1min":1.262,"5min":1.262,"15min":1.262},"min":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"max":{"1min":2.2709999999999999,"5min":2.2709999999999999,"15min":2.2709999999999999},"last":1.3720000000000001}]},{"osd":5,"last update":"Fri Jun 9 04:42:43 2023","interfaces":[{"interface":"back","average":{"1min":1.321,"5min":1.321,"15min":1.321},"min":{"1min":0.998,"5min":0.998,"15min":0.998},"max":{"1min":2.2839999999999998,"5min":2.2839999999999998,"15min":2.2839999999999998},"last":1.3160000000000001},{"interface":"front","average":{"1min":1.496,"5min":1.496,"15min":1.496},"min":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"max":{"1min":3.4390000000000001,"5min":3.4390000000000001,"15min":3.4390000000000001},"last":0.999}]},{"osd":6,"last update":"Fri Jun 9 04:42:43 2023","interfaces":[{"interface":"back","average":{"1min":1.381,"5min":1.381,"15min":1.381},"min":{"1min":0.871,"5min":0.871,"15min":0.871},"max":{"1min":2.54,"5min":2.54,"15min":2.54},"last":0.96899999999999997},{"interface":"front","average":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"min":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"max":{"1min":3.1480000000000001,"5min":3.1480000000000001,"15min":3.1480000000000001},"last":1.425}]},{"osd":7,"last update":"Fri Jun 9 04:42:43 2023","interfaces":[{"interface":"back","average":{"1min":1.494,"5min":1.494,"15min":1.494},"min":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"max":{"1min":3.8079999999999998,"5min":3.8079999999999998,"15min":3.8079999999999998},"last":1.155},{"interface":"front","average":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"min":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"max":{"1min":2.927,"5min":2.927,"15min":2.927},"last":0.93100000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574868,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27960,"kb_used_data":1008,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343880,"statfs":{"total":96636764160,"available":96608133120,"internally_reserved":0,"allocated":1032192,"data_stored":770461,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jun 9 04:42:45 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.867,"5min":1.867,"15min":1.867},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.595,"5min":1.595,"15min":1.595},"last":1.444}]},{"osd":2,"last update":"Fri Jun 9 04:42:45 2023","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.2889999999999999,"5min":1.2889999999999999,"15min":1.2889999999999999},"last":0.88800000000000001},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.4850000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"last":1.038}]},{"osd":3,"last update":"Fri Jun 9 04:42:45 2023","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"min":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":1.111},{"interface":"front","average":{"1min":1.028,"5min":1.028,"15min":1.028},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.675,"5min":1.675,"15min":1.675},"last":0.98199999999999998}]},{"osd":4,"last update":"Fri Jun 9 04:42:45 2023","interfaces":[{"interface":"back","average":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"min":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":1.863,"5min":1.863,"15min":1.863},"last":1.2929999999999999},{"interface":"front","average":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"min":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"max":{"1min":1.9950000000000001,"5min":1.9950000000000001,"15min":1.9950000000000001},"last":1.3300000000000001}]},{"osd":5,"last update":"Fri Jun 9 04:42:45 2023","interfaces":[{"interface":"back","average":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"min":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":2.093,"5min":2.093,"15min":2.093},"last":1.7430000000000001},{"interface":"front","average":{"1min":1.302,"5min":1.302,"15min":1.302},"min":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"max":{"1min":2.0369999999999999,"5min":2.0369999999999999,"15min":2.0369999999999999},"last":1.3799999999999999}]},{"osd":6,"last update":"Fri Jun 9 04:42:45 2023","interfaces":[{"interface":"back","average":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"min":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"max":{"1min":1.9359999999999999,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":1.2410000000000001},{"interface":"front","average":{"1min":1.395,"5min":1.395,"15min":1.395},"min":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"max":{"1min":2.3650000000000002,"5min":2.3650000000000002,"15min":2.3650000000000002},"last":1.8160000000000001}]},{"osd":7,"last update":"Fri Jun 9 04:42:45 2023","interfaces":[{"interface":"back","average":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"min":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"max":{"1min":2.2879999999999998,"5min":2.2879999999999998,"15min":2.2879999999999998},"last":1.8740000000000001},{"interface":"front","average":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"min":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"max":{"1min":1.7370000000000001,"5min":1.7370000000000001,"15min":1.7370000000000001},"last":1.704}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-09T04:43:02.764 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-06-09T04:43:02.765 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-06-09T04:43:02.979 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.974+0000 7fb0e1476700 1 Processor -- start 2023-06-09T04:43:02.979 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.978+0000 7fb0e1476700 1 -- start start 2023-06-09T04:43:02.980 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.978+0000 7fb0e1476700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb0dc0b1ca0 0x7fb0dc160920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:43:02.980 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.978+0000 7fb0e1476700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb0dc0d2400 0x7fb0dc0d28a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:43:02.981 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.978+0000 7fb0e1476700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0dc15c6b0 con 0x7fb0dc0b18d0 2023-06-09T04:43:02.981 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.978+0000 7fb0e1476700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0dc0d2de0 con 0x7fb0dc0b1ca0 2023-06-09T04:43:02.981 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.978+0000 7fb0e1476700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0dc0cf6a0 con 0x7fb0dc0d2400 2023-06-09T04:43:02.982 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.978+0000 7fb0dbfff700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7fb0dc0b18d0 0x7fb0dc0cee90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:54450/0 (socket says 172.21.15.90:54450) 2023-06-09T04:43:02.982 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.978+0000 7fb0dbfff700 1 -- 172.21.15.90:0/1420764744 learned_addr learned my addr 172.21.15.90:0/1420764744 (peer_addr_for_me v1:172.21.15.90:0/0) 2023-06-09T04:43:02.982 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.978+0000 7fb0d37fe700 1 --2- 172.21.15.90:0/1420764744 >> v2:172.21.15.174:3300/0 conn(0x7fb0dc0b1ca0 0x7fb0dc160920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:43:02.982 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.978+0000 7fb0e0c75700 1 --2- 172.21.15.90:0/1420764744 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb0dc0d2400 0x7fb0dc0d28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:43:02.982 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.978+0000 7fb0db7fe700 1 -- 172.21.15.90:0/1420764744 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1386377700 0 0) 0x7fb0dc15c6b0 con 0x7fb0dc0b18d0 2023-06-09T04:43:02.983 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.978+0000 7fb0db7fe700 1 -- 172.21.15.90:0/1420764744 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb0c80035d0 con 0x7fb0dc0b18d0 2023-06-09T04:43:02.983 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.978+0000 7fb0d37fe700 1 -- 172.21.15.90:0/1420764744 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb0dc0d2400 msgr2=0x7fb0dc0d28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:43:02.983 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.978+0000 7fb0d37fe700 1 --2- 172.21.15.90:0/1420764744 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb0dc0d2400 0x7fb0dc0d28a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:43:02.983 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.978+0000 7fb0d37fe700 1 -- 172.21.15.90:0/1420764744 >> v1:172.21.15.90:6789/0 conn(0x7fb0dc0b18d0 legacy=0x7fb0dc0cee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:43:02.983 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.978+0000 7fb0d37fe700 1 -- 172.21.15.90:0/1420764744 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0dc0cf980 con 0x7fb0dc0b1ca0 2023-06-09T04:43:02.984 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.978+0000 7fb0d37fe700 1 --2- 172.21.15.90:0/1420764744 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb0dc0b1ca0 0x7fb0dc160920 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fb0c4009850 tx=0x7fb0c4009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ffe8aa9b0892bc16 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:43:02.984 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.982+0000 7fb0db7fe700 1 -- 172.21.15.90:0/1420764744 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0c4011830 con 0x7fb0dc0b1ca0 2023-06-09T04:43:02.984 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.982+0000 7fb0db7fe700 1 -- 172.21.15.90:0/1420764744 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0c4011990 con 0x7fb0dc0b1ca0 2023-06-09T04:43:02.984 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.982+0000 7fb0db7fe700 1 -- 172.21.15.90:0/1420764744 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0c4011d40 con 0x7fb0dc0b1ca0 2023-06-09T04:43:02.984 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.982+0000 7fb0e1476700 1 -- 172.21.15.90:0/1420764744 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb0dc0b1ca0 msgr2=0x7fb0dc160920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:43:02.985 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.982+0000 7fb0e1476700 1 --2- 172.21.15.90:0/1420764744 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb0dc0b1ca0 0x7fb0dc160920 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fb0c4009850 tx=0x7fb0c4009b60 comp rx=0 tx=0).stop 2023-06-09T04:43:02.985 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.982+0000 7fb0e1476700 1 -- 172.21.15.90:0/1420764744 shutdown_connections 2023-06-09T04:43:02.985 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.982+0000 7fb0e1476700 1 --2- 172.21.15.90:0/1420764744 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb0dc0d2400 0x7fb0dc0d28a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:43:02.986 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.982+0000 7fb0e1476700 1 --2- 172.21.15.90:0/1420764744 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb0dc0b1ca0 0x7fb0dc160920 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:43:02.986 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.982+0000 7fb0e1476700 1 -- 172.21.15.90:0/1420764744 >> 172.21.15.90:0/1420764744 conn(0x7fb0dc09b9b0 msgr2=0x7fb0dc0b55d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:43:02.986 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.982+0000 7fb0e1476700 1 -- 172.21.15.90:0/1420764744 shutdown_connections 2023-06-09T04:43:02.986 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.982+0000 7fb0e1476700 1 -- 172.21.15.90:0/1420764744 wait complete. 2023-06-09T04:43:02.987 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.982+0000 7fb0e1476700 1 Processor -- start 2023-06-09T04:43:02.987 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.986+0000 7fb0e1476700 1 -- start start 2023-06-09T04:43:02.988 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.986+0000 7fb0e1476700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb0dc0b18d0 0x7fb0dc15c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:43:02.989 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.986+0000 7fb0e1476700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb0dc0b1ca0 0x7fb0dc0c7c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:43:02.989 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.986+0000 7fb0e1476700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb0dc0d2400 0x7fb0dc1f09a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:43:02.989 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.986+0000 7fb0e1476700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0dc0b23e0 con 0x7fb0dc0b1ca0 2023-06-09T04:43:02.989 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.986+0000 7fb0e1476700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0dc15f770 con 0x7fb0dc0d2400 2023-06-09T04:43:02.989 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.986+0000 7fb0e1476700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0dc0b3db0 con 0x7fb0dc0b18d0 2023-06-09T04:43:02.990 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.986+0000 7fb0d37fe700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb0dc0b1ca0 0x7fb0dc0c7c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:43:02.990 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.986+0000 7fb0d37fe700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb0dc0b1ca0 0x7fb0dc0c7c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:44454/0 (socket says 172.21.15.90:44454) 2023-06-09T04:43:02.990 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.986+0000 7fb0d37fe700 1 -- 172.21.15.90:0/2905579743 learned_addr learned my addr 172.21.15.90:0/2905579743 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:43:02.991 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.986+0000 7fb0e0c75700 1 --2- 172.21.15.90:0/2905579743 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb0dc0d2400 0x7fb0dc1f09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:43:02.991 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.986+0000 7fb0dbfff700 1 --2- 172.21.15.90:0/2905579743 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb0dc0b18d0 0x7fb0dc15c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:43:02.991 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.986+0000 7fb0d37fe700 1 -- 172.21.15.90:0/2905579743 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb0dc0b18d0 msgr2=0x7fb0dc15c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:43:02.991 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.986+0000 7fb0d37fe700 1 --2- 172.21.15.90:0/2905579743 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb0dc0b18d0 0x7fb0dc15c860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:43:02.991 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.986+0000 7fb0d37fe700 1 -- 172.21.15.90:0/2905579743 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb0dc0d2400 msgr2=0x7fb0dc1f09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:43:02.991 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.986+0000 7fb0d37fe700 1 --2- 172.21.15.90:0/2905579743 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb0dc0d2400 0x7fb0dc1f09a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:43:02.991 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.986+0000 7fb0d37fe700 1 -- 172.21.15.90:0/2905579743 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0c40094b0 con 0x7fb0dc0b1ca0 2023-06-09T04:43:02.992 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.986+0000 7fb0e0c75700 1 --2- 172.21.15.90:0/2905579743 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb0dc0d2400 0x7fb0dc1f09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:43:02.992 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.986+0000 7fb0d37fe700 1 --2- 172.21.15.90:0/2905579743 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb0dc0b1ca0 0x7fb0dc0c7c10 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fb0c4013000 tx=0x7fb0c4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:43:02.992 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.986+0000 7fb0d97fa700 1 -- 172.21.15.90:0/2905579743 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0c4004480 con 0x7fb0dc0b1ca0 2023-06-09T04:43:02.992 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.986+0000 7fb0d97fa700 1 -- 172.21.15.90:0/2905579743 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0c401f070 con 0x7fb0dc0b1ca0 2023-06-09T04:43:02.993 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.986+0000 7fb0e1476700 1 -- 172.21.15.90:0/2905579743 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0dc0b37a0 con 0x7fb0dc0b1ca0 2023-06-09T04:43:02.993 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.986+0000 7fb0d97fa700 1 -- 172.21.15.90:0/2905579743 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0c4003900 con 0x7fb0dc0b1ca0 2023-06-09T04:43:02.993 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.990+0000 7fb0e1476700 1 -- 172.21.15.90:0/2905579743 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0dc0b3a40 con 0x7fb0dc0b1ca0 2023-06-09T04:43:02.993 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.990+0000 7fb0e1476700 1 -- 172.21.15.90:0/2905579743 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0dc04e380 con 0x7fb0dc0b1ca0 2023-06-09T04:43:02.994 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.990+0000 7fb0d97fa700 1 -- 172.21.15.90:0/2905579743 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb0c4021030 con 0x7fb0dc0b1ca0 2023-06-09T04:43:02.995 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.990+0000 7fb0d97fa700 1 --2- 172.21.15.90:0/2905579743 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fb0bc0662f0 0x7fb0bc0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:43:02.995 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.990+0000 7fb0d97fa700 1 -- 172.21.15.90:0/2905579743 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb0c4085170 con 0x7fb0dc0b1ca0 2023-06-09T04:43:02.995 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.994+0000 7fb0dbfff700 1 --2- 172.21.15.90:0/2905579743 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fb0bc0662f0 0x7fb0bc0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:43:02.996 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.994+0000 7fb0dbfff700 1 --2- 172.21.15.90:0/2905579743 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fb0bc0662f0 0x7fb0bc0687a0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fb0cc001810 tx=0x7fb0cc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:43:03.001 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:02.998+0000 7fb0d97fa700 1 -- 172.21.15.90:0/2905579743 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb0c4052700 con 0x7fb0dc0b1ca0 2023-06-09T04:43:03.232 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:03.230+0000 7fb0e1476700 1 -- 172.21.15.90:0/2905579743 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fb0dc0d33d0 con 0x7fb0dc0b1ca0 2023-06-09T04:43:03.242 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:03.238+0000 7fb0d97fa700 1 -- 172.21.15.90:0/2905579743 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v11) v1 ==== 190+0+0 (secure 0 0 0) 0x7fb0c4006ce0 con 0x7fb0dc0b1ca0 2023-06-09T04:43:03.244 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:03.242+0000 7fb0e1476700 1 -- 172.21.15.90:0/2905579743 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fb0bc0662f0 msgr2=0x7fb0bc0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:43:03.245 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:03.242+0000 7fb0e1476700 1 --2- 172.21.15.90:0/2905579743 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fb0bc0662f0 0x7fb0bc0687a0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fb0cc001810 tx=0x7fb0cc009040 comp rx=0 tx=0).stop 2023-06-09T04:43:03.245 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:03.242+0000 7fb0e1476700 1 -- 172.21.15.90:0/2905579743 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb0dc0b1ca0 msgr2=0x7fb0dc0c7c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:43:03.245 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:03.242+0000 7fb0e1476700 1 --2- 172.21.15.90:0/2905579743 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb0dc0b1ca0 0x7fb0dc0c7c10 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fb0c4013000 tx=0x7fb0c4004770 comp rx=0 tx=0).stop 2023-06-09T04:43:03.245 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:03.242+0000 7fb0e1476700 1 -- 172.21.15.90:0/2905579743 shutdown_connections 2023-06-09T04:43:03.246 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:03.242+0000 7fb0e1476700 1 --2- 172.21.15.90:0/2905579743 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fb0bc0662f0 0x7fb0bc0687a0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:43:03.246 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:03.242+0000 7fb0e1476700 1 --2- 172.21.15.90:0/2905579743 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb0dc0d2400 0x7fb0dc1f09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:43:03.246 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:03.242+0000 7fb0e1476700 1 --2- 172.21.15.90:0/2905579743 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb0dc0b1ca0 0x7fb0dc0c7c10 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:43:03.246 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:03.242+0000 7fb0e1476700 1 --2- 172.21.15.90:0/2905579743 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb0dc0b18d0 0x7fb0dc15c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:43:03.246 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:03.242+0000 7fb0e1476700 1 -- 172.21.15.90:0/2905579743 >> 172.21.15.90:0/2905579743 conn(0x7fb0dc09b9b0 msgr2=0x7fb0dc0b03b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:43:03.246 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:03.242+0000 7fb0e1476700 1 -- 172.21.15.90:0/2905579743 shutdown_connections 2023-06-09T04:43:03.246 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:03.242+0000 7fb0e1476700 1 -- 172.21.15.90:0/2905579743 wait complete. 2023-06-09T04:43:03.247 INFO:teuthology.orchestra.run.smithi090.stderr:updated caps for client.0 2023-06-09T04:43:03.265 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-09T04:43:03.434 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:03.430+0000 7f23288b0700 1 Processor -- start 2023-06-09T04:43:03.434 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:03.430+0000 7f23288b0700 1 -- start start 2023-06-09T04:43:03.435 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:03.434+0000 7f23288b0700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f2324154350 0x7f23240cc0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:43:03.435 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:03.434+0000 7f23288b0700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f23240cafb0 0x7f232406acf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:43:03.435 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:03.434+0000 7f23288b0700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f232415d7a0 0x7f232415dc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:43:03.436 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:03.434+0000 7f23288b0700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2324154720 con 0x7f23240cafb0 2023-06-09T04:43:03.436 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:03.434+0000 7f23288b0700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f232415e160 con 0x7f2324154350 2023-06-09T04:43:03.436 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:03.434+0000 7f23288b0700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23240cd8a0 con 0x7f232415d7a0 2023-06-09T04:43:03.437 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:03.434+0000 7f231a59c700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f23240cafb0 0x7f232406acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:43:03.437 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:03.434+0000 7f231a59c700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f23240cafb0 0x7f232406acf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:44462/0 (socket says 172.21.15.90:44462) 2023-06-09T04:43:03.437 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:03.434+0000 7f231a59c700 1 -- 172.21.15.90:0/1300146853 learned_addr learned my addr 172.21.15.90:0/1300146853 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:43:03.437 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:03.434+0000 7f232359e700 1 --2- 172.21.15.90:0/1300146853 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f232415d7a0 0x7f232415dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:43:03.437 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:03.434+0000 7f2322d9d700 1 --2- 172.21.15.90:0/1300146853 >> v2:172.21.15.174:3300/0 conn(0x7f2324154350 0x7f23240cc0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:43:03.438 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:03.434+0000 7f231a59c700 1 -- 172.21.15.90:0/1300146853 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f232415d7a0 msgr2=0x7f232415dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:43:03.438 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:03.434+0000 7f231a59c700 1 --2- 172.21.15.90:0/1300146853 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f232415d7a0 0x7f232415dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:43:03.438 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:03.434+0000 7f231a59c700 1 -- 172.21.15.90:0/1300146853 >> v2:172.21.15.174:3300/0 conn(0x7f2324154350 msgr2=0x7f23240cc0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:43:03.438 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:03.434+0000 7f231a59c700 1 --2- 172.21.15.90:0/1300146853 >> v2:172.21.15.174:3300/0 conn(0x7f2324154350 0x7f23240cc0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:43:03.438 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:03.434+0000 7f231a59c700 1 -- 172.21.15.90:0/1300146853 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23240cb420 con 0x7f23240cafb0 2023-06-09T04:43:03.439 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:03.434+0000 7f231a59c700 1 --2- 172.21.15.90:0/1300146853 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f23240cafb0 0x7f232406acf0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f232406f160 tx=0x7f230c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17ca918b09088d3c server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:43:03.439 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:03.434+0000 7f232259c700 1 -- 172.21.15.90:0/1300146853 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f230c011830 con 0x7f23240cafb0 2023-06-09T04:43:03.439 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:03.434+0000 7f232259c700 1 -- 172.21.15.90:0/1300146853 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f230c011990 con 0x7f23240cafb0 2023-06-09T04:43:03.439 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:03.434+0000 7f232259c700 1 -- 172.21.15.90:0/1300146853 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f230c011d20 con 0x7f23240cafb0 2023-06-09T04:43:03.440 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:03.434+0000 7f23288b0700 1 -- 172.21.15.90:0/1300146853 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f23240cafb0 msgr2=0x7f232406acf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:43:03.440 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:03.434+0000 7f23288b0700 1 --2- 172.21.15.90:0/1300146853 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f23240cafb0 0x7f232406acf0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f232406f160 tx=0x7f230c009bf0 comp rx=0 tx=0).stop 2023-06-09T04:43:03.440 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:03.434+0000 7f23288b0700 1 -- 172.21.15.90:0/1300146853 shutdown_connections 2023-06-09T04:43:03.440 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:03.434+0000 7f23288b0700 1 --2- 172.21.15.90:0/1300146853 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f232415d7a0 0x7f232415dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:43:03.440 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:03.434+0000 7f23288b0700 1 --2- 172.21.15.90:0/1300146853 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f23240cafb0 0x7f232406acf0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:43:03.440 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:03.434+0000 7f23288b0700 1 --2- 172.21.15.90:0/1300146853 >> v2:172.21.15.174:3300/0 conn(0x7f2324154350 0x7f23240cc0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:43:03.440 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:03.434+0000 7f23288b0700 1 -- 172.21.15.90:0/1300146853 >> 172.21.15.90:0/1300146853 conn(0x7f232406c690 msgr2=0x7f23240aff00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:43:03.441 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:03.434+0000 7f23288b0700 1 -- 172.21.15.90:0/1300146853 shutdown_connections 2023-06-09T04:43:03.441 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:03.434+0000 7f23288b0700 1 -- 172.21.15.90:0/1300146853 wait complete. 2023-06-09T04:43:03.441 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:03.438+0000 7f23288b0700 1 Processor -- start 2023-06-09T04:43:03.442 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:03.438+0000 7f23288b0700 1 -- start start 2023-06-09T04:43:03.443 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:03.442+0000 7f23288b0700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f23240cafb0 0x7f232413abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:43:03.443 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:03.442+0000 7f23288b0700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2324154350 0x7f2324137540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:43:03.443 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:03.442+0000 7f23288b0700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f232415d7a0 0x7f23241341c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:43:03.443 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:03.442+0000 7f23288b0700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2324137a80 con 0x7f232415d7a0 2023-06-09T04:43:03.444 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:03.442+0000 7f23288b0700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23241f2e70 con 0x7f23240cafb0 2023-06-09T04:43:03.444 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:03.442+0000 7f23288b0700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23241f3150 con 0x7f2324154350 2023-06-09T04:43:03.445 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:03.442+0000 7f232359e700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f232415d7a0 0x7f23241341c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:43:03.445 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:03.442+0000 7f232359e700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f232415d7a0 0x7f23241341c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:44474/0 (socket says 172.21.15.90:44474) 2023-06-09T04:43:03.445 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:03.442+0000 7f232359e700 1 -- 172.21.15.90:0/2227802119 learned_addr learned my addr 172.21.15.90:0/2227802119 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:43:03.445 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:03.442+0000 7f231a59c700 1 --2- 172.21.15.90:0/2227802119 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2324154350 0x7f2324137540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:43:03.446 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:03.442+0000 7f2322d9d700 1 --2- 172.21.15.90:0/2227802119 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f23240cafb0 0x7f232413abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:43:03.446 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:03.442+0000 7f232359e700 1 -- 172.21.15.90:0/2227802119 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2324154350 msgr2=0x7f2324137540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:43:03.446 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:03.442+0000 7f232359e700 1 --2- 172.21.15.90:0/2227802119 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2324154350 0x7f2324137540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:43:03.446 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:03.442+0000 7f232359e700 1 -- 172.21.15.90:0/2227802119 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f23240cafb0 msgr2=0x7f232413abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:43:03.446 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:03.442+0000 7f232359e700 1 --2- 172.21.15.90:0/2227802119 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f23240cafb0 0x7f232413abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:43:03.446 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:03.442+0000 7f232359e700 1 -- 172.21.15.90:0/2227802119 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f230c009570 con 0x7f232415d7a0 2023-06-09T04:43:03.446 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:03.442+0000 7f232359e700 1 --2- 172.21.15.90:0/2227802119 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f232415d7a0 0x7f23241341c0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f231c00efc0 tx=0x7f231c00c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:43:03.446 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:03.442+0000 7f231bfff700 1 -- 172.21.15.90:0/2227802119 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f231c00cad0 con 0x7f232415d7a0 2023-06-09T04:43:03.447 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:03.442+0000 7f231bfff700 1 -- 172.21.15.90:0/2227802119 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f231c00f040 con 0x7f232415d7a0 2023-06-09T04:43:03.447 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:03.442+0000 7f23288b0700 1 -- 172.21.15.90:0/2227802119 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23241f3430 con 0x7f232415d7a0 2023-06-09T04:43:03.447 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:03.442+0000 7f231bfff700 1 -- 172.21.15.90:0/2227802119 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f231c00ce70 con 0x7f232415d7a0 2023-06-09T04:43:03.447 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:03.442+0000 7f23288b0700 1 -- 172.21.15.90:0/2227802119 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2324134700 con 0x7f232415d7a0 2023-06-09T04:43:03.447 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:03.442+0000 7f23288b0700 1 -- 172.21.15.90:0/2227802119 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f232406b390 con 0x7f232415d7a0 2023-06-09T04:43:03.448 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:03.446+0000 7f231bfff700 1 -- 172.21.15.90:0/2227802119 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f231c014480 con 0x7f232415d7a0 2023-06-09T04:43:03.450 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:03.446+0000 7f231bfff700 1 --2- 172.21.15.90:0/2227802119 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f23040662f0 0x7f23040687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:43:03.450 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:03.446+0000 7f231bfff700 1 -- 172.21.15.90:0/2227802119 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f231c084420 con 0x7f232415d7a0 2023-06-09T04:43:03.451 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:03.446+0000 7f2322d9d700 1 --2- 172.21.15.90:0/2227802119 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f23040662f0 0x7f23040687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:43:03.452 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:03.450+0000 7f2322d9d700 1 --2- 172.21.15.90:0/2227802119 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f23040662f0 0x7f23040687a0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f2314009bf0 tx=0x7f2314009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:43:03.458 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:03.454+0000 7f231bfff700 1 -- 172.21.15.90:0/2227802119 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f231c0518b0 con 0x7f232415d7a0 2023-06-09T04:43:03.664 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:03.662+0000 7f23288b0700 1 -- 172.21.15.90:0/2227802119 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f23241f3c30 con 0x7f232415d7a0 2023-06-09T04:43:03.665 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:03.662+0000 7f231bfff700 1 -- 172.21.15.90:0/2227802119 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4677 (secure 0 0 0) 0x7f23241f3c30 con 0x7f232415d7a0 2023-06-09T04:43:03.665 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:43:03.666 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4823,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6836/3809357484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":3809357484},{"type":"v1","addr":"172.21.15.174:6836","nonce":3809357484}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4826,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6837/3671460411","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6835","nonce":3671460411},{"type":"v1","addr":"172.21.15.174:6837","nonce":3671460411}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5121,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6833/3057926440","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3057926440},{"type":"v1","addr":"172.21.15.90:6833","nonce":3057926440}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-09T04:42:57.840003+0000","modified":"2023-06-09T04:43:01.026947+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5124},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5124":{"gid":5124,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.90:6835/1290764843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1290764843},{"type":"v1","addr":"172.21.15.90:6835","nonce":1290764843}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-06-09T04:43:03.668 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:03.666+0000 7f23288b0700 1 -- 172.21.15.90:0/2227802119 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f23040662f0 msgr2=0x7f23040687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:43:03.668 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:03.666+0000 7f23288b0700 1 --2- 172.21.15.90:0/2227802119 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f23040662f0 0x7f23040687a0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f2314009bf0 tx=0x7f2314009240 comp rx=0 tx=0).stop 2023-06-09T04:43:03.668 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:03.666+0000 7f23288b0700 1 -- 172.21.15.90:0/2227802119 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f232415d7a0 msgr2=0x7f23241341c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:43:03.668 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:03.666+0000 7f23288b0700 1 --2- 172.21.15.90:0/2227802119 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f232415d7a0 0x7f23241341c0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f231c00efc0 tx=0x7f231c00c0c0 comp rx=0 tx=0).stop 2023-06-09T04:43:03.668 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:03.666+0000 7f23288b0700 1 -- 172.21.15.90:0/2227802119 shutdown_connections 2023-06-09T04:43:03.669 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:03.666+0000 7f23288b0700 1 --2- 172.21.15.90:0/2227802119 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f23040662f0 0x7f23040687a0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:43:03.669 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:03.666+0000 7f23288b0700 1 --2- 172.21.15.90:0/2227802119 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f232415d7a0 0x7f23241341c0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:43:03.669 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:03.666+0000 7f23288b0700 1 --2- 172.21.15.90:0/2227802119 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2324154350 0x7f2324137540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:43:03.669 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:03.666+0000 7f23288b0700 1 --2- 172.21.15.90:0/2227802119 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f23240cafb0 0x7f232413abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:43:03.669 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:03.666+0000 7f23288b0700 1 -- 172.21.15.90:0/2227802119 >> 172.21.15.90:0/2227802119 conn(0x7f232406c690 msgr2=0x7f23240b3920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:43:03.669 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:03.666+0000 7f23288b0700 1 -- 172.21.15.90:0/2227802119 shutdown_connections 2023-06-09T04:43:03.670 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:03.666+0000 7f23288b0700 1 -- 172.21.15.90:0/2227802119 wait complete. 2023-06-09T04:43:03.671 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 15 2023-06-09T04:43:04.091 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 15, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-06-09T04:42:57.840003+0000', 'modified': '2023-06-09T04:43:01.026947+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5124}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5124': {'gid': 5124, 'name': 'c', 'rank': 0, 'incarnation': 12, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.90:6835/1290764843', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.90:6834', 'nonce': 1290764843}, {'type': 'v1', 'addr': '172.21.15.90:6835', 'nonce': 1290764843}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-06-09T04:43:04.091 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-06-09T04:43:04.092 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-06-09T04:43:04.270 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.266+0000 7f740e797700 1 Processor -- start 2023-06-09T04:43:04.270 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.266+0000 7f740e797700 1 -- start start 2023-06-09T04:43:04.273 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.270+0000 7f740e797700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7408158dc0 0x7f7408070870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:43:04.274 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.270+0000 7f740e797700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74080698c0 con 0x7f74080cd810 2023-06-09T04:43:04.274 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.270+0000 7f740e797700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7408069ba0 con 0x7f7408070db0 2023-06-09T04:43:04.274 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.270+0000 7f740e797700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7408069e80 con 0x7f7408158dc0 2023-06-09T04:43:04.275 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.270+0000 7f740df96700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f74080cd810 0x7f74080ccc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:54452/0 (socket says 172.21.15.90:54452) 2023-06-09T04:43:04.275 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.270+0000 7f740df96700 1 -- 172.21.15.90:0/2437202605 learned_addr learned my addr 172.21.15.90:0/2437202605 (peer_addr_for_me v1:172.21.15.90:0/0) 2023-06-09T04:43:04.275 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.270+0000 7f740d795700 1 --2- 172.21.15.90:0/2437202605 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7408158dc0 0x7f7408070870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:43:04.276 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.270+0000 7f73fffff700 1 -- 172.21.15.90:0/2437202605 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2923535567 0 0) 0x7f74080698c0 con 0x7f74080cd810 2023-06-09T04:43:04.276 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.274+0000 7f73fffff700 1 -- 172.21.15.90:0/2437202605 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f73f40057e0 con 0x7f74080cd810 2023-06-09T04:43:04.276 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.274+0000 7f73fffff700 1 -- 172.21.15.90:0/2437202605 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2684613652 0 0) 0x7f73f40057e0 con 0x7f74080cd810 2023-06-09T04:43:04.276 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.274+0000 7f73fffff700 1 -- 172.21.15.90:0/2437202605 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7408158dc0 msgr2=0x7f7408070870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:43:04.277 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.274+0000 7f73fffff700 1 --2- 172.21.15.90:0/2437202605 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7408158dc0 0x7f7408070870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:43:04.277 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.274+0000 7f73fffff700 1 -- 172.21.15.90:0/2437202605 >> v1:172.21.15.174:6789/0 conn(0x7f7408070db0 legacy=0x7f740806a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:43:04.277 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.274+0000 7f73fffff700 1 -- 172.21.15.90:0/2437202605 --> v1:172.21.15.90:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f740806a160 con 0x7f74080cd810 2023-06-09T04:43:04.277 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.274+0000 7f73fffff700 1 -- 172.21.15.90:0/2437202605 <== mon.0 v1:172.21.15.90:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3604404106 0 0) 0x7f7400001670 con 0x7f74080cd810 2023-06-09T04:43:04.277 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.274+0000 7f73fffff700 1 -- 172.21.15.90:0/2437202605 >> v1:172.21.15.90:6789/0 conn(0x7f74080cd810 legacy=0x7f74080ccc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:43:04.277 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.274+0000 7f73fffff700 1 --2- 172.21.15.90:0/2437202605 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f73f4005c60 0x7f73f4006030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:43:04.277 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.274+0000 7f73fffff700 1 --2- 172.21.15.90:0/2437202605 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f73f4006570 0x7f73f4006a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:43:04.278 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.274+0000 7f73fffff700 1 --2- 172.21.15.90:0/2437202605 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f73f4007210 0x7f73f400dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:43:04.278 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.274+0000 7f73fffff700 1 -- 172.21.15.90:0/2437202605 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7408069e80 con 0x7f73f4006570 2023-06-09T04:43:04.278 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.274+0000 7f73fffff700 1 -- 172.21.15.90:0/2437202605 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73f400e180 con 0x7f73f4007210 2023-06-09T04:43:04.278 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.274+0000 7f73fffff700 1 -- 172.21.15.90:0/2437202605 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73f400e2c0 con 0x7f73f4005c60 2023-06-09T04:43:04.278 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.274+0000 7f740cf94700 1 --2- 172.21.15.90:0/2437202605 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f73f4006570 0x7f73f4006a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:43:04.279 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.274+0000 7f740d795700 1 --2- 172.21.15.90:0/2437202605 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f73f4005c60 0x7f73f4006030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:43:04.280 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.274+0000 7f740df96700 1 --2- 172.21.15.90:0/2437202605 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f73f4007210 0x7f73f400dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:43:04.280 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.274+0000 7f740cf94700 1 -- 172.21.15.90:0/2437202605 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f73f4005c60 msgr2=0x7f73f4006030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:43:04.280 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.274+0000 7f740cf94700 1 --2- 172.21.15.90:0/2437202605 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f73f4005c60 0x7f73f4006030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:43:04.280 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.274+0000 7f740cf94700 1 -- 172.21.15.90:0/2437202605 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f73f4007210 msgr2=0x7f73f400dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:43:04.280 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.274+0000 7f740cf94700 1 --2- 172.21.15.90:0/2437202605 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f73f4007210 0x7f73f400dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:43:04.280 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.274+0000 7f740cf94700 1 -- 172.21.15.90:0/2437202605 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73f40057e0 con 0x7f73f4006570 2023-06-09T04:43:04.280 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.274+0000 7f740d795700 1 --2- 172.21.15.90:0/2437202605 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f73f4005c60 0x7f73f4006030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:43:04.281 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.274+0000 7f740cf94700 1 --2- 172.21.15.90:0/2437202605 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f73f4006570 0x7f73f4006a80 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f73f80019a0 tx=0x7f73f4007ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3fa158ddf555f62 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:43:04.281 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.274+0000 7f73fffff700 1 -- 172.21.15.90:0/2437202605 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73f8001440 con 0x7f73f4006570 2023-06-09T04:43:04.281 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.274+0000 7f73fffff700 1 -- 172.21.15.90:0/2437202605 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73f8006aa0 con 0x7f73f4006570 2023-06-09T04:43:04.281 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.274+0000 7f73fffff700 1 -- 172.21.15.90:0/2437202605 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73f8006e50 con 0x7f73f4006570 2023-06-09T04:43:04.281 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.278+0000 7f740e797700 1 -- 172.21.15.90:0/2437202605 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f73f4006570 msgr2=0x7f73f4006a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:43:04.281 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.278+0000 7f740e797700 1 --2- 172.21.15.90:0/2437202605 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f73f4006570 0x7f73f4006a80 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f73f80019a0 tx=0x7f73f4007ab0 comp rx=0 tx=0).stop 2023-06-09T04:43:04.281 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.278+0000 7f740df96700 1 -- 172.21.15.90:0/2437202605 reap_dead start 2023-06-09T04:43:04.281 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.278+0000 7f740e797700 1 -- 172.21.15.90:0/2437202605 shutdown_connections 2023-06-09T04:43:04.282 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.278+0000 7f740e797700 1 -- 172.21.15.90:0/2437202605 >> 172.21.15.90:0/2437202605 conn(0x7f740806c690 msgr2=0x7f74080aff00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:43:04.282 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.278+0000 7f740e797700 1 -- 172.21.15.90:0/2437202605 shutdown_connections 2023-06-09T04:43:04.282 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.278+0000 7f740e797700 1 -- 172.21.15.90:0/2437202605 wait complete. 2023-06-09T04:43:04.282 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.278+0000 7f740e797700 1 Processor -- start 2023-06-09T04:43:04.283 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.278+0000 7f740e797700 1 -- start start 2023-06-09T04:43:04.284 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.282+0000 7f740e797700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f73f4006570 0x7f74081ed5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:43:04.284 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.282+0000 7f740e797700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f740814b680 0x7f740814cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:43:04.284 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.282+0000 7f740e797700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7408140e60 0x7f74080b2b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:43:04.284 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.282+0000 7f740e797700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f740814baf0 con 0x7f73f4006570 2023-06-09T04:43:04.284 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.282+0000 7f740e797700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f740814bdd0 con 0x7f7408140e60 2023-06-09T04:43:04.285 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.282+0000 7f740e797700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f740814c0b0 con 0x7f740814b680 2023-06-09T04:43:04.285 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.282+0000 7f740d795700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f73f4006570 0x7f74081ed5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:43:04.286 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.282+0000 7f740d795700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f73f4006570 0x7f74081ed5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:44492/0 (socket says 172.21.15.90:44492) 2023-06-09T04:43:04.286 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.282+0000 7f740d795700 1 -- 172.21.15.90:0/202698095 learned_addr learned my addr 172.21.15.90:0/202698095 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:43:04.286 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.282+0000 7f740cf94700 1 --2- 172.21.15.90:0/202698095 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f740814b680 0x7f740814cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:43:04.286 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.282+0000 7f740df96700 1 --2- 172.21.15.90:0/202698095 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7408140e60 0x7f74080b2b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:43:04.286 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.282+0000 7f740d795700 1 -- 172.21.15.90:0/202698095 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f740814b680 msgr2=0x7f740814cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:43:04.287 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.282+0000 7f740d795700 1 --2- 172.21.15.90:0/202698095 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f740814b680 0x7f740814cb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:43:04.287 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.282+0000 7f740d795700 1 -- 172.21.15.90:0/202698095 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7408140e60 msgr2=0x7f74080b2b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:43:04.287 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.282+0000 7f740d795700 1 --2- 172.21.15.90:0/202698095 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7408140e60 0x7f74080b2b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:43:04.287 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.282+0000 7f740d795700 1 -- 172.21.15.90:0/202698095 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f740814c390 con 0x7f73f4006570 2023-06-09T04:43:04.287 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.282+0000 7f740d795700 1 --2- 172.21.15.90:0/202698095 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f73f4006570 0x7f74081ed5f0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f74040101c0 tx=0x7f7404010580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:43:04.287 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.282+0000 7f73fdffb700 1 -- 172.21.15.90:0/202698095 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f740400e050 con 0x7f73f4006570 2023-06-09T04:43:04.287 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.282+0000 7f73fdffb700 1 -- 172.21.15.90:0/202698095 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f740400f040 con 0x7f73f4006570 2023-06-09T04:43:04.287 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.282+0000 7f740e797700 1 -- 172.21.15.90:0/202698095 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f740814c670 con 0x7f73f4006570 2023-06-09T04:43:04.288 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.282+0000 7f73fdffb700 1 -- 172.21.15.90:0/202698095 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7404003c60 con 0x7f73f4006570 2023-06-09T04:43:04.288 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.282+0000 7f740e797700 1 -- 172.21.15.90:0/202698095 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f740814d0d0 con 0x7f73f4006570 2023-06-09T04:43:04.289 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.286+0000 7f73fdffb700 1 -- 172.21.15.90:0/202698095 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7404004020 con 0x7f73f4006570 2023-06-09T04:43:04.291 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.286+0000 7f7412c7a740 1 Processor -- start 2023-06-09T04:43:04.291 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.290+0000 7f73fdffb700 1 --2- 172.21.15.90:0/202698095 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f73ec0662f0 0x7f73ec0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:43:04.291 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.290+0000 7f7412c7a740 1 -- start start 2023-06-09T04:43:04.291 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.290+0000 7f73fdffb700 1 -- 172.21.15.90:0/202698095 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7404084a80 con 0x7f73f4006570 2023-06-09T04:43:04.292 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.290+0000 7f740df96700 1 --2- 172.21.15.90:0/202698095 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f73ec0662f0 0x7f73ec0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:43:04.292 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.290+0000 7f7412c7a740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0xc51eb0 0xec0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:43:04.293 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.290+0000 7f7412c7a740 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0xc51ae0 0xec1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:43:04.293 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.290+0000 7f7412c7a740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0xc51710 0xf072b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:43:04.293 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.290+0000 7f7412c7a740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0xe50ee0 con 0xc51eb0 2023-06-09T04:43:04.293 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.290+0000 7f7412c7a740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0xdde690 con 0xc51710 2023-06-09T04:43:04.293 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.290+0000 7f7412c7a740 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0xe31340 con 0xc51ae0 2023-06-09T04:43:04.294 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.290+0000 7f740d795700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0xc51eb0 0xec0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:43:04.295 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.290+0000 7f740d795700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0xc51eb0 0xec0ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:44496/0 (socket says 172.21.15.90:44496) 2023-06-09T04:43:04.295 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.290+0000 7f740d795700 1 -- 172.21.15.90:0/214796890 learned_addr learned my addr 172.21.15.90:0/214796890 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:43:04.295 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.290+0000 7f740cf94700 1 --2- 172.21.15.90:0/214796890 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0xc51ae0 0xec1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:43:04.295 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.290+0000 7f740df96700 1 --2- 172.21.15.90:0/214796890 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0xc51710 0xf072b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:43:04.295 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.290+0000 7f740df96700 1 --2- 172.21.15.90:0/202698095 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f73ec0662f0 0x7f73ec0687a0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f740806f2a0 tx=0x7f7400009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:43:04.295 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.290+0000 7f740d795700 1 -- 172.21.15.90:0/214796890 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0xc51ae0 msgr2=0xec1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:43:04.295 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.290+0000 7f740d795700 1 --2- 172.21.15.90:0/214796890 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0xc51ae0 0xec1420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:43:04.296 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.290+0000 7f740d795700 1 -- 172.21.15.90:0/214796890 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0xc51710 msgr2=0xf072b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:43:04.296 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.290+0000 7f740d795700 1 --2- 172.21.15.90:0/214796890 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0xc51710 0xf072b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:43:04.296 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.290+0000 7f740d795700 1 -- 172.21.15.90:0/214796890 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0xddc9a0 con 0xc51eb0 2023-06-09T04:43:04.296 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.290+0000 7f740d795700 1 --2- 172.21.15.90:0/214796890 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0xc51eb0 0xec0ee0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f740405d940 tx=0x7f74040554f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24bfb826baa7979f server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:43:04.296 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.290+0000 7f73f2ffd700 1 -- 172.21.15.90:0/214796890 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7404053bd0 con 0xc51eb0 2023-06-09T04:43:04.296 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.290+0000 7f73f2ffd700 1 -- 172.21.15.90:0/214796890 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7404053e30 con 0xc51eb0 2023-06-09T04:43:04.296 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.290+0000 7f73f2ffd700 1 -- 172.21.15.90:0/214796890 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7404054f80 con 0xc51eb0 2023-06-09T04:43:04.297 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.294+0000 7f7412c7a740 1 -- 172.21.15.90:0/214796890 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0xc51eb0 msgr2=0xec0ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:43:04.297 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.294+0000 7f7412c7a740 1 --2- 172.21.15.90:0/214796890 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0xc51eb0 0xec0ee0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f740405d940 tx=0x7f74040554f0 comp rx=0 tx=0).stop 2023-06-09T04:43:04.298 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.294+0000 7f7412c7a740 1 -- 172.21.15.90:0/214796890 shutdown_connections 2023-06-09T04:43:04.298 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.294+0000 7f7412c7a740 1 --2- 172.21.15.90:0/214796890 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0xc51710 0xf072b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:43:04.298 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.294+0000 7f7412c7a740 1 --2- 172.21.15.90:0/214796890 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0xc51ae0 0xec1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:43:04.298 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.294+0000 7f7412c7a740 1 --2- 172.21.15.90:0/214796890 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0xc51eb0 0xec0ee0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:43:04.298 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.294+0000 7f7412c7a740 1 -- 172.21.15.90:0/214796890 >> 172.21.15.90:0/214796890 conn(0xebbd10 msgr2=0xeedf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:43:04.298 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.294+0000 7f7412c7a740 1 -- 172.21.15.90:0/214796890 shutdown_connections 2023-06-09T04:43:04.298 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.294+0000 7f7412c7a740 1 -- 172.21.15.90:0/214796890 wait complete. 2023-06-09T04:43:04.298 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.294+0000 7f7412c7a740 1 -- start start 2023-06-09T04:43:04.299 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.294+0000 7f7412c7a740 1 Processor -- start 2023-06-09T04:43:04.300 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.294+0000 7f7412c7a740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0xc51710 0xeef1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:43:04.300 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.294+0000 7f7412c7a740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0xc51ae0 0xf110a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:43:04.300 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.294+0000 7f7412c7a740 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0xc51eb0 0xeeace0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:43:04.300 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.294+0000 7f7412c7a740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0xe2a5a0 con 0xc51710 2023-06-09T04:43:04.300 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.294+0000 7f7412c7a740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0xdecf20 con 0xc51ae0 2023-06-09T04:43:04.300 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.294+0000 7f7412c7a740 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0xdeb890 con 0xc51eb0 2023-06-09T04:43:04.300 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.294+0000 7f7412c7a740 10 client.0 _ll_register_callbacks cb 0xe7d7d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-06-09T04:43:04.301 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.298+0000 7f740d795700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0xc51710 0xeef1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:43:04.301 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.298+0000 7f740d795700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0xc51710 0xeef1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:44502/0 (socket says 172.21.15.90:44502) 2023-06-09T04:43:04.301 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.298+0000 7f740d795700 1 -- 172.21.15.90:0/1495650640 learned_addr learned my addr 172.21.15.90:0/1495650640 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:43:04.301 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.298+0000 7f740cf94700 1 --2- 172.21.15.90:0/1495650640 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0xc51ae0 0xf110a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:43:04.301 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.298+0000 7f740df96700 1 --2- 172.21.15.90:0/1495650640 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0xc51eb0 0xeeace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:43:04.301 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.298+0000 7f740d795700 1 -- 172.21.15.90:0/1495650640 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0xc51eb0 msgr2=0xeeace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:43:04.301 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.298+0000 7f740d795700 1 --2- 172.21.15.90:0/1495650640 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0xc51eb0 0xeeace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:43:04.302 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.298+0000 7f740d795700 1 -- 172.21.15.90:0/1495650640 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0xc51ae0 msgr2=0xf110a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:43:04.302 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.298+0000 7f740d795700 1 --2- 172.21.15.90:0/1495650640 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0xc51ae0 0xf110a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:43:04.302 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.298+0000 7f740d795700 1 -- 172.21.15.90:0/1495650640 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f740814d0d0 con 0xc51710 2023-06-09T04:43:04.303 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.298+0000 7f740d795700 1 --2- 172.21.15.90:0/1495650640 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0xc51710 0xeef1c0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f7404058010 tx=0x7f7404058040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5809ed1c07353eff server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:43:04.303 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.298+0000 7f73e7fff700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2023-06-09T04:43:04.303 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.298+0000 7f73e7fff700 1 -- 172.21.15.90:0/1495650640 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7404077070 con 0xc51710 2023-06-09T04:43:04.304 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.298+0000 7f7412c7a740 1 -- 172.21.15.90:0/1495650640 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0xe23580 con 0xc51710 2023-06-09T04:43:04.304 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.298+0000 7f73e7fff700 1 -- 172.21.15.90:0/1495650640 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f740406d210 con 0xc51710 2023-06-09T04:43:04.304 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.298+0000 7f73e7fff700 1 -- 172.21.15.90:0/1495650640 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7f740405d9e0 con 0xc51710 2023-06-09T04:43:04.304 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.298+0000 7f7412c7a740 10 client.5307 fetch_fsmap learned FSMap version 15 2023-06-09T04:43:04.304 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.298+0000 7f7412c7a740 1 -- 172.21.15.90:0/1495650640 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0xc9d9e0 con 0xc51710 2023-06-09T04:43:04.304 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.298+0000 7f73e7fff700 1 -- 172.21.15.90:0/1495650640 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0xe23580 con 0xc51710 2023-06-09T04:43:04.304 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.298+0000 7f73e7fff700 1 -- 172.21.15.90:0/1495650640 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 15) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f740407a020 con 0xc51710 2023-06-09T04:43:04.305 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.298+0000 7f7412c7a740 10 client.5307 fetch_fsmap finished waiting for FSMap version 15 2023-06-09T04:43:04.305 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.298+0000 7f7412c7a740 10 client.5307 resolve_mds: resolved name 'c' to daemon mds.c 2023-06-09T04:43:04.305 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.298+0000 7f7412c7a740 20 client.5307 populate_metadata read hostname 'smithi090' 2023-06-09T04:43:04.305 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.298+0000 7f7412c7a740 1 --2- 172.21.15.90:0/1495650640 >> [v2:172.21.15.90:6834/1290764843,v1:172.21.15.90:6835/1290764843] conn(0xc9c790 0xf120a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:43:04.305 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.298+0000 7f7412c7a740 4 client.5307 mds_command: new command op to 5124 tid=0[{"prefix": "get_command_descriptions"}] 2023-06-09T04:43:04.305 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.298+0000 7f7412c7a740 1 -- 172.21.15.90:0/1495650640 --> [v2:172.21.15.90:6834/1290764843,v1:172.21.15.90:6835/1290764843] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0xe232a0 con 0xc9c790 2023-06-09T04:43:04.305 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.298+0000 7f740cf94700 1 --2- 172.21.15.90:0/1495650640 >> [v2:172.21.15.90:6834/1290764843,v1:172.21.15.90:6835/1290764843] conn(0xc9c790 0xf120a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:43:04.305 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.298+0000 7f73e7fff700 10 client.5307 ms_handle_connect on v2:172.21.15.90:6834/1290764843 2023-06-09T04:43:04.306 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.298+0000 7f740cf94700 1 --2- 172.21.15.90:0/1495650640 >> [v2:172.21.15.90:6834/1290764843,v1:172.21.15.90:6835/1290764843] conn(0xc9c790 0xf120a0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bcfc9eabe63ab0d server_cookie=9b1b9d79f7935de9 in_seq=0 out_seq=0 2023-06-09T04:43:04.306 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.302+0000 7f73e7fff700 1 -- 172.21.15.90:0/1495650640 <== mds.0 v2:172.21.15.90:6834/1290764843 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0xe232a0 con 0xc9c790 2023-06-09T04:43:04.307 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.302+0000 7f73e7fff700 10 client.5307 handle_command_reply: tid=0 2023-06-09T04:43:04.307 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.302+0000 7f7412c7a740 1 client.5307 shutdown 2023-06-09T04:43:04.307 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.302+0000 7f7412c7a740 1 -- 172.21.15.90:0/1495650640 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0xc51710 msgr2=0xeef1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:43:04.307 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.302+0000 7f7412c7a740 1 --2- 172.21.15.90:0/1495650640 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0xc51710 0xeef1c0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f7404058010 tx=0x7f7404058040 comp rx=0 tx=0).stop 2023-06-09T04:43:04.307 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.302+0000 7f7412c7a740 1 -- 172.21.15.90:0/1495650640 shutdown_connections 2023-06-09T04:43:04.307 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.302+0000 7f7412c7a740 1 --2- 172.21.15.90:0/1495650640 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0xc51eb0 0xeeace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:43:04.307 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.302+0000 7f7412c7a740 1 --2- 172.21.15.90:0/1495650640 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0xc51ae0 0xf110a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:43:04.308 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.302+0000 7f7412c7a740 1 --2- 172.21.15.90:0/1495650640 >> [v2:172.21.15.90:6834/1290764843,v1:172.21.15.90:6835/1290764843] conn(0xc9c790 0xf120a0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:43:04.308 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.302+0000 7f7412c7a740 1 --2- 172.21.15.90:0/1495650640 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0xc51710 0xeef1c0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:43:04.308 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.302+0000 7f73e7fff700 0 client.5307 ms_handle_reset on v2:172.21.15.90:6834/1290764843 2023-06-09T04:43:04.308 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.302+0000 7f7412c7a740 1 -- 172.21.15.90:0/1495650640 >> 172.21.15.90:0/1495650640 conn(0xebbd10 msgr2=0xec05d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:43:04.308 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.302+0000 7f7412c7a740 1 -- 172.21.15.90:0/1495650640 shutdown_connections 2023-06-09T04:43:04.308 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.302+0000 7f7412c7a740 1 -- 172.21.15.90:0/1495650640 wait complete. 2023-06-09T04:43:04.308 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.302+0000 7f7412c7a740 20 client.5307 trim_cache size 0 max 16384 2023-06-09T04:43:04.325 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.322+0000 7f7412c7a740 1 Processor -- start 2023-06-09T04:43:04.325 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.322+0000 7f7412c7a740 1 -- start start 2023-06-09T04:43:04.326 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.322+0000 7f7412c7a740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0xc51710 0xf1a850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:43:04.326 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.322+0000 7f7412c7a740 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0xc51ae0 0xf02860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:43:04.327 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.322+0000 7f7412c7a740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0xc51eb0 0xf02da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:43:04.327 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.322+0000 7f7412c7a740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0xcd6b20 con 0xc51710 2023-06-09T04:43:04.327 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.322+0000 7f7412c7a740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0xe29430 con 0xc51eb0 2023-06-09T04:43:04.327 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.322+0000 7f7412c7a740 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0xdf6f70 con 0xc51ae0 2023-06-09T04:43:04.327 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.326+0000 7f740d795700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0xc51710 0xf1a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:43:04.328 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.326+0000 7f740cf94700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0xc51ae0 0xf02860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:43:04.328 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.326+0000 7f740cf94700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0xc51ae0 0xf02860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.90:47024/0 (socket says 172.21.15.90:47024) 2023-06-09T04:43:04.328 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.326+0000 7f740cf94700 1 -- 172.21.15.90:0/2565761331 learned_addr learned my addr 172.21.15.90:0/2565761331 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:43:04.328 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.326+0000 7f740df96700 1 --2- 172.21.15.90:0/2565761331 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0xc51eb0 0xf02da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:43:04.329 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.326+0000 7f740cf94700 1 -- 172.21.15.90:0/2565761331 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0xc51eb0 msgr2=0xf02da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:43:04.329 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.326+0000 7f740cf94700 1 --2- 172.21.15.90:0/2565761331 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0xc51eb0 0xf02da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:43:04.329 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.326+0000 7f740cf94700 1 -- 172.21.15.90:0/2565761331 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0xc51710 msgr2=0xf1a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:43:04.329 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.326+0000 7f740cf94700 1 --2- 172.21.15.90:0/2565761331 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0xc51710 0xf1a850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:43:04.329 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.326+0000 7f740cf94700 1 -- 172.21.15.90:0/2565761331 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74080b33e0 con 0xc51ae0 2023-06-09T04:43:04.329 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.326+0000 7f740cf94700 1 --2- 172.21.15.90:0/2565761331 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0xc51ae0 0xf02860 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f73f8007000 tx=0x7f73f8009030 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9e5ff3ac6170235c server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:43:04.329 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.326+0000 7f73f37fe700 1 -- 172.21.15.90:0/2565761331 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73f8022040 con 0xc51ae0 2023-06-09T04:43:04.330 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.326+0000 7f73f37fe700 1 -- 172.21.15.90:0/2565761331 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73f8023040 con 0xc51ae0 2023-06-09T04:43:04.330 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.326+0000 7f73f37fe700 1 -- 172.21.15.90:0/2565761331 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73f802ac40 con 0xc51ae0 2023-06-09T04:43:04.330 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.326+0000 7f7412c7a740 1 -- 172.21.15.90:0/2565761331 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0xc51ae0 msgr2=0xf02860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:43:04.331 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.326+0000 7f7412c7a740 1 --2- 172.21.15.90:0/2565761331 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0xc51ae0 0xf02860 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f73f8007000 tx=0x7f73f8009030 comp rx=0 tx=0).stop 2023-06-09T04:43:04.331 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.326+0000 7f7412c7a740 1 -- 172.21.15.90:0/2565761331 shutdown_connections 2023-06-09T04:43:04.331 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.326+0000 7f7412c7a740 1 --2- 172.21.15.90:0/2565761331 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0xc51eb0 0xf02da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:43:04.331 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.326+0000 7f7412c7a740 1 --2- 172.21.15.90:0/2565761331 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0xc51ae0 0xf02860 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:43:04.331 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.326+0000 7f7412c7a740 1 --2- 172.21.15.90:0/2565761331 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0xc51710 0xf1a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:43:04.331 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.326+0000 7f7412c7a740 1 -- 172.21.15.90:0/2565761331 >> 172.21.15.90:0/2565761331 conn(0xebbd10 msgr2=0xf1a140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:43:04.331 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.326+0000 7f7412c7a740 1 -- 172.21.15.90:0/2565761331 shutdown_connections 2023-06-09T04:43:04.332 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.326+0000 7f7412c7a740 1 -- 172.21.15.90:0/2565761331 wait complete. 2023-06-09T04:43:04.332 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.326+0000 7f7412c7a740 1 -- start start 2023-06-09T04:43:04.332 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.326+0000 7f7412c7a740 1 Processor -- start 2023-06-09T04:43:04.333 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.330+0000 7f7412c7a740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0xc51710 0xf21ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:43:04.333 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.330+0000 7f7412c7a740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0xc51ae0 0xf70a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:43:04.333 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.330+0000 7f7412c7a740 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0xc51eb0 0xf206f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:43:04.333 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.330+0000 7f7412c7a740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0xe23b20 con 0xc51ae0 2023-06-09T04:43:04.333 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.330+0000 7f7412c7a740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0xf11b10 con 0xc51710 2023-06-09T04:43:04.334 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.330+0000 7f7412c7a740 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0xdeafe0 con 0xc51eb0 2023-06-09T04:43:04.334 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.330+0000 7f7412c7a740 10 client.0 _ll_register_callbacks cb 0xe29170 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-06-09T04:43:04.334 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.330+0000 7f740cf94700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0xc51ae0 0xf70a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:43:04.334 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.330+0000 7f740cf94700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0xc51ae0 0xf70a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:44530/0 (socket says 172.21.15.90:44530) 2023-06-09T04:43:04.334 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.330+0000 7f740cf94700 1 -- 172.21.15.90:0/3976565188 learned_addr learned my addr 172.21.15.90:0/3976565188 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:43:04.334 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.330+0000 7f740d795700 1 --2- 172.21.15.90:0/3976565188 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0xc51710 0xf21ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:43:04.334 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.330+0000 7f740df96700 1 --2- 172.21.15.90:0/3976565188 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0xc51eb0 0xf206f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:43:04.335 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.330+0000 7f740cf94700 1 -- 172.21.15.90:0/3976565188 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0xc51eb0 msgr2=0xf206f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:43:04.335 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.330+0000 7f740cf94700 1 --2- 172.21.15.90:0/3976565188 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0xc51eb0 0xf206f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:43:04.335 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.330+0000 7f740cf94700 1 -- 172.21.15.90:0/3976565188 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0xc51710 msgr2=0xf21ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:43:04.335 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.330+0000 7f740cf94700 1 --2- 172.21.15.90:0/3976565188 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0xc51710 0xf21ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:43:04.335 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.330+0000 7f740cf94700 1 -- 172.21.15.90:0/3976565188 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73f40057e0 con 0xc51ae0 2023-06-09T04:43:04.336 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.330+0000 7f740cf94700 1 --2- 172.21.15.90:0/3976565188 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0xc51ae0 0xf70a40 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f73f8007dd0 tx=0x7f73f800f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab8d461ae1b9555 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:43:04.337 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.330+0000 7f73e7fff700 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2023-06-09T04:43:04.337 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.330+0000 7f73e7fff700 1 -- 172.21.15.90:0/3976565188 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73f8022070 con 0xc51ae0 2023-06-09T04:43:04.337 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.330+0000 7f7412c7a740 1 -- 172.21.15.90:0/3976565188 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7404053e30 con 0xc51ae0 2023-06-09T04:43:04.337 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.330+0000 7f73e7fff700 1 -- 172.21.15.90:0/3976565188 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f73f802ac40 con 0xc51ae0 2023-06-09T04:43:04.337 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.330+0000 7f73e7fff700 1 -- 172.21.15.90:0/3976565188 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7f73f802ae00 con 0xc51ae0 2023-06-09T04:43:04.337 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.330+0000 7f7412c7a740 10 client.5313 fetch_fsmap learned FSMap version 15 2023-06-09T04:43:04.337 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.330+0000 7f7412c7a740 1 -- 172.21.15.90:0/3976565188 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0xdf0670 con 0xc51ae0 2023-06-09T04:43:04.338 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.330+0000 7f73e7fff700 1 -- 172.21.15.90:0/3976565188 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7404053e30 con 0xc51ae0 2023-06-09T04:43:04.338 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.330+0000 7f73e7fff700 1 -- 172.21.15.90:0/3976565188 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 15) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f73f8005090 con 0xc51ae0 2023-06-09T04:43:04.338 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.330+0000 7f7412c7a740 10 client.5313 fetch_fsmap finished waiting for FSMap version 15 2023-06-09T04:43:04.338 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.330+0000 7f7412c7a740 10 client.5313 resolve_mds: resolved name 'c' to daemon mds.c 2023-06-09T04:43:04.338 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.330+0000 7f7412c7a740 20 client.5313 populate_metadata read hostname 'smithi090' 2023-06-09T04:43:04.338 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.330+0000 7f7412c7a740 1 --2- 172.21.15.90:0/3976565188 >> [v2:172.21.15.90:6834/1290764843,v1:172.21.15.90:6835/1290764843] conn(0xf5a7f0 0xf5abc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:43:04.338 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.334+0000 7f7412c7a740 4 client.5313 mds_command: new command op to 5124 tid=0[{"prefix": "status"}] 2023-06-09T04:43:04.338 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.334+0000 7f7412c7a740 1 -- 172.21.15.90:0/3976565188 --> [v2:172.21.15.90:6834/1290764843,v1:172.21.15.90:6835/1290764843] -- command(tid 0: {"prefix": "status"}) v1 -- 0xca94e0 con 0xf5a7f0 2023-06-09T04:43:04.339 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.334+0000 7f740d795700 1 --2- 172.21.15.90:0/3976565188 >> [v2:172.21.15.90:6834/1290764843,v1:172.21.15.90:6835/1290764843] conn(0xf5a7f0 0xf5abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:43:04.339 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.334+0000 7f73e7fff700 10 client.5313 ms_handle_connect on v2:172.21.15.90:6834/1290764843 2023-06-09T04:43:04.339 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.334+0000 7f740d795700 1 --2- 172.21.15.90:0/3976565188 >> [v2:172.21.15.90:6834/1290764843,v1:172.21.15.90:6835/1290764843] conn(0xf5a7f0 0xf5abc0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=80697f801abfaa43 server_cookie=a2229a6a9307d5c9 in_seq=0 out_seq=0 2023-06-09T04:43:04.339 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.334+0000 7f73e7fff700 1 -- 172.21.15.90:0/3976565188 <== mds.0 v2:172.21.15.90:6834/1290764843 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0xca94e0 con 0xf5a7f0 2023-06-09T04:43:04.339 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.334+0000 7f73e7fff700 10 client.5313 handle_command_reply: tid=0 2023-06-09T04:43:04.339 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.334+0000 7f7412c7a740 1 client.5313 shutdown 2023-06-09T04:43:04.340 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.334+0000 7f7412c7a740 1 -- 172.21.15.90:0/3976565188 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0xc51ae0 msgr2=0xf70a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:43:04.340 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.334+0000 7f7412c7a740 1 --2- 172.21.15.90:0/3976565188 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0xc51ae0 0xf70a40 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f73f8007dd0 tx=0x7f73f800f000 comp rx=0 tx=0).stop 2023-06-09T04:43:04.340 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.334+0000 7f7412c7a740 1 -- 172.21.15.90:0/3976565188 shutdown_connections 2023-06-09T04:43:04.341 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.334+0000 7f7412c7a740 1 --2- 172.21.15.90:0/3976565188 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0xc51eb0 0xf206f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:43:04.341 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.334+0000 7f7412c7a740 1 --2- 172.21.15.90:0/3976565188 >> [v2:172.21.15.90:6834/1290764843,v1:172.21.15.90:6835/1290764843] conn(0xf5a7f0 0xf5abc0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:43:04.341 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.334+0000 7f7412c7a740 1 --2- 172.21.15.90:0/3976565188 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0xc51ae0 0xf70a40 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:43:04.341 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.334+0000 7f7412c7a740 1 --2- 172.21.15.90:0/3976565188 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0xc51710 0xf21ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:43:04.341 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.334+0000 7f73e7fff700 0 client.5313 ms_handle_reset on v2:172.21.15.90:6834/1290764843 2023-06-09T04:43:04.341 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.334+0000 7f7412c7a740 1 -- 172.21.15.90:0/3976565188 >> 172.21.15.90:0/3976565188 conn(0xebbd10 msgr2=0xf12930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:43:04.341 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.334+0000 7f7412c7a740 1 -- 172.21.15.90:0/3976565188 shutdown_connections 2023-06-09T04:43:04.342 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.334+0000 7f7412c7a740 1 -- 172.21.15.90:0/3976565188 wait complete. 2023-06-09T04:43:04.342 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.334+0000 7f7412c7a740 20 client.5313 trim_cache size 0 max 16384 2023-06-09T04:43:04.342 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2023-06-09T04:43:04.342 INFO:teuthology.orchestra.run.smithi090.stdout: "cluster_fsid": "700369c0-a111-43b4-9415-844ad1742b70", 2023-06-09T04:43:04.342 INFO:teuthology.orchestra.run.smithi090.stdout: "whoami": 0, 2023-06-09T04:43:04.342 INFO:teuthology.orchestra.run.smithi090.stdout: "id": 5124, 2023-06-09T04:43:04.343 INFO:teuthology.orchestra.run.smithi090.stdout: "want_state": "up:active", 2023-06-09T04:43:04.343 INFO:teuthology.orchestra.run.smithi090.stdout: "state": "up:active", 2023-06-09T04:43:04.343 INFO:teuthology.orchestra.run.smithi090.stdout: "fs_name": "cephfs", 2023-06-09T04:43:04.343 INFO:teuthology.orchestra.run.smithi090.stdout: "rank_uptime": 6.4911678769999996, 2023-06-09T04:43:04.343 INFO:teuthology.orchestra.run.smithi090.stdout: "mdsmap_epoch": 15, 2023-06-09T04:43:04.343 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap_epoch": 38, 2023-06-09T04:43:04.343 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap_epoch_barrier": 38, 2023-06-09T04:43:04.343 INFO:teuthology.orchestra.run.smithi090.stdout: "uptime": 14.753950517 2023-06-09T04:43:04.344 INFO:teuthology.orchestra.run.smithi090.stdout:} 2023-06-09T04:43:04.344 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.334+0000 7f740e797700 1 -- 172.21.15.90:0/202698095 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f73ec0662f0 msgr2=0x7f73ec0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:43:04.345 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.334+0000 7f740e797700 1 --2- 172.21.15.90:0/202698095 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f73ec0662f0 0x7f73ec0687a0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f740806f2a0 tx=0x7f7400009040 comp rx=0 tx=0).stop 2023-06-09T04:43:04.345 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.334+0000 7f740e797700 1 -- 172.21.15.90:0/202698095 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f73f4006570 msgr2=0x7f74081ed5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:43:04.345 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.334+0000 7f740e797700 1 --2- 172.21.15.90:0/202698095 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f73f4006570 0x7f74081ed5f0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f74040101c0 tx=0x7f7404010580 comp rx=0 tx=0).stop 2023-06-09T04:43:04.345 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.338+0000 7f740e797700 1 -- 172.21.15.90:0/202698095 shutdown_connections 2023-06-09T04:43:04.345 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.338+0000 7f740e797700 1 --2- 172.21.15.90:0/202698095 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f73ec0662f0 0x7f73ec0687a0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:43:04.345 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.338+0000 7f740e797700 1 --2- 172.21.15.90:0/202698095 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7408140e60 0x7f74080b2b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:43:04.345 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.338+0000 7f740e797700 1 --2- 172.21.15.90:0/202698095 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f740814b680 0x7f740814cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:43:04.346 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.338+0000 7f740e797700 1 --2- 172.21.15.90:0/202698095 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f73f4006570 0x7f74081ed5f0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:43:04.346 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.338+0000 7f740e797700 1 -- 172.21.15.90:0/202698095 >> 172.21.15.90:0/202698095 conn(0x7f740806c690 msgr2=0x7f7408154500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:43:04.346 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.338+0000 7f740e797700 1 -- 172.21.15.90:0/202698095 shutdown_connections 2023-06-09T04:43:04.346 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.338+0000 7f740e797700 1 -- 172.21.15.90:0/202698095 wait complete. 2023-06-09T04:43:04.359 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-06-09T04:43:04.529 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.526+0000 7fad8b1ec700 1 Processor -- start 2023-06-09T04:43:04.530 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.526+0000 7fad8b1ec700 1 -- start start 2023-06-09T04:43:04.531 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.530+0000 7fad8b1ec700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fad8415e120 0x7fad840c8b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:43:04.532 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.530+0000 7fad8b1ec700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad840cae10 con 0x7fad840ca7a0 2023-06-09T04:43:04.532 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.530+0000 7fad8b1ec700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad840cb0f0 con 0x7fad84154370 2023-06-09T04:43:04.532 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.530+0000 7fad8b1ec700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad840cac00 con 0x7fad8415e120 2023-06-09T04:43:04.533 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.530+0000 7fad89789700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7fad840ca7a0 0x7fad840b3340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:54464/0 (socket says 172.21.15.90:54464) 2023-06-09T04:43:04.533 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.530+0000 7fad89789700 1 -- 172.21.15.90:0/980415712 learned_addr learned my addr 172.21.15.90:0/980415712 (peer_addr_for_me v1:172.21.15.90:0/0) 2023-06-09T04:43:04.534 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.530+0000 7fad7bfff700 1 --2- 172.21.15.90:0/980415712 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fad8415e120 0x7fad840c8b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:43:04.534 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.530+0000 7fad7b7fe700 1 -- 172.21.15.90:0/980415712 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2274953313 0 0) 0x7fad840cae10 con 0x7fad840ca7a0 2023-06-09T04:43:04.534 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.530+0000 7fad7b7fe700 1 -- 172.21.15.90:0/980415712 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad6c0035d0 con 0x7fad840ca7a0 2023-06-09T04:43:04.534 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.530+0000 7fad7b7fe700 1 -- 172.21.15.90:0/980415712 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1304338096 0 0) 0x7fad840cb0f0 con 0x7fad84154370 2023-06-09T04:43:04.534 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.530+0000 7fad7b7fe700 1 -- 172.21.15.90:0/980415712 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad840cae10 con 0x7fad84154370 2023-06-09T04:43:04.535 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.530+0000 7fad7b7fe700 1 -- 172.21.15.90:0/980415712 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3005024328 0 0) 0x7fad6c0035d0 con 0x7fad840ca7a0 2023-06-09T04:43:04.535 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.530+0000 7fad7b7fe700 1 -- 172.21.15.90:0/980415712 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fad8415e120 msgr2=0x7fad840c8b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:43:04.535 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.530+0000 7fad7b7fe700 1 --2- 172.21.15.90:0/980415712 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fad8415e120 0x7fad840c8b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:43:04.535 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.530+0000 7fad7b7fe700 1 -- 172.21.15.90:0/980415712 >> v1:172.21.15.174:6789/0 conn(0x7fad84154370 legacy=0x7fad8415da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:43:04.535 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.530+0000 7fad7b7fe700 1 -- 172.21.15.90:0/980415712 --> v1:172.21.15.90:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad840cb3d0 con 0x7fad840ca7a0 2023-06-09T04:43:04.535 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.530+0000 7fad7b7fe700 1 -- 172.21.15.90:0/980415712 <== mon.0 v1:172.21.15.90:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3604404106 0 0) 0x7fad7c0019f0 con 0x7fad840ca7a0 2023-06-09T04:43:04.535 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.530+0000 7fad7b7fe700 1 -- 172.21.15.90:0/980415712 >> v1:172.21.15.90:6789/0 conn(0x7fad840ca7a0 legacy=0x7fad840b3340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:43:04.535 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.530+0000 7fad7b7fe700 1 --2- 172.21.15.90:0/980415712 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fad6c003be0 0x7fad6c003fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:43:04.536 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.530+0000 7fad7b7fe700 1 --2- 172.21.15.90:0/980415712 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fad6c004870 0x7fad6c004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:43:04.536 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.530+0000 7fad7b7fe700 1 --2- 172.21.15.90:0/980415712 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fad8415e120 0x7fad6c005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:43:04.536 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.530+0000 7fad7b7fe700 1 -- 172.21.15.90:0/980415712 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad840cac00 con 0x7fad6c004870 2023-06-09T04:43:04.536 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.530+0000 7fad7b7fe700 1 -- 172.21.15.90:0/980415712 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad6c00bae0 con 0x7fad6c003be0 2023-06-09T04:43:04.536 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.530+0000 7fad7b7fe700 1 -- 172.21.15.90:0/980415712 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad6c00bc50 con 0x7fad8415e120 2023-06-09T04:43:04.537 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.530+0000 7fad7bfff700 1 --2- 172.21.15.90:0/980415712 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fad6c004870 0x7fad6c004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:43:04.538 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.530+0000 7fad88f88700 1 --2- 172.21.15.90:0/980415712 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fad6c003be0 0x7fad6c003fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:43:04.538 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.530+0000 7fad89789700 1 --2- 172.21.15.90:0/980415712 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fad8415e120 0x7fad6c005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:43:04.538 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.534+0000 7fad7bfff700 1 -- 172.21.15.90:0/980415712 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fad8415e120 msgr2=0x7fad6c005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:43:04.538 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.534+0000 7fad7bfff700 1 --2- 172.21.15.90:0/980415712 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fad8415e120 0x7fad6c005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:43:04.538 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.534+0000 7fad7bfff700 1 -- 172.21.15.90:0/980415712 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fad6c003be0 msgr2=0x7fad6c003fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:43:04.538 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.534+0000 7fad7bfff700 1 --2- 172.21.15.90:0/980415712 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fad6c003be0 0x7fad6c003fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:43:04.538 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.534+0000 7fad7bfff700 1 -- 172.21.15.90:0/980415712 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad6c0035d0 con 0x7fad6c004870 2023-06-09T04:43:04.539 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.534+0000 7fad7bfff700 1 --2- 172.21.15.90:0/980415712 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fad6c004870 0x7fad6c004ce0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fad74009b40 tx=0x7fad6c0058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b903e1f677dca2f server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:43:04.539 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.534+0000 7fad7b7fe700 1 -- 172.21.15.90:0/980415712 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad7400e6c0 con 0x7fad6c004870 2023-06-09T04:43:04.539 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.534+0000 7fad7b7fe700 1 -- 172.21.15.90:0/980415712 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad7400e820 con 0x7fad6c004870 2023-06-09T04:43:04.539 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.534+0000 7fad7b7fe700 1 -- 172.21.15.90:0/980415712 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad7400eb90 con 0x7fad6c004870 2023-06-09T04:43:04.539 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.534+0000 7fad8b1ec700 1 -- 172.21.15.90:0/980415712 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fad6c004870 msgr2=0x7fad6c004ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:43:04.539 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.534+0000 7fad8b1ec700 1 --2- 172.21.15.90:0/980415712 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fad6c004870 0x7fad6c004ce0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fad74009b40 tx=0x7fad6c0058a0 comp rx=0 tx=0).stop 2023-06-09T04:43:04.539 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.534+0000 7fad89789700 1 -- 172.21.15.90:0/980415712 reap_dead start 2023-06-09T04:43:04.539 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.534+0000 7fad8b1ec700 1 -- 172.21.15.90:0/980415712 shutdown_connections 2023-06-09T04:43:04.540 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.534+0000 7fad8b1ec700 1 -- 172.21.15.90:0/980415712 >> 172.21.15.90:0/980415712 conn(0x7fad8406c810 msgr2=0x7fad840b0000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:43:04.540 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.534+0000 7fad8b1ec700 1 -- 172.21.15.90:0/980415712 shutdown_connections 2023-06-09T04:43:04.540 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.534+0000 7fad8b1ec700 1 -- 172.21.15.90:0/980415712 wait complete. 2023-06-09T04:43:04.540 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.538+0000 7fad8b1ec700 1 Processor -- start 2023-06-09T04:43:04.540 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.538+0000 7fad8b1ec700 1 -- start start 2023-06-09T04:43:04.541 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.538+0000 7fad8b1ec700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fad6c004870 0x7fad84152eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:43:04.542 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.538+0000 7fad8b1ec700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fad8415c120 0x7fad8415c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:43:04.542 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.538+0000 7fad8b1ec700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fad8415cba0 0x7fad84159000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:43:04.542 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.538+0000 7fad8b1ec700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad8415d3e0 con 0x7fad6c004870 2023-06-09T04:43:04.542 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.538+0000 7fad8b1ec700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad8415d100 con 0x7fad8415cba0 2023-06-09T04:43:04.542 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.538+0000 7fad8b1ec700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad8415b640 con 0x7fad8415c120 2023-06-09T04:43:04.542 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.538+0000 7fad88f88700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fad6c004870 0x7fad84152eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:43:04.542 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.538+0000 7fad88f88700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fad6c004870 0x7fad84152eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:44542/0 (socket says 172.21.15.90:44542) 2023-06-09T04:43:04.543 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.538+0000 7fad88f88700 1 -- 172.21.15.90:0/799633576 learned_addr learned my addr 172.21.15.90:0/799633576 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:43:04.544 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.538+0000 7fad7bfff700 1 --2- 172.21.15.90:0/799633576 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fad8415c120 0x7fad8415c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:43:04.544 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.538+0000 7fad89789700 1 --2- 172.21.15.90:0/799633576 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fad8415cba0 0x7fad84159000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:43:04.544 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.538+0000 7fad88f88700 1 -- 172.21.15.90:0/799633576 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fad8415c120 msgr2=0x7fad8415c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:43:04.544 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.538+0000 7fad88f88700 1 --2- 172.21.15.90:0/799633576 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fad8415c120 0x7fad8415c660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:43:04.544 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.538+0000 7fad88f88700 1 -- 172.21.15.90:0/799633576 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fad8415cba0 msgr2=0x7fad84159000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:43:04.545 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.538+0000 7fad88f88700 1 --2- 172.21.15.90:0/799633576 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fad8415cba0 0x7fad84159000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:43:04.545 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.538+0000 7fad88f88700 1 -- 172.21.15.90:0/799633576 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad841548c0 con 0x7fad6c004870 2023-06-09T04:43:04.545 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.538+0000 7fad7bfff700 1 --2- 172.21.15.90:0/799633576 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fad8415c120 0x7fad8415c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:43:04.545 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.538+0000 7fad89789700 1 --2- 172.21.15.90:0/799633576 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fad8415cba0 0x7fad84159000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:43:04.545 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.538+0000 7fad88f88700 1 --2- 172.21.15.90:0/799633576 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fad6c004870 0x7fad84152eb0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fad8000f810 tx=0x7fad8000fbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:43:04.545 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.542+0000 7fad797fa700 1 -- 172.21.15.90:0/799633576 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad800052e0 con 0x7fad6c004870 2023-06-09T04:43:04.545 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.542+0000 7fad797fa700 1 -- 172.21.15.90:0/799633576 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad80005440 con 0x7fad6c004870 2023-06-09T04:43:04.545 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.542+0000 7fad8b1ec700 1 -- 172.21.15.90:0/799633576 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad8415b920 con 0x7fad6c004870 2023-06-09T04:43:04.546 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.542+0000 7fad797fa700 1 -- 172.21.15.90:0/799633576 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad800038e0 con 0x7fad6c004870 2023-06-09T04:43:04.546 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.542+0000 7fad8b1ec700 1 -- 172.21.15.90:0/799633576 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad840cdbd0 con 0x7fad6c004870 2023-06-09T04:43:04.546 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.542+0000 7fad8b1ec700 1 -- 172.21.15.90:0/799633576 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad8415b4a0 con 0x7fad6c004870 2023-06-09T04:43:04.547 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.542+0000 7fad797fa700 1 -- 172.21.15.90:0/799633576 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fad80003a40 con 0x7fad6c004870 2023-06-09T04:43:04.548 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.546+0000 7fad797fa700 1 --2- 172.21.15.90:0/799633576 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fad70066320 0x7fad700687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:43:04.548 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.546+0000 7fad797fa700 1 -- 172.21.15.90:0/799633576 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fad80083bd0 con 0x7fad6c004870 2023-06-09T04:43:04.549 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.546+0000 7fad7bfff700 1 --2- 172.21.15.90:0/799633576 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fad70066320 0x7fad700687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:43:04.550 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.546+0000 7fad7bfff700 1 --2- 172.21.15.90:0/799633576 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fad70066320 0x7fad700687d0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fad840afa00 tx=0x7fad74008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:43:04.555 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.550+0000 7fad797fa700 1 -- 172.21.15.90:0/799633576 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fad8415b4a0 con 0x7fad6c004870 2023-06-09T04:43:04.762 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.758+0000 7fad8b1ec700 1 -- 172.21.15.90:0/799633576 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fad8415be40 con 0x7fad6c004870 2023-06-09T04:43:04.763 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.762+0000 7fad797fa700 1 -- 172.21.15.90:0/799633576 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v15) v1 ==== 53+0+73 (secure 0 0 0) 0x7fad8415be40 con 0x7fad6c004870 2023-06-09T04:43:04.763 INFO:teuthology.orchestra.run.smithi090.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-06-09T04:43:04.766 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.762+0000 7fad8b1ec700 1 -- 172.21.15.90:0/799633576 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fad70066320 msgr2=0x7fad700687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:43:04.766 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.762+0000 7fad8b1ec700 1 --2- 172.21.15.90:0/799633576 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fad70066320 0x7fad700687d0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fad840afa00 tx=0x7fad74008030 comp rx=0 tx=0).stop 2023-06-09T04:43:04.766 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.762+0000 7fad8b1ec700 1 -- 172.21.15.90:0/799633576 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fad6c004870 msgr2=0x7fad84152eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:43:04.766 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.762+0000 7fad8b1ec700 1 --2- 172.21.15.90:0/799633576 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fad6c004870 0x7fad84152eb0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fad8000f810 tx=0x7fad8000fbd0 comp rx=0 tx=0).stop 2023-06-09T04:43:04.767 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.762+0000 7fad8b1ec700 1 -- 172.21.15.90:0/799633576 shutdown_connections 2023-06-09T04:43:04.767 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.762+0000 7fad8b1ec700 1 --2- 172.21.15.90:0/799633576 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7fad70066320 0x7fad700687d0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:43:04.767 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.762+0000 7fad8b1ec700 1 --2- 172.21.15.90:0/799633576 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fad8415cba0 0x7fad84159000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:43:04.767 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.762+0000 7fad8b1ec700 1 --2- 172.21.15.90:0/799633576 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fad8415c120 0x7fad8415c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:43:04.768 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.762+0000 7fad8b1ec700 1 --2- 172.21.15.90:0/799633576 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fad6c004870 0x7fad84152eb0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:43:04.768 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.762+0000 7fad8b1ec700 1 -- 172.21.15.90:0/799633576 >> 172.21.15.90:0/799633576 conn(0x7fad8406c810 msgr2=0x7fad840acd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:43:04.768 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.762+0000 7fad8b1ec700 1 -- 172.21.15.90:0/799633576 shutdown_connections 2023-06-09T04:43:04.768 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:04.762+0000 7fad8b1ec700 1 -- 172.21.15.90:0/799633576 wait complete. 2023-06-09T04:43:04.786 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-06-09T04:43:04.787 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-06-09T04:43:04.787 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi090.front.sepia.ceph.com 2023-06-09T04:43:04.787 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-06-09T04:43:04.787 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-06-09T04:43:04.788 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-06-09T04:43:04.788 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-06-09T04:43:04.788 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-06-09T04:43:04.788 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-06-09T04:43:04.789 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:43:04.789 DEBUG:teuthology.orchestra.run.smithi090:> ip addr 2023-06-09T04:43:04.805 INFO:teuthology.orchestra.run.smithi090.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-06-09T04:43:04.805 INFO:teuthology.orchestra.run.smithi090.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-06-09T04:43:04.805 INFO:teuthology.orchestra.run.smithi090.stdout: inet 127.0.0.1/8 scope host lo 2023-06-09T04:43:04.805 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:43:04.806 INFO:teuthology.orchestra.run.smithi090.stdout: inet6 ::1/128 scope host 2023-06-09T04:43:04.806 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:43:04.806 INFO:teuthology.orchestra.run.smithi090.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-09T04:43:04.806 INFO:teuthology.orchestra.run.smithi090.stdout: link/ether 0c:c4:7a:d8:a1:a8 brd ff:ff:ff:ff:ff:ff 2023-06-09T04:43:04.806 INFO:teuthology.orchestra.run.smithi090.stdout: altname enp7s0f0 2023-06-09T04:43:04.806 INFO:teuthology.orchestra.run.smithi090.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-09T04:43:04.806 INFO:teuthology.orchestra.run.smithi090.stdout: link/ether 0c:c4:7a:d8:a1:a9 brd ff:ff:ff:ff:ff:ff 2023-06-09T04:43:04.806 INFO:teuthology.orchestra.run.smithi090.stdout: altname enp7s0f1 2023-06-09T04:43:04.807 INFO:teuthology.orchestra.run.smithi090.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-09T04:43:04.807 INFO:teuthology.orchestra.run.smithi090.stdout: link/ether 0c:c4:7a:8f:d7:66 brd ff:ff:ff:ff:ff:ff 2023-06-09T04:43:04.807 INFO:teuthology.orchestra.run.smithi090.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-06-09T04:43:04.807 INFO:teuthology.orchestra.run.smithi090.stdout: link/ether 0c:c4:7a:8f:d7:67 brd ff:ff:ff:ff:ff:ff 2023-06-09T04:43:04.807 INFO:teuthology.orchestra.run.smithi090.stdout: inet 172.21.15.90/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-06-09T04:43:04.807 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft 42348sec preferred_lft 42348sec 2023-06-09T04:43:04.807 INFO:teuthology.orchestra.run.smithi090.stdout: inet6 fe80::ec4:7aff:fe8f:d767/64 scope link 2023-06-09T04:43:04.807 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:43:04.808 INFO:teuthology.orchestra.run.smithi090.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-06-09T04:43:04.808 INFO:teuthology.orchestra.run.smithi090.stdout: link/ether 02:42:ee:21:41:51 brd ff:ff:ff:ff:ff:ff 2023-06-09T04:43:04.808 INFO:teuthology.orchestra.run.smithi090.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-06-09T04:43:04.808 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:43:04.808 INFO:teuthology.orchestra.run.smithi090.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-06-09T04:43:04.808 INFO:teuthology.orchestra.run.smithi090.stdout: link/ether 0e:84:da:f1:3c:6c brd ff:ff:ff:ff:ff:ff 2023-06-09T04:43:04.808 INFO:teuthology.orchestra.run.smithi090.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-06-09T04:43:04.809 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:43:04.809 INFO:teuthology.orchestra.run.smithi090.stdout: inet6 fe80::8cde:dfff:fe51:9c9d/64 scope link 2023-06-09T04:43:04.809 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:43:04.809 INFO:teuthology.orchestra.run.smithi090.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-06-09T04:43:04.809 INFO:teuthology.orchestra.run.smithi090.stdout: link/ether de:ba:21:40:69:32 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-06-09T04:43:04.809 INFO:teuthology.orchestra.run.smithi090.stdout: inet6 fe80::dcba:21ff:fe40:6932/64 scope link 2023-06-09T04:43:04.809 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:43:04.809 INFO:teuthology.orchestra.run.smithi090.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-06-09T04:43:04.810 INFO:teuthology.orchestra.run.smithi090.stdout: link/ether 0e:84:da:f1:3c:6c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-06-09T04:43:04.810 INFO:teuthology.orchestra.run.smithi090.stdout: inet6 fe80::c84:daff:fef1:3c6c/64 scope link 2023-06-09T04:43:04.810 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:43:04.811 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:43:04.811 DEBUG:teuthology.orchestra.run.smithi090:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-06-09T04:43:04.892 INFO:teuthology.orchestra.run.smithi090.stdout:1 2023-06-09T04:43:04.895 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:43:04.895 DEBUG:teuthology.orchestra.run.smithi090:> route 2023-06-09T04:43:04.959 INFO:teuthology.orchestra.run.smithi090.stdout:Kernel IP routing table 2023-06-09T04:43:04.959 INFO:teuthology.orchestra.run.smithi090.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-06-09T04:43:04.959 INFO:teuthology.orchestra.run.smithi090.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-06-09T04:43:04.959 INFO:teuthology.orchestra.run.smithi090.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-06-09T04:43:04.959 INFO:teuthology.orchestra.run.smithi090.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-06-09T04:43:04.959 INFO:teuthology.orchestra.run.smithi090.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2023-06-09T04:43:04.960 INFO:teuthology.orchestra.run.smithi090.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-06-09T04:43:04.960 INFO:teuthology.orchestra.run.smithi090.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-06-09T04:43:04.960 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:43:04.961 DEBUG:teuthology.orchestra.run.smithi090:> (cd / && exec bash -c ' 2023-06-09T04:43:04.961 DEBUG:teuthology.orchestra.run.smithi090:> set -e 2023-06-09T04:43:04.962 DEBUG:teuthology.orchestra.run.smithi090:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-06-09T04:43:04.962 DEBUG:teuthology.orchestra.run.smithi090:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-06-09T04:43:04.962 DEBUG:teuthology.orchestra.run.smithi090:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-06-09T04:43:04.962 DEBUG:teuthology.orchestra.run.smithi090:> ') 2023-06-09T04:43:05.086 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:43:05.086 DEBUG:teuthology.orchestra.run.smithi090:> ip netns list 2023-06-09T04:43:05.104 INFO:teuthology.orchestra.run.smithi090.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-06-09T04:43:05.104 INFO:teuthology.orchestra.run.smithi090.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-06-09T04:43:05.105 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-06-09T04:43:05.105 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:43:05.106 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip link set brx.0 up 2023-06-09T04:43:05.181 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-09T04:43:05.182 DEBUG:teuthology.orchestra.run.smithi090:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-06-09T04:43:05.241 INFO:teuthology.orchestra.run.smithi090.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-06-09T04:43:05.241 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-09T04:43:05.241 DEBUG:teuthology.orchestra.run.smithi090:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-06-09T04:43:05.299 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-06-09T04:43:05.299 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:43:05.299 DEBUG:teuthology.orchestra.run.smithi090:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-06-09T04:43:05.434 INFO:teuthology.orchestra.run.smithi090.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-06-09T04:43:05.434 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-06-09T04:43:05.457 INFO:teuthology.orchestra.run.smithi090.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-06-09T04:43:05.458 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-06-09T04:43:05.458 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: resolved to: "172.21.15.90:3300,172.21.15.174:3300,172.21.15.174:3301" 2023-06-09T04:43:05.458 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: trying mount with new device syntax: 0@700369c0-a111-43b4-9415-844ad1742b70.cephfs=/ 2023-06-09T04:43:05.458 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.90:3300/172.21.15.174:3300/172.21.15.174:3301" will pass to kernel 2023-06-09T04:43:05.465 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-06-09T04:43:05.466 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:43:05.466 DEBUG:teuthology.orchestra.run.smithi090:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-06-09T04:43:05.499 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:43:05.499 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-06-09T04:43:05.580 INFO:teuthology.orchestra.run.smithi090.stdout:client5281 2023-06-09T04:43:05.580 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2023-06-09T04:43:05.581 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-09T04:43:05.639 DEBUG:teuthology.orchestra.run.smithi090:> mktemp -d --suffix=xfstests-dev 2023-06-09T04:43:05.699 INFO:teuthology.orchestra.run.smithi090.stdout:/tmp/tmp.jICg1BPnIbxfstests-dev 2023-06-09T04:43:05.700 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:43:05.700 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo chmod a+rx /tmp/tmp.jICg1BPnIbxfstests-dev) 2023-06-09T04:43:05.780 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:43:05.781 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest/mnt.0 && exec git clone https://git.ceph.com/xfstests-dev.git --depth 1 /tmp/tmp.jICg1BPnIbxfstests-dev) 2023-06-09T04:43:05.853 INFO:teuthology.orchestra.run.smithi090.stderr:Cloning into '/tmp/tmp.jICg1BPnIbxfstests-dev'... 2023-06-09T04:43:06.734 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:43:06.734 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir test) 2023-06-09T04:43:06.812 DEBUG:teuthology.orchestra.run.smithi090:> mktemp -d --suffix=test 2023-06-09T04:43:06.871 INFO:teuthology.orchestra.run.smithi090.stdout:/tmp/tmp.WhlLVkLGHXtest 2023-06-09T04:43:06.871 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:43:06.872 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir scratch) 2023-06-09T04:43:06.941 DEBUG:teuthology.orchestra.run.smithi090:> mktemp -d --suffix=scratch 2023-06-09T04:43:07.000 INFO:teuthology.orchestra.run.smithi090.stdout:/tmp/tmp.dXSIBxNemoscratch 2023-06-09T04:43:07.001 INFO:tasks.cephfs.xfstests_dev:distro and version detected is "ubuntu" and "20.04". 2023-06-09T04:43:07.002 DEBUG:teuthology.orchestra.run.smithi090:> sudo apt-get install -y xfslibs-dev uuid-dev libtool-bin e2fsprogs automake gcc libuuid1 quota attr libattr1-dev make libacl1-dev libaio-dev xfsprogs libgdbm-dev gawk fio dbench uuid-runtime python2 sqlite3 2023-06-09T04:43:07.163 INFO:teuthology.orchestra.run.smithi090.stdout:Reading package lists... 2023-06-09T04:43:07.363 INFO:teuthology.orchestra.run.smithi090.stdout:Building dependency tree... 2023-06-09T04:43:07.364 INFO:teuthology.orchestra.run.smithi090.stdout:Reading state information... 2023-06-09T04:43:07.548 INFO:teuthology.orchestra.run.smithi090.stdout:attr is already the newest version (1:2.4.48-5). 2023-06-09T04:43:07.548 INFO:teuthology.orchestra.run.smithi090.stdout:automake is already the newest version (1:1.16.1-4ubuntu6). 2023-06-09T04:43:07.548 INFO:teuthology.orchestra.run.smithi090.stdout:gawk is already the newest version (1:5.0.1+dfsg-1). 2023-06-09T04:43:07.548 INFO:teuthology.orchestra.run.smithi090.stdout:gcc is already the newest version (4:9.3.0-1ubuntu2). 2023-06-09T04:43:07.548 INFO:teuthology.orchestra.run.smithi090.stdout:gcc set to manually installed. 2023-06-09T04:43:07.549 INFO:teuthology.orchestra.run.smithi090.stdout:libacl1-dev is already the newest version (2.2.53-6). 2023-06-09T04:43:07.549 INFO:teuthology.orchestra.run.smithi090.stdout:libaio-dev is already the newest version (0.3.112-5). 2023-06-09T04:43:07.549 INFO:teuthology.orchestra.run.smithi090.stdout:libattr1-dev is already the newest version (1:2.4.48-5). 2023-06-09T04:43:07.549 INFO:teuthology.orchestra.run.smithi090.stdout:libtool-bin is already the newest version (2.4.6-14). 2023-06-09T04:43:07.549 INFO:teuthology.orchestra.run.smithi090.stdout:make is already the newest version (4.2.1-1.2). 2023-06-09T04:43:07.549 INFO:teuthology.orchestra.run.smithi090.stdout:make set to manually installed. 2023-06-09T04:43:07.549 INFO:teuthology.orchestra.run.smithi090.stdout:quota is already the newest version (4.05-1). 2023-06-09T04:43:07.549 INFO:teuthology.orchestra.run.smithi090.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2023-06-09T04:43:07.550 INFO:teuthology.orchestra.run.smithi090.stdout:xfsprogs is already the newest version (5.3.0-1ubuntu2). 2023-06-09T04:43:07.550 INFO:teuthology.orchestra.run.smithi090.stdout:dbench is already the newest version (4.0-2build1). 2023-06-09T04:43:07.550 INFO:teuthology.orchestra.run.smithi090.stdout:python2 is already the newest version (2.7.17-2ubuntu4). 2023-06-09T04:43:07.550 INFO:teuthology.orchestra.run.smithi090.stdout:python2 set to manually installed. 2023-06-09T04:43:07.550 INFO:teuthology.orchestra.run.smithi090.stdout:e2fsprogs is already the newest version (1.45.5-2ubuntu1.1). 2023-06-09T04:43:07.550 INFO:teuthology.orchestra.run.smithi090.stdout:libuuid1 is already the newest version (2.34-0.1ubuntu9.3). 2023-06-09T04:43:07.550 INFO:teuthology.orchestra.run.smithi090.stdout:uuid-dev is already the newest version (2.34-0.1ubuntu9.3). 2023-06-09T04:43:07.551 INFO:teuthology.orchestra.run.smithi090.stdout:uuid-runtime is already the newest version (2.34-0.1ubuntu9.3). 2023-06-09T04:43:07.551 INFO:teuthology.orchestra.run.smithi090.stdout:The following packages were automatically installed and are no longer required: 2023-06-09T04:43:07.551 INFO:teuthology.orchestra.run.smithi090.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-06-09T04:43:07.551 INFO:teuthology.orchestra.run.smithi090.stdout:Use 'sudo apt autoremove' to remove them. 2023-06-09T04:43:07.552 INFO:teuthology.orchestra.run.smithi090.stdout:The following additional packages will be installed: 2023-06-09T04:43:07.552 INFO:teuthology.orchestra.run.smithi090.stdout: libgfapi0 libgfrpc0 libgfxdr0 libglusterfs0 libsqlite3-0 2023-06-09T04:43:07.552 INFO:teuthology.orchestra.run.smithi090.stdout:Suggested packages: 2023-06-09T04:43:07.552 INFO:teuthology.orchestra.run.smithi090.stdout: gnuplot gfio python-scipy sqlite3-doc 2023-06-09T04:43:07.616 INFO:teuthology.orchestra.run.smithi090.stdout:The following NEW packages will be installed: 2023-06-09T04:43:07.617 INFO:teuthology.orchestra.run.smithi090.stdout: fio libgdbm-dev libgfapi0 libgfrpc0 libgfxdr0 libglusterfs0 sqlite3 2023-06-09T04:43:07.618 INFO:teuthology.orchestra.run.smithi090.stdout:The following packages will be upgraded: 2023-06-09T04:43:07.619 INFO:teuthology.orchestra.run.smithi090.stdout: libsqlite3-0 2023-06-09T04:43:07.685 INFO:teuthology.orchestra.run.smithi090.stdout:1 upgraded, 7 newly installed, 0 to remove and 184 not upgraded. 2023-06-09T04:43:07.685 INFO:teuthology.orchestra.run.smithi090.stdout:Need to get 2,428 kB of archives. 2023-06-09T04:43:07.686 INFO:teuthology.orchestra.run.smithi090.stdout:After this operation, 7,043 kB of additional disk space will be used. 2023-06-09T04:43:07.686 INFO:teuthology.orchestra.run.smithi090.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libsqlite3-0 amd64 3.31.1-4ubuntu0.5 [549 kB] 2023-06-09T04:43:07.801 INFO:teuthology.orchestra.run.smithi090.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/universe amd64 libglusterfs0 amd64 7.2-2build1 [286 kB] 2023-06-09T04:43:07.808 INFO:teuthology.orchestra.run.smithi090.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/universe amd64 libgfxdr0 amd64 7.2-2build1 [24.2 kB] 2023-06-09T04:43:07.809 INFO:teuthology.orchestra.run.smithi090.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/universe amd64 libgfrpc0 amd64 7.2-2build1 [46.1 kB] 2023-06-09T04:43:07.811 INFO:teuthology.orchestra.run.smithi090.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/universe amd64 libgfapi0 amd64 7.2-2build1 [72.6 kB] 2023-06-09T04:43:07.812 INFO:teuthology.orchestra.run.smithi090.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/universe amd64 fio amd64 3.16-1 [507 kB] 2023-06-09T04:43:07.826 INFO:teuthology.orchestra.run.smithi090.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 libgdbm-dev amd64 1.18.1-5 [83.4 kB] 2023-06-09T04:43:07.828 INFO:teuthology.orchestra.run.smithi090.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 sqlite3 amd64 3.31.1-4ubuntu0.5 [860 kB] 2023-06-09T04:43:08.156 INFO:teuthology.orchestra.run.smithi090.stderr:debconf: unable to initialize frontend: Dialog 2023-06-09T04:43:08.156 INFO:teuthology.orchestra.run.smithi090.stderr:debconf: (Dialog frontend will not work on a dumb terminal, an emacs shell buffer, or without a controlling terminal.) 2023-06-09T04:43:08.157 INFO:teuthology.orchestra.run.smithi090.stderr:debconf: falling back to frontend: Readline 2023-06-09T04:43:08.194 INFO:teuthology.orchestra.run.smithi090.stderr:debconf: unable to initialize frontend: Readline 2023-06-09T04:43:08.194 INFO:teuthology.orchestra.run.smithi090.stderr:debconf: (This frontend requires a controlling tty.) 2023-06-09T04:43:08.194 INFO:teuthology.orchestra.run.smithi090.stderr:debconf: falling back to frontend: Teletype 2023-06-09T04:43:08.212 INFO:teuthology.orchestra.run.smithi090.stderr:dpkg-preconfigure: unable to re-open stdin: 2023-06-09T04:43:08.298 INFO:teuthology.orchestra.run.smithi090.stdout:Fetched 2,428 kB in 0s (11.3 MB/s) 2023-06-09T04:43:08.571 INFO:teuthology.orchestra.run.smithi090.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 121309 files and directories currently installed.) 2023-06-09T04:43:08.575 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../0-libsqlite3-0_3.31.1-4ubuntu0.5_amd64.deb ... 2023-06-09T04:43:08.750 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking libsqlite3-0:amd64 (3.31.1-4ubuntu0.5) over (3.31.1-4ubuntu0.3) ... 2023-06-09T04:43:09.181 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package libglusterfs0:amd64. 2023-06-09T04:43:09.202 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../1-libglusterfs0_7.2-2build1_amd64.deb ... 2023-06-09T04:43:09.248 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking libglusterfs0:amd64 (7.2-2build1) ... 2023-06-09T04:43:09.635 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package libgfxdr0:amd64. 2023-06-09T04:43:09.654 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../2-libgfxdr0_7.2-2build1_amd64.deb ... 2023-06-09T04:43:09.701 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking libgfxdr0:amd64 (7.2-2build1) ... 2023-06-09T04:43:10.039 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package libgfrpc0:amd64. 2023-06-09T04:43:10.059 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../3-libgfrpc0_7.2-2build1_amd64.deb ... 2023-06-09T04:43:10.106 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking libgfrpc0:amd64 (7.2-2build1) ... 2023-06-09T04:43:10.810 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package libgfapi0:amd64. 2023-06-09T04:43:10.829 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../4-libgfapi0_7.2-2build1_amd64.deb ... 2023-06-09T04:43:10.876 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking libgfapi0:amd64 (7.2-2build1) ... 2023-06-09T04:43:11.256 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package fio. 2023-06-09T04:43:11.276 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../5-fio_3.16-1_amd64.deb ... 2023-06-09T04:43:11.314 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking fio (3.16-1) ... 2023-06-09T04:43:11.778 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package libgdbm-dev:amd64. 2023-06-09T04:43:11.797 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../6-libgdbm-dev_1.18.1-5_amd64.deb ... 2023-06-09T04:43:11.844 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking libgdbm-dev:amd64 (1.18.1-5) ... 2023-06-09T04:43:12.165 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package sqlite3. 2023-06-09T04:43:12.180 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../7-sqlite3_3.31.1-4ubuntu0.5_amd64.deb ... 2023-06-09T04:43:12.223 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking sqlite3 (3.31.1-4ubuntu0.5) ... 2023-06-09T04:43:12.626 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up libsqlite3-0:amd64 (3.31.1-4ubuntu0.5) ... 2023-06-09T04:43:12.754 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up libglusterfs0:amd64 (7.2-2build1) ... 2023-06-09T04:43:12.880 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up libgdbm-dev:amd64 (1.18.1-5) ... 2023-06-09T04:43:13.006 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up sqlite3 (3.31.1-4ubuntu0.5) ... 2023-06-09T04:43:13.134 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up libgfxdr0:amd64 (7.2-2build1) ... 2023-06-09T04:43:13.260 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up libgfrpc0:amd64 (7.2-2build1) ... 2023-06-09T04:43:13.386 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up libgfapi0:amd64 (7.2-2build1) ... 2023-06-09T04:43:13.512 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up fio (3.16-1) ... 2023-06-09T04:43:13.798 INFO:teuthology.orchestra.run.smithi090.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-06-09T04:43:13.967 INFO:teuthology.orchestra.run.smithi090.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-06-09T04:43:14.486 INFO:teuthology.orchestra.run.smithi090.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-06-09T04:43:17.572 INFO:teuthology.orchestra.run.smithi090.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2023-06-09T04:43:18.367 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:43:18.375 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:43:18.467 DEBUG:teuthology.orchestra.run.smithi090:> sudo useradd -m fsgqa 2023-06-09T04:43:18.544 INFO:teuthology.orchestra.run.smithi090.stderr:useradd: user 'fsgqa' already exists 2023-06-09T04:43:18.547 DEBUG:teuthology.orchestra.run:got remote process result: 9 2023-06-09T04:43:18.548 DEBUG:teuthology.orchestra.run.smithi090:> sudo groupadd fsgqa 2023-06-09T04:43:18.627 INFO:teuthology.orchestra.run.smithi090.stderr:groupadd: group 'fsgqa' already exists 2023-06-09T04:43:18.631 DEBUG:teuthology.orchestra.run:got remote process result: 9 2023-06-09T04:43:18.631 DEBUG:teuthology.orchestra.run.smithi090:> sudo useradd fsgqa2 2023-06-09T04:43:19.094 DEBUG:teuthology.orchestra.run.smithi090:> sudo useradd 123456-fsgqa 2023-06-09T04:43:19.511 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json mon dump 2023-06-09T04:43:19.687 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:19.682+0000 7f843f4d8700 1 Processor -- start 2023-06-09T04:43:19.687 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:19.686+0000 7f843f4d8700 1 -- start start 2023-06-09T04:43:19.689 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:19.686+0000 7f843f4d8700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8438154370 0x7f84380c8b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:43:19.690 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:19.686+0000 7f843f4d8700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f84380ca7a0 0x7f84380ad920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:43:19.690 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:19.686+0000 7f843f4d8700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f843815da10 0x7f843815de90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:43:19.690 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:19.686+0000 7f843f4d8700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f843815e3d0 con 0x7f84380ca7a0 2023-06-09T04:43:19.690 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:19.686+0000 7f843f4d8700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84380cabf0 con 0x7f843815da10 2023-06-09T04:43:19.690 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:19.686+0000 7f843f4d8700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84380cae10 con 0x7f8438154370 2023-06-09T04:43:19.691 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:19.686+0000 7f843ca73700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f84380ca7a0 0x7f84380ad920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:43:19.691 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:19.686+0000 7f843ca73700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f84380ca7a0 0x7f84380ad920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:41616/0 (socket says 172.21.15.90:41616) 2023-06-09T04:43:19.691 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:19.686+0000 7f843ca73700 1 -- 172.21.15.90:0/678563371 learned_addr learned my addr 172.21.15.90:0/678563371 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:43:19.692 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:19.686+0000 7f843da75700 1 --2- 172.21.15.90:0/678563371 >> v2:172.21.15.174:3300/0 conn(0x7f843815da10 0x7f843815de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:43:19.692 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:19.686+0000 7f843d274700 1 --2- 172.21.15.90:0/678563371 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8438154370 0x7f84380c8b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:43:19.692 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:19.686+0000 7f843ca73700 1 -- 172.21.15.90:0/678563371 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8438154370 msgr2=0x7f84380c8b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:43:19.692 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:19.690+0000 7f843ca73700 1 --2- 172.21.15.90:0/678563371 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8438154370 0x7f84380c8b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:43:19.692 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:19.690+0000 7f843ca73700 1 -- 172.21.15.90:0/678563371 >> v2:172.21.15.174:3300/0 conn(0x7f843815da10 msgr2=0x7f843815de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:43:19.692 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:19.690+0000 7f843ca73700 1 --2- 172.21.15.90:0/678563371 >> v2:172.21.15.174:3300/0 conn(0x7f843815da10 0x7f843815de90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:43:19.692 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:19.690+0000 7f843ca73700 1 -- 172.21.15.90:0/678563371 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84380cb0f0 con 0x7f84380ca7a0 2023-06-09T04:43:19.693 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:19.690+0000 7f843da75700 1 --2- 172.21.15.90:0/678563371 >> v2:172.21.15.174:3300/0 conn(0x7f843815da10 0x7f843815de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:43:19.694 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:19.690+0000 7f843ca73700 1 --2- 172.21.15.90:0/678563371 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f84380ca7a0 0x7f84380ad920 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f8438157f60 tx=0x7f8428009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=462501e7b6ad51f7 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:43:19.694 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:19.690+0000 7f842ffff700 1 -- 172.21.15.90:0/678563371 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f842800b8a0 con 0x7f84380ca7a0 2023-06-09T04:43:19.694 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:19.690+0000 7f842ffff700 1 -- 172.21.15.90:0/678563371 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f842800ba00 con 0x7f84380ca7a0 2023-06-09T04:43:19.694 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:19.690+0000 7f842ffff700 1 -- 172.21.15.90:0/678563371 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f842800bd90 con 0x7f84380ca7a0 2023-06-09T04:43:19.694 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:19.690+0000 7f843f4d8700 1 -- 172.21.15.90:0/678563371 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f84380ca7a0 msgr2=0x7f84380ad920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:43:19.694 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:19.690+0000 7f843f4d8700 1 --2- 172.21.15.90:0/678563371 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f84380ca7a0 0x7f84380ad920 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f8438157f60 tx=0x7f8428009bf0 comp rx=0 tx=0).stop 2023-06-09T04:43:19.695 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:19.690+0000 7f843f4d8700 1 -- 172.21.15.90:0/678563371 shutdown_connections 2023-06-09T04:43:19.695 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:19.690+0000 7f843f4d8700 1 --2- 172.21.15.90:0/678563371 >> v2:172.21.15.174:3300/0 conn(0x7f843815da10 0x7f843815de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:43:19.695 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:19.690+0000 7f843f4d8700 1 --2- 172.21.15.90:0/678563371 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f84380ca7a0 0x7f84380ad920 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:43:19.695 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:19.690+0000 7f843f4d8700 1 --2- 172.21.15.90:0/678563371 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8438154370 0x7f84380c8b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:43:19.695 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:19.690+0000 7f843f4d8700 1 -- 172.21.15.90:0/678563371 >> 172.21.15.90:0/678563371 conn(0x7f843806c810 msgr2=0x7f84380b0000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:43:19.695 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:19.690+0000 7f843f4d8700 1 -- 172.21.15.90:0/678563371 shutdown_connections 2023-06-09T04:43:19.695 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:19.690+0000 7f843f4d8700 1 -- 172.21.15.90:0/678563371 wait complete. 2023-06-09T04:43:19.696 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:19.694+0000 7f843f4d8700 1 Processor -- start 2023-06-09T04:43:19.696 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:19.694+0000 7f843f4d8700 1 -- start start 2023-06-09T04:43:19.697 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:19.694+0000 7f843f4d8700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f84380ca7a0 0x7f84380cc170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:43:19.697 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:19.694+0000 7f843f4d8700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8438154370 0x7f84381f1410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:43:19.697 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:19.694+0000 7f843f4d8700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f843815da10 0x7f84381f1950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:43:19.697 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:19.694+0000 7f843f4d8700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84380cdbf0 con 0x7f84380ca7a0 2023-06-09T04:43:19.697 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:19.694+0000 7f843f4d8700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84380ccb50 con 0x7f843815da10 2023-06-09T04:43:19.697 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:19.694+0000 7f843f4d8700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84380cce30 con 0x7f8438154370 2023-06-09T04:43:19.698 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:19.694+0000 7f843d274700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f84380ca7a0 0x7f84380cc170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:43:19.699 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:19.694+0000 7f843d274700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f84380ca7a0 0x7f84380cc170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:41626/0 (socket says 172.21.15.90:41626) 2023-06-09T04:43:19.699 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:19.694+0000 7f843d274700 1 -- 172.21.15.90:0/38976066 learned_addr learned my addr 172.21.15.90:0/38976066 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:43:19.699 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:19.694+0000 7f843da75700 1 --2- 172.21.15.90:0/38976066 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f843815da10 0x7f84381f1950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:43:19.699 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:19.694+0000 7f843ca73700 1 --2- 172.21.15.90:0/38976066 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8438154370 0x7f84381f1410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:43:19.699 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:19.694+0000 7f843d274700 1 -- 172.21.15.90:0/38976066 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8438154370 msgr2=0x7f84381f1410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:43:19.699 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:19.694+0000 7f843d274700 1 --2- 172.21.15.90:0/38976066 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8438154370 0x7f84381f1410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:43:19.699 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:19.694+0000 7f843d274700 1 -- 172.21.15.90:0/38976066 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f843815da10 msgr2=0x7f84381f1950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:43:19.700 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:19.694+0000 7f843d274700 1 --2- 172.21.15.90:0/38976066 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f843815da10 0x7f84381f1950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:43:19.700 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:19.694+0000 7f843d274700 1 -- 172.21.15.90:0/38976066 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8428009570 con 0x7f84380ca7a0 2023-06-09T04:43:19.700 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:19.694+0000 7f843d274700 1 --2- 172.21.15.90:0/38976066 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f84380ca7a0 0x7f84380cc170 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f843400e810 tx=0x7f843400ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:43:19.700 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:19.694+0000 7f842dffb700 1 -- 172.21.15.90:0/38976066 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8434013610 con 0x7f84380ca7a0 2023-06-09T04:43:19.701 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:19.694+0000 7f842dffb700 1 -- 172.21.15.90:0/38976066 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8434013790 con 0x7f84380ca7a0 2023-06-09T04:43:19.701 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:19.694+0000 7f843f4d8700 1 -- 172.21.15.90:0/38976066 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84380cd110 con 0x7f84380ca7a0 2023-06-09T04:43:19.701 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:19.694+0000 7f842dffb700 1 -- 172.21.15.90:0/38976066 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8434013b40 con 0x7f84380ca7a0 2023-06-09T04:43:19.701 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:19.698+0000 7f843f4d8700 1 -- 172.21.15.90:0/38976066 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84380cd6d0 con 0x7f84380ca7a0 2023-06-09T04:43:19.701 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:19.698+0000 7f843f4d8700 1 -- 172.21.15.90:0/38976066 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f843815b250 con 0x7f84380ca7a0 2023-06-09T04:43:19.702 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:19.698+0000 7f842dffb700 1 -- 172.21.15.90:0/38976066 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8434013ca0 con 0x7f84380ca7a0 2023-06-09T04:43:19.704 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:19.702+0000 7f842dffb700 1 --2- 172.21.15.90:0/38976066 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f841c0662f0 0x7f841c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:43:19.705 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:19.702+0000 7f842dffb700 1 -- 172.21.15.90:0/38976066 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8434083960 con 0x7f84380ca7a0 2023-06-09T04:43:19.705 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:19.702+0000 7f843ca73700 1 --2- 172.21.15.90:0/38976066 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f841c0662f0 0x7f841c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:43:19.706 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:19.702+0000 7f843ca73700 1 --2- 172.21.15.90:0/38976066 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f841c0662f0 0x7f841c0687a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f8428000c00 tx=0x7f8428008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:43:19.710 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:19.706+0000 7f842dffb700 1 -- 172.21.15.90:0/38976066 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8434054870 con 0x7f84380ca7a0 2023-06-09T04:43:19.940 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:19.938+0000 7f843f4d8700 1 -- 172.21.15.90:0/38976066 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f843804db30 con 0x7f84380ca7a0 2023-06-09T04:43:19.941 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:19.938+0000 7f842dffb700 1 -- 172.21.15.90:0/38976066 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+1276 (secure 0 0 0) 0x7f8434021510 con 0x7f84380ca7a0 2023-06-09T04:43:19.942 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:43:19.942 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":1,"fsid":"700369c0-a111-43b4-9415-844ad1742b70","modified":"2023-06-09T04:40:50.107321Z","created":"2023-06-09T04:40:50.107321Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:3300","nonce":0},{"type":"v1","addr":"172.21.15.90:6789","nonce":0}]},"addr":"172.21.15.90:6789/0","public_addr":"172.21.15.90:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:3300","nonce":0},{"type":"v1","addr":"172.21.15.174:6789","nonce":0}]},"addr":"172.21.15.174:6789/0","public_addr":"172.21.15.174:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:3301","nonce":0},{"type":"v1","addr":"172.21.15.174:6790","nonce":0}]},"addr":"172.21.15.174:6790/0","public_addr":"172.21.15.174:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2023-06-09T04:43:19.944 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:19.942+0000 7f843f4d8700 1 -- 172.21.15.90:0/38976066 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f841c0662f0 msgr2=0x7f841c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:43:19.944 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:19.942+0000 7f843f4d8700 1 --2- 172.21.15.90:0/38976066 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f841c0662f0 0x7f841c0687a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f8428000c00 tx=0x7f8428008030 comp rx=0 tx=0).stop 2023-06-09T04:43:19.944 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:19.942+0000 7f843f4d8700 1 -- 172.21.15.90:0/38976066 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f84380ca7a0 msgr2=0x7f84380cc170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:43:19.945 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:19.942+0000 7f843f4d8700 1 --2- 172.21.15.90:0/38976066 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f84380ca7a0 0x7f84380cc170 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f843400e810 tx=0x7f843400ebd0 comp rx=0 tx=0).stop 2023-06-09T04:43:19.945 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:19.942+0000 7f843f4d8700 1 -- 172.21.15.90:0/38976066 shutdown_connections 2023-06-09T04:43:19.945 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:19.942+0000 7f843f4d8700 1 --2- 172.21.15.90:0/38976066 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f841c0662f0 0x7f841c0687a0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:43:19.945 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:19.942+0000 7f843f4d8700 1 --2- 172.21.15.90:0/38976066 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f843815da10 0x7f84381f1950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:43:19.945 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:19.942+0000 7f843f4d8700 1 --2- 172.21.15.90:0/38976066 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8438154370 0x7f84381f1410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:43:19.945 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:19.942+0000 7f843f4d8700 1 --2- 172.21.15.90:0/38976066 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f84380ca7a0 0x7f84380cc170 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:43:19.945 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:19.942+0000 7f843f4d8700 1 -- 172.21.15.90:0/38976066 >> 172.21.15.90:0/38976066 conn(0x7f843806c810 msgr2=0x7f84380cb8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:43:19.946 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:19.942+0000 7f843f4d8700 1 -- 172.21.15.90:0/38976066 shutdown_connections 2023-06-09T04:43:19.946 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:19.942+0000 7f843f4d8700 1 -- 172.21.15.90:0/38976066 wait complete. 2023-06-09T04:43:19.946 INFO:teuthology.orchestra.run.smithi090.stderr:dumped monmap epoch 1 2023-06-09T04:43:19.964 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get-or-create client.admin 2023-06-09T04:43:20.136 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:20.134+0000 7f75ef59e700 1 Processor -- start 2023-06-09T04:43:20.136 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:20.134+0000 7f75ef59e700 1 -- start start 2023-06-09T04:43:20.139 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:20.134+0000 7f75ef59e700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f75f00cafb0 0x7f75f00cc0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:43:20.139 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:20.134+0000 7f75ef59e700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75f00cd8a0 con 0x7f75f015deb0 2023-06-09T04:43:20.139 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:20.134+0000 7f75ef59e700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75f00cb420 con 0x7f75f0154350 2023-06-09T04:43:20.139 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:20.134+0000 7f75ef59e700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75f0154720 con 0x7f75f00cafb0 2023-06-09T04:43:20.140 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:20.138+0000 7f75edd9b700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f75f00cafb0 0x7f75f00cc0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:43:20.140 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:20.138+0000 7f75edd9b700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f75f00cafb0 0x7f75f00cc0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:41632/0 (socket says 172.21.15.90:41632) 2023-06-09T04:43:20.140 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:20.138+0000 7f75edd9b700 1 -- 172.21.15.90:0/890040425 learned_addr learned my addr 172.21.15.90:0/890040425 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:43:20.140 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:20.138+0000 7f75edd9b700 1 -- 172.21.15.90:0/890040425 >> v1:172.21.15.174:6789/0 conn(0x7f75f0154350 legacy=0x7f75f015d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:43:20.140 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:20.138+0000 7f75edd9b700 1 -- 172.21.15.90:0/890040425 >> v1:172.21.15.90:6789/0 conn(0x7f75f015deb0 legacy=0x7f75f0069c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:43:20.141 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:20.138+0000 7f75edd9b700 1 -- 172.21.15.90:0/890040425 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75f00cdaf0 con 0x7f75f00cafb0 2023-06-09T04:43:20.141 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:20.138+0000 7f75edd9b700 1 --2- 172.21.15.90:0/890040425 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f75f00cafb0 0x7f75f00cc0f0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f75e4009910 tx=0x7f75e4009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35114b4830869631 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:43:20.141 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:20.138+0000 7f75ed59a700 1 -- 172.21.15.90:0/890040425 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75e4004230 con 0x7f75f00cafb0 2023-06-09T04:43:20.142 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:20.138+0000 7f75ed59a700 1 -- 172.21.15.90:0/890040425 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75e4004390 con 0x7f75f00cafb0 2023-06-09T04:43:20.142 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:20.138+0000 7f75ed59a700 1 -- 172.21.15.90:0/890040425 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75e4009e60 con 0x7f75f00cafb0 2023-06-09T04:43:20.142 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:20.138+0000 7f75ef59e700 1 -- 172.21.15.90:0/890040425 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f75f00cafb0 msgr2=0x7f75f00cc0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:43:20.142 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:20.138+0000 7f75ef59e700 1 --2- 172.21.15.90:0/890040425 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f75f00cafb0 0x7f75f00cc0f0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f75e4009910 tx=0x7f75e4009c20 comp rx=0 tx=0).stop 2023-06-09T04:43:20.143 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:20.138+0000 7f75ef59e700 1 -- 172.21.15.90:0/890040425 shutdown_connections 2023-06-09T04:43:20.143 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:20.138+0000 7f75ef59e700 1 --2- 172.21.15.90:0/890040425 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f75f00cafb0 0x7f75f00cc0f0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:43:20.143 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:20.138+0000 7f75ef59e700 1 -- 172.21.15.90:0/890040425 >> 172.21.15.90:0/890040425 conn(0x7f75f006c690 msgr2=0x7f75f00aff00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:43:20.143 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:20.138+0000 7f75ef59e700 1 -- 172.21.15.90:0/890040425 shutdown_connections 2023-06-09T04:43:20.143 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:20.138+0000 7f75ef59e700 1 -- 172.21.15.90:0/890040425 wait complete. 2023-06-09T04:43:20.146 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:20.142+0000 7f75ef59e700 1 Processor -- start 2023-06-09T04:43:20.147 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:20.146+0000 7f75ef59e700 1 -- start start 2023-06-09T04:43:20.148 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:20.146+0000 7f75ef59e700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f75f00cafb0 0x7f75f013b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:43:20.148 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:20.146+0000 7f75ef59e700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f75f0154350 0x7f75f0070d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:43:20.149 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:20.146+0000 7f75ef59e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f75f015deb0 0x7f75f0137e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:43:20.149 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:20.146+0000 7f75ef59e700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75f015c950 con 0x7f75f0154350 2023-06-09T04:43:20.149 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:20.146+0000 7f75ef59e700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75f015cba0 con 0x7f75f00cafb0 2023-06-09T04:43:20.149 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:20.146+0000 7f75ef59e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75f015ce80 con 0x7f75f015deb0 2023-06-09T04:43:20.150 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:20.146+0000 7f75edd9b700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f75f0154350 0x7f75f0070d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:43:20.150 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:20.146+0000 7f75edd9b700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f75f0154350 0x7f75f0070d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:41646/0 (socket says 172.21.15.90:41646) 2023-06-09T04:43:20.150 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:20.146+0000 7f75edd9b700 1 -- 172.21.15.90:0/2836187443 learned_addr learned my addr 172.21.15.90:0/2836187443 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T04:43:20.150 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:20.146+0000 7f75ee59c700 1 --2- 172.21.15.90:0/2836187443 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f75f00cafb0 0x7f75f013b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:43:20.150 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:20.146+0000 7f75eed9d700 1 --2- 172.21.15.90:0/2836187443 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f75f015deb0 0x7f75f0137e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:43:20.151 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:20.146+0000 7f75edd9b700 1 -- 172.21.15.90:0/2836187443 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f75f015deb0 msgr2=0x7f75f0137e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:43:20.151 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:20.146+0000 7f75edd9b700 1 --2- 172.21.15.90:0/2836187443 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f75f015deb0 0x7f75f0137e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:43:20.151 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:20.146+0000 7f75edd9b700 1 -- 172.21.15.90:0/2836187443 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f75f00cafb0 msgr2=0x7f75f013b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:43:20.151 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:20.146+0000 7f75edd9b700 1 --2- 172.21.15.90:0/2836187443 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f75f00cafb0 0x7f75f013b2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:43:20.151 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:20.146+0000 7f75edd9b700 1 -- 172.21.15.90:0/2836187443 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75e4009570 con 0x7f75f0154350 2023-06-09T04:43:20.151 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:20.146+0000 7f75ee59c700 1 --2- 172.21.15.90:0/2836187443 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f75f00cafb0 0x7f75f013b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:43:20.152 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:20.146+0000 7f75edd9b700 1 --2- 172.21.15.90:0/2836187443 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f75f0154350 0x7f75f0070d50 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f75e4004000 tx=0x7f75e4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:43:20.152 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:20.146+0000 7f75deffd700 1 -- 172.21.15.90:0/2836187443 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75e400bca0 con 0x7f75f0154350 2023-06-09T04:43:20.152 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:20.146+0000 7f75deffd700 1 -- 172.21.15.90:0/2836187443 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75e401f070 con 0x7f75f0154350 2023-06-09T04:43:20.152 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:20.146+0000 7f75deffd700 1 -- 172.21.15.90:0/2836187443 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75e40036c0 con 0x7f75f0154350 2023-06-09T04:43:20.153 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:20.146+0000 7f75ef59e700 1 -- 172.21.15.90:0/2836187443 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75f015d160 con 0x7f75f0154350 2023-06-09T04:43:20.153 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:20.150+0000 7f75ef59e700 1 -- 172.21.15.90:0/2836187443 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75f013b800 con 0x7f75f0154350 2023-06-09T04:43:20.153 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:20.150+0000 7f75ef59e700 1 -- 172.21.15.90:0/2836187443 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75f006b390 con 0x7f75f0154350 2023-06-09T04:43:20.154 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:20.150+0000 7f75deffd700 1 -- 172.21.15.90:0/2836187443 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f75e4021030 con 0x7f75f0154350 2023-06-09T04:43:20.156 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:20.154+0000 7f75deffd700 1 --2- 172.21.15.90:0/2836187443 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f75d00662f0 0x7f75d00687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:43:20.156 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:20.154+0000 7f75deffd700 1 -- 172.21.15.90:0/2836187443 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f75e4085240 con 0x7f75f0154350 2023-06-09T04:43:20.157 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:20.154+0000 7f75ee59c700 1 --2- 172.21.15.90:0/2836187443 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f75d00662f0 0x7f75d00687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:43:20.158 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:20.154+0000 7f75ee59c700 1 --2- 172.21.15.90:0/2836187443 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f75d00662f0 0x7f75d00687a0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f75e0007fd0 tx=0x7f75e0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:43:20.163 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:20.158+0000 7f75deffd700 1 -- 172.21.15.90:0/2836187443 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f75e4052750 con 0x7f75f0154350 2023-06-09T04:43:20.393 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:20.390+0000 7f75ef59e700 1 -- 172.21.15.90:0/2836187443 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.admin"} v 0) v1 -- 0x7f75f006b390 con 0x7f75f0154350 2023-06-09T04:43:20.394 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:20.390+0000 7f75deffd700 1 -- 172.21.15.90:0/2836187443 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.admin"}]=0 v11) v1 ==== 92+0+63 (secure 0 0 0) 0x7f75e4010380 con 0x7f75f0154350 2023-06-09T04:43:20.395 INFO:teuthology.orchestra.run.smithi090.stdout:[client.admin] 2023-06-09T04:43:20.395 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQBSrYJkdxJcFhAA3pMTvAiq3IjuROLw5ndprg== 2023-06-09T04:43:20.397 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:20.394+0000 7f75ef59e700 1 -- 172.21.15.90:0/2836187443 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f75d00662f0 msgr2=0x7f75d00687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:43:20.398 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:20.394+0000 7f75ef59e700 1 --2- 172.21.15.90:0/2836187443 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f75d00662f0 0x7f75d00687a0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f75e0007fd0 tx=0x7f75e0009040 comp rx=0 tx=0).stop 2023-06-09T04:43:20.398 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:20.394+0000 7f75ef59e700 1 -- 172.21.15.90:0/2836187443 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f75f0154350 msgr2=0x7f75f0070d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:43:20.398 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:20.394+0000 7f75ef59e700 1 --2- 172.21.15.90:0/2836187443 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f75f0154350 0x7f75f0070d50 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f75e4004000 tx=0x7f75e4004770 comp rx=0 tx=0).stop 2023-06-09T04:43:20.398 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:20.394+0000 7f75ef59e700 1 -- 172.21.15.90:0/2836187443 shutdown_connections 2023-06-09T04:43:20.399 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:20.394+0000 7f75ef59e700 1 --2- 172.21.15.90:0/2836187443 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f75d00662f0 0x7f75d00687a0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:43:20.399 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:20.394+0000 7f75ef59e700 1 --2- 172.21.15.90:0/2836187443 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f75f015deb0 0x7f75f0137e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:43:20.399 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:20.394+0000 7f75ef59e700 1 --2- 172.21.15.90:0/2836187443 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f75f0154350 0x7f75f0070d50 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:43:20.399 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:20.394+0000 7f75ef59e700 1 --2- 172.21.15.90:0/2836187443 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f75f00cafb0 0x7f75f013b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:43:20.399 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:20.394+0000 7f75ef59e700 1 -- 172.21.15.90:0/2836187443 >> 172.21.15.90:0/2836187443 conn(0x7f75f006c690 msgr2=0x7f75f014f2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:43:20.400 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:20.394+0000 7f75ef59e700 1 -- 172.21.15.90:0/2836187443 shutdown_connections 2023-06-09T04:43:20.400 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T04:43:20.394+0000 7f75ef59e700 1 -- 172.21.15.90:0/2836187443 wait complete. 2023-06-09T04:43:20.419 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2023-06-09T04:43:20.419 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd of=/tmp/tmp.jICg1BPnIbxfstests-dev/local.config 2023-06-09T04:43:20.449 INFO:tasks.cephfs.xfstests_dev:local.config's contents - export FSTYP=ceph export TEST_DEV=172.21.15.90:6789:/test export TEST_DIR=/tmp/tmp.WhlLVkLGHXtest export SCRATCH_DEV=172.21.15.90:6789:/scratch export SCRATCH_MNT=/tmp/tmp.dXSIBxNemoscratch export CEPHFS_MOUNT_OPTIONS="-o name=admin,secret=AQBSrYJkdxJcFhAA3pMTvAiq3IjuROLw5ndprg==" 2023-06-09T04:43:20.450 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2023-06-09T04:43:20.450 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd of=/tmp/tmp.jICg1BPnIbxfstests-dev/ceph.exclude 2023-06-09T04:43:20.526 DEBUG:teuthology.orchestra.run.smithi090:> (cd /tmp/tmp.jICg1BPnIbxfstests-dev && exec sudo make) 2023-06-09T04:43:20.638 INFO:teuthology.orchestra.run.smithi090.stdout:libtoolize -cfi 2023-06-09T04:43:21.257 INFO:teuthology.orchestra.run.smithi090.stdout:libtoolize: putting auxiliary files in '.'. 2023-06-09T04:43:21.257 INFO:teuthology.orchestra.run.smithi090.stdout:libtoolize: copying file './config.guess' 2023-06-09T04:43:21.283 INFO:teuthology.orchestra.run.smithi090.stdout:libtoolize: copying file './config.sub' 2023-06-09T04:43:21.317 INFO:teuthology.orchestra.run.smithi090.stdout:libtoolize: copying file './install-sh' 2023-06-09T04:43:21.348 INFO:teuthology.orchestra.run.smithi090.stdout:libtoolize: copying file './ltmain.sh' 2023-06-09T04:43:21.448 INFO:teuthology.orchestra.run.smithi090.stdout:libtoolize: putting macros in AC_CONFIG_MACRO_DIRS, 'm4'. 2023-06-09T04:43:21.449 INFO:teuthology.orchestra.run.smithi090.stdout:libtoolize: copying file 'm4/libtool.m4' 2023-06-09T04:43:21.476 INFO:teuthology.orchestra.run.smithi090.stdout:libtoolize: copying file 'm4/ltoptions.m4' 2023-06-09T04:43:21.502 INFO:teuthology.orchestra.run.smithi090.stdout:libtoolize: copying file 'm4/ltsugar.m4' 2023-06-09T04:43:21.527 INFO:teuthology.orchestra.run.smithi090.stdout:libtoolize: copying file 'm4/ltversion.m4' 2023-06-09T04:43:21.554 INFO:teuthology.orchestra.run.smithi090.stdout:libtoolize: copying file 'm4/lt~obsolete.m4' 2023-06-09T04:43:21.575 INFO:teuthology.orchestra.run.smithi090.stdout:libtoolize: Consider adding '-I m4' to ACLOCAL_AMFLAGS in Makefile.am. 2023-06-09T04:43:21.581 INFO:teuthology.orchestra.run.smithi090.stdout:cp include/install-sh . 2023-06-09T04:43:21.586 INFO:teuthology.orchestra.run.smithi090.stdout:aclocal -I m4 2023-06-09T04:43:23.137 INFO:teuthology.orchestra.run.smithi090.stdout:autoheader 2023-06-09T04:43:23.576 INFO:teuthology.orchestra.run.smithi090.stdout:autoconf 2023-06-09T04:43:23.903 INFO:teuthology.orchestra.run.smithi090.stdout:./configure \ 2023-06-09T04:43:23.903 INFO:teuthology.orchestra.run.smithi090.stdout: --libexecdir=/usr/lib \ 2023-06-09T04:43:23.903 INFO:teuthology.orchestra.run.smithi090.stdout: --exec_prefix=/var/lib 2023-06-09T04:43:25.086 INFO:teuthology.orchestra.run.smithi090.stdout:checking build system type... x86_64-pc-linux-gnu 2023-06-09T04:43:25.087 INFO:teuthology.orchestra.run.smithi090.stdout:checking host system type... x86_64-pc-linux-gnu 2023-06-09T04:43:25.154 INFO:teuthology.orchestra.run.smithi090.stdout:checking how to print strings... printf 2023-06-09T04:43:25.156 INFO:teuthology.orchestra.run.smithi090.stdout:checking for gcc... gcc 2023-06-09T04:43:25.563 INFO:teuthology.orchestra.run.smithi090.stdout:checking whether the C compiler works... yes 2023-06-09T04:43:25.564 INFO:teuthology.orchestra.run.smithi090.stdout:checking for C compiler default output file name... a.out 2023-06-09T04:43:25.642 INFO:teuthology.orchestra.run.smithi090.stdout:checking for suffix of executables... 2023-06-09T04:43:25.805 INFO:teuthology.orchestra.run.smithi090.stdout:checking whether we are cross compiling... no 2023-06-09T04:43:25.869 INFO:teuthology.orchestra.run.smithi090.stdout:checking for suffix of object files... o 2023-06-09T04:43:25.928 INFO:teuthology.orchestra.run.smithi090.stdout:checking whether we are using the GNU C compiler... yes 2023-06-09T04:43:25.991 INFO:teuthology.orchestra.run.smithi090.stdout:checking whether gcc accepts -g... yes 2023-06-09T04:43:26.164 INFO:teuthology.orchestra.run.smithi090.stdout:checking for gcc option to accept ISO C89... none needed 2023-06-09T04:43:26.178 INFO:teuthology.orchestra.run.smithi090.stdout:checking for a sed that does not truncate output... /usr/bin/sed 2023-06-09T04:43:26.190 INFO:teuthology.orchestra.run.smithi090.stdout:checking for grep that handles long lines and -e... /usr/bin/grep 2023-06-09T04:43:26.197 INFO:teuthology.orchestra.run.smithi090.stdout:checking for egrep... /usr/bin/grep -E 2023-06-09T04:43:26.203 INFO:teuthology.orchestra.run.smithi090.stdout:checking for fgrep... /usr/bin/grep -F 2023-06-09T04:43:26.220 INFO:teuthology.orchestra.run.smithi090.stdout:checking for ld used by gcc... /usr/bin/ld 2023-06-09T04:43:26.230 INFO:teuthology.orchestra.run.smithi090.stdout:checking if the linker (/usr/bin/ld) is GNU ld... yes 2023-06-09T04:43:26.244 INFO:teuthology.orchestra.run.smithi090.stdout:checking for BSD- or MS-compatible name lister (nm)... /usr/bin/nm -B 2023-06-09T04:43:26.320 INFO:teuthology.orchestra.run.smithi090.stdout:checking the name lister (/usr/bin/nm -B) interface... BSD nm 2023-06-09T04:43:26.321 INFO:teuthology.orchestra.run.smithi090.stdout:checking whether ln -s works... yes 2023-06-09T04:43:26.342 INFO:teuthology.orchestra.run.smithi090.stdout:checking the maximum length of command line arguments... 1572864 2023-06-09T04:43:26.354 INFO:teuthology.orchestra.run.smithi090.stdout:checking how to convert x86_64-pc-linux-gnu file names to x86_64-pc-linux-gnu format... func_convert_file_noop 2023-06-09T04:43:26.354 INFO:teuthology.orchestra.run.smithi090.stdout:checking how to convert x86_64-pc-linux-gnu file names to toolchain format... func_convert_file_noop 2023-06-09T04:43:26.355 INFO:teuthology.orchestra.run.smithi090.stdout:checking for /usr/bin/ld option to reload object files... -r 2023-06-09T04:43:26.356 INFO:teuthology.orchestra.run.smithi090.stdout:checking for objdump... objdump 2023-06-09T04:43:26.357 INFO:teuthology.orchestra.run.smithi090.stdout:checking how to recognize dependent libraries... pass_all 2023-06-09T04:43:26.358 INFO:teuthology.orchestra.run.smithi090.stdout:checking for dlltool... no 2023-06-09T04:43:26.359 INFO:teuthology.orchestra.run.smithi090.stdout:checking how to associate runtime and link libraries... printf %s\n 2023-06-09T04:43:26.360 INFO:teuthology.orchestra.run.smithi090.stdout:checking for ar... ar 2023-06-09T04:43:26.453 INFO:teuthology.orchestra.run.smithi090.stdout:checking for archiver @FILE support... @ 2023-06-09T04:43:26.481 INFO:teuthology.orchestra.run.smithi090.stdout:checking for strip... strip 2023-06-09T04:43:26.481 INFO:teuthology.orchestra.run.smithi090.stdout:checking for ranlib... ranlib 2023-06-09T04:43:26.481 INFO:teuthology.orchestra.run.smithi090.stdout:checking for gawk... gawk 2023-06-09T04:43:26.655 INFO:teuthology.orchestra.run.smithi090.stdout:checking command to parse /usr/bin/nm -B output from gcc object... ok 2023-06-09T04:43:26.663 INFO:teuthology.orchestra.run.smithi090.stdout:checking for sysroot... no 2023-06-09T04:43:26.677 INFO:teuthology.orchestra.run.smithi090.stdout:checking for a working dd... /usr/bin/dd 2023-06-09T04:43:26.692 INFO:teuthology.orchestra.run.smithi090.stdout:checking how to truncate binary pipes... /usr/bin/dd bs=4096 count=1 2023-06-09T04:43:26.748 INFO:teuthology.orchestra.run.smithi090.stdout:checking for mt... mt 2023-06-09T04:43:26.771 INFO:teuthology.orchestra.run.smithi090.stdout:checking if mt is a manifest tool... no 2023-06-09T04:43:26.902 INFO:teuthology.orchestra.run.smithi090.stdout:checking how to run the C preprocessor... gcc -E 2023-06-09T04:43:27.280 INFO:teuthology.orchestra.run.smithi090.stdout:checking for ANSI C header files... yes 2023-06-09T04:43:27.355 INFO:teuthology.orchestra.run.smithi090.stdout:checking for sys/types.h... yes 2023-06-09T04:43:27.449 INFO:teuthology.orchestra.run.smithi090.stdout:checking for sys/stat.h... yes 2023-06-09T04:43:27.543 INFO:teuthology.orchestra.run.smithi090.stdout:checking for stdlib.h... yes 2023-06-09T04:43:27.642 INFO:teuthology.orchestra.run.smithi090.stdout:checking for string.h... yes 2023-06-09T04:43:27.736 INFO:teuthology.orchestra.run.smithi090.stdout:checking for memory.h... yes 2023-06-09T04:43:27.832 INFO:teuthology.orchestra.run.smithi090.stdout:checking for strings.h... yes 2023-06-09T04:43:27.931 INFO:teuthology.orchestra.run.smithi090.stdout:checking for inttypes.h... yes 2023-06-09T04:43:28.025 INFO:teuthology.orchestra.run.smithi090.stdout:checking for stdint.h... yes 2023-06-09T04:43:28.125 INFO:teuthology.orchestra.run.smithi090.stdout:checking for unistd.h... yes 2023-06-09T04:43:28.221 INFO:teuthology.orchestra.run.smithi090.stdout:checking for dlfcn.h... yes 2023-06-09T04:43:28.238 INFO:teuthology.orchestra.run.smithi090.stdout:checking for objdir... .libs 2023-06-09T04:43:28.481 INFO:teuthology.orchestra.run.smithi090.stdout:checking if gcc supports -fno-rtti -fno-exceptions... no 2023-06-09T04:43:28.481 INFO:teuthology.orchestra.run.smithi090.stdout:checking for gcc option to produce PIC... -fPIC -DPIC 2023-06-09T04:43:28.558 INFO:teuthology.orchestra.run.smithi090.stdout:checking if gcc PIC flag -fPIC -DPIC works... yes 2023-06-09T04:43:28.765 INFO:teuthology.orchestra.run.smithi090.stdout:checking if gcc static flag -static works... yes 2023-06-09T04:43:28.861 INFO:teuthology.orchestra.run.smithi090.stdout:checking if gcc supports -c -o file.o... yes 2023-06-09T04:43:28.861 INFO:teuthology.orchestra.run.smithi090.stdout:checking if gcc supports -c -o file.o... (cached) yes 2023-06-09T04:43:28.906 INFO:teuthology.orchestra.run.smithi090.stdout:checking whether the gcc linker (/usr/bin/ld -m elf_x86_64) supports shared libraries... yes 2023-06-09T04:43:28.984 INFO:teuthology.orchestra.run.smithi090.stdout:checking whether -lc should be explicitly linked in... no 2023-06-09T04:43:29.149 INFO:teuthology.orchestra.run.smithi090.stdout:checking dynamic linker characteristics... GNU/Linux ld.so 2023-06-09T04:43:29.149 INFO:teuthology.orchestra.run.smithi090.stdout:checking how to hardcode library paths into programs... immediate 2023-06-09T04:43:29.164 INFO:teuthology.orchestra.run.smithi090.stdout:checking whether stripping libraries is possible... yes 2023-06-09T04:43:29.165 INFO:teuthology.orchestra.run.smithi090.stdout:checking if libtool supports shared libraries... yes 2023-06-09T04:43:29.166 INFO:teuthology.orchestra.run.smithi090.stdout:checking whether to build shared libraries... yes 2023-06-09T04:43:29.166 INFO:teuthology.orchestra.run.smithi090.stdout:checking whether to build static libraries... yes 2023-06-09T04:43:29.207 INFO:teuthology.orchestra.run.smithi090.stdout:checking for gcc... (cached) gcc 2023-06-09T04:43:29.283 INFO:teuthology.orchestra.run.smithi090.stdout:checking whether we are using the GNU C compiler... (cached) yes 2023-06-09T04:43:29.284 INFO:teuthology.orchestra.run.smithi090.stdout:checking whether gcc accepts -g... (cached) yes 2023-06-09T04:43:29.284 INFO:teuthology.orchestra.run.smithi090.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2023-06-09T04:43:29.285 INFO:teuthology.orchestra.run.smithi090.stdout:checking for gmake... no 2023-06-09T04:43:29.285 INFO:teuthology.orchestra.run.smithi090.stdout:checking for make... /usr/bin/make 2023-06-09T04:43:29.286 INFO:teuthology.orchestra.run.smithi090.stderr:./configure: line 8824: test: $(SHELL): binary operator expected 2023-06-09T04:43:29.286 INFO:teuthology.orchestra.run.smithi090.stdout:checking for tar... /bin/tar 2023-06-09T04:43:29.287 INFO:teuthology.orchestra.run.smithi090.stdout:checking for gzip... /bin/gzip 2023-06-09T04:43:29.317 INFO:teuthology.orchestra.run.smithi090.stdout:checking whether gcc -MM is supported... yes 2023-06-09T04:43:29.319 INFO:teuthology.orchestra.run.smithi090.stdout:checking for sort... /bin/sort 2023-06-09T04:43:29.320 INFO:teuthology.orchestra.run.smithi090.stdout:checking whether ln -s works... yes 2023-06-09T04:43:29.322 INFO:teuthology.orchestra.run.smithi090.stdout:checking for rpm... no 2023-06-09T04:43:29.414 INFO:teuthology.orchestra.run.smithi090.stdout:checking assert.h usability... yes 2023-06-09T04:43:29.440 INFO:teuthology.orchestra.run.smithi090.stdout:checking assert.h presence... yes 2023-06-09T04:43:29.441 INFO:teuthology.orchestra.run.smithi090.stdout:checking for assert.h... yes 2023-06-09T04:43:29.547 INFO:teuthology.orchestra.run.smithi090.stdout:checking bstring.h usability... no 2023-06-09T04:43:29.596 INFO:teuthology.orchestra.run.smithi090.stdout:checking bstring.h presence... no 2023-06-09T04:43:29.596 INFO:teuthology.orchestra.run.smithi090.stdout:checking for bstring.h... no 2023-06-09T04:43:29.683 INFO:teuthology.orchestra.run.smithi090.stdout:checking libgen.h usability... yes 2023-06-09T04:43:29.713 INFO:teuthology.orchestra.run.smithi090.stdout:checking libgen.h presence... yes 2023-06-09T04:43:29.713 INFO:teuthology.orchestra.run.smithi090.stdout:checking for libgen.h... yes 2023-06-09T04:43:29.826 INFO:teuthology.orchestra.run.smithi090.stdout:checking dirent.h usability... yes 2023-06-09T04:43:29.858 INFO:teuthology.orchestra.run.smithi090.stdout:checking dirent.h presence... yes 2023-06-09T04:43:29.859 INFO:teuthology.orchestra.run.smithi090.stdout:checking for dirent.h... yes 2023-06-09T04:43:29.997 INFO:teuthology.orchestra.run.smithi090.stdout:checking errno.h usability... yes 2023-06-09T04:43:30.023 INFO:teuthology.orchestra.run.smithi090.stdout:checking errno.h presence... yes 2023-06-09T04:43:30.024 INFO:teuthology.orchestra.run.smithi090.stdout:checking for errno.h... yes 2023-06-09T04:43:30.131 INFO:teuthology.orchestra.run.smithi090.stdout:checking malloc.h usability... yes 2023-06-09T04:43:30.165 INFO:teuthology.orchestra.run.smithi090.stdout:checking malloc.h presence... yes 2023-06-09T04:43:30.165 INFO:teuthology.orchestra.run.smithi090.stdout:checking for malloc.h... yes 2023-06-09T04:43:30.270 INFO:teuthology.orchestra.run.smithi090.stdout:checking uuid.h usability... no 2023-06-09T04:43:30.312 INFO:teuthology.orchestra.run.smithi090.stdout:checking uuid.h presence... no 2023-06-09T04:43:30.313 INFO:teuthology.orchestra.run.smithi090.stdout:checking for uuid.h... no 2023-06-09T04:43:30.447 INFO:teuthology.orchestra.run.smithi090.stdout:checking uuid/uuid.h usability... yes 2023-06-09T04:43:30.481 INFO:teuthology.orchestra.run.smithi090.stdout:checking uuid/uuid.h presence... yes 2023-06-09T04:43:30.481 INFO:teuthology.orchestra.run.smithi090.stdout:checking for uuid/uuid.h... yes 2023-06-09T04:43:30.589 INFO:teuthology.orchestra.run.smithi090.stdout:checking sys/uuid.h usability... no 2023-06-09T04:43:30.641 INFO:teuthology.orchestra.run.smithi090.stdout:checking sys/uuid.h presence... no 2023-06-09T04:43:30.641 INFO:teuthology.orchestra.run.smithi090.stdout:checking for sys/uuid.h... no 2023-06-09T04:43:30.728 INFO:teuthology.orchestra.run.smithi090.stdout:checking sys/file.h usability... yes 2023-06-09T04:43:30.757 INFO:teuthology.orchestra.run.smithi090.stdout:checking sys/file.h presence... yes 2023-06-09T04:43:30.757 INFO:teuthology.orchestra.run.smithi090.stdout:checking for sys/file.h... yes 2023-06-09T04:43:30.864 INFO:teuthology.orchestra.run.smithi090.stdout:checking sys/fcntl.h usability... yes 2023-06-09T04:43:30.895 INFO:teuthology.orchestra.run.smithi090.stdout:checking sys/fcntl.h presence... yes 2023-06-09T04:43:30.896 INFO:teuthology.orchestra.run.smithi090.stdout:checking for sys/fcntl.h... yes 2023-06-09T04:43:31.002 INFO:teuthology.orchestra.run.smithi090.stdout:checking sys/syssgi.h usability... no 2023-06-09T04:43:31.043 INFO:teuthology.orchestra.run.smithi090.stdout:checking sys/syssgi.h presence... no 2023-06-09T04:43:31.044 INFO:teuthology.orchestra.run.smithi090.stdout:checking for sys/syssgi.h... no 2023-06-09T04:43:31.156 INFO:teuthology.orchestra.run.smithi090.stdout:checking sys/param.h usability... yes 2023-06-09T04:43:31.193 INFO:teuthology.orchestra.run.smithi090.stdout:checking sys/param.h presence... yes 2023-06-09T04:43:31.193 INFO:teuthology.orchestra.run.smithi090.stdout:checking for sys/param.h... yes 2023-06-09T04:43:31.222 INFO:teuthology.orchestra.run.smithi090.stdout:checking for sys/stat.h... (cached) yes 2023-06-09T04:43:31.325 INFO:teuthology.orchestra.run.smithi090.stdout:checking sys/statvfs.h usability... yes 2023-06-09T04:43:31.353 INFO:teuthology.orchestra.run.smithi090.stdout:checking sys/statvfs.h presence... yes 2023-06-09T04:43:31.353 INFO:teuthology.orchestra.run.smithi090.stdout:checking for sys/statvfs.h... yes 2023-06-09T04:43:31.457 INFO:teuthology.orchestra.run.smithi090.stdout:checking sys/time.h usability... yes 2023-06-09T04:43:31.493 INFO:teuthology.orchestra.run.smithi090.stdout:checking sys/time.h presence... yes 2023-06-09T04:43:31.493 INFO:teuthology.orchestra.run.smithi090.stdout:checking for sys/time.h... yes 2023-06-09T04:43:31.607 INFO:teuthology.orchestra.run.smithi090.stdout:checking sys/ioctl.h usability... yes 2023-06-09T04:43:31.638 INFO:teuthology.orchestra.run.smithi090.stdout:checking sys/ioctl.h presence... yes 2023-06-09T04:43:31.639 INFO:teuthology.orchestra.run.smithi090.stdout:checking for sys/ioctl.h... yes 2023-06-09T04:43:31.742 INFO:teuthology.orchestra.run.smithi090.stdout:checking sys/wait.h usability... yes 2023-06-09T04:43:31.774 INFO:teuthology.orchestra.run.smithi090.stdout:checking sys/wait.h presence... yes 2023-06-09T04:43:31.775 INFO:teuthology.orchestra.run.smithi090.stdout:checking for sys/wait.h... yes 2023-06-09T04:43:31.804 INFO:teuthology.orchestra.run.smithi090.stdout:checking for sys/types.h... (cached) yes 2023-06-09T04:43:31.833 INFO:teuthology.orchestra.run.smithi090.stdout:checking for strings.h... (cached) yes 2023-06-09T04:43:31.936 INFO:teuthology.orchestra.run.smithi090.stdout:checking err.h usability... yes 2023-06-09T04:43:31.965 INFO:teuthology.orchestra.run.smithi090.stdout:checking err.h presence... yes 2023-06-09T04:43:31.965 INFO:teuthology.orchestra.run.smithi090.stdout:checking for err.h... yes 2023-06-09T04:43:32.074 INFO:teuthology.orchestra.run.smithi090.stdout:checking linux/falloc.h usability... yes 2023-06-09T04:43:32.104 INFO:teuthology.orchestra.run.smithi090.stdout:checking linux/falloc.h presence... yes 2023-06-09T04:43:32.104 INFO:teuthology.orchestra.run.smithi090.stdout:checking for linux/falloc.h... yes 2023-06-09T04:43:32.211 INFO:teuthology.orchestra.run.smithi090.stdout:checking sys/fs/xfs_fsops.h usability... no 2023-06-09T04:43:32.265 INFO:teuthology.orchestra.run.smithi090.stdout:checking sys/fs/xfs_fsops.h presence... no 2023-06-09T04:43:32.265 INFO:teuthology.orchestra.run.smithi090.stdout:checking for sys/fs/xfs_fsops.h... no 2023-06-09T04:43:32.360 INFO:teuthology.orchestra.run.smithi090.stdout:checking sys/fs/xfs_itable.h usability... no 2023-06-09T04:43:32.414 INFO:teuthology.orchestra.run.smithi090.stdout:checking sys/fs/xfs_itable.h presence... no 2023-06-09T04:43:32.414 INFO:teuthology.orchestra.run.smithi090.stdout:checking for sys/fs/xfs_itable.h... no 2023-06-09T04:43:32.503 INFO:teuthology.orchestra.run.smithi090.stdout:checking xfs/platform_defs.h usability... no 2023-06-09T04:43:32.555 INFO:teuthology.orchestra.run.smithi090.stdout:checking xfs/platform_defs.h presence... no 2023-06-09T04:43:32.555 INFO:teuthology.orchestra.run.smithi090.stdout:checking for xfs/platform_defs.h... no 2023-06-09T04:43:32.645 INFO:teuthology.orchestra.run.smithi090.stdout:checking btrfs/ioctl.h usability... no 2023-06-09T04:43:32.697 INFO:teuthology.orchestra.run.smithi090.stdout:checking btrfs/ioctl.h presence... no 2023-06-09T04:43:32.698 INFO:teuthology.orchestra.run.smithi090.stdout:checking for btrfs/ioctl.h... no 2023-06-09T04:43:32.790 INFO:teuthology.orchestra.run.smithi090.stdout:checking cifs/ioctl.h usability... no 2023-06-09T04:43:32.839 INFO:teuthology.orchestra.run.smithi090.stdout:checking cifs/ioctl.h presence... no 2023-06-09T04:43:32.840 INFO:teuthology.orchestra.run.smithi090.stdout:checking for cifs/ioctl.h... no 2023-06-09T04:43:32.932 INFO:teuthology.orchestra.run.smithi090.stdout:checking sys/mman.h usability... yes 2023-06-09T04:43:32.964 INFO:teuthology.orchestra.run.smithi090.stdout:checking sys/mman.h presence... yes 2023-06-09T04:43:32.964 INFO:teuthology.orchestra.run.smithi090.stdout:checking for sys/mman.h... yes 2023-06-09T04:43:33.034 INFO:teuthology.orchestra.run.smithi090.stdout:checking for xfs/xfs_log_format.h... no 2023-06-09T04:43:33.145 INFO:teuthology.orchestra.run.smithi090.stdout:checking for uuid_compare... no 2023-06-09T04:43:33.237 INFO:teuthology.orchestra.run.smithi090.stdout:checking for uuid_compare in -luuid... yes 2023-06-09T04:43:33.378 INFO:teuthology.orchestra.run.smithi090.stdout:checking for xfs/xfs.h... yes 2023-06-09T04:43:33.437 INFO:teuthology.orchestra.run.smithi090.stdout:checking for xfs/libxfs.h... no 2023-06-09T04:43:33.510 INFO:teuthology.orchestra.run.smithi090.stdout:checking whether xlog_assign_lsn is declared... no 2023-06-09T04:43:33.595 INFO:teuthology.orchestra.run.smithi090.stdout:checking for xfs/xqm.h... yes 2023-06-09T04:43:33.727 INFO:teuthology.orchestra.run.smithi090.stdout:checking xfsctl from xfs/xfs.h... ok 2023-06-09T04:43:33.807 INFO:teuthology.orchestra.run.smithi090.stdout:checking xfs/handle.h usability... yes 2023-06-09T04:43:33.837 INFO:teuthology.orchestra.run.smithi090.stdout:checking xfs/handle.h presence... yes 2023-06-09T04:43:33.838 INFO:teuthology.orchestra.run.smithi090.stdout:checking for xfs/handle.h... yes 2023-06-09T04:43:33.944 INFO:teuthology.orchestra.run.smithi090.stdout:checking for attr_list_by_handle in -lhandle... yes 2023-06-09T04:43:34.025 INFO:teuthology.orchestra.run.smithi090.stdout:checking sys/acl.h usability... yes 2023-06-09T04:43:34.056 INFO:teuthology.orchestra.run.smithi090.stdout:checking sys/acl.h presence... yes 2023-06-09T04:43:34.057 INFO:teuthology.orchestra.run.smithi090.stdout:checking for sys/acl.h... yes 2023-06-09T04:43:34.139 INFO:teuthology.orchestra.run.smithi090.stdout:checking acl/libacl.h usability... yes 2023-06-09T04:43:34.172 INFO:teuthology.orchestra.run.smithi090.stdout:checking acl/libacl.h presence... yes 2023-06-09T04:43:34.173 INFO:teuthology.orchestra.run.smithi090.stdout:checking for acl/libacl.h... yes 2023-06-09T04:43:34.267 INFO:teuthology.orchestra.run.smithi090.stdout:checking for acl_init in -lacl... yes 2023-06-09T04:43:34.349 INFO:teuthology.orchestra.run.smithi090.stdout:checking gdbm-ndbm.h usability... no 2023-06-09T04:43:34.393 INFO:teuthology.orchestra.run.smithi090.stdout:checking gdbm-ndbm.h presence... no 2023-06-09T04:43:34.393 INFO:teuthology.orchestra.run.smithi090.stdout:checking for gdbm-ndbm.h... no 2023-06-09T04:43:34.473 INFO:teuthology.orchestra.run.smithi090.stdout:checking gdbm/ndbm.h usability... no 2023-06-09T04:43:34.522 INFO:teuthology.orchestra.run.smithi090.stdout:checking gdbm/ndbm.h presence... no 2023-06-09T04:43:34.522 INFO:teuthology.orchestra.run.smithi090.stdout:checking for gdbm/ndbm.h... no 2023-06-09T04:43:34.606 INFO:teuthology.orchestra.run.smithi090.stdout:checking ndbm.h usability... no 2023-06-09T04:43:34.646 INFO:teuthology.orchestra.run.smithi090.stdout:checking ndbm.h presence... no 2023-06-09T04:43:34.647 INFO:teuthology.orchestra.run.smithi090.stdout:checking for ndbm.h... no 2023-06-09T04:43:34.729 INFO:teuthology.orchestra.run.smithi090.stdout:checking libaio.h usability... yes 2023-06-09T04:43:34.765 INFO:teuthology.orchestra.run.smithi090.stdout:checking libaio.h presence... yes 2023-06-09T04:43:34.765 INFO:teuthology.orchestra.run.smithi090.stdout:checking for libaio.h... yes 2023-06-09T04:43:34.852 INFO:teuthology.orchestra.run.smithi090.stdout:checking liburing.h usability... no 2023-06-09T04:43:34.902 INFO:teuthology.orchestra.run.smithi090.stdout:checking liburing.h presence... no 2023-06-09T04:43:34.903 INFO:teuthology.orchestra.run.smithi090.stdout:checking for liburing.h... no 2023-06-09T04:43:34.978 INFO:teuthology.orchestra.run.smithi090.stdout:checking sys/capability.h usability... no 2023-06-09T04:43:35.034 INFO:teuthology.orchestra.run.smithi090.stdout:checking sys/capability.h presence... no 2023-06-09T04:43:35.034 INFO:teuthology.orchestra.run.smithi090.stdout:checking for sys/capability.h... no 2023-06-09T04:43:35.111 INFO:teuthology.orchestra.run.smithi090.stdout:checking linux/fiemap.h usability... yes 2023-06-09T04:43:35.140 INFO:teuthology.orchestra.run.smithi090.stdout:checking linux/fiemap.h presence... yes 2023-06-09T04:43:35.141 INFO:teuthology.orchestra.run.smithi090.stdout:checking for linux/fiemap.h... yes 2023-06-09T04:43:35.234 INFO:teuthology.orchestra.run.smithi090.stdout:checking for fallocate... yes 2023-06-09T04:43:35.331 INFO:teuthology.orchestra.run.smithi090.stdout:checking for open_by_handle_at... yes 2023-06-09T04:43:35.413 INFO:teuthology.orchestra.run.smithi090.stdout:checking sys/prctl.h usability... yes 2023-06-09T04:43:35.444 INFO:teuthology.orchestra.run.smithi090.stdout:checking sys/prctl.h presence... yes 2023-06-09T04:43:35.444 INFO:teuthology.orchestra.run.smithi090.stdout:checking for sys/prctl.h... yes 2023-06-09T04:43:35.532 INFO:teuthology.orchestra.run.smithi090.stdout:checking linux/fs.h usability... yes 2023-06-09T04:43:35.565 INFO:teuthology.orchestra.run.smithi090.stdout:checking linux/fs.h presence... yes 2023-06-09T04:43:35.565 INFO:teuthology.orchestra.run.smithi090.stdout:checking for linux/fs.h... yes 2023-06-09T04:43:35.645 INFO:teuthology.orchestra.run.smithi090.stdout:checking btrfsutil.h usability... no 2023-06-09T04:43:35.686 INFO:teuthology.orchestra.run.smithi090.stdout:checking btrfsutil.h presence... no 2023-06-09T04:43:35.687 INFO:teuthology.orchestra.run.smithi090.stdout:checking for btrfsutil.h... no 2023-06-09T04:43:35.783 INFO:teuthology.orchestra.run.smithi090.stdout:checking for copy_file_range... yes 2023-06-09T04:43:35.885 INFO:teuthology.orchestra.run.smithi090.stdout:checking for SEEK_DATA... yes 2023-06-09T04:43:36.008 INFO:teuthology.orchestra.run.smithi090.stdout:checking for BMV_OF_SHARED... yes 2023-06-09T04:43:36.108 INFO:teuthology.orchestra.run.smithi090.stdout:checking for nftw... yes 2023-06-09T04:43:36.207 INFO:teuthology.orchestra.run.smithi090.stdout:checking for RLIMIT_NOFILE... yes 2023-06-09T04:43:36.292 INFO:teuthology.orchestra.run.smithi090.stdout:checking for FIEXCHANGE_RANGE... no 2023-06-09T04:43:36.392 INFO:teuthology.orchestra.run.smithi090.stdout:checking for renameat2... yes 2023-06-09T04:43:36.492 INFO:teuthology.orchestra.run.smithi090.stdout:checking for reallocarray... yes 2023-06-09T04:43:36.553 INFO:teuthology.orchestra.run.smithi090.stdout:checking for struct mount_attr... no 2023-06-09T04:43:36.685 INFO:teuthology.orchestra.run.smithi090.stdout:checking for struct btrfs_qgroup_limit... yes 2023-06-09T04:43:36.812 INFO:teuthology.orchestra.run.smithi090.stdout:checking for struct btrfs_qgroup_inherit... yes 2023-06-09T04:43:36.937 INFO:teuthology.orchestra.run.smithi090.stdout:checking for struct btrfs_ioctl_vol_args... yes 2023-06-09T04:43:37.061 INFO:teuthology.orchestra.run.smithi090.stdout:checking for struct btrfs_ioctl_vol_args_v2... yes 2023-06-09T04:43:37.195 INFO:teuthology.orchestra.run.smithi090.stdout:checking for struct btrfs_ioctl_ino_lookup_args... yes 2023-06-09T04:43:37.311 INFO:teuthology.orchestra.run.smithi090.stdout:checking for struct btrfs_ioctl_ino_lookup_user_args... yes 2023-06-09T04:43:37.432 INFO:teuthology.orchestra.run.smithi090.stdout:checking for struct btrfs_ioctl_get_subvol_rootref_args... yes 2023-06-09T04:43:37.527 INFO:teuthology.orchestra.run.smithi090.stdout:checking linux/btrfs.h usability... yes 2023-06-09T04:43:37.556 INFO:teuthology.orchestra.run.smithi090.stdout:checking linux/btrfs.h presence... yes 2023-06-09T04:43:37.557 INFO:teuthology.orchestra.run.smithi090.stdout:checking for linux/btrfs.h... yes 2023-06-09T04:43:37.660 INFO:teuthology.orchestra.run.smithi090.stdout:checking linux/btrfs_tree.h usability... yes 2023-06-09T04:43:37.692 INFO:teuthology.orchestra.run.smithi090.stdout:checking linux/btrfs_tree.h presence... yes 2023-06-09T04:43:37.693 INFO:teuthology.orchestra.run.smithi090.stdout:checking for linux/btrfs_tree.h... yes 2023-06-09T04:43:37.826 INFO:teuthology.orchestra.run.smithi090.stdout:checking for struct btrfs_ioctl_vol_args_v2.subvolid... no 2023-06-09T04:43:37.879 INFO:teuthology.orchestra.run.smithi090.stdout:configure: creating ./config.status 2023-06-09T04:43:39.756 INFO:teuthology.orchestra.run.smithi090.stdout:config.status: creating include/builddefs 2023-06-09T04:43:39.824 INFO:teuthology.orchestra.run.smithi090.stdout:config.status: creating include/config.h 2023-06-09T04:43:39.871 INFO:teuthology.orchestra.run.smithi090.stdout:config.status: executing libtool commands 2023-06-09T04:43:40.026 INFO:teuthology.orchestra.run.smithi090.stdout:Building include 2023-06-09T04:43:40.041 INFO:teuthology.orchestra.run.smithi090.stdout:Building lib 2023-06-09T04:43:40.055 INFO:teuthology.orchestra.run.smithi090.stdout: [LTDEP] 2023-06-09T04:43:40.401 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] dataascii.lo 2023-06-09T04:43:40.696 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] databin.lo 2023-06-09T04:43:41.028 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] datapid.lo 2023-06-09T04:43:41.309 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] file_lock.lo 2023-06-09T04:43:41.935 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] forker.lo 2023-06-09T04:43:42.249 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] pattern.lo 2023-06-09T04:43:42.540 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] open_flags.lo 2023-06-09T04:43:42.859 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] random_range.lo 2023-06-09T04:43:43.267 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] string_to_tokens.lo 2023-06-09T04:43:43.539 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] str_to_bytes.lo 2023-06-09T04:43:43.845 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] tlibio.lo 2023-06-09T04:43:44.282 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] write_log.lo 2023-06-09T04:43:44.454 INFO:teuthology.orchestra.run.smithi090.stderr:write_log.c: In function 'wlog_record_write': 2023-06-09T04:43:44.455 INFO:teuthology.orchestra.run.smithi090.stderr:write_log.c:205:6: warning: ignoring return value of 'write', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:43:44.455 INFO:teuthology.orchestra.run.smithi090.stderr: 205 | write(wfile->w_afd, wbuf, reclen); 2023-06-09T04:43:44.455 INFO:teuthology.orchestra.run.smithi090.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:43:44.455 INFO:teuthology.orchestra.run.smithi090.stderr:write_log.c:209:6: warning: ignoring return value of 'write', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:43:44.455 INFO:teuthology.orchestra.run.smithi090.stderr: 209 | write(wfile->w_rfd, wbuf, reclen); 2023-06-09T04:43:44.455 INFO:teuthology.orchestra.run.smithi090.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:43:44.700 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] random.lo 2023-06-09T04:43:44.964 INFO:teuthology.orchestra.run.smithi090.stdout: [LD] 2023-06-09T04:43:45.190 INFO:teuthology.orchestra.run.smithi090.stdout:Building ltp 2023-06-09T04:43:45.205 INFO:teuthology.orchestra.run.smithi090.stdout: [DEP] 2023-06-09T04:43:45.495 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] doio 2023-06-09T04:43:46.518 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] fsstress 2023-06-09T04:43:48.275 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] fsx 2023-06-09T04:43:48.524 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:43:48.530 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:43:49.469 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] growfiles 2023-06-09T04:43:50.283 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] iogen 2023-06-09T04:43:50.581 INFO:teuthology.orchestra.run.smithi090.stderr:iogen.c: In function 'main': 2023-06-09T04:43:50.581 INFO:teuthology.orchestra.run.smithi090.stderr:iogen.c:280:2: warning: ignoring return value of 'write', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:43:50.581 INFO:teuthology.orchestra.run.smithi090.stderr: 280 | write(outfd, (char *)&req, sizeof(req)); 2023-06-09T04:43:50.582 INFO:teuthology.orchestra.run.smithi090.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:43:50.585 INFO:teuthology.orchestra.run.smithi090.stderr:iogen.c: In function 'parse_cmdline': 2023-06-09T04:43:50.585 INFO:teuthology.orchestra.run.smithi090.stderr:iogen.c:1535:10: warning: ignoring return value of 'getcwd', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:43:50.585 INFO:teuthology.orchestra.run.smithi090.stderr: 1535 | getcwd(fptr->f_path, 2023-06-09T04:43:50.586 INFO:teuthology.orchestra.run.smithi090.stderr: | ^~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:43:50.586 INFO:teuthology.orchestra.run.smithi090.stderr: 1536 | sizeof(fptr->f_path)-1); 2023-06-09T04:43:50.586 INFO:teuthology.orchestra.run.smithi090.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:43:50.899 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] aio-stress 2023-06-09T04:43:51.235 INFO:teuthology.orchestra.run.smithi090.stderr:aio-stress.c: In function 'setup_shared_mem': 2023-06-09T04:43:51.235 INFO:teuthology.orchestra.run.smithi090.stderr:aio-stress.c:1013:2: warning: ignoring return value of 'ftruncate', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:43:51.236 INFO:teuthology.orchestra.run.smithi090.stderr: 1013 | ftruncate(fd, total_ram); 2023-06-09T04:43:51.236 INFO:teuthology.orchestra.run.smithi090.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:43:51.626 INFO:teuthology.orchestra.run.smithi090.stdout:Building src 2023-06-09T04:43:51.642 INFO:teuthology.orchestra.run.smithi090.stdout: [DEP] 2023-06-09T04:43:55.313 INFO:teuthology.orchestra.run.smithi090.stdout: [DEP] 2023-06-09T04:43:55.400 INFO:teuthology.orchestra.run.smithi090.stdout: [DEP] 2023-06-09T04:43:55.435 INFO:teuthology.orchestra.run.smithi090.stdout: [DEP] 2023-06-09T04:43:55.917 INFO:teuthology.orchestra.run.smithi090.stdout: [DEP] 2023-06-09T04:43:55.999 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] dirstress 2023-06-09T04:43:56.509 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] fill 2023-06-09T04:43:56.888 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] fill2 2023-06-09T04:43:57.336 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] getpagesize 2023-06-09T04:43:57.699 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] holes 2023-06-09T04:43:58.147 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] lstat64 2023-06-09T04:43:58.570 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] nametest 2023-06-09T04:43:58.898 INFO:teuthology.orchestra.run.smithi090.stderr:nametest.c: In function 'main': 2023-06-09T04:43:58.898 INFO:teuthology.orchestra.run.smithi090.stderr:nametest.c:236:5: warning: ignoring return value of 'write', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:43:58.898 INFO:teuthology.orchestra.run.smithi090.stderr: 236 | write(1, "\n", 1); 2023-06-09T04:43:58.898 INFO:teuthology.orchestra.run.smithi090.stderr: | ^~~~~~~~~~~~~~~~~ 2023-06-09T04:43:58.898 INFO:teuthology.orchestra.run.smithi090.stderr:nametest.c:238:4: warning: ignoring return value of 'write', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:43:58.898 INFO:teuthology.orchestra.run.smithi090.stderr: 238 | write(1, ".", 1); 2023-06-09T04:43:58.899 INFO:teuthology.orchestra.run.smithi090.stderr: | ^~~~~~~~~~~~~~~~ 2023-06-09T04:43:58.899 INFO:teuthology.orchestra.run.smithi090.stderr:nametest.c:288:5: warning: ignoring return value of 'write', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:43:58.899 INFO:teuthology.orchestra.run.smithi090.stderr: 288 | write(1, ".", 1); 2023-06-09T04:43:58.899 INFO:teuthology.orchestra.run.smithi090.stderr: | ^~~~~~~~~~~~~~~~ 2023-06-09T04:43:59.068 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] permname 2023-06-09T04:43:59.515 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] randholes 2023-06-09T04:44:00.017 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] runas 2023-06-09T04:44:00.433 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] truncfile 2023-06-09T04:44:00.861 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] usemem 2023-06-09T04:44:01.242 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] mmapcat 2023-06-09T04:44:01.544 INFO:teuthology.orchestra.run.smithi090.stderr:mmapcat.c: In function 'main': 2023-06-09T04:44:01.545 INFO:teuthology.orchestra.run.smithi090.stderr:mmapcat.c:29:2: warning: ignoring return value of 'write', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:01.545 INFO:teuthology.orchestra.run.smithi090.stderr: 29 | write(1,ptr2,ptr - ptr2); 2023-06-09T04:44:01.545 INFO:teuthology.orchestra.run.smithi090.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:44:01.621 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] append_reader 2023-06-09T04:44:02.011 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] append_writer 2023-06-09T04:44:02.388 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] dirperf 2023-06-09T04:44:02.865 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] metaperf 2023-06-09T04:44:03.191 INFO:teuthology.orchestra.run.smithi090.stderr:metaperf.c: In function 'crfiles': 2023-06-09T04:44:03.192 INFO:teuthology.orchestra.run.smithi090.stderr:metaperf.c:166:4: warning: ignoring return value of 'write', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:03.192 INFO:teuthology.orchestra.run.smithi090.stderr: 166 | write(fd, buf, fsize); 2023-06-09T04:44:03.192 INFO:teuthology.orchestra.run.smithi090.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:44:03.193 INFO:teuthology.orchestra.run.smithi090.stderr:metaperf.c: In function 't_linkun': 2023-06-09T04:44:03.193 INFO:teuthology.orchestra.run.smithi090.stderr:metaperf.c:454:4: warning: ignoring return value of 'link', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:03.193 INFO:teuthology.orchestra.run.smithi090.stderr: 454 | link("a", *fnp); 2023-06-09T04:44:03.193 INFO:teuthology.orchestra.run.smithi090.stderr: | ^~~~~~~~~~~~~~~ 2023-06-09T04:44:03.193 INFO:teuthology.orchestra.run.smithi090.stderr:metaperf.c: In function 't_chown': 2023-06-09T04:44:03.193 INFO:teuthology.orchestra.run.smithi090.stderr:metaperf.c:404:5: warning: ignoring return value of 'chown', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:03.194 INFO:teuthology.orchestra.run.smithi090.stderr: 404 | chown(*fnp, 2, -1); 2023-06-09T04:44:03.194 INFO:teuthology.orchestra.run.smithi090.stderr: | ^~~~~~~~~~~~~~~~~~ 2023-06-09T04:44:03.194 INFO:teuthology.orchestra.run.smithi090.stderr:metaperf.c:406:5: warning: ignoring return value of 'chown', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:03.194 INFO:teuthology.orchestra.run.smithi090.stderr: 406 | chown(*fnp, 1, -1); 2023-06-09T04:44:03.194 INFO:teuthology.orchestra.run.smithi090.stderr: | ^~~~~~~~~~~~~~~~~~ 2023-06-09T04:44:03.194 INFO:teuthology.orchestra.run.smithi090.stderr:metaperf.c: In function 'i_chown': 2023-06-09T04:44:03.194 INFO:teuthology.orchestra.run.smithi090.stderr:metaperf.c:291:3: warning: ignoring return value of 'chown', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:03.195 INFO:teuthology.orchestra.run.smithi090.stderr: 291 | chown(*fnp, 1, -1); 2023-06-09T04:44:03.195 INFO:teuthology.orchestra.run.smithi090.stderr: | ^~~~~~~~~~~~~~~~~~ 2023-06-09T04:44:03.195 INFO:teuthology.orchestra.run.smithi090.stderr:metaperf.c: In function 'main': 2023-06-09T04:44:03.195 INFO:teuthology.orchestra.run.smithi090.stderr:metaperf.c:152:2: warning: ignoring return value of 'chdir', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:03.195 INFO:teuthology.orchestra.run.smithi090.stderr: 152 | chdir(".."); 2023-06-09T04:44:03.195 INFO:teuthology.orchestra.run.smithi090.stderr: | ^~~~~~~~~~~ 2023-06-09T04:44:03.378 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] devzero 2023-06-09T04:44:03.799 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] feature 2023-06-09T04:44:04.285 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] alloc 2023-06-09T04:44:04.613 INFO:teuthology.orchestra.run.smithi090.stderr:alloc.c: In function 'main': 2023-06-09T04:44:04.614 INFO:teuthology.orchestra.run.smithi090.stderr:alloc.c:247:3: warning: ignoring return value of 'mkstemp', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:04.614 INFO:teuthology.orchestra.run.smithi090.stderr: 247 | mkstemp(tmpfile); 2023-06-09T04:44:04.614 INFO:teuthology.orchestra.run.smithi090.stderr: | ^~~~~~~~~~~~~~~~ 2023-06-09T04:44:04.748 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] fault 2023-06-09T04:44:05.149 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] fstest 2023-06-09T04:44:05.654 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] t_access_root 2023-06-09T04:44:05.966 INFO:teuthology.orchestra.run.smithi090.stderr:t_access_root.c: In function 'main': 2023-06-09T04:44:05.967 INFO:teuthology.orchestra.run.smithi090.stderr:t_access_root.c:55:5: warning: ignoring return value of 'system', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:05.967 INFO:teuthology.orchestra.run.smithi090.stderr: 55 | system(cmd); 2023-06-09T04:44:05.967 INFO:teuthology.orchestra.run.smithi090.stderr: | ^~~~~~~~~~~ 2023-06-09T04:44:06.048 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] godown 2023-06-09T04:44:06.452 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] resvtest 2023-06-09T04:44:06.903 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] writemod 2023-06-09T04:44:07.271 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] writev_on_pagefault 2023-06-09T04:44:07.668 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] makeextents 2023-06-09T04:44:08.106 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] itrash 2023-06-09T04:44:08.494 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] rename 2023-06-09T04:44:08.854 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] multi_open_unlink 2023-06-09T04:44:09.264 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] unwritten_sync 2023-06-09T04:44:09.676 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] genhashnames 2023-06-09T04:44:10.082 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] t_holes 2023-06-09T04:44:10.468 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] t_mmap_writev 2023-06-09T04:44:10.849 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] t_truncate_cmtime 2023-06-09T04:44:11.251 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] dirhash_collide 2023-06-09T04:44:11.673 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] t_rename_overwrite 2023-06-09T04:44:12.041 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] holetest 2023-06-09T04:44:12.362 INFO:teuthology.orchestra.run.smithi090.stderr:holetest.c: In function 'pt_write_marker': 2023-06-09T04:44:12.363 INFO:teuthology.orchestra.run.smithi090.stderr:holetest.c:140:3: warning: ignoring return value of 'pwrite', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:12.363 INFO:teuthology.orchestra.run.smithi090.stderr: 140 | pwrite(fd, &tid, sizeof(tid), i * page_size + pgoff); 2023-06-09T04:44:12.363 INFO:teuthology.orchestra.run.smithi090.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:44:12.511 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] t_truncate_self 2023-06-09T04:44:12.878 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] af_unix 2023-06-09T04:44:13.277 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] t_mmap_stale_pmd 2023-06-09T04:44:13.597 INFO:teuthology.orchestra.run.smithi090.stderr:t_mmap_stale_pmd.c: In function 'main': 2023-06-09T04:44:13.597 INFO:teuthology.orchestra.run.smithi090.stderr:t_mmap_stale_pmd.c:42:2: warning: ignoring return value of 'ftruncate', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:13.597 INFO:teuthology.orchestra.run.smithi090.stderr: 42 | ftruncate(fd, 0); 2023-06-09T04:44:13.597 INFO:teuthology.orchestra.run.smithi090.stderr: | ^~~~~~~~~~~~~~~~ 2023-06-09T04:44:13.597 INFO:teuthology.orchestra.run.smithi090.stderr:t_mmap_stale_pmd.c:43:2: warning: ignoring return value of 'ftruncate', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:13.597 INFO:teuthology.orchestra.run.smithi090.stderr: 43 | ftruncate(fd, MiB(4)); 2023-06-09T04:44:13.598 INFO:teuthology.orchestra.run.smithi090.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:44:13.598 INFO:teuthology.orchestra.run.smithi090.stderr:t_mmap_stale_pmd.c:55:2: warning: ignoring return value of 'pwrite', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:13.598 INFO:teuthology.orchestra.run.smithi090.stderr: 55 | pwrite(fd, buffer, strlen(buffer), MiB(2)); 2023-06-09T04:44:13.598 INFO:teuthology.orchestra.run.smithi090.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:44:13.671 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] t_mmap_cow_race 2023-06-09T04:44:13.988 INFO:teuthology.orchestra.run.smithi090.stderr:t_mmap_cow_race.c: In function 'main': 2023-06-09T04:44:13.988 INFO:teuthology.orchestra.run.smithi090.stderr:t_mmap_cow_race.c:61:2: warning: ignoring return value of 'ftruncate', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:13.988 INFO:teuthology.orchestra.run.smithi090.stderr: 61 | ftruncate(fd, 0); 2023-06-09T04:44:13.989 INFO:teuthology.orchestra.run.smithi090.stderr: | ^~~~~~~~~~~~~~~~ 2023-06-09T04:44:13.989 INFO:teuthology.orchestra.run.smithi090.stderr:t_mmap_cow_race.c:62:2: warning: ignoring return value of 'ftruncate', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:13.989 INFO:teuthology.orchestra.run.smithi090.stderr: 62 | ftruncate(fd, MiB(2)); 2023-06-09T04:44:13.989 INFO:teuthology.orchestra.run.smithi090.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:44:14.074 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] t_mmap_fallocate 2023-06-09T04:44:14.453 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] fsync-err 2023-06-09T04:44:14.896 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] t_mmap_write_ro 2023-06-09T04:44:15.289 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] t_ext4_dax_journal_corruption 2023-06-09T04:44:15.618 INFO:teuthology.orchestra.run.smithi090.stderr:t_ext4_dax_journal_corruption.c: In function 'main': 2023-06-09T04:44:15.619 INFO:teuthology.orchestra.run.smithi090.stderr:t_ext4_dax_journal_corruption.c:61:2: warning: ignoring return value of 'ftruncate', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:15.619 INFO:teuthology.orchestra.run.smithi090.stderr: 61 | ftruncate(fd, 0); 2023-06-09T04:44:15.619 INFO:teuthology.orchestra.run.smithi090.stderr: | ^~~~~~~~~~~~~~~~ 2023-06-09T04:44:15.699 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] t_ext4_dax_inline_corruption 2023-06-09T04:44:16.093 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] t_ofd_locks 2023-06-09T04:44:16.532 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] t_mmap_collision 2023-06-09T04:44:16.983 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] mmap-write-concurrent 2023-06-09T04:44:17.380 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] t_get_file_time 2023-06-09T04:44:17.758 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] t_create_short_dirs 2023-06-09T04:44:18.158 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] t_create_long_dirs 2023-06-09T04:44:18.559 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] t_enospc 2023-06-09T04:44:18.653 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:44:18.661 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:44:18.981 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] t_mmap_writev_overlap 2023-06-09T04:44:19.393 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] checkpoint_journal 2023-06-09T04:44:19.789 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] mmap-rw-fault 2023-06-09T04:44:20.230 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] allocstale 2023-06-09T04:44:20.633 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] t_mmap_cow_memory_failure 2023-06-09T04:44:21.051 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] fake-dump-rootino 2023-06-09T04:44:21.433 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] dio-buf-fault 2023-06-09T04:44:21.818 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] xfsctl 2023-06-09T04:44:22.256 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] bstat 2023-06-09T04:44:22.708 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] t_mtab 2023-06-09T04:44:23.020 INFO:teuthology.orchestra.run.smithi090.stderr:t_mtab.c: In function 'update_mtab': 2023-06-09T04:44:23.020 INFO:teuthology.orchestra.run.smithi090.stderr:t_mtab.c:256:3: warning: ignoring return value of 'chown', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:23.020 INFO:teuthology.orchestra.run.smithi090.stderr: 256 | chown (mounted_temp, sbuf.st_uid, sbuf.st_gid); 2023-06-09T04:44:23.020 INFO:teuthology.orchestra.run.smithi090.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:44:23.133 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] getdevicesize 2023-06-09T04:44:23.496 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] preallo_rw_pattern_reader 2023-06-09T04:44:23.822 INFO:teuthology.orchestra.run.smithi090.stderr:In file included from preallo_rw_pattern_reader.c:2: 2023-06-09T04:44:23.822 INFO:teuthology.orchestra.run.smithi090.stderr:iopat.c: In function 'main': 2023-06-09T04:44:23.822 INFO:teuthology.orchestra.run.smithi090.stderr:iopat.c:38:4: warning: ignoring return value of 'read', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:23.822 INFO:teuthology.orchestra.run.smithi090.stderr: 38 | read(fd, &x, 1048576); 2023-06-09T04:44:23.822 INFO:teuthology.orchestra.run.smithi090.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:44:23.893 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] preallo_rw_pattern_writer 2023-06-09T04:44:24.214 INFO:teuthology.orchestra.run.smithi090.stderr:In file included from preallo_rw_pattern_writer.c:2: 2023-06-09T04:44:24.214 INFO:teuthology.orchestra.run.smithi090.stderr:iopat.c: In function 'main': 2023-06-09T04:44:24.214 INFO:teuthology.orchestra.run.smithi090.stderr:iopat.c:34:4: warning: ignoring return value of 'write', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:24.215 INFO:teuthology.orchestra.run.smithi090.stderr: 34 | write(fd, &x, 1048576); 2023-06-09T04:44:24.215 INFO:teuthology.orchestra.run.smithi090.stderr: | ^~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:44:24.287 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] ftrunc 2023-06-09T04:44:24.673 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] trunc 2023-06-09T04:44:25.074 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] fs_perms 2023-06-09T04:44:25.395 INFO:teuthology.orchestra.run.smithi090.stderr:fs_perms.c: In function 'main': 2023-06-09T04:44:25.395 INFO:teuthology.orchestra.run.smithi090.stderr:fs_perms.c:54:4: warning: ignoring return value of 'system', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:25.396 INFO:teuthology.orchestra.run.smithi090.stderr: 54 | system("rm -f test.file"); 2023-06-09T04:44:25.396 INFO:teuthology.orchestra.run.smithi090.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:44:25.396 INFO:teuthology.orchestra.run.smithi090.stderr:fs_perms.c: In function 'testsetup': 2023-06-09T04:44:25.397 INFO:teuthology.orchestra.run.smithi090.stderr:fs_perms.c:67:4: warning: ignoring return value of 'system', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:25.397 INFO:teuthology.orchestra.run.smithi090.stderr: 67 | system("cp testx.file test.file"); 2023-06-09T04:44:25.397 INFO:teuthology.orchestra.run.smithi090.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:44:25.398 INFO:teuthology.orchestra.run.smithi090.stderr:fs_perms.c:69:4: warning: ignoring return value of 'chown', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:25.398 INFO:teuthology.orchestra.run.smithi090.stderr: 69 | chown("test.file",cuserId,cgroupId); 2023-06-09T04:44:25.398 INFO:teuthology.orchestra.run.smithi090.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:44:25.398 INFO:teuthology.orchestra.run.smithi090.stderr:fs_perms.c: In function 'testfperm': 2023-06-09T04:44:25.399 INFO:teuthology.orchestra.run.smithi090.stderr:fs_perms.c:123:5: warning: ignoring return value of 'seteuid', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:25.399 INFO:teuthology.orchestra.run.smithi090.stderr: 123 | seteuid(0); 2023-06-09T04:44:25.399 INFO:teuthology.orchestra.run.smithi090.stderr: | ^~~~~~~~~~ 2023-06-09T04:44:25.399 INFO:teuthology.orchestra.run.smithi090.stderr:fs_perms.c:124:5: warning: ignoring return value of 'setegid', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:25.400 INFO:teuthology.orchestra.run.smithi090.stderr: 124 | setegid(0); 2023-06-09T04:44:25.400 INFO:teuthology.orchestra.run.smithi090.stderr: | ^~~~~~~~~~ 2023-06-09T04:44:25.475 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] testx 2023-06-09T04:44:25.837 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] looptest 2023-06-09T04:44:26.276 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] locktest 2023-06-09T04:44:26.872 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] unwritten_mmap 2023-06-09T04:44:27.277 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] bulkstat_unlink_test 2023-06-09T04:44:27.617 INFO:teuthology.orchestra.run.smithi090.stderr:bulkstat_unlink_test.c: In function 'main': 2023-06-09T04:44:27.618 INFO:teuthology.orchestra.run.smithi090.stderr:bulkstat_unlink_test.c:106:4: warning: ignoring return value of 'write', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:27.618 INFO:teuthology.orchestra.run.smithi090.stderr: 106 | write(fd[i], fname, sizeof(fname)); 2023-06-09T04:44:27.618 INFO:teuthology.orchestra.run.smithi090.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:44:27.618 INFO:teuthology.orchestra.run.smithi090.stderr:bulkstat_unlink_test.c:178:3: warning: ignoring return value of 'system', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:27.618 INFO:teuthology.orchestra.run.smithi090.stderr: 178 | system(fname); 2023-06-09T04:44:27.618 INFO:teuthology.orchestra.run.smithi090.stderr: | ^~~~~~~~~~~~~ 2023-06-09T04:44:27.744 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] deduperace 2023-06-09T04:44:28.198 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] bulkstat_unlink_test_modified 2023-06-09T04:44:28.532 INFO:teuthology.orchestra.run.smithi090.stderr:bulkstat_unlink_test_modified.c: In function 'main': 2023-06-09T04:44:28.532 INFO:teuthology.orchestra.run.smithi090.stderr:bulkstat_unlink_test_modified.c:83:6: warning: ignoring return value of 'write', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:28.533 INFO:teuthology.orchestra.run.smithi090.stderr: 83 | write(fd, fname, sizeof(fname)); 2023-06-09T04:44:28.533 INFO:teuthology.orchestra.run.smithi090.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:44:28.533 INFO:teuthology.orchestra.run.smithi090.stderr:bulkstat_unlink_test_modified.c:139:6: warning: ignoring return value of 'write', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:28.533 INFO:teuthology.orchestra.run.smithi090.stderr: 139 | write(fd, fname, sizeof(fname)); 2023-06-09T04:44:28.533 INFO:teuthology.orchestra.run.smithi090.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:44:28.533 INFO:teuthology.orchestra.run.smithi090.stderr:bulkstat_unlink_test_modified.c:185:2: warning: ignoring return value of 'system', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:28.533 INFO:teuthology.orchestra.run.smithi090.stderr: 185 | system(fname); 2023-06-09T04:44:28.534 INFO:teuthology.orchestra.run.smithi090.stderr: | ^~~~~~~~~~~~~ 2023-06-09T04:44:28.653 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] t_dir_offset 2023-06-09T04:44:29.032 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] t_futimens 2023-06-09T04:44:29.401 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] t_immutable 2023-06-09T04:44:29.754 INFO:teuthology.orchestra.run.smithi090.stderr:t_immutable.c: In function 'create_test_area': 2023-06-09T04:44:29.755 INFO:teuthology.orchestra.run.smithi090.stderr:t_immutable.c:2061:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:29.755 INFO:teuthology.orchestra.run.smithi090.stderr: 2061 | asprintf(&path, "%s/immutable.d", dir); 2023-06-09T04:44:29.755 INFO:teuthology.orchestra.run.smithi090.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:44:29.755 INFO:teuthology.orchestra.run.smithi090.stderr:t_immutable.c:2096:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:29.755 INFO:teuthology.orchestra.run.smithi090.stderr: 2096 | asprintf(&path, "%s/append-only.d", dir); 2023-06-09T04:44:29.755 INFO:teuthology.orchestra.run.smithi090.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:44:29.756 INFO:teuthology.orchestra.run.smithi090.stderr:t_immutable.c: In function 'remove_test_area': 2023-06-09T04:44:29.756 INFO:teuthology.orchestra.run.smithi090.stderr:t_immutable.c:2152:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:29.756 INFO:teuthology.orchestra.run.smithi090.stderr: 2152 | asprintf(&path, "%s/immutable.d", dir); 2023-06-09T04:44:29.757 INFO:teuthology.orchestra.run.smithi090.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:44:29.757 INFO:teuthology.orchestra.run.smithi090.stderr:t_immutable.c:2163:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:29.757 INFO:teuthology.orchestra.run.smithi090.stderr: 2163 | asprintf(&path, "%s/empty-immutable.d", dir); 2023-06-09T04:44:29.757 INFO:teuthology.orchestra.run.smithi090.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:44:29.757 INFO:teuthology.orchestra.run.smithi090.stderr:t_immutable.c:2175:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:29.757 INFO:teuthology.orchestra.run.smithi090.stderr: 2175 | asprintf(&path, "%s/append-only.d", dir); 2023-06-09T04:44:29.757 INFO:teuthology.orchestra.run.smithi090.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:44:29.758 INFO:teuthology.orchestra.run.smithi090.stderr:t_immutable.c:2186:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:29.758 INFO:teuthology.orchestra.run.smithi090.stderr: 2186 | asprintf(&path, "%s/empty-append-only.d", dir); 2023-06-09T04:44:29.758 INFO:teuthology.orchestra.run.smithi090.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:44:29.758 INFO:teuthology.orchestra.run.smithi090.stderr:t_immutable.c:2197:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:29.758 INFO:teuthology.orchestra.run.smithi090.stderr: 2197 | asprintf(&path, "%s/append-only.f", dir); 2023-06-09T04:44:29.758 INFO:teuthology.orchestra.run.smithi090.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:44:29.758 INFO:teuthology.orchestra.run.smithi090.stderr:t_immutable.c:2209:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:29.758 INFO:teuthology.orchestra.run.smithi090.stderr: 2209 | asprintf(&path, "%s/immutable.f", dir); 2023-06-09T04:44:29.759 INFO:teuthology.orchestra.run.smithi090.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:44:29.760 INFO:teuthology.orchestra.run.smithi090.stderr:t_immutable.c: In function 'check_test_area': 2023-06-09T04:44:29.760 INFO:teuthology.orchestra.run.smithi090.stderr:t_immutable.c:1788:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:29.760 INFO:teuthology.orchestra.run.smithi090.stderr: 1788 | asprintf(&path, "%s/", dir); 2023-06-09T04:44:29.760 INFO:teuthology.orchestra.run.smithi090.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:44:29.760 INFO:teuthology.orchestra.run.smithi090.stderr:t_immutable.c:1800:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:29.760 INFO:teuthology.orchestra.run.smithi090.stderr: 1800 | asprintf(&path, "%s/immutable.f", dir); 2023-06-09T04:44:29.760 INFO:teuthology.orchestra.run.smithi090.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:44:29.761 INFO:teuthology.orchestra.run.smithi090.stderr:t_immutable.c:1812:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:29.761 INFO:teuthology.orchestra.run.smithi090.stderr: 1812 | asprintf(&path, "%s/append-only.f", dir); 2023-06-09T04:44:29.761 INFO:teuthology.orchestra.run.smithi090.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:44:29.761 INFO:teuthology.orchestra.run.smithi090.stderr:t_immutable.c:1824:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:29.761 INFO:teuthology.orchestra.run.smithi090.stderr: 1824 | asprintf(&path, "%s/immutable.d", dir); 2023-06-09T04:44:29.761 INFO:teuthology.orchestra.run.smithi090.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:44:29.761 INFO:teuthology.orchestra.run.smithi090.stderr:t_immutable.c:1837:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:29.761 INFO:teuthology.orchestra.run.smithi090.stderr: 1837 | asprintf(&path, "%s/append-only.d", dir); 2023-06-09T04:44:29.762 INFO:teuthology.orchestra.run.smithi090.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:44:29.762 INFO:teuthology.orchestra.run.smithi090.stderr:t_immutable.c:1850:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:29.762 INFO:teuthology.orchestra.run.smithi090.stderr: 1850 | asprintf(&path, "%s/immutable.d/file", dir); 2023-06-09T04:44:29.762 INFO:teuthology.orchestra.run.smithi090.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:44:29.762 INFO:teuthology.orchestra.run.smithi090.stderr:t_immutable.c:1862:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:29.762 INFO:teuthology.orchestra.run.smithi090.stderr: 1862 | asprintf(&path, "%s/append-only.d/file", dir); 2023-06-09T04:44:29.762 INFO:teuthology.orchestra.run.smithi090.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:44:29.762 INFO:teuthology.orchestra.run.smithi090.stderr:t_immutable.c:1874:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:29.763 INFO:teuthology.orchestra.run.smithi090.stderr: 1874 | asprintf(&path, "%s/immutable.d/dir", dir); 2023-06-09T04:44:29.763 INFO:teuthology.orchestra.run.smithi090.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:44:29.763 INFO:teuthology.orchestra.run.smithi090.stderr:t_immutable.c:1887:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:29.763 INFO:teuthology.orchestra.run.smithi090.stderr: 1887 | asprintf(&path, "%s/append-only.d/dir", dir); 2023-06-09T04:44:29.763 INFO:teuthology.orchestra.run.smithi090.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:44:29.763 INFO:teuthology.orchestra.run.smithi090.stderr:t_immutable.c: In function 'test_immutable': 2023-06-09T04:44:29.763 INFO:teuthology.orchestra.run.smithi090.stderr:t_immutable.c:151:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:29.763 INFO:teuthology.orchestra.run.smithi090.stderr: 151 | asprintf(&path, "%s/immutable.f", dir); 2023-06-09T04:44:29.764 INFO:teuthology.orchestra.run.smithi090.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:44:29.764 INFO:teuthology.orchestra.run.smithi090.stderr:t_immutable.c:381:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:29.764 INFO:teuthology.orchestra.run.smithi090.stderr: 381 | asprintf(&linkpath, "%s/immutable.f.hardlink", dir); 2023-06-09T04:44:29.764 INFO:teuthology.orchestra.run.smithi090.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:44:29.764 INFO:teuthology.orchestra.run.smithi090.stderr:t_immutable.c:408:9: warning: ignoring return value of 'chown', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:29.764 INFO:teuthology.orchestra.run.smithi090.stderr: 408 | chown(path, 0, 0); 2023-06-09T04:44:29.764 INFO:teuthology.orchestra.run.smithi090.stderr: | ^~~~~~~~~~~~~~~~~ 2023-06-09T04:44:29.765 INFO:teuthology.orchestra.run.smithi090.stderr:t_immutable.c:485:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:29.765 INFO:teuthology.orchestra.run.smithi090.stderr: 485 | asprintf(&linkpath, "%s/immutable.f.newname", dir); 2023-06-09T04:44:29.765 INFO:teuthology.orchestra.run.smithi090.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:44:29.765 INFO:teuthology.orchestra.run.smithi090.stderr:t_immutable.c:532:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:29.765 INFO:teuthology.orchestra.run.smithi090.stderr: 532 | asprintf(&path, "%s/immutable.d/file", dir); 2023-06-09T04:44:29.765 INFO:teuthology.orchestra.run.smithi090.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:44:29.765 INFO:teuthology.orchestra.run.smithi090.stderr:t_immutable.c:553:9: warning: ignoring return value of 'chown', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:29.765 INFO:teuthology.orchestra.run.smithi090.stderr: 553 | chown(path, 0, 0); 2023-06-09T04:44:29.766 INFO:teuthology.orchestra.run.smithi090.stderr: | ^~~~~~~~~~~~~~~~~ 2023-06-09T04:44:29.766 INFO:teuthology.orchestra.run.smithi090.stderr:t_immutable.c:556:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:29.766 INFO:teuthology.orchestra.run.smithi090.stderr: 556 | asprintf(&linkpath, "%s/immutable.d/file.link", dir); 2023-06-09T04:44:29.766 INFO:teuthology.orchestra.run.smithi090.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:44:29.766 INFO:teuthology.orchestra.run.smithi090.stderr:t_immutable.c:575:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:29.766 INFO:teuthology.orchestra.run.smithi090.stderr: 575 | asprintf(&linkpath, "%s/immutable.d/file.newname", dir); 2023-06-09T04:44:29.766 INFO:teuthology.orchestra.run.smithi090.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:44:29.766 INFO:teuthology.orchestra.run.smithi090.stderr:t_immutable.c:595:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:29.767 INFO:teuthology.orchestra.run.smithi090.stderr: 595 | asprintf(&path, "%s/immutable.d/newfile", dir); 2023-06-09T04:44:29.767 INFO:teuthology.orchestra.run.smithi090.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:44:29.767 INFO:teuthology.orchestra.run.smithi090.stderr:t_immutable.c:619:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:29.767 INFO:teuthology.orchestra.run.smithi090.stderr: 619 | asprintf(&path, "%s/immutable.d/newdir", dir); 2023-06-09T04:44:29.767 INFO:teuthology.orchestra.run.smithi090.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:44:29.767 INFO:teuthology.orchestra.run.smithi090.stderr:t_immutable.c:631:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:29.767 INFO:teuthology.orchestra.run.smithi090.stderr: 631 | asprintf(&path, "%s/immutable.d/dir/newfile-%d", dir, getuid()); 2023-06-09T04:44:29.767 INFO:teuthology.orchestra.run.smithi090.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:44:29.768 INFO:teuthology.orchestra.run.smithi090.stderr:t_immutable.c:653:16: warning: ignoring return value of 'chown', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:29.768 INFO:teuthology.orchestra.run.smithi090.stderr: 653 | chown(path, 0, 0); 2023-06-09T04:44:29.768 INFO:teuthology.orchestra.run.smithi090.stderr: | ^~~~~~~~~~~~~~~~~ 2023-06-09T04:44:29.768 INFO:teuthology.orchestra.run.smithi090.stderr:t_immutable.c:657:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:29.768 INFO:teuthology.orchestra.run.smithi090.stderr: 657 | asprintf(&path, "%s/immutable.d/dir", dir); 2023-06-09T04:44:29.768 INFO:teuthology.orchestra.run.smithi090.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:44:29.768 INFO:teuthology.orchestra.run.smithi090.stderr:t_immutable.c:668:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:29.769 INFO:teuthology.orchestra.run.smithi090.stderr: 668 | asprintf(&path, "%s/immutable.d", dir); 2023-06-09T04:44:29.769 INFO:teuthology.orchestra.run.smithi090.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:44:29.769 INFO:teuthology.orchestra.run.smithi090.stderr:t_immutable.c:705:9: warning: ignoring return value of 'chown', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:29.769 INFO:teuthology.orchestra.run.smithi090.stderr: 705 | chown(path, 0, 0); 2023-06-09T04:44:29.769 INFO:teuthology.orchestra.run.smithi090.stderr: | ^~~~~~~~~~~~~~~~~ 2023-06-09T04:44:29.769 INFO:teuthology.orchestra.run.smithi090.stderr:t_immutable.c:782:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:29.769 INFO:teuthology.orchestra.run.smithi090.stderr: 782 | asprintf(&path, "%s/empty-immutable.d", dir); 2023-06-09T04:44:29.769 INFO:teuthology.orchestra.run.smithi090.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:44:29.770 INFO:teuthology.orchestra.run.smithi090.stderr:t_immutable.c: In function 'test_append': 2023-06-09T04:44:29.771 INFO:teuthology.orchestra.run.smithi090.stderr:t_immutable.c:822:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:29.771 INFO:teuthology.orchestra.run.smithi090.stderr: 822 | asprintf(&path, "%s/append-only.f", dir); 2023-06-09T04:44:29.771 INFO:teuthology.orchestra.run.smithi090.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:44:29.771 INFO:teuthology.orchestra.run.smithi090.stderr:t_immutable.c:1024:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:29.771 INFO:teuthology.orchestra.run.smithi090.stderr: 1024 | asprintf(&linkpath, "%s/append-only.f.hardlink", dir); 2023-06-09T04:44:29.771 INFO:teuthology.orchestra.run.smithi090.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:44:29.771 INFO:teuthology.orchestra.run.smithi090.stderr:t_immutable.c:1051:9: warning: ignoring return value of 'chown', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:29.772 INFO:teuthology.orchestra.run.smithi090.stderr: 1051 | chown(path, 0, 0); 2023-06-09T04:44:29.772 INFO:teuthology.orchestra.run.smithi090.stderr: | ^~~~~~~~~~~~~~~~~ 2023-06-09T04:44:29.772 INFO:teuthology.orchestra.run.smithi090.stderr:t_immutable.c:1126:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:29.772 INFO:teuthology.orchestra.run.smithi090.stderr: 1126 | asprintf(&linkpath, "%s/append-only.f.newname", dir); 2023-06-09T04:44:29.772 INFO:teuthology.orchestra.run.smithi090.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:44:29.772 INFO:teuthology.orchestra.run.smithi090.stderr:t_immutable.c:1495:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:29.772 INFO:teuthology.orchestra.run.smithi090.stderr: 1495 | asprintf(&path, "%s/append-only.d/file", dir); 2023-06-09T04:44:29.773 INFO:teuthology.orchestra.run.smithi090.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:44:29.773 INFO:teuthology.orchestra.run.smithi090.stderr:t_immutable.c:1516:9: warning: ignoring return value of 'chown', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:29.773 INFO:teuthology.orchestra.run.smithi090.stderr: 1516 | chown(path, 0, 0); 2023-06-09T04:44:29.773 INFO:teuthology.orchestra.run.smithi090.stderr: | ^~~~~~~~~~~~~~~~~ 2023-06-09T04:44:29.773 INFO:teuthology.orchestra.run.smithi090.stderr:t_immutable.c:1519:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:29.773 INFO:teuthology.orchestra.run.smithi090.stderr: 1519 | asprintf(&linkpath, "%s/append-only.d/file.link-%d", dir, getuid()); 2023-06-09T04:44:29.773 INFO:teuthology.orchestra.run.smithi090.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:44:29.773 INFO:teuthology.orchestra.run.smithi090.stderr:t_immutable.c:1529:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:29.774 INFO:teuthology.orchestra.run.smithi090.stderr: 1529 | asprintf(&linkpath, "%s/append-only.d/file.symlink-%d", dir, getuid()); 2023-06-09T04:44:29.774 INFO:teuthology.orchestra.run.smithi090.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:44:29.774 INFO:teuthology.orchestra.run.smithi090.stderr:t_immutable.c:1539:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:29.774 INFO:teuthology.orchestra.run.smithi090.stderr: 1539 | asprintf(&linkpath, "%s/append-only.d/file.newname", dir); 2023-06-09T04:44:29.774 INFO:teuthology.orchestra.run.smithi090.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:44:29.774 INFO:teuthology.orchestra.run.smithi090.stderr:t_immutable.c:1559:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:29.774 INFO:teuthology.orchestra.run.smithi090.stderr: 1559 | asprintf(&path, "%s/append-only.d/newfile-%d", dir, getuid()); 2023-06-09T04:44:29.774 INFO:teuthology.orchestra.run.smithi090.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:44:29.775 INFO:teuthology.orchestra.run.smithi090.stderr:t_immutable.c:1573:4: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:29.775 INFO:teuthology.orchestra.run.smithi090.stderr: 1573 | asprintf(&path, "%s/append-only.d/newdev-%d", dir, getuid()); 2023-06-09T04:44:29.775 INFO:teuthology.orchestra.run.smithi090.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:44:29.775 INFO:teuthology.orchestra.run.smithi090.stderr:t_immutable.c:1586:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:29.775 INFO:teuthology.orchestra.run.smithi090.stderr: 1586 | asprintf(&path, "%s/append-only.d/newdir-%d", dir, getuid()); 2023-06-09T04:44:29.775 INFO:teuthology.orchestra.run.smithi090.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:44:29.775 INFO:teuthology.orchestra.run.smithi090.stderr:t_immutable.c:1596:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:29.775 INFO:teuthology.orchestra.run.smithi090.stderr: 1596 | asprintf(&path, "%s/append-only.d/newdir-%d/newfile-%d", dir, getuid(), getuid()); 2023-06-09T04:44:29.776 INFO:teuthology.orchestra.run.smithi090.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:44:29.776 INFO:teuthology.orchestra.run.smithi090.stderr:t_immutable.c:1618:16: warning: ignoring return value of 'chown', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:29.776 INFO:teuthology.orchestra.run.smithi090.stderr: 1618 | chown(path, 0, 0); 2023-06-09T04:44:29.776 INFO:teuthology.orchestra.run.smithi090.stderr: | ^~~~~~~~~~~~~~~~~ 2023-06-09T04:44:29.776 INFO:teuthology.orchestra.run.smithi090.stderr:t_immutable.c:1622:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:29.776 INFO:teuthology.orchestra.run.smithi090.stderr: 1622 | asprintf(&path, "%s/append-only.d/dir/newfile-%d", dir, getuid()); 2023-06-09T04:44:29.776 INFO:teuthology.orchestra.run.smithi090.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:44:29.777 INFO:teuthology.orchestra.run.smithi090.stderr:t_immutable.c:1644:16: warning: ignoring return value of 'chown', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:29.777 INFO:teuthology.orchestra.run.smithi090.stderr: 1644 | chown(path, 0, 0); 2023-06-09T04:44:29.777 INFO:teuthology.orchestra.run.smithi090.stderr: | ^~~~~~~~~~~~~~~~~ 2023-06-09T04:44:29.777 INFO:teuthology.orchestra.run.smithi090.stderr:t_immutable.c:1648:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:29.777 INFO:teuthology.orchestra.run.smithi090.stderr: 1648 | asprintf(&path, "%s/append-only.d/dir", dir); 2023-06-09T04:44:29.777 INFO:teuthology.orchestra.run.smithi090.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:44:29.777 INFO:teuthology.orchestra.run.smithi090.stderr:t_immutable.c:1659:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:29.777 INFO:teuthology.orchestra.run.smithi090.stderr: 1659 | asprintf(&path, "%s/append-only.d", dir); 2023-06-09T04:44:29.778 INFO:teuthology.orchestra.run.smithi090.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:44:29.778 INFO:teuthology.orchestra.run.smithi090.stderr:t_immutable.c:1692:9: warning: ignoring return value of 'chown', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:29.778 INFO:teuthology.orchestra.run.smithi090.stderr: 1692 | chown(path, 0, 0); 2023-06-09T04:44:29.778 INFO:teuthology.orchestra.run.smithi090.stderr: | ^~~~~~~~~~~~~~~~~ 2023-06-09T04:44:29.778 INFO:teuthology.orchestra.run.smithi090.stderr:t_immutable.c:1769:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:29.778 INFO:teuthology.orchestra.run.smithi090.stderr: 1769 | asprintf(&path, "%s/empty-append-only.d", dir); 2023-06-09T04:44:29.778 INFO:teuthology.orchestra.run.smithi090.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:44:30.407 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] stale_handle 2023-06-09T04:44:30.732 INFO:teuthology.orchestra.run.smithi090.stderr:stale_handle.c: In function 'main': 2023-06-09T04:44:30.733 INFO:teuthology.orchestra.run.smithi090.stderr:stale_handle.c:102:2: warning: ignoring return value of 'system', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:30.733 INFO:teuthology.orchestra.run.smithi090.stderr: 102 | system("echo 3 > /proc/sys/vm/drop_caches"); 2023-06-09T04:44:30.733 INFO:teuthology.orchestra.run.smithi090.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:44:30.822 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] pwrite_mmap_blocked 2023-06-09T04:44:31.221 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] t_dir_offset2 2023-06-09T04:44:31.664 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] seek_sanity_test 2023-06-09T04:44:32.002 INFO:teuthology.orchestra.run.smithi090.stderr:seek_sanity_test.c: In function 'test18': 2023-06-09T04:44:32.002 INFO:teuthology.orchestra.run.smithi090.stderr:seek_sanity_test.c:460:2: warning: ignoring return value of 'ftruncate', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:32.002 INFO:teuthology.orchestra.run.smithi090.stderr: 460 | ftruncate(fd, 0); 2023-06-09T04:44:32.003 INFO:teuthology.orchestra.run.smithi090.stderr: | ^~~~~~~~~~~~~~~~ 2023-06-09T04:44:32.005 INFO:teuthology.orchestra.run.smithi090.stderr:seek_sanity_test.c: In function 'test_basic_support': 2023-06-09T04:44:32.006 INFO:teuthology.orchestra.run.smithi090.stderr:seek_sanity_test.c:1207:2: warning: ignoring return value of 'ftruncate', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:32.006 INFO:teuthology.orchestra.run.smithi090.stderr: 1207 | ftruncate(fd, 0); 2023-06-09T04:44:32.006 INFO:teuthology.orchestra.run.smithi090.stderr: | ^~~~~~~~~~~~~~~~ 2023-06-09T04:44:32.006 INFO:teuthology.orchestra.run.smithi090.stderr:seek_sanity_test.c:1256:2: warning: ignoring return value of 'ftruncate', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:32.006 INFO:teuthology.orchestra.run.smithi090.stderr: 1256 | ftruncate(fd, 0); 2023-06-09T04:44:32.006 INFO:teuthology.orchestra.run.smithi090.stderr: | ^~~~~~~~~~~~~~~~ 2023-06-09T04:44:32.007 INFO:teuthology.orchestra.run.smithi090.stderr:seek_sanity_test.c: In function 'get_io_sizes': 2023-06-09T04:44:32.007 INFO:teuthology.orchestra.run.smithi090.stderr:seek_sanity_test.c:88:3: warning: ignoring return value of 'ftruncate', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:32.007 INFO:teuthology.orchestra.run.smithi090.stderr: 88 | ftruncate(fd, 0); 2023-06-09T04:44:32.007 INFO:teuthology.orchestra.run.smithi090.stderr: | ^~~~~~~~~~~~~~~~ 2023-06-09T04:44:32.007 INFO:teuthology.orchestra.run.smithi090.stderr:seek_sanity_test.c:89:3: warning: ignoring return value of 'pwrite', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:32.008 INFO:teuthology.orchestra.run.smithi090.stderr: 89 | pwrite(fd, "a", 1, offset); 2023-06-09T04:44:32.008 INFO:teuthology.orchestra.run.smithi090.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:44:32.008 INFO:teuthology.orchestra.run.smithi090.stderr:seek_sanity_test.c:98:3: warning: ignoring return value of 'ftruncate', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:32.008 INFO:teuthology.orchestra.run.smithi090.stderr: 98 | ftruncate(fd, 0); 2023-06-09T04:44:32.008 INFO:teuthology.orchestra.run.smithi090.stderr: | ^~~~~~~~~~~~~~~~ 2023-06-09T04:44:32.008 INFO:teuthology.orchestra.run.smithi090.stderr:seek_sanity_test.c:99:3: warning: ignoring return value of 'pwrite', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:32.008 INFO:teuthology.orchestra.run.smithi090.stderr: 99 | pwrite(fd, "a", 1, offset); 2023-06-09T04:44:32.008 INFO:teuthology.orchestra.run.smithi090.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:44:32.376 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] seek_copy_test 2023-06-09T04:44:32.795 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] t_readdir_1 2023-06-09T04:44:33.107 INFO:teuthology.orchestra.run.smithi090.stderr:t_readdir_1.c: In function 'main': 2023-06-09T04:44:33.107 INFO:teuthology.orchestra.run.smithi090.stderr:t_readdir_1.c:30:25: warning: ignoring return value of 'read', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:33.107 INFO:teuthology.orchestra.run.smithi090.stderr: 30 | read(fd, buf, 100); 2023-06-09T04:44:33.107 INFO:teuthology.orchestra.run.smithi090.stderr: | ^~~~~~~~~~~~~~~~~~ 2023-06-09T04:44:33.173 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] t_readdir_2 2023-06-09T04:44:33.563 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] fsync-tester 2023-06-09T04:44:33.885 INFO:teuthology.orchestra.run.smithi090.stderr:fsync-tester.c: In function 'main': 2023-06-09T04:44:33.886 INFO:teuthology.orchestra.run.smithi090.stderr:fsync-tester.c:391:3: warning: ignoring return value of 'read', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:33.886 INFO:teuthology.orchestra.run.smithi090.stderr: 391 | read(fd, &seed, sizeof(seed)); 2023-06-09T04:44:33.886 INFO:teuthology.orchestra.run.smithi090.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:44:33.886 INFO:teuthology.orchestra.run.smithi090.stderr:fsync-tester.c:541:3: warning: ignoring return value of 'system', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:33.886 INFO:teuthology.orchestra.run.smithi090.stderr: 541 | system("reboot -fn"); 2023-06-09T04:44:33.887 INFO:teuthology.orchestra.run.smithi090.stderr: | ^~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:44:33.887 INFO:teuthology.orchestra.run.smithi090.stderr:fsync-tester.c: In function 'drop_all_caches': 2023-06-09T04:44:33.887 INFO:teuthology.orchestra.run.smithi090.stderr:fsync-tester.c:90:2: warning: ignoring return value of 'write', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:33.887 INFO:teuthology.orchestra.run.smithi090.stderr: 90 | write(fd, value, sizeof(value)-1); 2023-06-09T04:44:33.887 INFO:teuthology.orchestra.run.smithi090.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:44:34.080 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] nsexec 2023-06-09T04:44:34.500 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] cloner 2023-06-09T04:44:34.926 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] renameat2 2023-06-09T04:44:35.329 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] t_getcwd 2023-06-09T04:44:35.642 INFO:teuthology.orchestra.run.smithi090.stderr:t_getcwd.c: In function 'test_getcwd': 2023-06-09T04:44:35.642 INFO:teuthology.orchestra.run.smithi090.stderr:t_getcwd.c:21:3: warning: ignoring return value of 'getcwd', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:35.643 INFO:teuthology.orchestra.run.smithi090.stderr: 21 | getcwd(cur_cwd, BUF_SIZE); 2023-06-09T04:44:35.643 INFO:teuthology.orchestra.run.smithi090.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:44:35.725 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] e4compact 2023-06-09T04:44:36.170 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] test-nextquota 2023-06-09T04:44:36.577 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] punch-alternating 2023-06-09T04:44:36.991 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] attr-list-by-handle-cursor-test 2023-06-09T04:44:37.398 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] listxattr 2023-06-09T04:44:37.766 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] dio-interleaved 2023-06-09T04:44:38.176 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] t_dir_type 2023-06-09T04:44:38.569 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] dio-invalidate-cache 2023-06-09T04:44:38.886 INFO:teuthology.orchestra.run.smithi090.stderr:dio-invalidate-cache.c: In function 'main': 2023-06-09T04:44:38.886 INFO:teuthology.orchestra.run.smithi090.stderr:dio-invalidate-cache.c:286:3: warning: ignoring return value of 'write', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:38.886 INFO:teuthology.orchestra.run.smithi090.stderr: 286 | write(fd, buf, blksz * nr_child); 2023-06-09T04:44:38.886 INFO:teuthology.orchestra.run.smithi090.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:44:39.024 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] stat_test 2023-06-09T04:44:39.591 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] t_encrypted_d_revalidate 2023-06-09T04:44:40.006 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] attr_replace_test 2023-06-09T04:44:40.411 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] swapon 2023-06-09T04:44:40.819 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] mkswap 2023-06-09T04:44:41.205 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] t_attr_corruption 2023-06-09T04:44:41.580 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] t_open_tmpfiles 2023-06-09T04:44:41.996 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] fscrypt-crypt-util 2023-06-09T04:44:42.991 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] bulkstat_null_ocount 2023-06-09T04:44:43.388 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] splice-test 2023-06-09T04:44:43.812 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] chprojid_fail 2023-06-09T04:44:44.222 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] detached_mounts_propagation 2023-06-09T04:44:44.645 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] ext4_resize 2023-06-09T04:44:45.035 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] t_readdir_3 2023-06-09T04:44:45.477 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] splice2pipe 2023-06-09T04:44:45.782 INFO:teuthology.orchestra.run.smithi090.stderr:splice2pipe.c: In function 'prepare_pipe': 2023-06-09T04:44:45.782 INFO:teuthology.orchestra.run.smithi090.stderr:splice2pipe.c:56:3: warning: ignoring return value of 'write', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:45.782 INFO:teuthology.orchestra.run.smithi090.stderr: 56 | write(p[1], buffer, n); 2023-06-09T04:44:45.782 INFO:teuthology.orchestra.run.smithi090.stderr: | ^~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:44:45.783 INFO:teuthology.orchestra.run.smithi090.stderr:splice2pipe.c:64:3: warning: ignoring return value of 'read', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:45.783 INFO:teuthology.orchestra.run.smithi090.stderr: 64 | read(p[0], buffer, n); 2023-06-09T04:44:45.783 INFO:teuthology.orchestra.run.smithi090.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:44:45.873 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] uuid_ioctl 2023-06-09T04:44:46.276 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] fiemap-tester 2023-06-09T04:44:46.815 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] t_stripealign 2023-06-09T04:44:47.217 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] open_by_handle 2023-06-09T04:44:47.728 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] t_mmap_dio 2023-06-09T04:44:48.132 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] xfsfind 2023-06-09T04:44:48.570 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] fssum 2023-06-09T04:44:48.793 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:44:48.798 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:44:49.300 INFO:teuthology.orchestra.run.smithi090.stdout:Building log-writes 2023-06-09T04:44:49.317 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] replay-log 2023-06-09T04:44:49.919 INFO:teuthology.orchestra.run.smithi090.stdout:Building perf 2023-06-09T04:44:49.934 INFO:teuthology.orchestra.run.smithi090.stdout:Building aio-dio-regress 2023-06-09T04:44:49.958 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] aio-dio-append-write-fallocate-race 2023-06-09T04:44:50.361 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] aio-dio-fcntl-race 2023-06-09T04:44:50.750 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] aio-dio-subblock-eof-read 2023-06-09T04:44:51.133 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] aio-dio-append-write-read-race 2023-06-09T04:44:51.558 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] aio-dio-invalidate-readahead 2023-06-09T04:44:51.977 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] aio-dio-hole-filling-race 2023-06-09T04:44:52.365 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] aio-free-ring-with-bogus-nr-pages 2023-06-09T04:44:52.737 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] aio-last-ref-held-by-io 2023-06-09T04:44:53.164 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] aio-dio-cycle-write 2023-06-09T04:44:53.471 INFO:teuthology.orchestra.run.smithi090.stderr:aio-dio-cycle-write.c: In function 'init_test': 2023-06-09T04:44:53.471 INFO:teuthology.orchestra.run.smithi090.stderr:aio-dio-cycle-write.c:83:2: warning: ignoring return value of 'ftruncate', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:53.472 INFO:teuthology.orchestra.run.smithi090.stderr: 83 | ftruncate(fd, buf_size); 2023-06-09T04:44:53.472 INFO:teuthology.orchestra.run.smithi090.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:44:53.597 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] aio-dio-extend-stat 2023-06-09T04:44:54.006 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] aio-io-setup-with-nonwritable-context-pointer 2023-06-09T04:44:54.369 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] aiocp 2023-06-09T04:44:54.852 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] aio-dio-invalidate-failure 2023-06-09T04:44:55.263 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] aiodio_sparse2 2023-06-09T04:44:55.570 INFO:teuthology.orchestra.run.smithi090.stderr:aiodio_sparse2.c: In function 'aiodio_sparse': 2023-06-09T04:44:55.571 INFO:teuthology.orchestra.run.smithi090.stderr:aiodio_sparse2.c:111:3: warning: ignoring return value of 'ftruncate', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:55.571 INFO:teuthology.orchestra.run.smithi090.stderr: 111 | ftruncate(fd, filesize); 2023-06-09T04:44:55.571 INFO:teuthology.orchestra.run.smithi090.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:44:55.571 INFO:teuthology.orchestra.run.smithi090.stderr:aiodio_sparse2.c: In function 'dirty_freeblocks': 2023-06-09T04:44:55.572 INFO:teuthology.orchestra.run.smithi090.stderr:aiodio_sparse2.c:274:2: warning: ignoring return value of 'ftruncate', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:55.572 INFO:teuthology.orchestra.run.smithi090.stderr: 274 | ftruncate(fd, size); 2023-06-09T04:44:55.572 INFO:teuthology.orchestra.run.smithi090.stderr: | ^~~~~~~~~~~~~~~~~~~ 2023-06-09T04:44:55.737 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] aio-dio-cow-race 2023-06-09T04:44:56.136 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] aio-dio-write-verify 2023-06-09T04:44:56.576 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] aio-dio-eof-race 2023-06-09T04:44:57.012 INFO:teuthology.orchestra.run.smithi090.stdout:Building vfs 2023-06-09T04:44:57.028 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] vfstest 2023-06-09T04:44:59.657 INFO:teuthology.orchestra.run.smithi090.stdout: [CC] mount-idmapped 2023-06-09T04:45:00.326 INFO:teuthology.orchestra.run.smithi090.stdout:Building m4 2023-06-09T04:45:00.341 INFO:teuthology.orchestra.run.smithi090.stdout:Building common 2023-06-09T04:45:00.352 INFO:teuthology.orchestra.run.smithi090.stdout:Building tests 2023-06-09T04:45:00.372 INFO:teuthology.orchestra.run.smithi090.stdout:Building perf 2023-06-09T04:45:00.390 INFO:teuthology.orchestra.run.smithi090.stdout: [GROUP] /tmp/tmp.jICg1BPnIbxfstests-dev/tests/perf/group.list 2023-06-09T04:45:00.444 INFO:teuthology.orchestra.run.smithi090.stdout:Building ext4 2023-06-09T04:45:00.462 INFO:teuthology.orchestra.run.smithi090.stdout: [GROUP] /tmp/tmp.jICg1BPnIbxfstests-dev/tests/ext4/group.list 2023-06-09T04:45:00.638 INFO:teuthology.orchestra.run.smithi090.stdout:Building ocfs2 2023-06-09T04:45:00.656 INFO:teuthology.orchestra.run.smithi090.stdout: [GROUP] /tmp/tmp.jICg1BPnIbxfstests-dev/tests/ocfs2/group.list 2023-06-09T04:45:00.723 INFO:teuthology.orchestra.run.smithi090.stdout:Building overlay 2023-06-09T04:45:00.742 INFO:teuthology.orchestra.run.smithi090.stdout: [GROUP] /tmp/tmp.jICg1BPnIbxfstests-dev/tests/overlay/group.list 2023-06-09T04:45:00.932 INFO:teuthology.orchestra.run.smithi090.stdout:Building cifs 2023-06-09T04:45:00.952 INFO:teuthology.orchestra.run.smithi090.stdout: [GROUP] /tmp/tmp.jICg1BPnIbxfstests-dev/tests/cifs/group.list 2023-06-09T04:45:01.007 INFO:teuthology.orchestra.run.smithi090.stdout:Building generic 2023-06-09T04:45:01.026 INFO:teuthology.orchestra.run.smithi090.stdout: [GROUP] /tmp/tmp.jICg1BPnIbxfstests-dev/tests/generic/group.list 2023-06-09T04:45:01.446 INFO:teuthology.orchestra.run.smithi090.stdout:Building shared 2023-06-09T04:45:01.462 INFO:teuthology.orchestra.run.smithi090.stdout: [GROUP] /tmp/tmp.jICg1BPnIbxfstests-dev/tests/shared/group.list 2023-06-09T04:45:01.549 INFO:teuthology.orchestra.run.smithi090.stdout:Building xfs 2023-06-09T04:45:01.568 INFO:teuthology.orchestra.run.smithi090.stdout: [GROUP] /tmp/tmp.jICg1BPnIbxfstests-dev/tests/xfs/group.list 2023-06-09T04:45:02.040 INFO:teuthology.orchestra.run.smithi090.stdout:Building f2fs 2023-06-09T04:45:02.057 INFO:teuthology.orchestra.run.smithi090.stdout: [GROUP] /tmp/tmp.jICg1BPnIbxfstests-dev/tests/f2fs/group.list 2023-06-09T04:45:02.141 INFO:teuthology.orchestra.run.smithi090.stdout:Building udf 2023-06-09T04:45:02.157 INFO:teuthology.orchestra.run.smithi090.stdout: [GROUP] /tmp/tmp.jICg1BPnIbxfstests-dev/tests/udf/group.list 2023-06-09T04:45:02.214 INFO:teuthology.orchestra.run.smithi090.stdout:Building ceph 2023-06-09T04:45:02.229 INFO:teuthology.orchestra.run.smithi090.stdout: [GROUP] /tmp/tmp.jICg1BPnIbxfstests-dev/tests/ceph/group.list 2023-06-09T04:45:02.300 INFO:teuthology.orchestra.run.smithi090.stdout:Building nfs 2023-06-09T04:45:02.318 INFO:teuthology.orchestra.run.smithi090.stdout: [GROUP] /tmp/tmp.jICg1BPnIbxfstests-dev/tests/nfs/group.list 2023-06-09T04:45:02.382 INFO:teuthology.orchestra.run.smithi090.stdout:Building btrfs 2023-06-09T04:45:02.401 INFO:teuthology.orchestra.run.smithi090.stdout: [GROUP] /tmp/tmp.jICg1BPnIbxfstests-dev/tests/btrfs/group.list 2023-06-09T04:45:02.681 INFO:teuthology.orchestra.run.smithi090.stdout:Building tmpfs 2023-06-09T04:45:02.698 INFO:teuthology.orchestra.run.smithi090.stdout: [GROUP] /tmp/tmp.jICg1BPnIbxfstests-dev/tests/tmpfs/group.list 2023-06-09T04:45:02.764 INFO:teuthology.orchestra.run.smithi090.stdout:Building selftest 2023-06-09T04:45:02.779 INFO:teuthology.orchestra.run.smithi090.stdout: [GROUP] /tmp/tmp.jICg1BPnIbxfstests-dev/tests/selftest/group.list 2023-06-09T04:45:02.846 DEBUG:teuthology.orchestra.run.smithi090:> (cd /tmp/tmp.jICg1BPnIbxfstests-dev && exec sudo make install) 2023-06-09T04:45:02.929 INFO:teuthology.orchestra.run.smithi090.stdout:Building include 2023-06-09T04:45:02.943 INFO:teuthology.orchestra.run.smithi090.stdout:Building lib 2023-06-09T04:45:02.955 INFO:teuthology.orchestra.run.smithi090.stdout:Building ltp 2023-06-09T04:45:02.971 INFO:teuthology.orchestra.run.smithi090.stdout:Building src 2023-06-09T04:45:03.084 INFO:teuthology.orchestra.run.smithi090.stdout:Building log-writes 2023-06-09T04:45:03.098 INFO:teuthology.orchestra.run.smithi090.stdout:Building perf 2023-06-09T04:45:03.110 INFO:teuthology.orchestra.run.smithi090.stdout:Building aio-dio-regress 2023-06-09T04:45:03.122 INFO:teuthology.orchestra.run.smithi090.stdout:Building vfs 2023-06-09T04:45:03.136 INFO:teuthology.orchestra.run.smithi090.stdout:Building m4 2023-06-09T04:45:03.153 INFO:teuthology.orchestra.run.smithi090.stdout:Building common 2023-06-09T04:45:03.167 INFO:teuthology.orchestra.run.smithi090.stdout:Building tests 2023-06-09T04:45:03.186 INFO:teuthology.orchestra.run.smithi090.stdout:Building perf 2023-06-09T04:45:03.203 INFO:teuthology.orchestra.run.smithi090.stdout: [GROUP] /tmp/tmp.jICg1BPnIbxfstests-dev/tests/perf/group.list 2023-06-09T04:45:03.263 INFO:teuthology.orchestra.run.smithi090.stdout:Building ext4 2023-06-09T04:45:03.280 INFO:teuthology.orchestra.run.smithi090.stdout: [GROUP] /tmp/tmp.jICg1BPnIbxfstests-dev/tests/ext4/group.list 2023-06-09T04:45:03.465 INFO:teuthology.orchestra.run.smithi090.stdout:Building ocfs2 2023-06-09T04:45:03.482 INFO:teuthology.orchestra.run.smithi090.stdout: [GROUP] /tmp/tmp.jICg1BPnIbxfstests-dev/tests/ocfs2/group.list 2023-06-09T04:45:03.549 INFO:teuthology.orchestra.run.smithi090.stdout:Building overlay 2023-06-09T04:45:03.568 INFO:teuthology.orchestra.run.smithi090.stdout: [GROUP] /tmp/tmp.jICg1BPnIbxfstests-dev/tests/overlay/group.list 2023-06-09T04:45:03.749 INFO:teuthology.orchestra.run.smithi090.stdout:Building cifs 2023-06-09T04:45:03.765 INFO:teuthology.orchestra.run.smithi090.stdout: [GROUP] /tmp/tmp.jICg1BPnIbxfstests-dev/tests/cifs/group.list 2023-06-09T04:45:03.826 INFO:teuthology.orchestra.run.smithi090.stdout:Building generic 2023-06-09T04:45:03.844 INFO:teuthology.orchestra.run.smithi090.stdout: [GROUP] /tmp/tmp.jICg1BPnIbxfstests-dev/tests/generic/group.list 2023-06-09T04:45:04.298 INFO:teuthology.orchestra.run.smithi090.stdout:Building shared 2023-06-09T04:45:04.314 INFO:teuthology.orchestra.run.smithi090.stdout: [GROUP] /tmp/tmp.jICg1BPnIbxfstests-dev/tests/shared/group.list 2023-06-09T04:45:04.397 INFO:teuthology.orchestra.run.smithi090.stdout:Building xfs 2023-06-09T04:45:04.414 INFO:teuthology.orchestra.run.smithi090.stdout: [GROUP] /tmp/tmp.jICg1BPnIbxfstests-dev/tests/xfs/group.list 2023-06-09T04:45:04.870 INFO:teuthology.orchestra.run.smithi090.stdout:Building f2fs 2023-06-09T04:45:04.891 INFO:teuthology.orchestra.run.smithi090.stdout: [GROUP] /tmp/tmp.jICg1BPnIbxfstests-dev/tests/f2fs/group.list 2023-06-09T04:45:04.968 INFO:teuthology.orchestra.run.smithi090.stdout:Building udf 2023-06-09T04:45:04.984 INFO:teuthology.orchestra.run.smithi090.stdout: [GROUP] /tmp/tmp.jICg1BPnIbxfstests-dev/tests/udf/group.list 2023-06-09T04:45:05.039 INFO:teuthology.orchestra.run.smithi090.stdout:Building ceph 2023-06-09T04:45:05.057 INFO:teuthology.orchestra.run.smithi090.stdout: [GROUP] /tmp/tmp.jICg1BPnIbxfstests-dev/tests/ceph/group.list 2023-06-09T04:45:05.124 INFO:teuthology.orchestra.run.smithi090.stdout:Building nfs 2023-06-09T04:45:05.143 INFO:teuthology.orchestra.run.smithi090.stdout: [GROUP] /tmp/tmp.jICg1BPnIbxfstests-dev/tests/nfs/group.list 2023-06-09T04:45:05.212 INFO:teuthology.orchestra.run.smithi090.stdout:Building btrfs 2023-06-09T04:45:05.233 INFO:teuthology.orchestra.run.smithi090.stdout: [GROUP] /tmp/tmp.jICg1BPnIbxfstests-dev/tests/btrfs/group.list 2023-06-09T04:45:05.498 INFO:teuthology.orchestra.run.smithi090.stdout:Building tmpfs 2023-06-09T04:45:05.518 INFO:teuthology.orchestra.run.smithi090.stdout: [GROUP] /tmp/tmp.jICg1BPnIbxfstests-dev/tests/tmpfs/group.list 2023-06-09T04:45:05.583 INFO:teuthology.orchestra.run.smithi090.stdout:Building selftest 2023-06-09T04:45:05.599 INFO:teuthology.orchestra.run.smithi090.stdout: [GROUP] /tmp/tmp.jICg1BPnIbxfstests-dev/tests/selftest/group.list 2023-06-09T04:45:05.659 INFO:teuthology.orchestra.run.smithi090.stdout:/usr/bin/make --no-print-directory Q=@ -C include install 2023-06-09T04:45:05.668 INFO:teuthology.orchestra.run.smithi090.stdout:make[1]: Nothing to be done for 'install'. 2023-06-09T04:45:05.668 INFO:teuthology.orchestra.run.smithi090.stdout:/usr/bin/make --no-print-directory Q=@ -C lib install 2023-06-09T04:45:05.678 INFO:teuthology.orchestra.run.smithi090.stdout:make[1]: Nothing to be done for 'install'. 2023-06-09T04:45:05.678 INFO:teuthology.orchestra.run.smithi090.stdout:/usr/bin/make --no-print-directory Q=@ -C ltp install 2023-06-09T04:45:05.690 INFO:teuthology.orchestra.run.smithi090.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/ltp 2023-06-09T04:45:05.739 INFO:teuthology.orchestra.run.smithi090.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 doio fsstress fsx growfiles iogen aio-stress /var/lib/xfstests/ltp 2023-06-09T04:45:06.096 INFO:teuthology.orchestra.run.smithi090.stdout:../install-sh -o root -g root -m 755 rwtest.sh /var/lib/xfstests/ltp 2023-06-09T04:45:06.143 INFO:teuthology.orchestra.run.smithi090.stdout:/usr/bin/make --no-print-directory Q=@ -C src install 2023-06-09T04:45:06.208 INFO:teuthology.orchestra.run.smithi090.stdout:Building log-writes 2023-06-09T04:45:06.221 INFO:teuthology.orchestra.run.smithi090.stdout:Building perf 2023-06-09T04:45:06.234 INFO:teuthology.orchestra.run.smithi090.stdout:Building aio-dio-regress 2023-06-09T04:45:06.250 INFO:teuthology.orchestra.run.smithi090.stdout:Building vfs 2023-06-09T04:45:06.263 INFO:teuthology.orchestra.run.smithi090.stdout:/usr/bin/make -C log-writes install 2023-06-09T04:45:06.269 INFO:teuthology.orchestra.run.smithi090.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/log-writes 2023-06-09T04:45:06.314 INFO:teuthology.orchestra.run.smithi090.stdout:../../install-sh -o root -g root -m 755 replay-log /var/lib/xfstests/src/log-writes 2023-06-09T04:45:06.359 INFO:teuthology.orchestra.run.smithi090.stdout:/usr/bin/make -C perf install 2023-06-09T04:45:06.366 INFO:teuthology.orchestra.run.smithi090.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/perf 2023-06-09T04:45:06.410 INFO:teuthology.orchestra.run.smithi090.stdout:../../install-sh -o root -g root -m 755 ResultData.py fio-insert-and-compare.py FioResultDecoder.py FioCompare.py generate-schema.py fio-results.sql /var/lib/xfstests/src/perf 2023-06-09T04:45:06.514 INFO:teuthology.orchestra.run.smithi090.stdout:/usr/bin/make -C aio-dio-regress install 2023-06-09T04:45:06.525 INFO:teuthology.orchestra.run.smithi090.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/aio-dio-regress 2023-06-09T04:45:06.572 INFO:teuthology.orchestra.run.smithi090.stdout:../../install-sh -o root -g root -m 755 aio-dio-fcntl-race aio-dio-subblock-eof-read aio-dio-append-write-read-race aio-dio-invalidate-readahead aio-dio-hole-filling-race aio-free-ring-with-bogus-nr-pages aio-last-ref-held-by-io aio-dio-cycle-write aio-dio-extend-stat aio-io-setup-with-nonwritable-context-pointer aiocp aio-dio-append-write-fallocate-race aio-dio-invalidate-failure aiodio_sparse2 aio-dio-cow-race aio-dio-write-verify aio-dio-eof-race /var/lib/xfstests/src/aio-dio-regress 2023-06-09T04:45:06.819 INFO:teuthology.orchestra.run.smithi090.stdout:/usr/bin/make -C vfs install 2023-06-09T04:45:06.829 INFO:teuthology.orchestra.run.smithi090.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/vfs 2023-06-09T04:45:06.874 INFO:teuthology.orchestra.run.smithi090.stdout:../../install-sh -o root -g root -m 755 vfstest mount-idmapped /var/lib/xfstests/src/vfs 2023-06-09T04:45:06.931 INFO:teuthology.orchestra.run.smithi090.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src 2023-06-09T04:45:06.977 INFO:teuthology.orchestra.run.smithi090.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dirstress fill fill2 getpagesize holes lstat64 nametest permname randholes runas truncfile usemem mmapcat append_reader append_writer dirperf metaperf devzero feature alloc fault fstest t_access_root godown resvtest writemod writev_on_pagefault makeextents itrash rename multi_open_unlink unwritten_sync genhashnames t_holes t_mmap_writev t_truncate_cmtime dirhash_collide t_rename_overwrite holetest t_truncate_self af_unix t_mmap_stale_pmd t_mmap_cow_race t_mmap_fallocate fsync-err t_mmap_write_ro t_ext4_dax_journal_corruption t_ext4_dax_inline_corruption t_ofd_locks t_mmap_collision mmap-write-concurrent t_get_file_time t_create_short_dirs t_create_long_dirs t_enospc t_mmap_writev_overlap checkpoint_journal mmap-rw-fault allocstale t_mmap_cow_memory_failure fake-dump-rootino dio-buf-fault xfsctl bstat t_mtab getdevicesize preallo_rw_pattern_reader preallo_rw_pattern_writer ftrunc trunc fs_perms testx looptest locktest unwritten_mmap bulkstat_unlink_test deduperace bulkstat_unlink_test_modified t_dir_offset t_futimens t_immutable stale_handle pwrite_mmap_blocked t_dir_offset2 seek_sanity_test seek_copy_test t_readdir_1 t_readdir_2 fsync-tester nsexec cloner renameat2 t_getcwd e4compact test-nextquota punch-alternating attr-list-by-handle-cursor-test listxattr dio-interleaved t_dir_type dio-invalidate-cache stat_test t_encrypted_d_revalidate attr_replace_test swapon mkswap t_attr_corruption t_open_tmpfiles fscrypt-crypt-util bulkstat_null_ocount splice-test chprojid_fail detached_mounts_propagation ext4_resize t_readdir_3 splice2pipe uuid_ioctl fiemap-tester t_stripealign open_by_handle t_mmap_dio xfsfind fssum /var/lib/xfstests/src 2023-06-09T04:45:12.975 INFO:teuthology.orchestra.run.smithi090.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dmerror fill2attr fill2fs fill2fs_check scaleread.sh btrfs_crc32c_forged_name.py popdir.pl popattr.py /var/lib/xfstests/src 2023-06-09T04:45:13.418 INFO:teuthology.orchestra.run.smithi090.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 644 dumpfile /var/lib/xfstests/src 2023-06-09T04:45:13.524 INFO:teuthology.orchestra.run.smithi090.stdout:/usr/bin/make --no-print-directory Q=@ -C m4 install 2023-06-09T04:45:13.534 INFO:teuthology.orchestra.run.smithi090.stdout:make[1]: Nothing to be done for 'install'. 2023-06-09T04:45:13.534 INFO:teuthology.orchestra.run.smithi090.stdout:/usr/bin/make --no-print-directory Q=@ -C common install 2023-06-09T04:45:13.544 INFO:teuthology.orchestra.run.smithi090.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/common 2023-06-09T04:45:13.591 INFO:teuthology.orchestra.run.smithi090.stdout:../install-sh -o root -g root -m 644 * /var/lib/xfstests/common 2023-06-09T04:45:14.218 INFO:teuthology.orchestra.run.smithi090.stdout:/usr/bin/make --no-print-directory Q=@ -C tests install 2023-06-09T04:45:14.226 INFO:teuthology.orchestra.run.smithi090.stdout:/usr/bin/make --no-print-directory Q=@ -C /tmp/tmp.jICg1BPnIbxfstests-dev/tests/btrfs/ install 2023-06-09T04:45:14.237 INFO:teuthology.orchestra.run.smithi090.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/btrfs 2023-06-09T04:45:14.286 INFO:teuthology.orchestra.run.smithi090.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 290 291 299 /var/lib/xfstests/tests/btrfs 2023-06-09T04:45:18.141 INFO:teuthology.orchestra.run.smithi090.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/btrfs 2023-06-09T04:45:18.190 INFO:teuthology.orchestra.run.smithi090.stdout:../../install-sh -o root -g root -m 644 016.out 064.out 186.out 240.out 279.out 180.out 282.out 267.out 280.out 140.out 265.out 206.out 121.out 040.out 106.out 199.out 233.out 234.out 248.out 009.out 033.out 082.out 252.out 270.out 148.out 088.out 137.out 002.out 125.out 110.out 165.out 152.out 143.out 264.out 015.out 192.out 075.out 178.out 284.out 052.out 228.out 276.out 046.out 273.out 074.out 251.out 176.out 209.out 020.out 195.out 215.out 115.out 179.out 250.out 191.out 266.out 111.out 051.out 177.out 219.out 119.out 244.out 128.out 232.out 087.out 212.out 112.out 012.out 107.out 162.out 147.out 196.out 145.out 004.out 187.out 024.out 220.out 238.out 120.out 202.out 102.out 171.out 261.out 156.out 092.out 072.out 068.out 048.out 062.out 084.out 129.out 066.out 229.out 254.out 047.out 011.out 029.out 035.out 134.out 170.out 260.out 034.out 065.out 286.out 161.out 246.out 056.out 216.out 116.out 043.out 274.out 287.out 010.out 001.out 138.out 237.out 097.out 153.out 160.out 175.out 091.out 081.out 071.out 061.out 239.out 067.out 200.out 100.out 025.out 258.out 269.out 208.out 039.out 222.out 275.out 169.out 098.out 290.out 080.out 070.out 060.out 207.out 108.out 006.out 167.out 217.out 133.out 117.out 017.out 236.out 159.out 211.out 158.out 085.out 277.out 146.out 188.out 189.out 204.out 104.out 225.out 242.out 268.out 135.out 257.out 124.out 142.out 172.out 103.out 058.out 262.out 042.out 096.out 193.out 283.out 083.out 099.out 247.out 053.out 109.out 157.out 164.out 154.out 094.out 241.out 089.out 141.out 214.out 114.out 014.out 278.out 041.out 223.out 028.out 086.out 123.out 144.out 032.out 182.out 205.out 136.out 005.out 036.out 198.out 008.out 190.out 173.out 050.out 038.out 105.out 263.out 291.out 185.out 095.out 285.out 155.out 201.out 019.out 063.out 299.out 151.out 231.out 227.out 069.out 131.out 213.out 113.out 013.out 031.out 057.out 272.out 078.out 184.out 259.out 210.out 132.out 037.out 093.out 197.out 235.out 127.out 230.out 027.out 130.out 023.out 044.out 073.out 030.out 203.out 003.out 101.out 055.out 166.out 245.out 243.out 194.out 249.out 122.out 076.out 022.out 174.out 045.out 281.out 090.out 224.out 181.out 271.out 149.out 183.out 077.out 218.out 118.out 018.out 256.out 168.out 007.out 079.out 054.out 059.out 150.out 049.out 226.out 163.out 126.out 026.out 021.out 253.out 255.out 139.out 221.out /var/lib/xfstests/tests/btrfs 2023-06-09T04:45:18.947 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:45:18.952 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:45:22.029 INFO:teuthology.orchestra.run.smithi090.stdout:/usr/bin/make --no-print-directory Q=@ -C /tmp/tmp.jICg1BPnIbxfstests-dev/tests/ceph/ install 2023-06-09T04:45:22.038 INFO:teuthology.orchestra.run.smithi090.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ceph 2023-06-09T04:45:22.080 INFO:teuthology.orchestra.run.smithi090.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 /var/lib/xfstests/tests/ceph 2023-06-09T04:45:22.176 INFO:teuthology.orchestra.run.smithi090.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ceph 2023-06-09T04:45:22.225 INFO:teuthology.orchestra.run.smithi090.stdout:../../install-sh -o root -g root -m 644 003.out 005.out 001.out 004.out 002.out /var/lib/xfstests/tests/ceph 2023-06-09T04:45:22.324 INFO:teuthology.orchestra.run.smithi090.stdout:/usr/bin/make --no-print-directory Q=@ -C /tmp/tmp.jICg1BPnIbxfstests-dev/tests/cifs/ install 2023-06-09T04:45:22.332 INFO:teuthology.orchestra.run.smithi090.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/cifs 2023-06-09T04:45:22.382 INFO:teuthology.orchestra.run.smithi090.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/cifs 2023-06-09T04:45:22.426 INFO:teuthology.orchestra.run.smithi090.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/cifs 2023-06-09T04:45:22.471 INFO:teuthology.orchestra.run.smithi090.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/cifs 2023-06-09T04:45:22.514 INFO:teuthology.orchestra.run.smithi090.stdout:/usr/bin/make --no-print-directory Q=@ -C /tmp/tmp.jICg1BPnIbxfstests-dev/tests/ext4/ install 2023-06-09T04:45:22.525 INFO:teuthology.orchestra.run.smithi090.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ext4 2023-06-09T04:45:22.570 INFO:teuthology.orchestra.run.smithi090.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 271 301 302 303 304 305 306 307 308 /var/lib/xfstests/tests/ext4 2023-06-09T04:45:23.475 INFO:teuthology.orchestra.run.smithi090.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ext4 2023-06-09T04:45:23.525 INFO:teuthology.orchestra.run.smithi090.stdout:../../install-sh -o root -g root -m 644 001.out.nodelalloc 001.out.default 001.out.nozero 001.cfg 049.out 032.out 039.out 045.out 054.out 056.out 308.out 008.out 040.out 307.out 005.out 021.out 012.out 009.out 033.out 015.out 050.out 026.out 034.out 046.out 018.out 010.out 047.out 303.out 302.out 020.out 002.out 028.out 024.out 013.out 031.out 027.out 306.out 048.out 038.out 044.out 052.out 025.out 029.out 011.out 042.out 304.out 055.out 030.out 003.out 017.out 043.out 053.out 035.out 016.out 058.out 022.out 006.out 004.out 057.out 014.out 036.out 271.out 051.out 041.out 037.out 305.out 019.out 301.out 007.out 023.out 059.out /var/lib/xfstests/tests/ext4 2023-06-09T04:45:24.476 INFO:teuthology.orchestra.run.smithi090.stdout:/usr/bin/make --no-print-directory Q=@ -C /tmp/tmp.jICg1BPnIbxfstests-dev/tests/f2fs/ install 2023-06-09T04:45:24.484 INFO:teuthology.orchestra.run.smithi090.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/f2fs 2023-06-09T04:45:24.534 INFO:teuthology.orchestra.run.smithi090.stdout:../../install-sh -o root -g root -m 755 001 002 /var/lib/xfstests/tests/f2fs 2023-06-09T04:45:24.591 INFO:teuthology.orchestra.run.smithi090.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/f2fs 2023-06-09T04:45:24.636 INFO:teuthology.orchestra.run.smithi090.stdout:../../install-sh -o root -g root -m 644 001.out 002.out /var/lib/xfstests/tests/f2fs 2023-06-09T04:45:24.693 INFO:teuthology.orchestra.run.smithi090.stdout:/usr/bin/make --no-print-directory Q=@ -C /tmp/tmp.jICg1BPnIbxfstests-dev/tests/generic/ install 2023-06-09T04:45:24.705 INFO:teuthology.orchestra.run.smithi090.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/generic 2023-06-09T04:45:24.754 INFO:teuthology.orchestra.run.smithi090.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 602 603 604 605 606 607 608 609 610 611 612 613 614 615 616 617 618 619 620 621 622 623 624 625 626 627 628 629 630 631 632 633 634 635 636 637 638 639 640 641 642 643 644 645 646 647 648 649 650 651 652 653 654 655 656 657 658 659 660 661 662 663 664 665 666 667 668 669 670 671 672 673 674 675 676 677 678 679 680 681 682 683 684 685 686 687 688 689 690 691 692 693 694 695 696 697 698 699 700 701 702 703 704 705 706 707 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 /var/lib/xfstests/tests/generic 2023-06-09T04:45:34.317 INFO:teuthology.orchestra.run.smithi090.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/generic 2023-06-09T04:45:34.366 INFO:teuthology.orchestra.run.smithi090.stdout:../../install-sh -o root -g root -m 644 035.out.nfs 035.out.default 050.out.nojournal 050.out.xfsquota 050.out.default 050.cfg 035.cfg 047.out 021.out 233.out 518.out 055.out 295.out 683.out 337.out 385.out 082.out 270.out 237.out 502.out 088.out 597.out 097.out 202.out 137.out 034.out 110.out 389.out 593.out 571.out 040.out 646.out 592.out 282.out 472.out 468.out 628.out 428.out 507.out 328.out 566.out 127.out 557.out 273.out 182.out 420.out 609.out 576.out 087.out 506.out 057.out 195.out 711.out 007.out 466.out 311.out 532.out 591.out 719.out 111.out 432.out 519.out 623.out 131.out 319.out 177.out 219.out 119.out 423.out 661.out 232.out 645.out 134.out 260.out 095.out 611.out 638.out 465.out 716.out 161.out 416.out 026.out 216.out 116.out 043.out 358.out 338.out 238.out 439.out 138.out 263.out 497.out 160.out 647.out 433.out 481.out 061.out 555.out 686.out 333.out 258.out 322.out 039.out 222.out 098.out 330.out 690.out 480.out 706.out 606.out 406.out 306.out 206.out 106.out 006.out 167.out 003.out 217.out 120.out 191.out 117.out 355.out 357.out 542.out 485.out 074.out 033.out 188.out 367.out 489.out 279.out 624.out 524.out 174.out 163.out 324.out 224.out 257.out 124.out 672.out 668.out 058.out 262.out 366.out 648.out 042.out 537.out 377.out 193.out 083.out 399.out 365.out 509.out 568.out 309.out 209.out 441.out 255.out 356.out 474.out 341.out 094.out 241.out 089.out 691.out 616.out 614.out 514.out 312.out 141.out 314.out 214.out 381.out 056.out 671.out 041.out 016.out 340.out 649.out 572.out 586.out 240.out 549.out 673.out 633.out 321.out 140.out 708.out 608.out 449.out 185.out 408.out 308.out 208.out 380.out 670.out 604.out 404.out 104.out 663.out 599.out 476.out 192.out 199.out 278.out 639.out 443.out 540.out 186.out 539.out 133.out 164.out 376.out 589.out 154.out 339.out 652.out 239.out 440.out 498.out 139.out 180.out 267.out 317.out 552.out 017.out 169.out 565.out 315.out 580.out 452.out 679.out 336.out 020.out 252.out 585.out 678.out 448.out 352.out 348.out 651.out 184.out 435.out 409.out 248.out 009.out 482.out 625.out 283.out 488.out 496.out 325.out 551.out 225.out 636.out 125.out 544.out 693.out 296.out 650.out 152.out 563.out 143.out 024.out 015.out 392.out 682.out 595.out 578.out 642.out 550.out 052.out 062.out 655.out 276.out 451.out 450.out 463.out 004.out 157.out 069.out 644.out 316.out 344.out 487.out 715.out 615.out 395.out 151.out 415.out 674.out 215.out 115.out 384.out 351.out 250.out 266.out 051.out 536.out 228.out 577.out 244.out 128.out 662.out 579.out 144.out 405.out 205.out 136.out 598.out 363.out 712.out 176.out 198.out 723.out 108.out 390.out 680.out 705.out 605.out 505.out 305.out 105.out 005.out 523.out 084.out 703.out 619.out 727.out 685.out 562.out 419.out 570.out 388.out 527.out 158.out 044.out 019.out 695.out 086.out 574.out 332.out 060.out 142.out 584.out 045.out 372.out 478.out 612.out 462.out 173.out 687.out 350.out 132.out 037.out 293.out 197.out 492.out 499.out 246.out 032.out 112.out 660.out 414.out 063.out 101.out 561.out 343.out 323.out 702.out 362.out 387.out 594.out 438.out 721.out 289.out 699.out 284.out 477.out 621.out 290.out 548.out 299.out 456.out 707.out 461.out 391.out 445.out 632.out 256.out 493.out 107.out 658.out 251.out 526.out 479.out 713.out 426.out 221.out 326.out 226.out 413.out 126.out 121.out 313.out 447.out 460.out 694.out 347.out 275.out 038.out 090.out 361.out 528.out 564.out 294.out 656.out 066.out 455.out 558.out 162.out 147.out 288.out 396.out 547.out 531.out 698.out 148.out 301.out 360.out 374.out 261.out 375.out 076.out 657.out 692.out 304.out 634.out 724.out 129.out 726.out 458.out 534.out 626.out 529.out 603.out 434.out 329.out 587.out 165.out 229.out 590.out 371.out 234.out 183.out 486.out 223.out 123.out 179.out 669.out 023.out 459.out 688.out 277.out 516.out 146.out 398.out 696.out 247.out 427.out 190.out 280.out 484.out 491.out 187.out 046.out 227.out 583.out 285.out 631.out 654.out 359.out 501.out 171.out 155.out 431.out 099.out 331.out 231.out 613.out 513.out 028.out 213.out 113.out 013.out 031.out 630.out 675.out 667.out 272.out 530.out 627.out 573.out 430.out 310.out 454.out 259.out 210.out 327.out 397.out 067.out 093.out 287.out 230.out 027.out 292.out 130.out 370.out 403.out 030.out 203.out 103.out 354.out 025.out 386.out 560.out 722.out 291.out 622.out 243.out 522.out 543.out 422.out 394.out 159.out 249.out 122.out 689.out 166.out 022.out 424.out 637.out 684.out 490.out 353.out 181.out 676.out 271.out 149.out 618.out 064.out 018.out 418.out 077.out 218.out 118.out 575.out 172.out 079.out 469.out 054.out 059.out 049.out 442.out 569.out 521.out 378.out 253.out 421.out 475.out 512.out 494.out 412.out 212.out 538.out 379.out 342.out 012.out 554.out 471.out 070.out 596.out 720.out 620.out 196.out 520.out 242.out 457.out 320.out 220.out 629.out 602.out 153.out 402.out 302.out 102.out 002.out 717.out 617.out 517.out 429.out 417.out 156.out 092.out 664.out 072.out 068.out 473.out 369.out 511.out 411.out 029.out 211.out 011.out 659.out 194.out 170.out 053.out 065.out 286.out 245.out 437.out 545.out 714.out 559.out 710.out 036.out 610.out 510.out 274.out 410.out 701.out 601.out 401.out 201.out 010.out 001.out 495.out 281.out 048.out 665.out 114.out 014.out 346.out 581.out 297.out 145.out 168.out 641.out 436.out 091.out 081.out 071.out 075.out 653.out 700.out 600.out 500.out 400.out 300.out 200.out 100.out 464.out 541.out 269.out 546.out 382.out 677.out 553.out 178.out 175.out 298.out 446.out 444.out 080.out 709.out 607.out 508.out 407.out 307.out 207.out 109.out 008.out 643.out 150.out 349.out 453.out 666.out 236.out 078.out 364.out 567.out 725.out 582.out 383.out 085.out 704.out 588.out 635.out 334.out 504.out 525.out 189.out 204.out 535.out 425.out 345.out 318.out 467.out 368.out 681.out 254.out 335.out 718.out 073.out 235.out 470.out 268.out 556.out 135.out 503.out 533.out 303.out 264.out 515.out 373.out 265.out 697.out 640.out 483.out 096.out 393.out /var/lib/xfstests/tests/generic 2023-06-09T04:45:44.045 INFO:teuthology.orchestra.run.smithi090.stdout:/usr/bin/make --no-print-directory Q=@ -C /tmp/tmp.jICg1BPnIbxfstests-dev/tests/nfs/ install 2023-06-09T04:45:44.054 INFO:teuthology.orchestra.run.smithi090.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/nfs 2023-06-09T04:45:44.102 INFO:teuthology.orchestra.run.smithi090.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/nfs 2023-06-09T04:45:44.150 INFO:teuthology.orchestra.run.smithi090.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/nfs 2023-06-09T04:45:44.197 INFO:teuthology.orchestra.run.smithi090.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/nfs 2023-06-09T04:45:44.239 INFO:teuthology.orchestra.run.smithi090.stdout:/usr/bin/make --no-print-directory Q=@ -C /tmp/tmp.jICg1BPnIbxfstests-dev/tests/ocfs2/ install 2023-06-09T04:45:44.246 INFO:teuthology.orchestra.run.smithi090.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ocfs2 2023-06-09T04:45:44.294 INFO:teuthology.orchestra.run.smithi090.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/ocfs2 2023-06-09T04:45:44.335 INFO:teuthology.orchestra.run.smithi090.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ocfs2 2023-06-09T04:45:44.377 INFO:teuthology.orchestra.run.smithi090.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/ocfs2 2023-06-09T04:45:44.424 INFO:teuthology.orchestra.run.smithi090.stdout:/usr/bin/make --no-print-directory Q=@ -C /tmp/tmp.jICg1BPnIbxfstests-dev/tests/overlay/ install 2023-06-09T04:45:44.434 INFO:teuthology.orchestra.run.smithi090.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/overlay 2023-06-09T04:45:44.481 INFO:teuthology.orchestra.run.smithi090.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 /var/lib/xfstests/tests/overlay 2023-06-09T04:45:45.761 INFO:teuthology.orchestra.run.smithi090.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/overlay 2023-06-09T04:45:45.806 INFO:teuthology.orchestra.run.smithi090.stdout:../../install-sh -o root -g root -m 644 050.out 044.out 019.out 103.out 003.out 074.out 018.out 024.out 078.out 069.out 020.out 102.out 002.out 060.out 113.out 013.out 031.out 015.out 117.out 045.out 072.out 106.out 048.out 062.out 038.out 052.out 076.out 037.out 029.out 111.out 112.out 042.out 035.out 073.out 068.out 030.out 034.out 017.out 055.out 053.out 109.out 116.out 043.out 056.out 010.out 001.out 009.out 065.out 022.out 004.out 115.out 066.out 114.out 014.out 071.out 007.out 061.out 051.out 011.out 041.out 067.out 058.out 100.out 064.out 104.out 028.out 027.out 023.out 059.out 049.out 032.out 039.out 077.out 105.out 005.out 025.out 026.out 036.out 070.out 108.out 008.out 040.out 107.out 006.out 075.out 063.out 021.out 016.out 047.out 110.out 046.out 012.out 101.out 054.out 033.out 057.out /var/lib/xfstests/tests/overlay 2023-06-09T04:45:47.091 INFO:teuthology.orchestra.run.smithi090.stdout:/usr/bin/make --no-print-directory Q=@ -C /tmp/tmp.jICg1BPnIbxfstests-dev/tests/perf/ install 2023-06-09T04:45:47.100 INFO:teuthology.orchestra.run.smithi090.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/perf 2023-06-09T04:45:47.140 INFO:teuthology.orchestra.run.smithi090.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/perf 2023-06-09T04:45:47.187 INFO:teuthology.orchestra.run.smithi090.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/perf 2023-06-09T04:45:47.231 INFO:teuthology.orchestra.run.smithi090.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/perf 2023-06-09T04:45:47.278 INFO:teuthology.orchestra.run.smithi090.stdout:/usr/bin/make --no-print-directory Q=@ -C /tmp/tmp.jICg1BPnIbxfstests-dev/tests/selftest/ install 2023-06-09T04:45:47.285 INFO:teuthology.orchestra.run.smithi090.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/selftest 2023-06-09T04:45:47.332 INFO:teuthology.orchestra.run.smithi090.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 /var/lib/xfstests/tests/selftest 2023-06-09T04:45:47.438 INFO:teuthology.orchestra.run.smithi090.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/selftest 2023-06-09T04:45:47.486 INFO:teuthology.orchestra.run.smithi090.stdout:../../install-sh -o root -g root -m 644 003.out 005.out 006.out 001.out 004.out 002.out /var/lib/xfstests/tests/selftest 2023-06-09T04:45:47.595 INFO:teuthology.orchestra.run.smithi090.stdout:/usr/bin/make --no-print-directory Q=@ -C /tmp/tmp.jICg1BPnIbxfstests-dev/tests/shared/ install 2023-06-09T04:45:47.603 INFO:teuthology.orchestra.run.smithi090.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/shared 2023-06-09T04:45:47.646 INFO:teuthology.orchestra.run.smithi090.stdout:../../install-sh -o root -g root -m 755 002 032 298 /var/lib/xfstests/tests/shared 2023-06-09T04:45:47.710 INFO:teuthology.orchestra.run.smithi090.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/shared 2023-06-09T04:45:47.756 INFO:teuthology.orchestra.run.smithi090.stdout:../../install-sh -o root -g root -m 644 032.out 298.out 002.out /var/lib/xfstests/tests/shared 2023-06-09T04:45:47.830 INFO:teuthology.orchestra.run.smithi090.stdout:/usr/bin/make --no-print-directory Q=@ -C /tmp/tmp.jICg1BPnIbxfstests-dev/tests/tmpfs/ install 2023-06-09T04:45:47.838 INFO:teuthology.orchestra.run.smithi090.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/tmpfs 2023-06-09T04:45:47.886 INFO:teuthology.orchestra.run.smithi090.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/tmpfs 2023-06-09T04:45:47.934 INFO:teuthology.orchestra.run.smithi090.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/tmpfs 2023-06-09T04:45:47.974 INFO:teuthology.orchestra.run.smithi090.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/tmpfs 2023-06-09T04:45:48.020 INFO:teuthology.orchestra.run.smithi090.stdout:/usr/bin/make --no-print-directory Q=@ -C /tmp/tmp.jICg1BPnIbxfstests-dev/tests/udf/ install 2023-06-09T04:45:48.028 INFO:teuthology.orchestra.run.smithi090.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/udf 2023-06-09T04:45:48.078 INFO:teuthology.orchestra.run.smithi090.stdout:../../install-sh -o root -g root -m 755 102 /var/lib/xfstests/tests/udf 2023-06-09T04:45:48.121 INFO:teuthology.orchestra.run.smithi090.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/udf 2023-06-09T04:45:48.162 INFO:teuthology.orchestra.run.smithi090.stdout:../../install-sh -o root -g root -m 644 102.out /var/lib/xfstests/tests/udf 2023-06-09T04:45:48.210 INFO:teuthology.orchestra.run.smithi090.stdout:/usr/bin/make --no-print-directory Q=@ -C /tmp/tmp.jICg1BPnIbxfstests-dev/tests/xfs/ install 2023-06-09T04:45:48.223 INFO:teuthology.orchestra.run.smithi090.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/xfs 2023-06-09T04:45:48.268 INFO:teuthology.orchestra.run.smithi090.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 734 735 736 737 738 739 740 741 742 743 744 745 746 747 748 749 750 751 752 753 754 755 756 757 758 759 760 761 762 763 764 765 766 767 768 769 770 771 772 773 774 775 776 777 778 779 780 781 782 783 784 785 786 787 788 789 790 791 792 793 794 795 796 797 798 799 800 /var/lib/xfstests/tests/xfs 2023-06-09T04:45:49.026 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:45:49.034 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:45:57.219 INFO:teuthology.orchestra.run.smithi090.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/xfs 2023-06-09T04:45:57.264 INFO:teuthology.orchestra.run.smithi090.stdout:../../install-sh -o root -g root -m 644 033.out.crc 096.out.external 033.out.default 071.out.64 216.out.classic 096.out.internal 216.out.64mblog 071.out.32 216.cfg 033.cfg 508.out 221.out 057.out 308.out 208.out 737.out 108.out 404.out 457.out 021.out 455.out 233.out 194.out 443.out 295.out 337.out 237.out 759.out 502.out 088.out 366.out 202.out 137.out 002.out 389.out 593.out 571.out 775.out 040.out 765.out 592.out 282.out 728.out 528.out 428.out 407.out 328.out 566.out 261.out 557.out 273.out 468.out 074.out 427.out 059.out 595.out 789.out 195.out 346.out 732.out 784.out 532.out 191.out 111.out 432.out 519.out 419.out 131.out 319.out 177.out 219.out 119.out 423.out 232.out 329.out 467.out 229.out 103.out 234.out 183.out 733.out 134.out 260.out 157.out 718.out 034.out 465.out 716.out 161.out 416.out 116.out 043.out 155.out 358.out 338.out 238.out 065.out 439.out 138.out 189.out 097.out 160.out 175.out 373.out 481.out 345.out 025.out 772.out 768.out 258.out 379.out 322.out 039.out 498.out 742.out 290.out 480.out 060.out 506.out 406.out 306.out 206.out 006.out 167.out 003.out 217.out 117.out 355.out 017.out 542.out 783.out 485.out 442.out 188.out 099.out 342.out 279.out 524.out 174.out 771.out 324.out 224.out 313.out 257.out 124.out 758.out 058.out 741.out 384.out 262.out 042.out 497.out 377.out 193.out 799.out 473.out 770.out 365.out 409.out 309.out 209.out 441.out 109.out 255.out 740.out 558.out 474.out 341.out 094.out 555.out 712.out 241.out 089.out 540.out 256.out 714.out 514.out 414.out 314.out 214.out 114.out 381.out 147.out 275.out 041.out 721.out 340.out 793.out 156.out 572.out 568.out 586.out 240.out 180.out 549.out 267.out 280.out 543.out 140.out 708.out 449.out 185.out 334.out 504.out 525.out 204.out 535.out 104.out 425.out 399.out 254.out 335.out 531.out 235.out 470.out 268.out 556.out 135.out 503.out 533.out 303.out 264.out 110.out 318.out 515.out 433.out 036.out 169.out 483.out 393.out 333.out 476.out 087.out 192.out 199.out 739.out 278.out 591.out 752.out 736.out 236.out 539.out 749.out 164.out 376.out 154.out 587.out 339.out 239.out 440.out 458.out 456.out 489.out 139.out 774.out 790.out 317.out 552.out 781.out 064.out 444.out 580.out 452.out 020.out 252.out 724.out 352.out 794.out 348.out 709.out 394.out 356.out 184.out 435.out 509.out 466.out 248.out 785.out 009.out 283.out 750.out 045.out 297.out 488.out 496.out 325.out 551.out 225.out 125.out 186.out 544.out 296.out 152.out 563.out 143.out 436.out 392.out 545.out 075.out 472.out 463.out 550.out 052.out 062.out 276.out 266.out 450.out 744.out 004.out 764.out 069.out 316.out 487.out 762.out 715.out 395.out 151.out 415.out 315.out 344.out 215.out 115.out 015.out 351.out 250.out 464.out 051.out 536.out 228.out 244.out 128.out 385.out 336.out 086.out 579.out 144.out 505.out 205.out 136.out 537.out 176.out 198.out 723.out 390.out 178.out 050.out 405.out 305.out 105.out 005.out 523.out 761.out 437.out 719.out 727.out 363.out 095.out 562.out 382.out 271.out 570.out 388.out 590.out 527.out 158.out 044.out 019.out 577.out 777.out 760.out 574.out 332.out 372.out 478.out 462.out 220.out 350.out 132.out 293.out 492.out 263.out 212.out 499.out 246.out 112.out 063.out 101.out 561.out 343.out 362.out 387.out 798.out 594.out 438.out 265.out 289.out 106.out 477.out 281.out 548.out 299.out 364.out 461.out 391.out 451.out 493.out 786.out 007.out 448.out 251.out 380.out 526.out 479.out 713.out 426.out 150.out 326.out 082.out 226.out 413.out 126.out 026.out 347.out 035.out 361.out 564.out 294.out 788.out 066.out 795.out 076.out 747.out 585.out 162.out 796.out 288.out 197.out 396.out 576.out 547.out 298.out 148.out 301.out 360.out 374.out 734.out 447.out 292.out 304.out 482.out 129.out 726.out 729.out 048.out 534.out 073.out 529.out 434.out 368.out 486.out 223.out 123.out 179.out 023.out 032.out 748.out 277.out 516.out 424.out 398.out 168.out 751.out 190.out 173.out 484.out 491.out 754.out 016.out 046.out 227.out 731.out 782.out 583.out 285.out 127.out 501.out 171.out 581.out 027.out 431.out 068.out 331.out 791.out 743.out 047.out 231.out 024.out 513.out 371.out 213.out 730.out 113.out 013.out 031.out 367.out 182.out 323.out 272.out 530.out 573.out 430.out 454.out 259.out 210.out 327.out 330.out 067.out 093.out 287.out 230.out 769.out 061.out 130.out 370.out 403.out 030.out 203.out 354.out 165.out 386.out 560.out 055.out 722.out 291.out 245.out 243.out 522.out 787.out 745.out 422.out 222.out 159.out 249.out 122.out 166.out 022.out 038.out 578.out 490.out 565.out 353.out 375.out 181.out 500.out 149.out 518.out 018.out 418.out 077.out 218.out 118.out 575.out 780.out 172.out 792.out 079.out 469.out 054.out 049.out 247.out 738.out 163.out 776.out 521.out 270.out 378.out 253.out 421.out 321.out 475.out 512.out 494.out 412.out 312.out 121.out 538.out 012.out 028.out 554.out 397.out 773.out 720.out 196.out 520.out 242.out 420.out 098.out 320.out 120.out 153.out 402.out 302.out 102.out 717.out 460.out 517.out 429.out 417.out 142.out 092.out 357.out 072.out 778.out 084.out 056.out 369.out 711.out 511.out 411.out 029.out 311.out 211.out 011.out 767.out 187.out 170.out 053.out 133.out 286.out 756.out 755.out 766.out 559.out 710.out 510.out 274.out 410.out 310.out 401.out 201.out 010.out 001.out 141.out 495.out 584.out 589.out 753.out 014.out 459.out 145.out 797.out 757.out 091.out 081.out 083.out 800.out 037.out 400.out 300.out 200.out 100.out 359.out 471.out 541.out 445.out 779.out 269.out 546.out 553.out 763.out 446.out 090.out 080.out 070.out 507.out 408.out 307.out 207.out 107.out 008.out 746.out 284.out 349.out 453.out 078.out 567.out 725.out 582.out 735.out 383.out 085.out 588.out 146.out /var/lib/xfstests/tests/xfs 2023-06-09T04:46:06.420 INFO:teuthology.orchestra.run.smithi090.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests 2023-06-09T04:46:06.464 INFO:teuthology.orchestra.run.smithi090.stdout:./install-sh -o root -g root -m 755 -d /var/lib/xfstests 2023-06-09T04:46:06.509 INFO:teuthology.orchestra.run.smithi090.stdout:./install-sh -o root -g root -m 755 check /var/lib/xfstests 2023-06-09T04:46:06.555 INFO:teuthology.orchestra.run.smithi090.stdout:./install-sh -o root -g root -m 644 randomize.awk /var/lib/xfstests 2023-06-09T04:46:06.609 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:46:06.610 DEBUG:teuthology.orchestra.run.smithi090:> (cd /tmp/tmp.jICg1BPnIbxfstests-dev && exec ls tests/generic) 2023-06-09T04:46:06.633 INFO:teuthology.orchestra.run.smithi090.stdout:001 2023-06-09T04:46:06.633 INFO:teuthology.orchestra.run.smithi090.stdout:001.out 2023-06-09T04:46:06.633 INFO:teuthology.orchestra.run.smithi090.stdout:002 2023-06-09T04:46:06.633 INFO:teuthology.orchestra.run.smithi090.stdout:002.out 2023-06-09T04:46:06.634 INFO:teuthology.orchestra.run.smithi090.stdout:003 2023-06-09T04:46:06.634 INFO:teuthology.orchestra.run.smithi090.stdout:003.out 2023-06-09T04:46:06.634 INFO:teuthology.orchestra.run.smithi090.stdout:004 2023-06-09T04:46:06.634 INFO:teuthology.orchestra.run.smithi090.stdout:004.out 2023-06-09T04:46:06.634 INFO:teuthology.orchestra.run.smithi090.stdout:005 2023-06-09T04:46:06.634 INFO:teuthology.orchestra.run.smithi090.stdout:005.out 2023-06-09T04:46:06.634 INFO:teuthology.orchestra.run.smithi090.stdout:006 2023-06-09T04:46:06.635 INFO:teuthology.orchestra.run.smithi090.stdout:006.out 2023-06-09T04:46:06.635 INFO:teuthology.orchestra.run.smithi090.stdout:007 2023-06-09T04:46:06.635 INFO:teuthology.orchestra.run.smithi090.stdout:007.out 2023-06-09T04:46:06.635 INFO:teuthology.orchestra.run.smithi090.stdout:008 2023-06-09T04:46:06.635 INFO:teuthology.orchestra.run.smithi090.stdout:008.out 2023-06-09T04:46:06.635 INFO:teuthology.orchestra.run.smithi090.stdout:009 2023-06-09T04:46:06.635 INFO:teuthology.orchestra.run.smithi090.stdout:009.out 2023-06-09T04:46:06.635 INFO:teuthology.orchestra.run.smithi090.stdout:010 2023-06-09T04:46:06.636 INFO:teuthology.orchestra.run.smithi090.stdout:010.out 2023-06-09T04:46:06.636 INFO:teuthology.orchestra.run.smithi090.stdout:011 2023-06-09T04:46:06.636 INFO:teuthology.orchestra.run.smithi090.stdout:011.out 2023-06-09T04:46:06.636 INFO:teuthology.orchestra.run.smithi090.stdout:012 2023-06-09T04:46:06.636 INFO:teuthology.orchestra.run.smithi090.stdout:012.out 2023-06-09T04:46:06.636 INFO:teuthology.orchestra.run.smithi090.stdout:013 2023-06-09T04:46:06.636 INFO:teuthology.orchestra.run.smithi090.stdout:013.out 2023-06-09T04:46:06.637 INFO:teuthology.orchestra.run.smithi090.stdout:014 2023-06-09T04:46:06.637 INFO:teuthology.orchestra.run.smithi090.stdout:014.out 2023-06-09T04:46:06.637 INFO:teuthology.orchestra.run.smithi090.stdout:015 2023-06-09T04:46:06.637 INFO:teuthology.orchestra.run.smithi090.stdout:015.out 2023-06-09T04:46:06.637 INFO:teuthology.orchestra.run.smithi090.stdout:016 2023-06-09T04:46:06.637 INFO:teuthology.orchestra.run.smithi090.stdout:016.out 2023-06-09T04:46:06.637 INFO:teuthology.orchestra.run.smithi090.stdout:017 2023-06-09T04:46:06.637 INFO:teuthology.orchestra.run.smithi090.stdout:017.out 2023-06-09T04:46:06.638 INFO:teuthology.orchestra.run.smithi090.stdout:018 2023-06-09T04:46:06.638 INFO:teuthology.orchestra.run.smithi090.stdout:018.out 2023-06-09T04:46:06.638 INFO:teuthology.orchestra.run.smithi090.stdout:019 2023-06-09T04:46:06.638 INFO:teuthology.orchestra.run.smithi090.stdout:019.out 2023-06-09T04:46:06.638 INFO:teuthology.orchestra.run.smithi090.stdout:020 2023-06-09T04:46:06.638 INFO:teuthology.orchestra.run.smithi090.stdout:020.out 2023-06-09T04:46:06.638 INFO:teuthology.orchestra.run.smithi090.stdout:021 2023-06-09T04:46:06.638 INFO:teuthology.orchestra.run.smithi090.stdout:021.out 2023-06-09T04:46:06.639 INFO:teuthology.orchestra.run.smithi090.stdout:022 2023-06-09T04:46:06.639 INFO:teuthology.orchestra.run.smithi090.stdout:022.out 2023-06-09T04:46:06.639 INFO:teuthology.orchestra.run.smithi090.stdout:023 2023-06-09T04:46:06.639 INFO:teuthology.orchestra.run.smithi090.stdout:023.out 2023-06-09T04:46:06.639 INFO:teuthology.orchestra.run.smithi090.stdout:024 2023-06-09T04:46:06.639 INFO:teuthology.orchestra.run.smithi090.stdout:024.out 2023-06-09T04:46:06.639 INFO:teuthology.orchestra.run.smithi090.stdout:025 2023-06-09T04:46:06.640 INFO:teuthology.orchestra.run.smithi090.stdout:025.out 2023-06-09T04:46:06.640 INFO:teuthology.orchestra.run.smithi090.stdout:026 2023-06-09T04:46:06.640 INFO:teuthology.orchestra.run.smithi090.stdout:026.out 2023-06-09T04:46:06.640 INFO:teuthology.orchestra.run.smithi090.stdout:027 2023-06-09T04:46:06.640 INFO:teuthology.orchestra.run.smithi090.stdout:027.out 2023-06-09T04:46:06.640 INFO:teuthology.orchestra.run.smithi090.stdout:028 2023-06-09T04:46:06.640 INFO:teuthology.orchestra.run.smithi090.stdout:028.out 2023-06-09T04:46:06.641 INFO:teuthology.orchestra.run.smithi090.stdout:029 2023-06-09T04:46:06.641 INFO:teuthology.orchestra.run.smithi090.stdout:029.out 2023-06-09T04:46:06.641 INFO:teuthology.orchestra.run.smithi090.stdout:030 2023-06-09T04:46:06.641 INFO:teuthology.orchestra.run.smithi090.stdout:030.out 2023-06-09T04:46:06.641 INFO:teuthology.orchestra.run.smithi090.stdout:031 2023-06-09T04:46:06.641 INFO:teuthology.orchestra.run.smithi090.stdout:031.out 2023-06-09T04:46:06.641 INFO:teuthology.orchestra.run.smithi090.stdout:032 2023-06-09T04:46:06.641 INFO:teuthology.orchestra.run.smithi090.stdout:032.out 2023-06-09T04:46:06.642 INFO:teuthology.orchestra.run.smithi090.stdout:033 2023-06-09T04:46:06.642 INFO:teuthology.orchestra.run.smithi090.stdout:033.out 2023-06-09T04:46:06.642 INFO:teuthology.orchestra.run.smithi090.stdout:034 2023-06-09T04:46:06.642 INFO:teuthology.orchestra.run.smithi090.stdout:034.out 2023-06-09T04:46:06.642 INFO:teuthology.orchestra.run.smithi090.stdout:035 2023-06-09T04:46:06.642 INFO:teuthology.orchestra.run.smithi090.stdout:035.cfg 2023-06-09T04:46:06.642 INFO:teuthology.orchestra.run.smithi090.stdout:035.out.default 2023-06-09T04:46:06.643 INFO:teuthology.orchestra.run.smithi090.stdout:035.out.nfs 2023-06-09T04:46:06.643 INFO:teuthology.orchestra.run.smithi090.stdout:036 2023-06-09T04:46:06.643 INFO:teuthology.orchestra.run.smithi090.stdout:036.out 2023-06-09T04:46:06.643 INFO:teuthology.orchestra.run.smithi090.stdout:037 2023-06-09T04:46:06.643 INFO:teuthology.orchestra.run.smithi090.stdout:037.out 2023-06-09T04:46:06.643 INFO:teuthology.orchestra.run.smithi090.stdout:038 2023-06-09T04:46:06.643 INFO:teuthology.orchestra.run.smithi090.stdout:038.out 2023-06-09T04:46:06.644 INFO:teuthology.orchestra.run.smithi090.stdout:039 2023-06-09T04:46:06.644 INFO:teuthology.orchestra.run.smithi090.stdout:039.out 2023-06-09T04:46:06.644 INFO:teuthology.orchestra.run.smithi090.stdout:040 2023-06-09T04:46:06.644 INFO:teuthology.orchestra.run.smithi090.stdout:040.out 2023-06-09T04:46:06.644 INFO:teuthology.orchestra.run.smithi090.stdout:041 2023-06-09T04:46:06.644 INFO:teuthology.orchestra.run.smithi090.stdout:041.out 2023-06-09T04:46:06.644 INFO:teuthology.orchestra.run.smithi090.stdout:042 2023-06-09T04:46:06.644 INFO:teuthology.orchestra.run.smithi090.stdout:042.out 2023-06-09T04:46:06.645 INFO:teuthology.orchestra.run.smithi090.stdout:043 2023-06-09T04:46:06.645 INFO:teuthology.orchestra.run.smithi090.stdout:043.out 2023-06-09T04:46:06.645 INFO:teuthology.orchestra.run.smithi090.stdout:044 2023-06-09T04:46:06.645 INFO:teuthology.orchestra.run.smithi090.stdout:044.out 2023-06-09T04:46:06.645 INFO:teuthology.orchestra.run.smithi090.stdout:045 2023-06-09T04:46:06.645 INFO:teuthology.orchestra.run.smithi090.stdout:045.out 2023-06-09T04:46:06.645 INFO:teuthology.orchestra.run.smithi090.stdout:046 2023-06-09T04:46:06.646 INFO:teuthology.orchestra.run.smithi090.stdout:046.out 2023-06-09T04:46:06.646 INFO:teuthology.orchestra.run.smithi090.stdout:047 2023-06-09T04:46:06.646 INFO:teuthology.orchestra.run.smithi090.stdout:047.out 2023-06-09T04:46:06.646 INFO:teuthology.orchestra.run.smithi090.stdout:048 2023-06-09T04:46:06.646 INFO:teuthology.orchestra.run.smithi090.stdout:048.out 2023-06-09T04:46:06.646 INFO:teuthology.orchestra.run.smithi090.stdout:049 2023-06-09T04:46:06.646 INFO:teuthology.orchestra.run.smithi090.stdout:049.out 2023-06-09T04:46:06.646 INFO:teuthology.orchestra.run.smithi090.stdout:050 2023-06-09T04:46:06.647 INFO:teuthology.orchestra.run.smithi090.stdout:050.cfg 2023-06-09T04:46:06.647 INFO:teuthology.orchestra.run.smithi090.stdout:050.out.default 2023-06-09T04:46:06.647 INFO:teuthology.orchestra.run.smithi090.stdout:050.out.nojournal 2023-06-09T04:46:06.647 INFO:teuthology.orchestra.run.smithi090.stdout:050.out.xfsquota 2023-06-09T04:46:06.647 INFO:teuthology.orchestra.run.smithi090.stdout:051 2023-06-09T04:46:06.647 INFO:teuthology.orchestra.run.smithi090.stdout:051.out 2023-06-09T04:46:06.647 INFO:teuthology.orchestra.run.smithi090.stdout:052 2023-06-09T04:46:06.647 INFO:teuthology.orchestra.run.smithi090.stdout:052.out 2023-06-09T04:46:06.648 INFO:teuthology.orchestra.run.smithi090.stdout:053 2023-06-09T04:46:06.648 INFO:teuthology.orchestra.run.smithi090.stdout:053.out 2023-06-09T04:46:06.648 INFO:teuthology.orchestra.run.smithi090.stdout:054 2023-06-09T04:46:06.648 INFO:teuthology.orchestra.run.smithi090.stdout:054.out 2023-06-09T04:46:06.648 INFO:teuthology.orchestra.run.smithi090.stdout:055 2023-06-09T04:46:06.648 INFO:teuthology.orchestra.run.smithi090.stdout:055.out 2023-06-09T04:46:06.648 INFO:teuthology.orchestra.run.smithi090.stdout:056 2023-06-09T04:46:06.649 INFO:teuthology.orchestra.run.smithi090.stdout:056.out 2023-06-09T04:46:06.649 INFO:teuthology.orchestra.run.smithi090.stdout:057 2023-06-09T04:46:06.649 INFO:teuthology.orchestra.run.smithi090.stdout:057.out 2023-06-09T04:46:06.649 INFO:teuthology.orchestra.run.smithi090.stdout:058 2023-06-09T04:46:06.649 INFO:teuthology.orchestra.run.smithi090.stdout:058.out 2023-06-09T04:46:06.649 INFO:teuthology.orchestra.run.smithi090.stdout:059 2023-06-09T04:46:06.649 INFO:teuthology.orchestra.run.smithi090.stdout:059.out 2023-06-09T04:46:06.650 INFO:teuthology.orchestra.run.smithi090.stdout:060 2023-06-09T04:46:06.650 INFO:teuthology.orchestra.run.smithi090.stdout:060.out 2023-06-09T04:46:06.650 INFO:teuthology.orchestra.run.smithi090.stdout:061 2023-06-09T04:46:06.650 INFO:teuthology.orchestra.run.smithi090.stdout:061.out 2023-06-09T04:46:06.650 INFO:teuthology.orchestra.run.smithi090.stdout:062 2023-06-09T04:46:06.650 INFO:teuthology.orchestra.run.smithi090.stdout:062.out 2023-06-09T04:46:06.650 INFO:teuthology.orchestra.run.smithi090.stdout:063 2023-06-09T04:46:06.650 INFO:teuthology.orchestra.run.smithi090.stdout:063.out 2023-06-09T04:46:06.651 INFO:teuthology.orchestra.run.smithi090.stdout:064 2023-06-09T04:46:06.651 INFO:teuthology.orchestra.run.smithi090.stdout:064.out 2023-06-09T04:46:06.651 INFO:teuthology.orchestra.run.smithi090.stdout:065 2023-06-09T04:46:06.651 INFO:teuthology.orchestra.run.smithi090.stdout:065.out 2023-06-09T04:46:06.651 INFO:teuthology.orchestra.run.smithi090.stdout:066 2023-06-09T04:46:06.651 INFO:teuthology.orchestra.run.smithi090.stdout:066.out 2023-06-09T04:46:06.651 INFO:teuthology.orchestra.run.smithi090.stdout:067 2023-06-09T04:46:06.651 INFO:teuthology.orchestra.run.smithi090.stdout:067.out 2023-06-09T04:46:06.652 INFO:teuthology.orchestra.run.smithi090.stdout:068 2023-06-09T04:46:06.652 INFO:teuthology.orchestra.run.smithi090.stdout:068.out 2023-06-09T04:46:06.652 INFO:teuthology.orchestra.run.smithi090.stdout:069 2023-06-09T04:46:06.652 INFO:teuthology.orchestra.run.smithi090.stdout:069.out 2023-06-09T04:46:06.652 INFO:teuthology.orchestra.run.smithi090.stdout:070 2023-06-09T04:46:06.652 INFO:teuthology.orchestra.run.smithi090.stdout:070.out 2023-06-09T04:46:06.652 INFO:teuthology.orchestra.run.smithi090.stdout:071 2023-06-09T04:46:06.653 INFO:teuthology.orchestra.run.smithi090.stdout:071.out 2023-06-09T04:46:06.653 INFO:teuthology.orchestra.run.smithi090.stdout:072 2023-06-09T04:46:06.653 INFO:teuthology.orchestra.run.smithi090.stdout:072.out 2023-06-09T04:46:06.653 INFO:teuthology.orchestra.run.smithi090.stdout:073 2023-06-09T04:46:06.653 INFO:teuthology.orchestra.run.smithi090.stdout:073.out 2023-06-09T04:46:06.653 INFO:teuthology.orchestra.run.smithi090.stdout:074 2023-06-09T04:46:06.653 INFO:teuthology.orchestra.run.smithi090.stdout:074.out 2023-06-09T04:46:06.653 INFO:teuthology.orchestra.run.smithi090.stdout:075 2023-06-09T04:46:06.654 INFO:teuthology.orchestra.run.smithi090.stdout:075.out 2023-06-09T04:46:06.654 INFO:teuthology.orchestra.run.smithi090.stdout:076 2023-06-09T04:46:06.654 INFO:teuthology.orchestra.run.smithi090.stdout:076.out 2023-06-09T04:46:06.654 INFO:teuthology.orchestra.run.smithi090.stdout:077 2023-06-09T04:46:06.654 INFO:teuthology.orchestra.run.smithi090.stdout:077.out 2023-06-09T04:46:06.654 INFO:teuthology.orchestra.run.smithi090.stdout:078 2023-06-09T04:46:06.654 INFO:teuthology.orchestra.run.smithi090.stdout:078.out 2023-06-09T04:46:06.654 INFO:teuthology.orchestra.run.smithi090.stdout:079 2023-06-09T04:46:06.655 INFO:teuthology.orchestra.run.smithi090.stdout:079.out 2023-06-09T04:46:06.655 INFO:teuthology.orchestra.run.smithi090.stdout:080 2023-06-09T04:46:06.655 INFO:teuthology.orchestra.run.smithi090.stdout:080.out 2023-06-09T04:46:06.655 INFO:teuthology.orchestra.run.smithi090.stdout:081 2023-06-09T04:46:06.655 INFO:teuthology.orchestra.run.smithi090.stdout:081.out 2023-06-09T04:46:06.655 INFO:teuthology.orchestra.run.smithi090.stdout:082 2023-06-09T04:46:06.656 INFO:teuthology.orchestra.run.smithi090.stdout:082.out 2023-06-09T04:46:06.656 INFO:teuthology.orchestra.run.smithi090.stdout:083 2023-06-09T04:46:06.656 INFO:teuthology.orchestra.run.smithi090.stdout:083.out 2023-06-09T04:46:06.656 INFO:teuthology.orchestra.run.smithi090.stdout:084 2023-06-09T04:46:06.657 INFO:teuthology.orchestra.run.smithi090.stdout:084.out 2023-06-09T04:46:06.657 INFO:teuthology.orchestra.run.smithi090.stdout:085 2023-06-09T04:46:06.657 INFO:teuthology.orchestra.run.smithi090.stdout:085.out 2023-06-09T04:46:06.658 INFO:teuthology.orchestra.run.smithi090.stdout:086 2023-06-09T04:46:06.658 INFO:teuthology.orchestra.run.smithi090.stdout:086.out 2023-06-09T04:46:06.658 INFO:teuthology.orchestra.run.smithi090.stdout:087 2023-06-09T04:46:06.659 INFO:teuthology.orchestra.run.smithi090.stdout:087.out 2023-06-09T04:46:06.659 INFO:teuthology.orchestra.run.smithi090.stdout:088 2023-06-09T04:46:06.659 INFO:teuthology.orchestra.run.smithi090.stdout:088.out 2023-06-09T04:46:06.659 INFO:teuthology.orchestra.run.smithi090.stdout:089 2023-06-09T04:46:06.660 INFO:teuthology.orchestra.run.smithi090.stdout:089.out 2023-06-09T04:46:06.660 INFO:teuthology.orchestra.run.smithi090.stdout:090 2023-06-09T04:46:06.660 INFO:teuthology.orchestra.run.smithi090.stdout:090.out 2023-06-09T04:46:06.660 INFO:teuthology.orchestra.run.smithi090.stdout:091 2023-06-09T04:46:06.660 INFO:teuthology.orchestra.run.smithi090.stdout:091.out 2023-06-09T04:46:06.661 INFO:teuthology.orchestra.run.smithi090.stdout:092 2023-06-09T04:46:06.661 INFO:teuthology.orchestra.run.smithi090.stdout:092.out 2023-06-09T04:46:06.661 INFO:teuthology.orchestra.run.smithi090.stdout:093 2023-06-09T04:46:06.661 INFO:teuthology.orchestra.run.smithi090.stdout:093.out 2023-06-09T04:46:06.662 INFO:teuthology.orchestra.run.smithi090.stdout:094 2023-06-09T04:46:06.662 INFO:teuthology.orchestra.run.smithi090.stdout:094.out 2023-06-09T04:46:06.662 INFO:teuthology.orchestra.run.smithi090.stdout:095 2023-06-09T04:46:06.662 INFO:teuthology.orchestra.run.smithi090.stdout:095.out 2023-06-09T04:46:06.663 INFO:teuthology.orchestra.run.smithi090.stdout:096 2023-06-09T04:46:06.663 INFO:teuthology.orchestra.run.smithi090.stdout:096.out 2023-06-09T04:46:06.663 INFO:teuthology.orchestra.run.smithi090.stdout:097 2023-06-09T04:46:06.663 INFO:teuthology.orchestra.run.smithi090.stdout:097.out 2023-06-09T04:46:06.663 INFO:teuthology.orchestra.run.smithi090.stdout:098 2023-06-09T04:46:06.663 INFO:teuthology.orchestra.run.smithi090.stdout:098.out 2023-06-09T04:46:06.663 INFO:teuthology.orchestra.run.smithi090.stdout:099 2023-06-09T04:46:06.664 INFO:teuthology.orchestra.run.smithi090.stdout:099.out 2023-06-09T04:46:06.664 INFO:teuthology.orchestra.run.smithi090.stdout:100 2023-06-09T04:46:06.664 INFO:teuthology.orchestra.run.smithi090.stdout:100.out 2023-06-09T04:46:06.664 INFO:teuthology.orchestra.run.smithi090.stdout:101 2023-06-09T04:46:06.664 INFO:teuthology.orchestra.run.smithi090.stdout:101.out 2023-06-09T04:46:06.664 INFO:teuthology.orchestra.run.smithi090.stdout:102 2023-06-09T04:46:06.664 INFO:teuthology.orchestra.run.smithi090.stdout:102.out 2023-06-09T04:46:06.664 INFO:teuthology.orchestra.run.smithi090.stdout:103 2023-06-09T04:46:06.665 INFO:teuthology.orchestra.run.smithi090.stdout:103.out 2023-06-09T04:46:06.665 INFO:teuthology.orchestra.run.smithi090.stdout:104 2023-06-09T04:46:06.665 INFO:teuthology.orchestra.run.smithi090.stdout:104.out 2023-06-09T04:46:06.665 INFO:teuthology.orchestra.run.smithi090.stdout:105 2023-06-09T04:46:06.665 INFO:teuthology.orchestra.run.smithi090.stdout:105.out 2023-06-09T04:46:06.665 INFO:teuthology.orchestra.run.smithi090.stdout:106 2023-06-09T04:46:06.665 INFO:teuthology.orchestra.run.smithi090.stdout:106.out 2023-06-09T04:46:06.666 INFO:teuthology.orchestra.run.smithi090.stdout:107 2023-06-09T04:46:06.666 INFO:teuthology.orchestra.run.smithi090.stdout:107.out 2023-06-09T04:46:06.666 INFO:teuthology.orchestra.run.smithi090.stdout:108 2023-06-09T04:46:06.666 INFO:teuthology.orchestra.run.smithi090.stdout:108.out 2023-06-09T04:46:06.666 INFO:teuthology.orchestra.run.smithi090.stdout:109 2023-06-09T04:46:06.666 INFO:teuthology.orchestra.run.smithi090.stdout:109.out 2023-06-09T04:46:06.666 INFO:teuthology.orchestra.run.smithi090.stdout:110 2023-06-09T04:46:06.666 INFO:teuthology.orchestra.run.smithi090.stdout:110.out 2023-06-09T04:46:06.667 INFO:teuthology.orchestra.run.smithi090.stdout:111 2023-06-09T04:46:06.667 INFO:teuthology.orchestra.run.smithi090.stdout:111.out 2023-06-09T04:46:06.667 INFO:teuthology.orchestra.run.smithi090.stdout:112 2023-06-09T04:46:06.667 INFO:teuthology.orchestra.run.smithi090.stdout:112.out 2023-06-09T04:46:06.667 INFO:teuthology.orchestra.run.smithi090.stdout:113 2023-06-09T04:46:06.667 INFO:teuthology.orchestra.run.smithi090.stdout:113.out 2023-06-09T04:46:06.667 INFO:teuthology.orchestra.run.smithi090.stdout:114 2023-06-09T04:46:06.667 INFO:teuthology.orchestra.run.smithi090.stdout:114.out 2023-06-09T04:46:06.668 INFO:teuthology.orchestra.run.smithi090.stdout:115 2023-06-09T04:46:06.668 INFO:teuthology.orchestra.run.smithi090.stdout:115.out 2023-06-09T04:46:06.668 INFO:teuthology.orchestra.run.smithi090.stdout:116 2023-06-09T04:46:06.668 INFO:teuthology.orchestra.run.smithi090.stdout:116.out 2023-06-09T04:46:06.668 INFO:teuthology.orchestra.run.smithi090.stdout:117 2023-06-09T04:46:06.668 INFO:teuthology.orchestra.run.smithi090.stdout:117.out 2023-06-09T04:46:06.668 INFO:teuthology.orchestra.run.smithi090.stdout:118 2023-06-09T04:46:06.669 INFO:teuthology.orchestra.run.smithi090.stdout:118.out 2023-06-09T04:46:06.669 INFO:teuthology.orchestra.run.smithi090.stdout:119 2023-06-09T04:46:06.669 INFO:teuthology.orchestra.run.smithi090.stdout:119.out 2023-06-09T04:46:06.669 INFO:teuthology.orchestra.run.smithi090.stdout:120 2023-06-09T04:46:06.669 INFO:teuthology.orchestra.run.smithi090.stdout:120.out 2023-06-09T04:46:06.669 INFO:teuthology.orchestra.run.smithi090.stdout:121 2023-06-09T04:46:06.669 INFO:teuthology.orchestra.run.smithi090.stdout:121.out 2023-06-09T04:46:06.669 INFO:teuthology.orchestra.run.smithi090.stdout:122 2023-06-09T04:46:06.670 INFO:teuthology.orchestra.run.smithi090.stdout:122.out 2023-06-09T04:46:06.670 INFO:teuthology.orchestra.run.smithi090.stdout:123 2023-06-09T04:46:06.670 INFO:teuthology.orchestra.run.smithi090.stdout:123.out 2023-06-09T04:46:06.670 INFO:teuthology.orchestra.run.smithi090.stdout:124 2023-06-09T04:46:06.670 INFO:teuthology.orchestra.run.smithi090.stdout:124.out 2023-06-09T04:46:06.670 INFO:teuthology.orchestra.run.smithi090.stdout:125 2023-06-09T04:46:06.670 INFO:teuthology.orchestra.run.smithi090.stdout:125.out 2023-06-09T04:46:06.671 INFO:teuthology.orchestra.run.smithi090.stdout:126 2023-06-09T04:46:06.671 INFO:teuthology.orchestra.run.smithi090.stdout:126.out 2023-06-09T04:46:06.671 INFO:teuthology.orchestra.run.smithi090.stdout:127 2023-06-09T04:46:06.671 INFO:teuthology.orchestra.run.smithi090.stdout:127.out 2023-06-09T04:46:06.671 INFO:teuthology.orchestra.run.smithi090.stdout:128 2023-06-09T04:46:06.671 INFO:teuthology.orchestra.run.smithi090.stdout:128.out 2023-06-09T04:46:06.671 INFO:teuthology.orchestra.run.smithi090.stdout:129 2023-06-09T04:46:06.671 INFO:teuthology.orchestra.run.smithi090.stdout:129.out 2023-06-09T04:46:06.672 INFO:teuthology.orchestra.run.smithi090.stdout:130 2023-06-09T04:46:06.672 INFO:teuthology.orchestra.run.smithi090.stdout:130.out 2023-06-09T04:46:06.672 INFO:teuthology.orchestra.run.smithi090.stdout:131 2023-06-09T04:46:06.672 INFO:teuthology.orchestra.run.smithi090.stdout:131.out 2023-06-09T04:46:06.672 INFO:teuthology.orchestra.run.smithi090.stdout:132 2023-06-09T04:46:06.672 INFO:teuthology.orchestra.run.smithi090.stdout:132.out 2023-06-09T04:46:06.672 INFO:teuthology.orchestra.run.smithi090.stdout:133 2023-06-09T04:46:06.673 INFO:teuthology.orchestra.run.smithi090.stdout:133.out 2023-06-09T04:46:06.673 INFO:teuthology.orchestra.run.smithi090.stdout:134 2023-06-09T04:46:06.673 INFO:teuthology.orchestra.run.smithi090.stdout:134.out 2023-06-09T04:46:06.673 INFO:teuthology.orchestra.run.smithi090.stdout:135 2023-06-09T04:46:06.673 INFO:teuthology.orchestra.run.smithi090.stdout:135.out 2023-06-09T04:46:06.673 INFO:teuthology.orchestra.run.smithi090.stdout:136 2023-06-09T04:46:06.673 INFO:teuthology.orchestra.run.smithi090.stdout:136.out 2023-06-09T04:46:06.673 INFO:teuthology.orchestra.run.smithi090.stdout:137 2023-06-09T04:46:06.674 INFO:teuthology.orchestra.run.smithi090.stdout:137.out 2023-06-09T04:46:06.674 INFO:teuthology.orchestra.run.smithi090.stdout:138 2023-06-09T04:46:06.674 INFO:teuthology.orchestra.run.smithi090.stdout:138.out 2023-06-09T04:46:06.674 INFO:teuthology.orchestra.run.smithi090.stdout:139 2023-06-09T04:46:06.674 INFO:teuthology.orchestra.run.smithi090.stdout:139.out 2023-06-09T04:46:06.674 INFO:teuthology.orchestra.run.smithi090.stdout:140 2023-06-09T04:46:06.674 INFO:teuthology.orchestra.run.smithi090.stdout:140.out 2023-06-09T04:46:06.674 INFO:teuthology.orchestra.run.smithi090.stdout:141 2023-06-09T04:46:06.675 INFO:teuthology.orchestra.run.smithi090.stdout:141.out 2023-06-09T04:46:06.675 INFO:teuthology.orchestra.run.smithi090.stdout:142 2023-06-09T04:46:06.675 INFO:teuthology.orchestra.run.smithi090.stdout:142.out 2023-06-09T04:46:06.675 INFO:teuthology.orchestra.run.smithi090.stdout:143 2023-06-09T04:46:06.675 INFO:teuthology.orchestra.run.smithi090.stdout:143.out 2023-06-09T04:46:06.675 INFO:teuthology.orchestra.run.smithi090.stdout:144 2023-06-09T04:46:06.675 INFO:teuthology.orchestra.run.smithi090.stdout:144.out 2023-06-09T04:46:06.675 INFO:teuthology.orchestra.run.smithi090.stdout:145 2023-06-09T04:46:06.676 INFO:teuthology.orchestra.run.smithi090.stdout:145.out 2023-06-09T04:46:06.676 INFO:teuthology.orchestra.run.smithi090.stdout:146 2023-06-09T04:46:06.676 INFO:teuthology.orchestra.run.smithi090.stdout:146.out 2023-06-09T04:46:06.676 INFO:teuthology.orchestra.run.smithi090.stdout:147 2023-06-09T04:46:06.676 INFO:teuthology.orchestra.run.smithi090.stdout:147.out 2023-06-09T04:46:06.676 INFO:teuthology.orchestra.run.smithi090.stdout:148 2023-06-09T04:46:06.676 INFO:teuthology.orchestra.run.smithi090.stdout:148.out 2023-06-09T04:46:06.677 INFO:teuthology.orchestra.run.smithi090.stdout:149 2023-06-09T04:46:06.677 INFO:teuthology.orchestra.run.smithi090.stdout:149.out 2023-06-09T04:46:06.677 INFO:teuthology.orchestra.run.smithi090.stdout:150 2023-06-09T04:46:06.677 INFO:teuthology.orchestra.run.smithi090.stdout:150.out 2023-06-09T04:46:06.677 INFO:teuthology.orchestra.run.smithi090.stdout:151 2023-06-09T04:46:06.677 INFO:teuthology.orchestra.run.smithi090.stdout:151.out 2023-06-09T04:46:06.677 INFO:teuthology.orchestra.run.smithi090.stdout:152 2023-06-09T04:46:06.678 INFO:teuthology.orchestra.run.smithi090.stdout:152.out 2023-06-09T04:46:06.678 INFO:teuthology.orchestra.run.smithi090.stdout:153 2023-06-09T04:46:06.678 INFO:teuthology.orchestra.run.smithi090.stdout:153.out 2023-06-09T04:46:06.678 INFO:teuthology.orchestra.run.smithi090.stdout:154 2023-06-09T04:46:06.678 INFO:teuthology.orchestra.run.smithi090.stdout:154.out 2023-06-09T04:46:06.678 INFO:teuthology.orchestra.run.smithi090.stdout:155 2023-06-09T04:46:06.678 INFO:teuthology.orchestra.run.smithi090.stdout:155.out 2023-06-09T04:46:06.678 INFO:teuthology.orchestra.run.smithi090.stdout:156 2023-06-09T04:46:06.679 INFO:teuthology.orchestra.run.smithi090.stdout:156.out 2023-06-09T04:46:06.679 INFO:teuthology.orchestra.run.smithi090.stdout:157 2023-06-09T04:46:06.679 INFO:teuthology.orchestra.run.smithi090.stdout:157.out 2023-06-09T04:46:06.679 INFO:teuthology.orchestra.run.smithi090.stdout:158 2023-06-09T04:46:06.679 INFO:teuthology.orchestra.run.smithi090.stdout:158.out 2023-06-09T04:46:06.679 INFO:teuthology.orchestra.run.smithi090.stdout:159 2023-06-09T04:46:06.679 INFO:teuthology.orchestra.run.smithi090.stdout:159.out 2023-06-09T04:46:06.679 INFO:teuthology.orchestra.run.smithi090.stdout:160 2023-06-09T04:46:06.680 INFO:teuthology.orchestra.run.smithi090.stdout:160.out 2023-06-09T04:46:06.680 INFO:teuthology.orchestra.run.smithi090.stdout:161 2023-06-09T04:46:06.680 INFO:teuthology.orchestra.run.smithi090.stdout:161.out 2023-06-09T04:46:06.680 INFO:teuthology.orchestra.run.smithi090.stdout:162 2023-06-09T04:46:06.680 INFO:teuthology.orchestra.run.smithi090.stdout:162.out 2023-06-09T04:46:06.680 INFO:teuthology.orchestra.run.smithi090.stdout:163 2023-06-09T04:46:06.680 INFO:teuthology.orchestra.run.smithi090.stdout:163.out 2023-06-09T04:46:06.680 INFO:teuthology.orchestra.run.smithi090.stdout:164 2023-06-09T04:46:06.681 INFO:teuthology.orchestra.run.smithi090.stdout:164.out 2023-06-09T04:46:06.681 INFO:teuthology.orchestra.run.smithi090.stdout:165 2023-06-09T04:46:06.681 INFO:teuthology.orchestra.run.smithi090.stdout:165.out 2023-06-09T04:46:06.681 INFO:teuthology.orchestra.run.smithi090.stdout:166 2023-06-09T04:46:06.681 INFO:teuthology.orchestra.run.smithi090.stdout:166.out 2023-06-09T04:46:06.681 INFO:teuthology.orchestra.run.smithi090.stdout:167 2023-06-09T04:46:06.682 INFO:teuthology.orchestra.run.smithi090.stdout:167.out 2023-06-09T04:46:06.682 INFO:teuthology.orchestra.run.smithi090.stdout:168 2023-06-09T04:46:06.682 INFO:teuthology.orchestra.run.smithi090.stdout:168.out 2023-06-09T04:46:06.682 INFO:teuthology.orchestra.run.smithi090.stdout:169 2023-06-09T04:46:06.682 INFO:teuthology.orchestra.run.smithi090.stdout:169.out 2023-06-09T04:46:06.682 INFO:teuthology.orchestra.run.smithi090.stdout:170 2023-06-09T04:46:06.682 INFO:teuthology.orchestra.run.smithi090.stdout:170.out 2023-06-09T04:46:06.682 INFO:teuthology.orchestra.run.smithi090.stdout:171 2023-06-09T04:46:06.683 INFO:teuthology.orchestra.run.smithi090.stdout:171.out 2023-06-09T04:46:06.683 INFO:teuthology.orchestra.run.smithi090.stdout:172 2023-06-09T04:46:06.683 INFO:teuthology.orchestra.run.smithi090.stdout:172.out 2023-06-09T04:46:06.683 INFO:teuthology.orchestra.run.smithi090.stdout:173 2023-06-09T04:46:06.683 INFO:teuthology.orchestra.run.smithi090.stdout:173.out 2023-06-09T04:46:06.683 INFO:teuthology.orchestra.run.smithi090.stdout:174 2023-06-09T04:46:06.683 INFO:teuthology.orchestra.run.smithi090.stdout:174.out 2023-06-09T04:46:06.684 INFO:teuthology.orchestra.run.smithi090.stdout:175 2023-06-09T04:46:06.684 INFO:teuthology.orchestra.run.smithi090.stdout:175.out 2023-06-09T04:46:06.684 INFO:teuthology.orchestra.run.smithi090.stdout:176 2023-06-09T04:46:06.684 INFO:teuthology.orchestra.run.smithi090.stdout:176.out 2023-06-09T04:46:06.684 INFO:teuthology.orchestra.run.smithi090.stdout:177 2023-06-09T04:46:06.684 INFO:teuthology.orchestra.run.smithi090.stdout:177.out 2023-06-09T04:46:06.684 INFO:teuthology.orchestra.run.smithi090.stdout:178 2023-06-09T04:46:06.684 INFO:teuthology.orchestra.run.smithi090.stdout:178.out 2023-06-09T04:46:06.685 INFO:teuthology.orchestra.run.smithi090.stdout:179 2023-06-09T04:46:06.685 INFO:teuthology.orchestra.run.smithi090.stdout:179.out 2023-06-09T04:46:06.685 INFO:teuthology.orchestra.run.smithi090.stdout:180 2023-06-09T04:46:06.685 INFO:teuthology.orchestra.run.smithi090.stdout:180.out 2023-06-09T04:46:06.685 INFO:teuthology.orchestra.run.smithi090.stdout:181 2023-06-09T04:46:06.685 INFO:teuthology.orchestra.run.smithi090.stdout:181.out 2023-06-09T04:46:06.685 INFO:teuthology.orchestra.run.smithi090.stdout:182 2023-06-09T04:46:06.686 INFO:teuthology.orchestra.run.smithi090.stdout:182.out 2023-06-09T04:46:06.686 INFO:teuthology.orchestra.run.smithi090.stdout:183 2023-06-09T04:46:06.686 INFO:teuthology.orchestra.run.smithi090.stdout:183.out 2023-06-09T04:46:06.686 INFO:teuthology.orchestra.run.smithi090.stdout:184 2023-06-09T04:46:06.686 INFO:teuthology.orchestra.run.smithi090.stdout:184.out 2023-06-09T04:46:06.686 INFO:teuthology.orchestra.run.smithi090.stdout:185 2023-06-09T04:46:06.686 INFO:teuthology.orchestra.run.smithi090.stdout:185.out 2023-06-09T04:46:06.686 INFO:teuthology.orchestra.run.smithi090.stdout:186 2023-06-09T04:46:06.687 INFO:teuthology.orchestra.run.smithi090.stdout:186.out 2023-06-09T04:46:06.687 INFO:teuthology.orchestra.run.smithi090.stdout:187 2023-06-09T04:46:06.687 INFO:teuthology.orchestra.run.smithi090.stdout:187.out 2023-06-09T04:46:06.687 INFO:teuthology.orchestra.run.smithi090.stdout:188 2023-06-09T04:46:06.687 INFO:teuthology.orchestra.run.smithi090.stdout:188.out 2023-06-09T04:46:06.687 INFO:teuthology.orchestra.run.smithi090.stdout:189 2023-06-09T04:46:06.687 INFO:teuthology.orchestra.run.smithi090.stdout:189.out 2023-06-09T04:46:06.687 INFO:teuthology.orchestra.run.smithi090.stdout:190 2023-06-09T04:46:06.688 INFO:teuthology.orchestra.run.smithi090.stdout:190.out 2023-06-09T04:46:06.688 INFO:teuthology.orchestra.run.smithi090.stdout:191 2023-06-09T04:46:06.688 INFO:teuthology.orchestra.run.smithi090.stdout:191.out 2023-06-09T04:46:06.688 INFO:teuthology.orchestra.run.smithi090.stdout:192 2023-06-09T04:46:06.688 INFO:teuthology.orchestra.run.smithi090.stdout:192.out 2023-06-09T04:46:06.688 INFO:teuthology.orchestra.run.smithi090.stdout:193 2023-06-09T04:46:06.688 INFO:teuthology.orchestra.run.smithi090.stdout:193.out 2023-06-09T04:46:06.689 INFO:teuthology.orchestra.run.smithi090.stdout:194 2023-06-09T04:46:06.689 INFO:teuthology.orchestra.run.smithi090.stdout:194.out 2023-06-09T04:46:06.689 INFO:teuthology.orchestra.run.smithi090.stdout:195 2023-06-09T04:46:06.689 INFO:teuthology.orchestra.run.smithi090.stdout:195.out 2023-06-09T04:46:06.689 INFO:teuthology.orchestra.run.smithi090.stdout:196 2023-06-09T04:46:06.689 INFO:teuthology.orchestra.run.smithi090.stdout:196.out 2023-06-09T04:46:06.689 INFO:teuthology.orchestra.run.smithi090.stdout:197 2023-06-09T04:46:06.689 INFO:teuthology.orchestra.run.smithi090.stdout:197.out 2023-06-09T04:46:06.690 INFO:teuthology.orchestra.run.smithi090.stdout:198 2023-06-09T04:46:06.690 INFO:teuthology.orchestra.run.smithi090.stdout:198.out 2023-06-09T04:46:06.690 INFO:teuthology.orchestra.run.smithi090.stdout:199 2023-06-09T04:46:06.690 INFO:teuthology.orchestra.run.smithi090.stdout:199.out 2023-06-09T04:46:06.690 INFO:teuthology.orchestra.run.smithi090.stdout:200 2023-06-09T04:46:06.690 INFO:teuthology.orchestra.run.smithi090.stdout:200.out 2023-06-09T04:46:06.691 INFO:teuthology.orchestra.run.smithi090.stdout:201 2023-06-09T04:46:06.691 INFO:teuthology.orchestra.run.smithi090.stdout:201.out 2023-06-09T04:46:06.691 INFO:teuthology.orchestra.run.smithi090.stdout:202 2023-06-09T04:46:06.691 INFO:teuthology.orchestra.run.smithi090.stdout:202.out 2023-06-09T04:46:06.691 INFO:teuthology.orchestra.run.smithi090.stdout:203 2023-06-09T04:46:06.691 INFO:teuthology.orchestra.run.smithi090.stdout:203.out 2023-06-09T04:46:06.692 INFO:teuthology.orchestra.run.smithi090.stdout:204 2023-06-09T04:46:06.692 INFO:teuthology.orchestra.run.smithi090.stdout:204.out 2023-06-09T04:46:06.692 INFO:teuthology.orchestra.run.smithi090.stdout:205 2023-06-09T04:46:06.692 INFO:teuthology.orchestra.run.smithi090.stdout:205.out 2023-06-09T04:46:06.692 INFO:teuthology.orchestra.run.smithi090.stdout:206 2023-06-09T04:46:06.692 INFO:teuthology.orchestra.run.smithi090.stdout:206.out 2023-06-09T04:46:06.692 INFO:teuthology.orchestra.run.smithi090.stdout:207 2023-06-09T04:46:06.693 INFO:teuthology.orchestra.run.smithi090.stdout:207.out 2023-06-09T04:46:06.693 INFO:teuthology.orchestra.run.smithi090.stdout:208 2023-06-09T04:46:06.693 INFO:teuthology.orchestra.run.smithi090.stdout:208.out 2023-06-09T04:46:06.693 INFO:teuthology.orchestra.run.smithi090.stdout:209 2023-06-09T04:46:06.693 INFO:teuthology.orchestra.run.smithi090.stdout:209.out 2023-06-09T04:46:06.693 INFO:teuthology.orchestra.run.smithi090.stdout:210 2023-06-09T04:46:06.693 INFO:teuthology.orchestra.run.smithi090.stdout:210.out 2023-06-09T04:46:06.693 INFO:teuthology.orchestra.run.smithi090.stdout:211 2023-06-09T04:46:06.694 INFO:teuthology.orchestra.run.smithi090.stdout:211.out 2023-06-09T04:46:06.694 INFO:teuthology.orchestra.run.smithi090.stdout:212 2023-06-09T04:46:06.694 INFO:teuthology.orchestra.run.smithi090.stdout:212.out 2023-06-09T04:46:06.694 INFO:teuthology.orchestra.run.smithi090.stdout:213 2023-06-09T04:46:06.694 INFO:teuthology.orchestra.run.smithi090.stdout:213.out 2023-06-09T04:46:06.694 INFO:teuthology.orchestra.run.smithi090.stdout:214 2023-06-09T04:46:06.694 INFO:teuthology.orchestra.run.smithi090.stdout:214.out 2023-06-09T04:46:06.694 INFO:teuthology.orchestra.run.smithi090.stdout:215 2023-06-09T04:46:06.695 INFO:teuthology.orchestra.run.smithi090.stdout:215.out 2023-06-09T04:46:06.695 INFO:teuthology.orchestra.run.smithi090.stdout:216 2023-06-09T04:46:06.695 INFO:teuthology.orchestra.run.smithi090.stdout:216.out 2023-06-09T04:46:06.695 INFO:teuthology.orchestra.run.smithi090.stdout:217 2023-06-09T04:46:06.695 INFO:teuthology.orchestra.run.smithi090.stdout:217.out 2023-06-09T04:46:06.695 INFO:teuthology.orchestra.run.smithi090.stdout:218 2023-06-09T04:46:06.695 INFO:teuthology.orchestra.run.smithi090.stdout:218.out 2023-06-09T04:46:06.695 INFO:teuthology.orchestra.run.smithi090.stdout:219 2023-06-09T04:46:06.696 INFO:teuthology.orchestra.run.smithi090.stdout:219.out 2023-06-09T04:46:06.696 INFO:teuthology.orchestra.run.smithi090.stdout:220 2023-06-09T04:46:06.696 INFO:teuthology.orchestra.run.smithi090.stdout:220.out 2023-06-09T04:46:06.696 INFO:teuthology.orchestra.run.smithi090.stdout:221 2023-06-09T04:46:06.696 INFO:teuthology.orchestra.run.smithi090.stdout:221.out 2023-06-09T04:46:06.696 INFO:teuthology.orchestra.run.smithi090.stdout:222 2023-06-09T04:46:06.696 INFO:teuthology.orchestra.run.smithi090.stdout:222.out 2023-06-09T04:46:06.697 INFO:teuthology.orchestra.run.smithi090.stdout:223 2023-06-09T04:46:06.697 INFO:teuthology.orchestra.run.smithi090.stdout:223.out 2023-06-09T04:46:06.697 INFO:teuthology.orchestra.run.smithi090.stdout:224 2023-06-09T04:46:06.697 INFO:teuthology.orchestra.run.smithi090.stdout:224.out 2023-06-09T04:46:06.697 INFO:teuthology.orchestra.run.smithi090.stdout:225 2023-06-09T04:46:06.697 INFO:teuthology.orchestra.run.smithi090.stdout:225.out 2023-06-09T04:46:06.697 INFO:teuthology.orchestra.run.smithi090.stdout:226 2023-06-09T04:46:06.697 INFO:teuthology.orchestra.run.smithi090.stdout:226.out 2023-06-09T04:46:06.698 INFO:teuthology.orchestra.run.smithi090.stdout:227 2023-06-09T04:46:06.698 INFO:teuthology.orchestra.run.smithi090.stdout:227.out 2023-06-09T04:46:06.698 INFO:teuthology.orchestra.run.smithi090.stdout:228 2023-06-09T04:46:06.698 INFO:teuthology.orchestra.run.smithi090.stdout:228.out 2023-06-09T04:46:06.698 INFO:teuthology.orchestra.run.smithi090.stdout:229 2023-06-09T04:46:06.698 INFO:teuthology.orchestra.run.smithi090.stdout:229.out 2023-06-09T04:46:06.698 INFO:teuthology.orchestra.run.smithi090.stdout:230 2023-06-09T04:46:06.698 INFO:teuthology.orchestra.run.smithi090.stdout:230.out 2023-06-09T04:46:06.699 INFO:teuthology.orchestra.run.smithi090.stdout:231 2023-06-09T04:46:06.699 INFO:teuthology.orchestra.run.smithi090.stdout:231.out 2023-06-09T04:46:06.699 INFO:teuthology.orchestra.run.smithi090.stdout:232 2023-06-09T04:46:06.699 INFO:teuthology.orchestra.run.smithi090.stdout:232.out 2023-06-09T04:46:06.699 INFO:teuthology.orchestra.run.smithi090.stdout:233 2023-06-09T04:46:06.699 INFO:teuthology.orchestra.run.smithi090.stdout:233.out 2023-06-09T04:46:06.699 INFO:teuthology.orchestra.run.smithi090.stdout:234 2023-06-09T04:46:06.699 INFO:teuthology.orchestra.run.smithi090.stdout:234.out 2023-06-09T04:46:06.700 INFO:teuthology.orchestra.run.smithi090.stdout:235 2023-06-09T04:46:06.700 INFO:teuthology.orchestra.run.smithi090.stdout:235.out 2023-06-09T04:46:06.700 INFO:teuthology.orchestra.run.smithi090.stdout:236 2023-06-09T04:46:06.700 INFO:teuthology.orchestra.run.smithi090.stdout:236.out 2023-06-09T04:46:06.700 INFO:teuthology.orchestra.run.smithi090.stdout:237 2023-06-09T04:46:06.700 INFO:teuthology.orchestra.run.smithi090.stdout:237.out 2023-06-09T04:46:06.700 INFO:teuthology.orchestra.run.smithi090.stdout:238 2023-06-09T04:46:06.701 INFO:teuthology.orchestra.run.smithi090.stdout:238.out 2023-06-09T04:46:06.701 INFO:teuthology.orchestra.run.smithi090.stdout:239 2023-06-09T04:46:06.701 INFO:teuthology.orchestra.run.smithi090.stdout:239.out 2023-06-09T04:46:06.701 INFO:teuthology.orchestra.run.smithi090.stdout:240 2023-06-09T04:46:06.701 INFO:teuthology.orchestra.run.smithi090.stdout:240.out 2023-06-09T04:46:06.701 INFO:teuthology.orchestra.run.smithi090.stdout:241 2023-06-09T04:46:06.701 INFO:teuthology.orchestra.run.smithi090.stdout:241.out 2023-06-09T04:46:06.702 INFO:teuthology.orchestra.run.smithi090.stdout:242 2023-06-09T04:46:06.702 INFO:teuthology.orchestra.run.smithi090.stdout:242.out 2023-06-09T04:46:06.702 INFO:teuthology.orchestra.run.smithi090.stdout:243 2023-06-09T04:46:06.702 INFO:teuthology.orchestra.run.smithi090.stdout:243.out 2023-06-09T04:46:06.702 INFO:teuthology.orchestra.run.smithi090.stdout:244 2023-06-09T04:46:06.702 INFO:teuthology.orchestra.run.smithi090.stdout:244.out 2023-06-09T04:46:06.702 INFO:teuthology.orchestra.run.smithi090.stdout:245 2023-06-09T04:46:06.703 INFO:teuthology.orchestra.run.smithi090.stdout:245.out 2023-06-09T04:46:06.703 INFO:teuthology.orchestra.run.smithi090.stdout:246 2023-06-09T04:46:06.703 INFO:teuthology.orchestra.run.smithi090.stdout:246.out 2023-06-09T04:46:06.703 INFO:teuthology.orchestra.run.smithi090.stdout:247 2023-06-09T04:46:06.703 INFO:teuthology.orchestra.run.smithi090.stdout:247.out 2023-06-09T04:46:06.703 INFO:teuthology.orchestra.run.smithi090.stdout:248 2023-06-09T04:46:06.703 INFO:teuthology.orchestra.run.smithi090.stdout:248.out 2023-06-09T04:46:06.703 INFO:teuthology.orchestra.run.smithi090.stdout:249 2023-06-09T04:46:06.704 INFO:teuthology.orchestra.run.smithi090.stdout:249.out 2023-06-09T04:46:06.704 INFO:teuthology.orchestra.run.smithi090.stdout:250 2023-06-09T04:46:06.704 INFO:teuthology.orchestra.run.smithi090.stdout:250.out 2023-06-09T04:46:06.704 INFO:teuthology.orchestra.run.smithi090.stdout:251 2023-06-09T04:46:06.704 INFO:teuthology.orchestra.run.smithi090.stdout:251.out 2023-06-09T04:46:06.704 INFO:teuthology.orchestra.run.smithi090.stdout:252 2023-06-09T04:46:06.704 INFO:teuthology.orchestra.run.smithi090.stdout:252.out 2023-06-09T04:46:06.704 INFO:teuthology.orchestra.run.smithi090.stdout:253 2023-06-09T04:46:06.705 INFO:teuthology.orchestra.run.smithi090.stdout:253.out 2023-06-09T04:46:06.705 INFO:teuthology.orchestra.run.smithi090.stdout:254 2023-06-09T04:46:06.705 INFO:teuthology.orchestra.run.smithi090.stdout:254.out 2023-06-09T04:46:06.705 INFO:teuthology.orchestra.run.smithi090.stdout:255 2023-06-09T04:46:06.705 INFO:teuthology.orchestra.run.smithi090.stdout:255.out 2023-06-09T04:46:06.705 INFO:teuthology.orchestra.run.smithi090.stdout:256 2023-06-09T04:46:06.705 INFO:teuthology.orchestra.run.smithi090.stdout:256.out 2023-06-09T04:46:06.706 INFO:teuthology.orchestra.run.smithi090.stdout:257 2023-06-09T04:46:06.706 INFO:teuthology.orchestra.run.smithi090.stdout:257.out 2023-06-09T04:46:06.706 INFO:teuthology.orchestra.run.smithi090.stdout:258 2023-06-09T04:46:06.706 INFO:teuthology.orchestra.run.smithi090.stdout:258.out 2023-06-09T04:46:06.706 INFO:teuthology.orchestra.run.smithi090.stdout:259 2023-06-09T04:46:06.706 INFO:teuthology.orchestra.run.smithi090.stdout:259.out 2023-06-09T04:46:06.706 INFO:teuthology.orchestra.run.smithi090.stdout:260 2023-06-09T04:46:06.706 INFO:teuthology.orchestra.run.smithi090.stdout:260.out 2023-06-09T04:46:06.707 INFO:teuthology.orchestra.run.smithi090.stdout:261 2023-06-09T04:46:06.707 INFO:teuthology.orchestra.run.smithi090.stdout:261.out 2023-06-09T04:46:06.707 INFO:teuthology.orchestra.run.smithi090.stdout:262 2023-06-09T04:46:06.707 INFO:teuthology.orchestra.run.smithi090.stdout:262.out 2023-06-09T04:46:06.707 INFO:teuthology.orchestra.run.smithi090.stdout:263 2023-06-09T04:46:06.707 INFO:teuthology.orchestra.run.smithi090.stdout:263.out 2023-06-09T04:46:06.707 INFO:teuthology.orchestra.run.smithi090.stdout:264 2023-06-09T04:46:06.707 INFO:teuthology.orchestra.run.smithi090.stdout:264.out 2023-06-09T04:46:06.708 INFO:teuthology.orchestra.run.smithi090.stdout:265 2023-06-09T04:46:06.708 INFO:teuthology.orchestra.run.smithi090.stdout:265.out 2023-06-09T04:46:06.708 INFO:teuthology.orchestra.run.smithi090.stdout:266 2023-06-09T04:46:06.708 INFO:teuthology.orchestra.run.smithi090.stdout:266.out 2023-06-09T04:46:06.708 INFO:teuthology.orchestra.run.smithi090.stdout:267 2023-06-09T04:46:06.708 INFO:teuthology.orchestra.run.smithi090.stdout:267.out 2023-06-09T04:46:06.708 INFO:teuthology.orchestra.run.smithi090.stdout:268 2023-06-09T04:46:06.709 INFO:teuthology.orchestra.run.smithi090.stdout:268.out 2023-06-09T04:46:06.709 INFO:teuthology.orchestra.run.smithi090.stdout:269 2023-06-09T04:46:06.709 INFO:teuthology.orchestra.run.smithi090.stdout:269.out 2023-06-09T04:46:06.709 INFO:teuthology.orchestra.run.smithi090.stdout:270 2023-06-09T04:46:06.709 INFO:teuthology.orchestra.run.smithi090.stdout:270.out 2023-06-09T04:46:06.709 INFO:teuthology.orchestra.run.smithi090.stdout:271 2023-06-09T04:46:06.709 INFO:teuthology.orchestra.run.smithi090.stdout:271.out 2023-06-09T04:46:06.710 INFO:teuthology.orchestra.run.smithi090.stdout:272 2023-06-09T04:46:06.710 INFO:teuthology.orchestra.run.smithi090.stdout:272.out 2023-06-09T04:46:06.710 INFO:teuthology.orchestra.run.smithi090.stdout:273 2023-06-09T04:46:06.710 INFO:teuthology.orchestra.run.smithi090.stdout:273.out 2023-06-09T04:46:06.710 INFO:teuthology.orchestra.run.smithi090.stdout:274 2023-06-09T04:46:06.710 INFO:teuthology.orchestra.run.smithi090.stdout:274.out 2023-06-09T04:46:06.710 INFO:teuthology.orchestra.run.smithi090.stdout:275 2023-06-09T04:46:06.710 INFO:teuthology.orchestra.run.smithi090.stdout:275.out 2023-06-09T04:46:06.711 INFO:teuthology.orchestra.run.smithi090.stdout:276 2023-06-09T04:46:06.711 INFO:teuthology.orchestra.run.smithi090.stdout:276.out 2023-06-09T04:46:06.711 INFO:teuthology.orchestra.run.smithi090.stdout:277 2023-06-09T04:46:06.711 INFO:teuthology.orchestra.run.smithi090.stdout:277.out 2023-06-09T04:46:06.711 INFO:teuthology.orchestra.run.smithi090.stdout:278 2023-06-09T04:46:06.711 INFO:teuthology.orchestra.run.smithi090.stdout:278.out 2023-06-09T04:46:06.711 INFO:teuthology.orchestra.run.smithi090.stdout:279 2023-06-09T04:46:06.712 INFO:teuthology.orchestra.run.smithi090.stdout:279.out 2023-06-09T04:46:06.712 INFO:teuthology.orchestra.run.smithi090.stdout:280 2023-06-09T04:46:06.712 INFO:teuthology.orchestra.run.smithi090.stdout:280.out 2023-06-09T04:46:06.712 INFO:teuthology.orchestra.run.smithi090.stdout:281 2023-06-09T04:46:06.712 INFO:teuthology.orchestra.run.smithi090.stdout:281.out 2023-06-09T04:46:06.712 INFO:teuthology.orchestra.run.smithi090.stdout:282 2023-06-09T04:46:06.712 INFO:teuthology.orchestra.run.smithi090.stdout:282.out 2023-06-09T04:46:06.713 INFO:teuthology.orchestra.run.smithi090.stdout:283 2023-06-09T04:46:06.713 INFO:teuthology.orchestra.run.smithi090.stdout:283.out 2023-06-09T04:46:06.713 INFO:teuthology.orchestra.run.smithi090.stdout:284 2023-06-09T04:46:06.713 INFO:teuthology.orchestra.run.smithi090.stdout:284.out 2023-06-09T04:46:06.713 INFO:teuthology.orchestra.run.smithi090.stdout:285 2023-06-09T04:46:06.713 INFO:teuthology.orchestra.run.smithi090.stdout:285.out 2023-06-09T04:46:06.713 INFO:teuthology.orchestra.run.smithi090.stdout:286 2023-06-09T04:46:06.713 INFO:teuthology.orchestra.run.smithi090.stdout:286.out 2023-06-09T04:46:06.714 INFO:teuthology.orchestra.run.smithi090.stdout:287 2023-06-09T04:46:06.714 INFO:teuthology.orchestra.run.smithi090.stdout:287.out 2023-06-09T04:46:06.714 INFO:teuthology.orchestra.run.smithi090.stdout:288 2023-06-09T04:46:06.714 INFO:teuthology.orchestra.run.smithi090.stdout:288.out 2023-06-09T04:46:06.714 INFO:teuthology.orchestra.run.smithi090.stdout:289 2023-06-09T04:46:06.714 INFO:teuthology.orchestra.run.smithi090.stdout:289.out 2023-06-09T04:46:06.714 INFO:teuthology.orchestra.run.smithi090.stdout:290 2023-06-09T04:46:06.714 INFO:teuthology.orchestra.run.smithi090.stdout:290.out 2023-06-09T04:46:06.715 INFO:teuthology.orchestra.run.smithi090.stdout:291 2023-06-09T04:46:06.715 INFO:teuthology.orchestra.run.smithi090.stdout:291.out 2023-06-09T04:46:06.715 INFO:teuthology.orchestra.run.smithi090.stdout:292 2023-06-09T04:46:06.715 INFO:teuthology.orchestra.run.smithi090.stdout:292.out 2023-06-09T04:46:06.715 INFO:teuthology.orchestra.run.smithi090.stdout:293 2023-06-09T04:46:06.715 INFO:teuthology.orchestra.run.smithi090.stdout:293.out 2023-06-09T04:46:06.715 INFO:teuthology.orchestra.run.smithi090.stdout:294 2023-06-09T04:46:06.715 INFO:teuthology.orchestra.run.smithi090.stdout:294.out 2023-06-09T04:46:06.716 INFO:teuthology.orchestra.run.smithi090.stdout:295 2023-06-09T04:46:06.716 INFO:teuthology.orchestra.run.smithi090.stdout:295.out 2023-06-09T04:46:06.716 INFO:teuthology.orchestra.run.smithi090.stdout:296 2023-06-09T04:46:06.716 INFO:teuthology.orchestra.run.smithi090.stdout:296.out 2023-06-09T04:46:06.716 INFO:teuthology.orchestra.run.smithi090.stdout:297 2023-06-09T04:46:06.716 INFO:teuthology.orchestra.run.smithi090.stdout:297.out 2023-06-09T04:46:06.717 INFO:teuthology.orchestra.run.smithi090.stdout:298 2023-06-09T04:46:06.717 INFO:teuthology.orchestra.run.smithi090.stdout:298.out 2023-06-09T04:46:06.717 INFO:teuthology.orchestra.run.smithi090.stdout:299 2023-06-09T04:46:06.717 INFO:teuthology.orchestra.run.smithi090.stdout:299.out 2023-06-09T04:46:06.717 INFO:teuthology.orchestra.run.smithi090.stdout:300 2023-06-09T04:46:06.717 INFO:teuthology.orchestra.run.smithi090.stdout:300.out 2023-06-09T04:46:06.717 INFO:teuthology.orchestra.run.smithi090.stdout:301 2023-06-09T04:46:06.717 INFO:teuthology.orchestra.run.smithi090.stdout:301.out 2023-06-09T04:46:06.718 INFO:teuthology.orchestra.run.smithi090.stdout:302 2023-06-09T04:46:06.718 INFO:teuthology.orchestra.run.smithi090.stdout:302.out 2023-06-09T04:46:06.718 INFO:teuthology.orchestra.run.smithi090.stdout:303 2023-06-09T04:46:06.718 INFO:teuthology.orchestra.run.smithi090.stdout:303.out 2023-06-09T04:46:06.718 INFO:teuthology.orchestra.run.smithi090.stdout:304 2023-06-09T04:46:06.718 INFO:teuthology.orchestra.run.smithi090.stdout:304.out 2023-06-09T04:46:06.718 INFO:teuthology.orchestra.run.smithi090.stdout:305 2023-06-09T04:46:06.718 INFO:teuthology.orchestra.run.smithi090.stdout:305.out 2023-06-09T04:46:06.719 INFO:teuthology.orchestra.run.smithi090.stdout:306 2023-06-09T04:46:06.719 INFO:teuthology.orchestra.run.smithi090.stdout:306.out 2023-06-09T04:46:06.719 INFO:teuthology.orchestra.run.smithi090.stdout:307 2023-06-09T04:46:06.719 INFO:teuthology.orchestra.run.smithi090.stdout:307.out 2023-06-09T04:46:06.719 INFO:teuthology.orchestra.run.smithi090.stdout:308 2023-06-09T04:46:06.719 INFO:teuthology.orchestra.run.smithi090.stdout:308.out 2023-06-09T04:46:06.719 INFO:teuthology.orchestra.run.smithi090.stdout:309 2023-06-09T04:46:06.720 INFO:teuthology.orchestra.run.smithi090.stdout:309.out 2023-06-09T04:46:06.720 INFO:teuthology.orchestra.run.smithi090.stdout:310 2023-06-09T04:46:06.720 INFO:teuthology.orchestra.run.smithi090.stdout:310.out 2023-06-09T04:46:06.720 INFO:teuthology.orchestra.run.smithi090.stdout:311 2023-06-09T04:46:06.720 INFO:teuthology.orchestra.run.smithi090.stdout:311.out 2023-06-09T04:46:06.720 INFO:teuthology.orchestra.run.smithi090.stdout:312 2023-06-09T04:46:06.720 INFO:teuthology.orchestra.run.smithi090.stdout:312.out 2023-06-09T04:46:06.721 INFO:teuthology.orchestra.run.smithi090.stdout:313 2023-06-09T04:46:06.721 INFO:teuthology.orchestra.run.smithi090.stdout:313.out 2023-06-09T04:46:06.721 INFO:teuthology.orchestra.run.smithi090.stdout:314 2023-06-09T04:46:06.721 INFO:teuthology.orchestra.run.smithi090.stdout:314.out 2023-06-09T04:46:06.721 INFO:teuthology.orchestra.run.smithi090.stdout:315 2023-06-09T04:46:06.721 INFO:teuthology.orchestra.run.smithi090.stdout:315.out 2023-06-09T04:46:06.721 INFO:teuthology.orchestra.run.smithi090.stdout:316 2023-06-09T04:46:06.721 INFO:teuthology.orchestra.run.smithi090.stdout:316.out 2023-06-09T04:46:06.722 INFO:teuthology.orchestra.run.smithi090.stdout:317 2023-06-09T04:46:06.722 INFO:teuthology.orchestra.run.smithi090.stdout:317.out 2023-06-09T04:46:06.722 INFO:teuthology.orchestra.run.smithi090.stdout:318 2023-06-09T04:46:06.722 INFO:teuthology.orchestra.run.smithi090.stdout:318.out 2023-06-09T04:46:06.722 INFO:teuthology.orchestra.run.smithi090.stdout:319 2023-06-09T04:46:06.722 INFO:teuthology.orchestra.run.smithi090.stdout:319.out 2023-06-09T04:46:06.722 INFO:teuthology.orchestra.run.smithi090.stdout:320 2023-06-09T04:46:06.723 INFO:teuthology.orchestra.run.smithi090.stdout:320.out 2023-06-09T04:46:06.723 INFO:teuthology.orchestra.run.smithi090.stdout:321 2023-06-09T04:46:06.723 INFO:teuthology.orchestra.run.smithi090.stdout:321.out 2023-06-09T04:46:06.723 INFO:teuthology.orchestra.run.smithi090.stdout:322 2023-06-09T04:46:06.723 INFO:teuthology.orchestra.run.smithi090.stdout:322.out 2023-06-09T04:46:06.724 INFO:teuthology.orchestra.run.smithi090.stdout:323 2023-06-09T04:46:06.724 INFO:teuthology.orchestra.run.smithi090.stdout:323.out 2023-06-09T04:46:06.724 INFO:teuthology.orchestra.run.smithi090.stdout:324 2023-06-09T04:46:06.725 INFO:teuthology.orchestra.run.smithi090.stdout:324.out 2023-06-09T04:46:06.725 INFO:teuthology.orchestra.run.smithi090.stdout:325 2023-06-09T04:46:06.725 INFO:teuthology.orchestra.run.smithi090.stdout:325.out 2023-06-09T04:46:06.725 INFO:teuthology.orchestra.run.smithi090.stdout:326 2023-06-09T04:46:06.726 INFO:teuthology.orchestra.run.smithi090.stdout:326.out 2023-06-09T04:46:06.726 INFO:teuthology.orchestra.run.smithi090.stdout:327 2023-06-09T04:46:06.726 INFO:teuthology.orchestra.run.smithi090.stdout:327.out 2023-06-09T04:46:06.727 INFO:teuthology.orchestra.run.smithi090.stdout:328 2023-06-09T04:46:06.727 INFO:teuthology.orchestra.run.smithi090.stdout:328.out 2023-06-09T04:46:06.727 INFO:teuthology.orchestra.run.smithi090.stdout:329 2023-06-09T04:46:06.728 INFO:teuthology.orchestra.run.smithi090.stdout:329.out 2023-06-09T04:46:06.728 INFO:teuthology.orchestra.run.smithi090.stdout:330 2023-06-09T04:46:06.728 INFO:teuthology.orchestra.run.smithi090.stdout:330.out 2023-06-09T04:46:06.728 INFO:teuthology.orchestra.run.smithi090.stdout:331 2023-06-09T04:46:06.729 INFO:teuthology.orchestra.run.smithi090.stdout:331.out 2023-06-09T04:46:06.729 INFO:teuthology.orchestra.run.smithi090.stdout:332 2023-06-09T04:46:06.729 INFO:teuthology.orchestra.run.smithi090.stdout:332.out 2023-06-09T04:46:06.729 INFO:teuthology.orchestra.run.smithi090.stdout:333 2023-06-09T04:46:06.730 INFO:teuthology.orchestra.run.smithi090.stdout:333.out 2023-06-09T04:46:06.730 INFO:teuthology.orchestra.run.smithi090.stdout:334 2023-06-09T04:46:06.730 INFO:teuthology.orchestra.run.smithi090.stdout:334.out 2023-06-09T04:46:06.730 INFO:teuthology.orchestra.run.smithi090.stdout:335 2023-06-09T04:46:06.730 INFO:teuthology.orchestra.run.smithi090.stdout:335.out 2023-06-09T04:46:06.731 INFO:teuthology.orchestra.run.smithi090.stdout:336 2023-06-09T04:46:06.731 INFO:teuthology.orchestra.run.smithi090.stdout:336.out 2023-06-09T04:46:06.731 INFO:teuthology.orchestra.run.smithi090.stdout:337 2023-06-09T04:46:06.731 INFO:teuthology.orchestra.run.smithi090.stdout:337.out 2023-06-09T04:46:06.732 INFO:teuthology.orchestra.run.smithi090.stdout:338 2023-06-09T04:46:06.732 INFO:teuthology.orchestra.run.smithi090.stdout:338.out 2023-06-09T04:46:06.732 INFO:teuthology.orchestra.run.smithi090.stdout:339 2023-06-09T04:46:06.732 INFO:teuthology.orchestra.run.smithi090.stdout:339.out 2023-06-09T04:46:06.733 INFO:teuthology.orchestra.run.smithi090.stdout:340 2023-06-09T04:46:06.733 INFO:teuthology.orchestra.run.smithi090.stdout:340.out 2023-06-09T04:46:06.733 INFO:teuthology.orchestra.run.smithi090.stdout:341 2023-06-09T04:46:06.733 INFO:teuthology.orchestra.run.smithi090.stdout:341.out 2023-06-09T04:46:06.733 INFO:teuthology.orchestra.run.smithi090.stdout:342 2023-06-09T04:46:06.733 INFO:teuthology.orchestra.run.smithi090.stdout:342.out 2023-06-09T04:46:06.733 INFO:teuthology.orchestra.run.smithi090.stdout:343 2023-06-09T04:46:06.734 INFO:teuthology.orchestra.run.smithi090.stdout:343.out 2023-06-09T04:46:06.734 INFO:teuthology.orchestra.run.smithi090.stdout:344 2023-06-09T04:46:06.734 INFO:teuthology.orchestra.run.smithi090.stdout:344.out 2023-06-09T04:46:06.734 INFO:teuthology.orchestra.run.smithi090.stdout:345 2023-06-09T04:46:06.734 INFO:teuthology.orchestra.run.smithi090.stdout:345.out 2023-06-09T04:46:06.734 INFO:teuthology.orchestra.run.smithi090.stdout:346 2023-06-09T04:46:06.734 INFO:teuthology.orchestra.run.smithi090.stdout:346.out 2023-06-09T04:46:06.735 INFO:teuthology.orchestra.run.smithi090.stdout:347 2023-06-09T04:46:06.735 INFO:teuthology.orchestra.run.smithi090.stdout:347.out 2023-06-09T04:46:06.735 INFO:teuthology.orchestra.run.smithi090.stdout:348 2023-06-09T04:46:06.735 INFO:teuthology.orchestra.run.smithi090.stdout:348.out 2023-06-09T04:46:06.735 INFO:teuthology.orchestra.run.smithi090.stdout:349 2023-06-09T04:46:06.735 INFO:teuthology.orchestra.run.smithi090.stdout:349.out 2023-06-09T04:46:06.735 INFO:teuthology.orchestra.run.smithi090.stdout:350 2023-06-09T04:46:06.735 INFO:teuthology.orchestra.run.smithi090.stdout:350.out 2023-06-09T04:46:06.736 INFO:teuthology.orchestra.run.smithi090.stdout:351 2023-06-09T04:46:06.736 INFO:teuthology.orchestra.run.smithi090.stdout:351.out 2023-06-09T04:46:06.736 INFO:teuthology.orchestra.run.smithi090.stdout:352 2023-06-09T04:46:06.736 INFO:teuthology.orchestra.run.smithi090.stdout:352.out 2023-06-09T04:46:06.736 INFO:teuthology.orchestra.run.smithi090.stdout:353 2023-06-09T04:46:06.736 INFO:teuthology.orchestra.run.smithi090.stdout:353.out 2023-06-09T04:46:06.736 INFO:teuthology.orchestra.run.smithi090.stdout:354 2023-06-09T04:46:06.736 INFO:teuthology.orchestra.run.smithi090.stdout:354.out 2023-06-09T04:46:06.737 INFO:teuthology.orchestra.run.smithi090.stdout:355 2023-06-09T04:46:06.737 INFO:teuthology.orchestra.run.smithi090.stdout:355.out 2023-06-09T04:46:06.737 INFO:teuthology.orchestra.run.smithi090.stdout:356 2023-06-09T04:46:06.737 INFO:teuthology.orchestra.run.smithi090.stdout:356.out 2023-06-09T04:46:06.737 INFO:teuthology.orchestra.run.smithi090.stdout:357 2023-06-09T04:46:06.737 INFO:teuthology.orchestra.run.smithi090.stdout:357.out 2023-06-09T04:46:06.737 INFO:teuthology.orchestra.run.smithi090.stdout:358 2023-06-09T04:46:06.739 INFO:teuthology.orchestra.run.smithi090.stdout:358.out 2023-06-09T04:46:06.739 INFO:teuthology.orchestra.run.smithi090.stdout:359 2023-06-09T04:46:06.740 INFO:teuthology.orchestra.run.smithi090.stdout:359.out 2023-06-09T04:46:06.740 INFO:teuthology.orchestra.run.smithi090.stdout:360 2023-06-09T04:46:06.740 INFO:teuthology.orchestra.run.smithi090.stdout:360.out 2023-06-09T04:46:06.740 INFO:teuthology.orchestra.run.smithi090.stdout:361 2023-06-09T04:46:06.741 INFO:teuthology.orchestra.run.smithi090.stdout:361.out 2023-06-09T04:46:06.741 INFO:teuthology.orchestra.run.smithi090.stdout:362 2023-06-09T04:46:06.741 INFO:teuthology.orchestra.run.smithi090.stdout:362.out 2023-06-09T04:46:06.741 INFO:teuthology.orchestra.run.smithi090.stdout:363 2023-06-09T04:46:06.741 INFO:teuthology.orchestra.run.smithi090.stdout:363.out 2023-06-09T04:46:06.741 INFO:teuthology.orchestra.run.smithi090.stdout:364 2023-06-09T04:46:06.741 INFO:teuthology.orchestra.run.smithi090.stdout:364.out 2023-06-09T04:46:06.742 INFO:teuthology.orchestra.run.smithi090.stdout:365 2023-06-09T04:46:06.742 INFO:teuthology.orchestra.run.smithi090.stdout:365.out 2023-06-09T04:46:06.742 INFO:teuthology.orchestra.run.smithi090.stdout:366 2023-06-09T04:46:06.742 INFO:teuthology.orchestra.run.smithi090.stdout:366.out 2023-06-09T04:46:06.742 INFO:teuthology.orchestra.run.smithi090.stdout:367 2023-06-09T04:46:06.742 INFO:teuthology.orchestra.run.smithi090.stdout:367.out 2023-06-09T04:46:06.742 INFO:teuthology.orchestra.run.smithi090.stdout:368 2023-06-09T04:46:06.742 INFO:teuthology.orchestra.run.smithi090.stdout:368.out 2023-06-09T04:46:06.743 INFO:teuthology.orchestra.run.smithi090.stdout:369 2023-06-09T04:46:06.743 INFO:teuthology.orchestra.run.smithi090.stdout:369.out 2023-06-09T04:46:06.743 INFO:teuthology.orchestra.run.smithi090.stdout:370 2023-06-09T04:46:06.743 INFO:teuthology.orchestra.run.smithi090.stdout:370.out 2023-06-09T04:46:06.743 INFO:teuthology.orchestra.run.smithi090.stdout:371 2023-06-09T04:46:06.743 INFO:teuthology.orchestra.run.smithi090.stdout:371.out 2023-06-09T04:46:06.743 INFO:teuthology.orchestra.run.smithi090.stdout:372 2023-06-09T04:46:06.743 INFO:teuthology.orchestra.run.smithi090.stdout:372.out 2023-06-09T04:46:06.744 INFO:teuthology.orchestra.run.smithi090.stdout:373 2023-06-09T04:46:06.744 INFO:teuthology.orchestra.run.smithi090.stdout:373.out 2023-06-09T04:46:06.744 INFO:teuthology.orchestra.run.smithi090.stdout:374 2023-06-09T04:46:06.744 INFO:teuthology.orchestra.run.smithi090.stdout:374.out 2023-06-09T04:46:06.744 INFO:teuthology.orchestra.run.smithi090.stdout:375 2023-06-09T04:46:06.744 INFO:teuthology.orchestra.run.smithi090.stdout:375.out 2023-06-09T04:46:06.744 INFO:teuthology.orchestra.run.smithi090.stdout:376 2023-06-09T04:46:06.745 INFO:teuthology.orchestra.run.smithi090.stdout:376.out 2023-06-09T04:46:06.745 INFO:teuthology.orchestra.run.smithi090.stdout:377 2023-06-09T04:46:06.745 INFO:teuthology.orchestra.run.smithi090.stdout:377.out 2023-06-09T04:46:06.745 INFO:teuthology.orchestra.run.smithi090.stdout:378 2023-06-09T04:46:06.745 INFO:teuthology.orchestra.run.smithi090.stdout:378.out 2023-06-09T04:46:06.745 INFO:teuthology.orchestra.run.smithi090.stdout:379 2023-06-09T04:46:06.745 INFO:teuthology.orchestra.run.smithi090.stdout:379.out 2023-06-09T04:46:06.745 INFO:teuthology.orchestra.run.smithi090.stdout:380 2023-06-09T04:46:06.746 INFO:teuthology.orchestra.run.smithi090.stdout:380.out 2023-06-09T04:46:06.746 INFO:teuthology.orchestra.run.smithi090.stdout:381 2023-06-09T04:46:06.746 INFO:teuthology.orchestra.run.smithi090.stdout:381.out 2023-06-09T04:46:06.746 INFO:teuthology.orchestra.run.smithi090.stdout:382 2023-06-09T04:46:06.746 INFO:teuthology.orchestra.run.smithi090.stdout:382.out 2023-06-09T04:46:06.746 INFO:teuthology.orchestra.run.smithi090.stdout:383 2023-06-09T04:46:06.746 INFO:teuthology.orchestra.run.smithi090.stdout:383.out 2023-06-09T04:46:06.746 INFO:teuthology.orchestra.run.smithi090.stdout:384 2023-06-09T04:46:06.747 INFO:teuthology.orchestra.run.smithi090.stdout:384.out 2023-06-09T04:46:06.747 INFO:teuthology.orchestra.run.smithi090.stdout:385 2023-06-09T04:46:06.747 INFO:teuthology.orchestra.run.smithi090.stdout:385.out 2023-06-09T04:46:06.747 INFO:teuthology.orchestra.run.smithi090.stdout:386 2023-06-09T04:46:06.747 INFO:teuthology.orchestra.run.smithi090.stdout:386.out 2023-06-09T04:46:06.747 INFO:teuthology.orchestra.run.smithi090.stdout:387 2023-06-09T04:46:06.747 INFO:teuthology.orchestra.run.smithi090.stdout:387.out 2023-06-09T04:46:06.747 INFO:teuthology.orchestra.run.smithi090.stdout:388 2023-06-09T04:46:06.748 INFO:teuthology.orchestra.run.smithi090.stdout:388.out 2023-06-09T04:46:06.748 INFO:teuthology.orchestra.run.smithi090.stdout:389 2023-06-09T04:46:06.748 INFO:teuthology.orchestra.run.smithi090.stdout:389.out 2023-06-09T04:46:06.748 INFO:teuthology.orchestra.run.smithi090.stdout:390 2023-06-09T04:46:06.748 INFO:teuthology.orchestra.run.smithi090.stdout:390.out 2023-06-09T04:46:06.748 INFO:teuthology.orchestra.run.smithi090.stdout:391 2023-06-09T04:46:06.748 INFO:teuthology.orchestra.run.smithi090.stdout:391.out 2023-06-09T04:46:06.749 INFO:teuthology.orchestra.run.smithi090.stdout:392 2023-06-09T04:46:06.749 INFO:teuthology.orchestra.run.smithi090.stdout:392.out 2023-06-09T04:46:06.749 INFO:teuthology.orchestra.run.smithi090.stdout:393 2023-06-09T04:46:06.749 INFO:teuthology.orchestra.run.smithi090.stdout:393.out 2023-06-09T04:46:06.749 INFO:teuthology.orchestra.run.smithi090.stdout:394 2023-06-09T04:46:06.749 INFO:teuthology.orchestra.run.smithi090.stdout:394.out 2023-06-09T04:46:06.749 INFO:teuthology.orchestra.run.smithi090.stdout:395 2023-06-09T04:46:06.749 INFO:teuthology.orchestra.run.smithi090.stdout:395.out 2023-06-09T04:46:06.750 INFO:teuthology.orchestra.run.smithi090.stdout:396 2023-06-09T04:46:06.750 INFO:teuthology.orchestra.run.smithi090.stdout:396.out 2023-06-09T04:46:06.750 INFO:teuthology.orchestra.run.smithi090.stdout:397 2023-06-09T04:46:06.750 INFO:teuthology.orchestra.run.smithi090.stdout:397.out 2023-06-09T04:46:06.750 INFO:teuthology.orchestra.run.smithi090.stdout:398 2023-06-09T04:46:06.750 INFO:teuthology.orchestra.run.smithi090.stdout:398.out 2023-06-09T04:46:06.750 INFO:teuthology.orchestra.run.smithi090.stdout:399 2023-06-09T04:46:06.750 INFO:teuthology.orchestra.run.smithi090.stdout:399.out 2023-06-09T04:46:06.751 INFO:teuthology.orchestra.run.smithi090.stdout:400 2023-06-09T04:46:06.751 INFO:teuthology.orchestra.run.smithi090.stdout:400.out 2023-06-09T04:46:06.751 INFO:teuthology.orchestra.run.smithi090.stdout:401 2023-06-09T04:46:06.751 INFO:teuthology.orchestra.run.smithi090.stdout:401.out 2023-06-09T04:46:06.751 INFO:teuthology.orchestra.run.smithi090.stdout:402 2023-06-09T04:46:06.751 INFO:teuthology.orchestra.run.smithi090.stdout:402.out 2023-06-09T04:46:06.751 INFO:teuthology.orchestra.run.smithi090.stdout:403 2023-06-09T04:46:06.752 INFO:teuthology.orchestra.run.smithi090.stdout:403.out 2023-06-09T04:46:06.752 INFO:teuthology.orchestra.run.smithi090.stdout:404 2023-06-09T04:46:06.752 INFO:teuthology.orchestra.run.smithi090.stdout:404.out 2023-06-09T04:46:06.752 INFO:teuthology.orchestra.run.smithi090.stdout:405 2023-06-09T04:46:06.752 INFO:teuthology.orchestra.run.smithi090.stdout:405.out 2023-06-09T04:46:06.752 INFO:teuthology.orchestra.run.smithi090.stdout:406 2023-06-09T04:46:06.752 INFO:teuthology.orchestra.run.smithi090.stdout:406.out 2023-06-09T04:46:06.753 INFO:teuthology.orchestra.run.smithi090.stdout:407 2023-06-09T04:46:06.753 INFO:teuthology.orchestra.run.smithi090.stdout:407.out 2023-06-09T04:46:06.753 INFO:teuthology.orchestra.run.smithi090.stdout:408 2023-06-09T04:46:06.753 INFO:teuthology.orchestra.run.smithi090.stdout:408.out 2023-06-09T04:46:06.753 INFO:teuthology.orchestra.run.smithi090.stdout:409 2023-06-09T04:46:06.753 INFO:teuthology.orchestra.run.smithi090.stdout:409.out 2023-06-09T04:46:06.753 INFO:teuthology.orchestra.run.smithi090.stdout:410 2023-06-09T04:46:06.753 INFO:teuthology.orchestra.run.smithi090.stdout:410.out 2023-06-09T04:46:06.754 INFO:teuthology.orchestra.run.smithi090.stdout:411 2023-06-09T04:46:06.754 INFO:teuthology.orchestra.run.smithi090.stdout:411.out 2023-06-09T04:46:06.754 INFO:teuthology.orchestra.run.smithi090.stdout:412 2023-06-09T04:46:06.754 INFO:teuthology.orchestra.run.smithi090.stdout:412.out 2023-06-09T04:46:06.754 INFO:teuthology.orchestra.run.smithi090.stdout:413 2023-06-09T04:46:06.754 INFO:teuthology.orchestra.run.smithi090.stdout:413.out 2023-06-09T04:46:06.754 INFO:teuthology.orchestra.run.smithi090.stdout:414 2023-06-09T04:46:06.754 INFO:teuthology.orchestra.run.smithi090.stdout:414.out 2023-06-09T04:46:06.755 INFO:teuthology.orchestra.run.smithi090.stdout:415 2023-06-09T04:46:06.755 INFO:teuthology.orchestra.run.smithi090.stdout:415.out 2023-06-09T04:46:06.755 INFO:teuthology.orchestra.run.smithi090.stdout:416 2023-06-09T04:46:06.755 INFO:teuthology.orchestra.run.smithi090.stdout:416.out 2023-06-09T04:46:06.755 INFO:teuthology.orchestra.run.smithi090.stdout:417 2023-06-09T04:46:06.755 INFO:teuthology.orchestra.run.smithi090.stdout:417.out 2023-06-09T04:46:06.755 INFO:teuthology.orchestra.run.smithi090.stdout:418 2023-06-09T04:46:06.756 INFO:teuthology.orchestra.run.smithi090.stdout:418.out 2023-06-09T04:46:06.756 INFO:teuthology.orchestra.run.smithi090.stdout:419 2023-06-09T04:46:06.756 INFO:teuthology.orchestra.run.smithi090.stdout:419.out 2023-06-09T04:46:06.756 INFO:teuthology.orchestra.run.smithi090.stdout:420 2023-06-09T04:46:06.756 INFO:teuthology.orchestra.run.smithi090.stdout:420.out 2023-06-09T04:46:06.756 INFO:teuthology.orchestra.run.smithi090.stdout:421 2023-06-09T04:46:06.756 INFO:teuthology.orchestra.run.smithi090.stdout:421.out 2023-06-09T04:46:06.756 INFO:teuthology.orchestra.run.smithi090.stdout:422 2023-06-09T04:46:06.757 INFO:teuthology.orchestra.run.smithi090.stdout:422.out 2023-06-09T04:46:06.757 INFO:teuthology.orchestra.run.smithi090.stdout:423 2023-06-09T04:46:06.757 INFO:teuthology.orchestra.run.smithi090.stdout:423.out 2023-06-09T04:46:06.757 INFO:teuthology.orchestra.run.smithi090.stdout:424 2023-06-09T04:46:06.757 INFO:teuthology.orchestra.run.smithi090.stdout:424.out 2023-06-09T04:46:06.757 INFO:teuthology.orchestra.run.smithi090.stdout:425 2023-06-09T04:46:06.757 INFO:teuthology.orchestra.run.smithi090.stdout:425.out 2023-06-09T04:46:06.757 INFO:teuthology.orchestra.run.smithi090.stdout:426 2023-06-09T04:46:06.758 INFO:teuthology.orchestra.run.smithi090.stdout:426.out 2023-06-09T04:46:06.758 INFO:teuthology.orchestra.run.smithi090.stdout:427 2023-06-09T04:46:06.758 INFO:teuthology.orchestra.run.smithi090.stdout:427.out 2023-06-09T04:46:06.758 INFO:teuthology.orchestra.run.smithi090.stdout:428 2023-06-09T04:46:06.758 INFO:teuthology.orchestra.run.smithi090.stdout:428.out 2023-06-09T04:46:06.758 INFO:teuthology.orchestra.run.smithi090.stdout:429 2023-06-09T04:46:06.758 INFO:teuthology.orchestra.run.smithi090.stdout:429.out 2023-06-09T04:46:06.758 INFO:teuthology.orchestra.run.smithi090.stdout:430 2023-06-09T04:46:06.759 INFO:teuthology.orchestra.run.smithi090.stdout:430.out 2023-06-09T04:46:06.759 INFO:teuthology.orchestra.run.smithi090.stdout:431 2023-06-09T04:46:06.759 INFO:teuthology.orchestra.run.smithi090.stdout:431.out 2023-06-09T04:46:06.759 INFO:teuthology.orchestra.run.smithi090.stdout:432 2023-06-09T04:46:06.759 INFO:teuthology.orchestra.run.smithi090.stdout:432.out 2023-06-09T04:46:06.759 INFO:teuthology.orchestra.run.smithi090.stdout:433 2023-06-09T04:46:06.759 INFO:teuthology.orchestra.run.smithi090.stdout:433.out 2023-06-09T04:46:06.759 INFO:teuthology.orchestra.run.smithi090.stdout:434 2023-06-09T04:46:06.760 INFO:teuthology.orchestra.run.smithi090.stdout:434.out 2023-06-09T04:46:06.760 INFO:teuthology.orchestra.run.smithi090.stdout:435 2023-06-09T04:46:06.760 INFO:teuthology.orchestra.run.smithi090.stdout:435.out 2023-06-09T04:46:06.760 INFO:teuthology.orchestra.run.smithi090.stdout:436 2023-06-09T04:46:06.760 INFO:teuthology.orchestra.run.smithi090.stdout:436.out 2023-06-09T04:46:06.760 INFO:teuthology.orchestra.run.smithi090.stdout:437 2023-06-09T04:46:06.760 INFO:teuthology.orchestra.run.smithi090.stdout:437.out 2023-06-09T04:46:06.760 INFO:teuthology.orchestra.run.smithi090.stdout:438 2023-06-09T04:46:06.761 INFO:teuthology.orchestra.run.smithi090.stdout:438.out 2023-06-09T04:46:06.761 INFO:teuthology.orchestra.run.smithi090.stdout:439 2023-06-09T04:46:06.761 INFO:teuthology.orchestra.run.smithi090.stdout:439.out 2023-06-09T04:46:06.761 INFO:teuthology.orchestra.run.smithi090.stdout:440 2023-06-09T04:46:06.761 INFO:teuthology.orchestra.run.smithi090.stdout:440.out 2023-06-09T04:46:06.761 INFO:teuthology.orchestra.run.smithi090.stdout:441 2023-06-09T04:46:06.761 INFO:teuthology.orchestra.run.smithi090.stdout:441.out 2023-06-09T04:46:06.761 INFO:teuthology.orchestra.run.smithi090.stdout:442 2023-06-09T04:46:06.762 INFO:teuthology.orchestra.run.smithi090.stdout:442.out 2023-06-09T04:46:06.762 INFO:teuthology.orchestra.run.smithi090.stdout:443 2023-06-09T04:46:06.762 INFO:teuthology.orchestra.run.smithi090.stdout:443.out 2023-06-09T04:46:06.762 INFO:teuthology.orchestra.run.smithi090.stdout:444 2023-06-09T04:46:06.762 INFO:teuthology.orchestra.run.smithi090.stdout:444.out 2023-06-09T04:46:06.762 INFO:teuthology.orchestra.run.smithi090.stdout:445 2023-06-09T04:46:06.762 INFO:teuthology.orchestra.run.smithi090.stdout:445.out 2023-06-09T04:46:06.763 INFO:teuthology.orchestra.run.smithi090.stdout:446 2023-06-09T04:46:06.763 INFO:teuthology.orchestra.run.smithi090.stdout:446.out 2023-06-09T04:46:06.763 INFO:teuthology.orchestra.run.smithi090.stdout:447 2023-06-09T04:46:06.763 INFO:teuthology.orchestra.run.smithi090.stdout:447.out 2023-06-09T04:46:06.763 INFO:teuthology.orchestra.run.smithi090.stdout:448 2023-06-09T04:46:06.763 INFO:teuthology.orchestra.run.smithi090.stdout:448.out 2023-06-09T04:46:06.763 INFO:teuthology.orchestra.run.smithi090.stdout:449 2023-06-09T04:46:06.763 INFO:teuthology.orchestra.run.smithi090.stdout:449.out 2023-06-09T04:46:06.764 INFO:teuthology.orchestra.run.smithi090.stdout:450 2023-06-09T04:46:06.764 INFO:teuthology.orchestra.run.smithi090.stdout:450.out 2023-06-09T04:46:06.764 INFO:teuthology.orchestra.run.smithi090.stdout:451 2023-06-09T04:46:06.764 INFO:teuthology.orchestra.run.smithi090.stdout:451.out 2023-06-09T04:46:06.764 INFO:teuthology.orchestra.run.smithi090.stdout:452 2023-06-09T04:46:06.764 INFO:teuthology.orchestra.run.smithi090.stdout:452.out 2023-06-09T04:46:06.764 INFO:teuthology.orchestra.run.smithi090.stdout:453 2023-06-09T04:46:06.765 INFO:teuthology.orchestra.run.smithi090.stdout:453.out 2023-06-09T04:46:06.765 INFO:teuthology.orchestra.run.smithi090.stdout:454 2023-06-09T04:46:06.765 INFO:teuthology.orchestra.run.smithi090.stdout:454.out 2023-06-09T04:46:06.765 INFO:teuthology.orchestra.run.smithi090.stdout:455 2023-06-09T04:46:06.765 INFO:teuthology.orchestra.run.smithi090.stdout:455.out 2023-06-09T04:46:06.765 INFO:teuthology.orchestra.run.smithi090.stdout:456 2023-06-09T04:46:06.765 INFO:teuthology.orchestra.run.smithi090.stdout:456.out 2023-06-09T04:46:06.765 INFO:teuthology.orchestra.run.smithi090.stdout:457 2023-06-09T04:46:06.766 INFO:teuthology.orchestra.run.smithi090.stdout:457.out 2023-06-09T04:46:06.766 INFO:teuthology.orchestra.run.smithi090.stdout:458 2023-06-09T04:46:06.766 INFO:teuthology.orchestra.run.smithi090.stdout:458.out 2023-06-09T04:46:06.766 INFO:teuthology.orchestra.run.smithi090.stdout:459 2023-06-09T04:46:06.766 INFO:teuthology.orchestra.run.smithi090.stdout:459.out 2023-06-09T04:46:06.766 INFO:teuthology.orchestra.run.smithi090.stdout:460 2023-06-09T04:46:06.766 INFO:teuthology.orchestra.run.smithi090.stdout:460.out 2023-06-09T04:46:06.766 INFO:teuthology.orchestra.run.smithi090.stdout:461 2023-06-09T04:46:06.767 INFO:teuthology.orchestra.run.smithi090.stdout:461.out 2023-06-09T04:46:06.767 INFO:teuthology.orchestra.run.smithi090.stdout:462 2023-06-09T04:46:06.767 INFO:teuthology.orchestra.run.smithi090.stdout:462.out 2023-06-09T04:46:06.767 INFO:teuthology.orchestra.run.smithi090.stdout:463 2023-06-09T04:46:06.767 INFO:teuthology.orchestra.run.smithi090.stdout:463.out 2023-06-09T04:46:06.767 INFO:teuthology.orchestra.run.smithi090.stdout:464 2023-06-09T04:46:06.767 INFO:teuthology.orchestra.run.smithi090.stdout:464.out 2023-06-09T04:46:06.767 INFO:teuthology.orchestra.run.smithi090.stdout:465 2023-06-09T04:46:06.768 INFO:teuthology.orchestra.run.smithi090.stdout:465.out 2023-06-09T04:46:06.768 INFO:teuthology.orchestra.run.smithi090.stdout:466 2023-06-09T04:46:06.768 INFO:teuthology.orchestra.run.smithi090.stdout:466.out 2023-06-09T04:46:06.768 INFO:teuthology.orchestra.run.smithi090.stdout:467 2023-06-09T04:46:06.768 INFO:teuthology.orchestra.run.smithi090.stdout:467.out 2023-06-09T04:46:06.768 INFO:teuthology.orchestra.run.smithi090.stdout:468 2023-06-09T04:46:06.768 INFO:teuthology.orchestra.run.smithi090.stdout:468.out 2023-06-09T04:46:06.768 INFO:teuthology.orchestra.run.smithi090.stdout:469 2023-06-09T04:46:06.769 INFO:teuthology.orchestra.run.smithi090.stdout:469.out 2023-06-09T04:46:06.769 INFO:teuthology.orchestra.run.smithi090.stdout:470 2023-06-09T04:46:06.769 INFO:teuthology.orchestra.run.smithi090.stdout:470.out 2023-06-09T04:46:06.769 INFO:teuthology.orchestra.run.smithi090.stdout:471 2023-06-09T04:46:06.769 INFO:teuthology.orchestra.run.smithi090.stdout:471.out 2023-06-09T04:46:06.769 INFO:teuthology.orchestra.run.smithi090.stdout:472 2023-06-09T04:46:06.769 INFO:teuthology.orchestra.run.smithi090.stdout:472.out 2023-06-09T04:46:06.769 INFO:teuthology.orchestra.run.smithi090.stdout:473 2023-06-09T04:46:06.770 INFO:teuthology.orchestra.run.smithi090.stdout:473.out 2023-06-09T04:46:06.770 INFO:teuthology.orchestra.run.smithi090.stdout:474 2023-06-09T04:46:06.770 INFO:teuthology.orchestra.run.smithi090.stdout:474.out 2023-06-09T04:46:06.770 INFO:teuthology.orchestra.run.smithi090.stdout:475 2023-06-09T04:46:06.770 INFO:teuthology.orchestra.run.smithi090.stdout:475.out 2023-06-09T04:46:06.770 INFO:teuthology.orchestra.run.smithi090.stdout:476 2023-06-09T04:46:06.770 INFO:teuthology.orchestra.run.smithi090.stdout:476.out 2023-06-09T04:46:06.770 INFO:teuthology.orchestra.run.smithi090.stdout:477 2023-06-09T04:46:06.771 INFO:teuthology.orchestra.run.smithi090.stdout:477.out 2023-06-09T04:46:06.771 INFO:teuthology.orchestra.run.smithi090.stdout:478 2023-06-09T04:46:06.771 INFO:teuthology.orchestra.run.smithi090.stdout:478.out 2023-06-09T04:46:06.771 INFO:teuthology.orchestra.run.smithi090.stdout:479 2023-06-09T04:46:06.771 INFO:teuthology.orchestra.run.smithi090.stdout:479.out 2023-06-09T04:46:06.771 INFO:teuthology.orchestra.run.smithi090.stdout:480 2023-06-09T04:46:06.771 INFO:teuthology.orchestra.run.smithi090.stdout:480.out 2023-06-09T04:46:06.771 INFO:teuthology.orchestra.run.smithi090.stdout:481 2023-06-09T04:46:06.772 INFO:teuthology.orchestra.run.smithi090.stdout:481.out 2023-06-09T04:46:06.772 INFO:teuthology.orchestra.run.smithi090.stdout:482 2023-06-09T04:46:06.772 INFO:teuthology.orchestra.run.smithi090.stdout:482.out 2023-06-09T04:46:06.772 INFO:teuthology.orchestra.run.smithi090.stdout:483 2023-06-09T04:46:06.772 INFO:teuthology.orchestra.run.smithi090.stdout:483.out 2023-06-09T04:46:06.772 INFO:teuthology.orchestra.run.smithi090.stdout:484 2023-06-09T04:46:06.772 INFO:teuthology.orchestra.run.smithi090.stdout:484.out 2023-06-09T04:46:06.773 INFO:teuthology.orchestra.run.smithi090.stdout:485 2023-06-09T04:46:06.773 INFO:teuthology.orchestra.run.smithi090.stdout:485.out 2023-06-09T04:46:06.773 INFO:teuthology.orchestra.run.smithi090.stdout:486 2023-06-09T04:46:06.773 INFO:teuthology.orchestra.run.smithi090.stdout:486.out 2023-06-09T04:46:06.773 INFO:teuthology.orchestra.run.smithi090.stdout:487 2023-06-09T04:46:06.773 INFO:teuthology.orchestra.run.smithi090.stdout:487.out 2023-06-09T04:46:06.773 INFO:teuthology.orchestra.run.smithi090.stdout:488 2023-06-09T04:46:06.773 INFO:teuthology.orchestra.run.smithi090.stdout:488.out 2023-06-09T04:46:06.774 INFO:teuthology.orchestra.run.smithi090.stdout:489 2023-06-09T04:46:06.774 INFO:teuthology.orchestra.run.smithi090.stdout:489.out 2023-06-09T04:46:06.774 INFO:teuthology.orchestra.run.smithi090.stdout:490 2023-06-09T04:46:06.774 INFO:teuthology.orchestra.run.smithi090.stdout:490.out 2023-06-09T04:46:06.774 INFO:teuthology.orchestra.run.smithi090.stdout:491 2023-06-09T04:46:06.774 INFO:teuthology.orchestra.run.smithi090.stdout:491.out 2023-06-09T04:46:06.774 INFO:teuthology.orchestra.run.smithi090.stdout:492 2023-06-09T04:46:06.774 INFO:teuthology.orchestra.run.smithi090.stdout:492.out 2023-06-09T04:46:06.775 INFO:teuthology.orchestra.run.smithi090.stdout:493 2023-06-09T04:46:06.775 INFO:teuthology.orchestra.run.smithi090.stdout:493.out 2023-06-09T04:46:06.775 INFO:teuthology.orchestra.run.smithi090.stdout:494 2023-06-09T04:46:06.775 INFO:teuthology.orchestra.run.smithi090.stdout:494.out 2023-06-09T04:46:06.775 INFO:teuthology.orchestra.run.smithi090.stdout:495 2023-06-09T04:46:06.775 INFO:teuthology.orchestra.run.smithi090.stdout:495.out 2023-06-09T04:46:06.775 INFO:teuthology.orchestra.run.smithi090.stdout:496 2023-06-09T04:46:06.775 INFO:teuthology.orchestra.run.smithi090.stdout:496.out 2023-06-09T04:46:06.776 INFO:teuthology.orchestra.run.smithi090.stdout:497 2023-06-09T04:46:06.776 INFO:teuthology.orchestra.run.smithi090.stdout:497.out 2023-06-09T04:46:06.776 INFO:teuthology.orchestra.run.smithi090.stdout:498 2023-06-09T04:46:06.776 INFO:teuthology.orchestra.run.smithi090.stdout:498.out 2023-06-09T04:46:06.776 INFO:teuthology.orchestra.run.smithi090.stdout:499 2023-06-09T04:46:06.776 INFO:teuthology.orchestra.run.smithi090.stdout:499.out 2023-06-09T04:46:06.776 INFO:teuthology.orchestra.run.smithi090.stdout:500 2023-06-09T04:46:06.776 INFO:teuthology.orchestra.run.smithi090.stdout:500.out 2023-06-09T04:46:06.777 INFO:teuthology.orchestra.run.smithi090.stdout:501 2023-06-09T04:46:06.777 INFO:teuthology.orchestra.run.smithi090.stdout:501.out 2023-06-09T04:46:06.777 INFO:teuthology.orchestra.run.smithi090.stdout:502 2023-06-09T04:46:06.777 INFO:teuthology.orchestra.run.smithi090.stdout:502.out 2023-06-09T04:46:06.777 INFO:teuthology.orchestra.run.smithi090.stdout:503 2023-06-09T04:46:06.777 INFO:teuthology.orchestra.run.smithi090.stdout:503.out 2023-06-09T04:46:06.777 INFO:teuthology.orchestra.run.smithi090.stdout:504 2023-06-09T04:46:06.777 INFO:teuthology.orchestra.run.smithi090.stdout:504.out 2023-06-09T04:46:06.778 INFO:teuthology.orchestra.run.smithi090.stdout:505 2023-06-09T04:46:06.778 INFO:teuthology.orchestra.run.smithi090.stdout:505.out 2023-06-09T04:46:06.778 INFO:teuthology.orchestra.run.smithi090.stdout:506 2023-06-09T04:46:06.778 INFO:teuthology.orchestra.run.smithi090.stdout:506.out 2023-06-09T04:46:06.778 INFO:teuthology.orchestra.run.smithi090.stdout:507 2023-06-09T04:46:06.778 INFO:teuthology.orchestra.run.smithi090.stdout:507.out 2023-06-09T04:46:06.778 INFO:teuthology.orchestra.run.smithi090.stdout:508 2023-06-09T04:46:06.779 INFO:teuthology.orchestra.run.smithi090.stdout:508.out 2023-06-09T04:46:06.779 INFO:teuthology.orchestra.run.smithi090.stdout:509 2023-06-09T04:46:06.779 INFO:teuthology.orchestra.run.smithi090.stdout:509.out 2023-06-09T04:46:06.779 INFO:teuthology.orchestra.run.smithi090.stdout:510 2023-06-09T04:46:06.779 INFO:teuthology.orchestra.run.smithi090.stdout:510.out 2023-06-09T04:46:06.779 INFO:teuthology.orchestra.run.smithi090.stdout:511 2023-06-09T04:46:06.779 INFO:teuthology.orchestra.run.smithi090.stdout:511.out 2023-06-09T04:46:06.779 INFO:teuthology.orchestra.run.smithi090.stdout:512 2023-06-09T04:46:06.780 INFO:teuthology.orchestra.run.smithi090.stdout:512.out 2023-06-09T04:46:06.780 INFO:teuthology.orchestra.run.smithi090.stdout:513 2023-06-09T04:46:06.780 INFO:teuthology.orchestra.run.smithi090.stdout:513.out 2023-06-09T04:46:06.780 INFO:teuthology.orchestra.run.smithi090.stdout:514 2023-06-09T04:46:06.780 INFO:teuthology.orchestra.run.smithi090.stdout:514.out 2023-06-09T04:46:06.780 INFO:teuthology.orchestra.run.smithi090.stdout:515 2023-06-09T04:46:06.780 INFO:teuthology.orchestra.run.smithi090.stdout:515.out 2023-06-09T04:46:06.780 INFO:teuthology.orchestra.run.smithi090.stdout:516 2023-06-09T04:46:06.781 INFO:teuthology.orchestra.run.smithi090.stdout:516.out 2023-06-09T04:46:06.781 INFO:teuthology.orchestra.run.smithi090.stdout:517 2023-06-09T04:46:06.781 INFO:teuthology.orchestra.run.smithi090.stdout:517.out 2023-06-09T04:46:06.781 INFO:teuthology.orchestra.run.smithi090.stdout:518 2023-06-09T04:46:06.781 INFO:teuthology.orchestra.run.smithi090.stdout:518.out 2023-06-09T04:46:06.781 INFO:teuthology.orchestra.run.smithi090.stdout:519 2023-06-09T04:46:06.781 INFO:teuthology.orchestra.run.smithi090.stdout:519.out 2023-06-09T04:46:06.781 INFO:teuthology.orchestra.run.smithi090.stdout:520 2023-06-09T04:46:06.782 INFO:teuthology.orchestra.run.smithi090.stdout:520.out 2023-06-09T04:46:06.782 INFO:teuthology.orchestra.run.smithi090.stdout:521 2023-06-09T04:46:06.782 INFO:teuthology.orchestra.run.smithi090.stdout:521.out 2023-06-09T04:46:06.782 INFO:teuthology.orchestra.run.smithi090.stdout:522 2023-06-09T04:46:06.782 INFO:teuthology.orchestra.run.smithi090.stdout:522.out 2023-06-09T04:46:06.782 INFO:teuthology.orchestra.run.smithi090.stdout:523 2023-06-09T04:46:06.782 INFO:teuthology.orchestra.run.smithi090.stdout:523.out 2023-06-09T04:46:06.782 INFO:teuthology.orchestra.run.smithi090.stdout:524 2023-06-09T04:46:06.783 INFO:teuthology.orchestra.run.smithi090.stdout:524.out 2023-06-09T04:46:06.783 INFO:teuthology.orchestra.run.smithi090.stdout:525 2023-06-09T04:46:06.783 INFO:teuthology.orchestra.run.smithi090.stdout:525.out 2023-06-09T04:46:06.783 INFO:teuthology.orchestra.run.smithi090.stdout:526 2023-06-09T04:46:06.783 INFO:teuthology.orchestra.run.smithi090.stdout:526.out 2023-06-09T04:46:06.783 INFO:teuthology.orchestra.run.smithi090.stdout:527 2023-06-09T04:46:06.783 INFO:teuthology.orchestra.run.smithi090.stdout:527.out 2023-06-09T04:46:06.784 INFO:teuthology.orchestra.run.smithi090.stdout:528 2023-06-09T04:46:06.784 INFO:teuthology.orchestra.run.smithi090.stdout:528.out 2023-06-09T04:46:06.784 INFO:teuthology.orchestra.run.smithi090.stdout:529 2023-06-09T04:46:06.784 INFO:teuthology.orchestra.run.smithi090.stdout:529.out 2023-06-09T04:46:06.784 INFO:teuthology.orchestra.run.smithi090.stdout:530 2023-06-09T04:46:06.784 INFO:teuthology.orchestra.run.smithi090.stdout:530.out 2023-06-09T04:46:06.784 INFO:teuthology.orchestra.run.smithi090.stdout:531 2023-06-09T04:46:06.784 INFO:teuthology.orchestra.run.smithi090.stdout:531.out 2023-06-09T04:46:06.785 INFO:teuthology.orchestra.run.smithi090.stdout:532 2023-06-09T04:46:06.785 INFO:teuthology.orchestra.run.smithi090.stdout:532.out 2023-06-09T04:46:06.785 INFO:teuthology.orchestra.run.smithi090.stdout:533 2023-06-09T04:46:06.785 INFO:teuthology.orchestra.run.smithi090.stdout:533.out 2023-06-09T04:46:06.785 INFO:teuthology.orchestra.run.smithi090.stdout:534 2023-06-09T04:46:06.785 INFO:teuthology.orchestra.run.smithi090.stdout:534.out 2023-06-09T04:46:06.785 INFO:teuthology.orchestra.run.smithi090.stdout:535 2023-06-09T04:46:06.785 INFO:teuthology.orchestra.run.smithi090.stdout:535.out 2023-06-09T04:46:06.786 INFO:teuthology.orchestra.run.smithi090.stdout:536 2023-06-09T04:46:06.786 INFO:teuthology.orchestra.run.smithi090.stdout:536.out 2023-06-09T04:46:06.786 INFO:teuthology.orchestra.run.smithi090.stdout:537 2023-06-09T04:46:06.786 INFO:teuthology.orchestra.run.smithi090.stdout:537.out 2023-06-09T04:46:06.786 INFO:teuthology.orchestra.run.smithi090.stdout:538 2023-06-09T04:46:06.786 INFO:teuthology.orchestra.run.smithi090.stdout:538.out 2023-06-09T04:46:06.786 INFO:teuthology.orchestra.run.smithi090.stdout:539 2023-06-09T04:46:06.786 INFO:teuthology.orchestra.run.smithi090.stdout:539.out 2023-06-09T04:46:06.787 INFO:teuthology.orchestra.run.smithi090.stdout:540 2023-06-09T04:46:06.787 INFO:teuthology.orchestra.run.smithi090.stdout:540.out 2023-06-09T04:46:06.787 INFO:teuthology.orchestra.run.smithi090.stdout:541 2023-06-09T04:46:06.787 INFO:teuthology.orchestra.run.smithi090.stdout:541.out 2023-06-09T04:46:06.787 INFO:teuthology.orchestra.run.smithi090.stdout:542 2023-06-09T04:46:06.787 INFO:teuthology.orchestra.run.smithi090.stdout:542.out 2023-06-09T04:46:06.787 INFO:teuthology.orchestra.run.smithi090.stdout:543 2023-06-09T04:46:06.787 INFO:teuthology.orchestra.run.smithi090.stdout:543.out 2023-06-09T04:46:06.788 INFO:teuthology.orchestra.run.smithi090.stdout:544 2023-06-09T04:46:06.788 INFO:teuthology.orchestra.run.smithi090.stdout:544.out 2023-06-09T04:46:06.788 INFO:teuthology.orchestra.run.smithi090.stdout:545 2023-06-09T04:46:06.788 INFO:teuthology.orchestra.run.smithi090.stdout:545.out 2023-06-09T04:46:06.788 INFO:teuthology.orchestra.run.smithi090.stdout:546 2023-06-09T04:46:06.788 INFO:teuthology.orchestra.run.smithi090.stdout:546.out 2023-06-09T04:46:06.788 INFO:teuthology.orchestra.run.smithi090.stdout:547 2023-06-09T04:46:06.789 INFO:teuthology.orchestra.run.smithi090.stdout:547.out 2023-06-09T04:46:06.789 INFO:teuthology.orchestra.run.smithi090.stdout:548 2023-06-09T04:46:06.789 INFO:teuthology.orchestra.run.smithi090.stdout:548.out 2023-06-09T04:46:06.789 INFO:teuthology.orchestra.run.smithi090.stdout:549 2023-06-09T04:46:06.789 INFO:teuthology.orchestra.run.smithi090.stdout:549.out 2023-06-09T04:46:06.789 INFO:teuthology.orchestra.run.smithi090.stdout:550 2023-06-09T04:46:06.789 INFO:teuthology.orchestra.run.smithi090.stdout:550.out 2023-06-09T04:46:06.789 INFO:teuthology.orchestra.run.smithi090.stdout:551 2023-06-09T04:46:06.790 INFO:teuthology.orchestra.run.smithi090.stdout:551.out 2023-06-09T04:46:06.790 INFO:teuthology.orchestra.run.smithi090.stdout:552 2023-06-09T04:46:06.790 INFO:teuthology.orchestra.run.smithi090.stdout:552.out 2023-06-09T04:46:06.790 INFO:teuthology.orchestra.run.smithi090.stdout:553 2023-06-09T04:46:06.790 INFO:teuthology.orchestra.run.smithi090.stdout:553.out 2023-06-09T04:46:06.790 INFO:teuthology.orchestra.run.smithi090.stdout:554 2023-06-09T04:46:06.790 INFO:teuthology.orchestra.run.smithi090.stdout:554.out 2023-06-09T04:46:06.790 INFO:teuthology.orchestra.run.smithi090.stdout:555 2023-06-09T04:46:06.791 INFO:teuthology.orchestra.run.smithi090.stdout:555.out 2023-06-09T04:46:06.791 INFO:teuthology.orchestra.run.smithi090.stdout:556 2023-06-09T04:46:06.791 INFO:teuthology.orchestra.run.smithi090.stdout:556.out 2023-06-09T04:46:06.791 INFO:teuthology.orchestra.run.smithi090.stdout:557 2023-06-09T04:46:06.791 INFO:teuthology.orchestra.run.smithi090.stdout:557.out 2023-06-09T04:46:06.791 INFO:teuthology.orchestra.run.smithi090.stdout:558 2023-06-09T04:46:06.791 INFO:teuthology.orchestra.run.smithi090.stdout:558.out 2023-06-09T04:46:06.791 INFO:teuthology.orchestra.run.smithi090.stdout:559 2023-06-09T04:46:06.792 INFO:teuthology.orchestra.run.smithi090.stdout:559.out 2023-06-09T04:46:06.792 INFO:teuthology.orchestra.run.smithi090.stdout:560 2023-06-09T04:46:06.792 INFO:teuthology.orchestra.run.smithi090.stdout:560.out 2023-06-09T04:46:06.792 INFO:teuthology.orchestra.run.smithi090.stdout:561 2023-06-09T04:46:06.792 INFO:teuthology.orchestra.run.smithi090.stdout:561.out 2023-06-09T04:46:06.792 INFO:teuthology.orchestra.run.smithi090.stdout:562 2023-06-09T04:46:06.792 INFO:teuthology.orchestra.run.smithi090.stdout:562.out 2023-06-09T04:46:06.792 INFO:teuthology.orchestra.run.smithi090.stdout:563 2023-06-09T04:46:06.793 INFO:teuthology.orchestra.run.smithi090.stdout:563.out 2023-06-09T04:46:06.793 INFO:teuthology.orchestra.run.smithi090.stdout:564 2023-06-09T04:46:06.793 INFO:teuthology.orchestra.run.smithi090.stdout:564.out 2023-06-09T04:46:06.793 INFO:teuthology.orchestra.run.smithi090.stdout:565 2023-06-09T04:46:06.793 INFO:teuthology.orchestra.run.smithi090.stdout:565.out 2023-06-09T04:46:06.793 INFO:teuthology.orchestra.run.smithi090.stdout:566 2023-06-09T04:46:06.793 INFO:teuthology.orchestra.run.smithi090.stdout:566.out 2023-06-09T04:46:06.793 INFO:teuthology.orchestra.run.smithi090.stdout:567 2023-06-09T04:46:06.794 INFO:teuthology.orchestra.run.smithi090.stdout:567.out 2023-06-09T04:46:06.794 INFO:teuthology.orchestra.run.smithi090.stdout:568 2023-06-09T04:46:06.794 INFO:teuthology.orchestra.run.smithi090.stdout:568.out 2023-06-09T04:46:06.794 INFO:teuthology.orchestra.run.smithi090.stdout:569 2023-06-09T04:46:06.794 INFO:teuthology.orchestra.run.smithi090.stdout:569.out 2023-06-09T04:46:06.794 INFO:teuthology.orchestra.run.smithi090.stdout:570 2023-06-09T04:46:06.794 INFO:teuthology.orchestra.run.smithi090.stdout:570.out 2023-06-09T04:46:06.794 INFO:teuthology.orchestra.run.smithi090.stdout:571 2023-06-09T04:46:06.795 INFO:teuthology.orchestra.run.smithi090.stdout:571.out 2023-06-09T04:46:06.795 INFO:teuthology.orchestra.run.smithi090.stdout:572 2023-06-09T04:46:06.795 INFO:teuthology.orchestra.run.smithi090.stdout:572.out 2023-06-09T04:46:06.795 INFO:teuthology.orchestra.run.smithi090.stdout:573 2023-06-09T04:46:06.795 INFO:teuthology.orchestra.run.smithi090.stdout:573.out 2023-06-09T04:46:06.795 INFO:teuthology.orchestra.run.smithi090.stdout:574 2023-06-09T04:46:06.795 INFO:teuthology.orchestra.run.smithi090.stdout:574.out 2023-06-09T04:46:06.796 INFO:teuthology.orchestra.run.smithi090.stdout:575 2023-06-09T04:46:06.796 INFO:teuthology.orchestra.run.smithi090.stdout:575.out 2023-06-09T04:46:06.796 INFO:teuthology.orchestra.run.smithi090.stdout:576 2023-06-09T04:46:06.796 INFO:teuthology.orchestra.run.smithi090.stdout:576.out 2023-06-09T04:46:06.796 INFO:teuthology.orchestra.run.smithi090.stdout:577 2023-06-09T04:46:06.796 INFO:teuthology.orchestra.run.smithi090.stdout:577.out 2023-06-09T04:46:06.796 INFO:teuthology.orchestra.run.smithi090.stdout:578 2023-06-09T04:46:06.796 INFO:teuthology.orchestra.run.smithi090.stdout:578.out 2023-06-09T04:46:06.797 INFO:teuthology.orchestra.run.smithi090.stdout:579 2023-06-09T04:46:06.797 INFO:teuthology.orchestra.run.smithi090.stdout:579.out 2023-06-09T04:46:06.797 INFO:teuthology.orchestra.run.smithi090.stdout:580 2023-06-09T04:46:06.797 INFO:teuthology.orchestra.run.smithi090.stdout:580.out 2023-06-09T04:46:06.797 INFO:teuthology.orchestra.run.smithi090.stdout:581 2023-06-09T04:46:06.797 INFO:teuthology.orchestra.run.smithi090.stdout:581.out 2023-06-09T04:46:06.797 INFO:teuthology.orchestra.run.smithi090.stdout:582 2023-06-09T04:46:06.797 INFO:teuthology.orchestra.run.smithi090.stdout:582.out 2023-06-09T04:46:06.798 INFO:teuthology.orchestra.run.smithi090.stdout:583 2023-06-09T04:46:06.798 INFO:teuthology.orchestra.run.smithi090.stdout:583.out 2023-06-09T04:46:06.798 INFO:teuthology.orchestra.run.smithi090.stdout:584 2023-06-09T04:46:06.798 INFO:teuthology.orchestra.run.smithi090.stdout:584.out 2023-06-09T04:46:06.798 INFO:teuthology.orchestra.run.smithi090.stdout:585 2023-06-09T04:46:06.798 INFO:teuthology.orchestra.run.smithi090.stdout:585.out 2023-06-09T04:46:06.798 INFO:teuthology.orchestra.run.smithi090.stdout:586 2023-06-09T04:46:06.798 INFO:teuthology.orchestra.run.smithi090.stdout:586.out 2023-06-09T04:46:06.799 INFO:teuthology.orchestra.run.smithi090.stdout:587 2023-06-09T04:46:06.799 INFO:teuthology.orchestra.run.smithi090.stdout:587.out 2023-06-09T04:46:06.799 INFO:teuthology.orchestra.run.smithi090.stdout:588 2023-06-09T04:46:06.799 INFO:teuthology.orchestra.run.smithi090.stdout:588.out 2023-06-09T04:46:06.799 INFO:teuthology.orchestra.run.smithi090.stdout:589 2023-06-09T04:46:06.799 INFO:teuthology.orchestra.run.smithi090.stdout:589.out 2023-06-09T04:46:06.799 INFO:teuthology.orchestra.run.smithi090.stdout:590 2023-06-09T04:46:06.799 INFO:teuthology.orchestra.run.smithi090.stdout:590.out 2023-06-09T04:46:06.800 INFO:teuthology.orchestra.run.smithi090.stdout:591 2023-06-09T04:46:06.800 INFO:teuthology.orchestra.run.smithi090.stdout:591.out 2023-06-09T04:46:06.800 INFO:teuthology.orchestra.run.smithi090.stdout:592 2023-06-09T04:46:06.800 INFO:teuthology.orchestra.run.smithi090.stdout:592.out 2023-06-09T04:46:06.800 INFO:teuthology.orchestra.run.smithi090.stdout:593 2023-06-09T04:46:06.800 INFO:teuthology.orchestra.run.smithi090.stdout:593.out 2023-06-09T04:46:06.800 INFO:teuthology.orchestra.run.smithi090.stdout:594 2023-06-09T04:46:06.800 INFO:teuthology.orchestra.run.smithi090.stdout:594.out 2023-06-09T04:46:06.801 INFO:teuthology.orchestra.run.smithi090.stdout:595 2023-06-09T04:46:06.801 INFO:teuthology.orchestra.run.smithi090.stdout:595.out 2023-06-09T04:46:06.801 INFO:teuthology.orchestra.run.smithi090.stdout:596 2023-06-09T04:46:06.801 INFO:teuthology.orchestra.run.smithi090.stdout:596.out 2023-06-09T04:46:06.801 INFO:teuthology.orchestra.run.smithi090.stdout:597 2023-06-09T04:46:06.801 INFO:teuthology.orchestra.run.smithi090.stdout:597.out 2023-06-09T04:46:06.801 INFO:teuthology.orchestra.run.smithi090.stdout:598 2023-06-09T04:46:06.802 INFO:teuthology.orchestra.run.smithi090.stdout:598.out 2023-06-09T04:46:06.802 INFO:teuthology.orchestra.run.smithi090.stdout:599 2023-06-09T04:46:06.802 INFO:teuthology.orchestra.run.smithi090.stdout:599.out 2023-06-09T04:46:06.802 INFO:teuthology.orchestra.run.smithi090.stdout:600 2023-06-09T04:46:06.802 INFO:teuthology.orchestra.run.smithi090.stdout:600.out 2023-06-09T04:46:06.802 INFO:teuthology.orchestra.run.smithi090.stdout:601 2023-06-09T04:46:06.802 INFO:teuthology.orchestra.run.smithi090.stdout:601.out 2023-06-09T04:46:06.802 INFO:teuthology.orchestra.run.smithi090.stdout:602 2023-06-09T04:46:06.803 INFO:teuthology.orchestra.run.smithi090.stdout:602.out 2023-06-09T04:46:06.803 INFO:teuthology.orchestra.run.smithi090.stdout:603 2023-06-09T04:46:06.803 INFO:teuthology.orchestra.run.smithi090.stdout:603.out 2023-06-09T04:46:06.803 INFO:teuthology.orchestra.run.smithi090.stdout:604 2023-06-09T04:46:06.803 INFO:teuthology.orchestra.run.smithi090.stdout:604.out 2023-06-09T04:46:06.803 INFO:teuthology.orchestra.run.smithi090.stdout:605 2023-06-09T04:46:06.803 INFO:teuthology.orchestra.run.smithi090.stdout:605.out 2023-06-09T04:46:06.803 INFO:teuthology.orchestra.run.smithi090.stdout:606 2023-06-09T04:46:06.804 INFO:teuthology.orchestra.run.smithi090.stdout:606.out 2023-06-09T04:46:06.804 INFO:teuthology.orchestra.run.smithi090.stdout:607 2023-06-09T04:46:06.804 INFO:teuthology.orchestra.run.smithi090.stdout:607.out 2023-06-09T04:46:06.804 INFO:teuthology.orchestra.run.smithi090.stdout:608 2023-06-09T04:46:06.804 INFO:teuthology.orchestra.run.smithi090.stdout:608.out 2023-06-09T04:46:06.804 INFO:teuthology.orchestra.run.smithi090.stdout:609 2023-06-09T04:46:06.804 INFO:teuthology.orchestra.run.smithi090.stdout:609.out 2023-06-09T04:46:06.804 INFO:teuthology.orchestra.run.smithi090.stdout:610 2023-06-09T04:46:06.805 INFO:teuthology.orchestra.run.smithi090.stdout:610.out 2023-06-09T04:46:06.805 INFO:teuthology.orchestra.run.smithi090.stdout:611 2023-06-09T04:46:06.805 INFO:teuthology.orchestra.run.smithi090.stdout:611.out 2023-06-09T04:46:06.805 INFO:teuthology.orchestra.run.smithi090.stdout:612 2023-06-09T04:46:06.805 INFO:teuthology.orchestra.run.smithi090.stdout:612.out 2023-06-09T04:46:06.805 INFO:teuthology.orchestra.run.smithi090.stdout:613 2023-06-09T04:46:06.805 INFO:teuthology.orchestra.run.smithi090.stdout:613.out 2023-06-09T04:46:06.806 INFO:teuthology.orchestra.run.smithi090.stdout:614 2023-06-09T04:46:06.806 INFO:teuthology.orchestra.run.smithi090.stdout:614.out 2023-06-09T04:46:06.806 INFO:teuthology.orchestra.run.smithi090.stdout:615 2023-06-09T04:46:06.806 INFO:teuthology.orchestra.run.smithi090.stdout:615.out 2023-06-09T04:46:06.806 INFO:teuthology.orchestra.run.smithi090.stdout:616 2023-06-09T04:46:06.806 INFO:teuthology.orchestra.run.smithi090.stdout:616.out 2023-06-09T04:46:06.806 INFO:teuthology.orchestra.run.smithi090.stdout:617 2023-06-09T04:46:06.806 INFO:teuthology.orchestra.run.smithi090.stdout:617.out 2023-06-09T04:46:06.807 INFO:teuthology.orchestra.run.smithi090.stdout:618 2023-06-09T04:46:06.807 INFO:teuthology.orchestra.run.smithi090.stdout:618.out 2023-06-09T04:46:06.807 INFO:teuthology.orchestra.run.smithi090.stdout:619 2023-06-09T04:46:06.807 INFO:teuthology.orchestra.run.smithi090.stdout:619.out 2023-06-09T04:46:06.807 INFO:teuthology.orchestra.run.smithi090.stdout:620 2023-06-09T04:46:06.807 INFO:teuthology.orchestra.run.smithi090.stdout:620.out 2023-06-09T04:46:06.807 INFO:teuthology.orchestra.run.smithi090.stdout:621 2023-06-09T04:46:06.807 INFO:teuthology.orchestra.run.smithi090.stdout:621.out 2023-06-09T04:46:06.808 INFO:teuthology.orchestra.run.smithi090.stdout:622 2023-06-09T04:46:06.808 INFO:teuthology.orchestra.run.smithi090.stdout:622.out 2023-06-09T04:46:06.808 INFO:teuthology.orchestra.run.smithi090.stdout:623 2023-06-09T04:46:06.808 INFO:teuthology.orchestra.run.smithi090.stdout:623.out 2023-06-09T04:46:06.808 INFO:teuthology.orchestra.run.smithi090.stdout:624 2023-06-09T04:46:06.808 INFO:teuthology.orchestra.run.smithi090.stdout:624.out 2023-06-09T04:46:06.808 INFO:teuthology.orchestra.run.smithi090.stdout:625 2023-06-09T04:46:06.808 INFO:teuthology.orchestra.run.smithi090.stdout:625.out 2023-06-09T04:46:06.809 INFO:teuthology.orchestra.run.smithi090.stdout:626 2023-06-09T04:46:06.809 INFO:teuthology.orchestra.run.smithi090.stdout:626.out 2023-06-09T04:46:06.809 INFO:teuthology.orchestra.run.smithi090.stdout:627 2023-06-09T04:46:06.809 INFO:teuthology.orchestra.run.smithi090.stdout:627.out 2023-06-09T04:46:06.809 INFO:teuthology.orchestra.run.smithi090.stdout:628 2023-06-09T04:46:06.809 INFO:teuthology.orchestra.run.smithi090.stdout:628.out 2023-06-09T04:46:06.809 INFO:teuthology.orchestra.run.smithi090.stdout:629 2023-06-09T04:46:06.810 INFO:teuthology.orchestra.run.smithi090.stdout:629.out 2023-06-09T04:46:06.810 INFO:teuthology.orchestra.run.smithi090.stdout:630 2023-06-09T04:46:06.810 INFO:teuthology.orchestra.run.smithi090.stdout:630.out 2023-06-09T04:46:06.810 INFO:teuthology.orchestra.run.smithi090.stdout:631 2023-06-09T04:46:06.810 INFO:teuthology.orchestra.run.smithi090.stdout:631.out 2023-06-09T04:46:06.810 INFO:teuthology.orchestra.run.smithi090.stdout:632 2023-06-09T04:46:06.810 INFO:teuthology.orchestra.run.smithi090.stdout:632.out 2023-06-09T04:46:06.810 INFO:teuthology.orchestra.run.smithi090.stdout:633 2023-06-09T04:46:06.811 INFO:teuthology.orchestra.run.smithi090.stdout:633.out 2023-06-09T04:46:06.811 INFO:teuthology.orchestra.run.smithi090.stdout:634 2023-06-09T04:46:06.811 INFO:teuthology.orchestra.run.smithi090.stdout:634.out 2023-06-09T04:46:06.811 INFO:teuthology.orchestra.run.smithi090.stdout:635 2023-06-09T04:46:06.811 INFO:teuthology.orchestra.run.smithi090.stdout:635.out 2023-06-09T04:46:06.811 INFO:teuthology.orchestra.run.smithi090.stdout:636 2023-06-09T04:46:06.811 INFO:teuthology.orchestra.run.smithi090.stdout:636.out 2023-06-09T04:46:06.811 INFO:teuthology.orchestra.run.smithi090.stdout:637 2023-06-09T04:46:06.812 INFO:teuthology.orchestra.run.smithi090.stdout:637.out 2023-06-09T04:46:06.812 INFO:teuthology.orchestra.run.smithi090.stdout:638 2023-06-09T04:46:06.812 INFO:teuthology.orchestra.run.smithi090.stdout:638.out 2023-06-09T04:46:06.812 INFO:teuthology.orchestra.run.smithi090.stdout:639 2023-06-09T04:46:06.812 INFO:teuthology.orchestra.run.smithi090.stdout:639.out 2023-06-09T04:46:06.812 INFO:teuthology.orchestra.run.smithi090.stdout:640 2023-06-09T04:46:06.812 INFO:teuthology.orchestra.run.smithi090.stdout:640.out 2023-06-09T04:46:06.813 INFO:teuthology.orchestra.run.smithi090.stdout:641 2023-06-09T04:46:06.813 INFO:teuthology.orchestra.run.smithi090.stdout:641.out 2023-06-09T04:46:06.813 INFO:teuthology.orchestra.run.smithi090.stdout:642 2023-06-09T04:46:06.813 INFO:teuthology.orchestra.run.smithi090.stdout:642.out 2023-06-09T04:46:06.813 INFO:teuthology.orchestra.run.smithi090.stdout:643 2023-06-09T04:46:06.813 INFO:teuthology.orchestra.run.smithi090.stdout:643.out 2023-06-09T04:46:06.813 INFO:teuthology.orchestra.run.smithi090.stdout:644 2023-06-09T04:46:06.813 INFO:teuthology.orchestra.run.smithi090.stdout:644.out 2023-06-09T04:46:06.814 INFO:teuthology.orchestra.run.smithi090.stdout:645 2023-06-09T04:46:06.814 INFO:teuthology.orchestra.run.smithi090.stdout:645.out 2023-06-09T04:46:06.814 INFO:teuthology.orchestra.run.smithi090.stdout:646 2023-06-09T04:46:06.814 INFO:teuthology.orchestra.run.smithi090.stdout:646.out 2023-06-09T04:46:06.814 INFO:teuthology.orchestra.run.smithi090.stdout:647 2023-06-09T04:46:06.814 INFO:teuthology.orchestra.run.smithi090.stdout:647.out 2023-06-09T04:46:06.814 INFO:teuthology.orchestra.run.smithi090.stdout:648 2023-06-09T04:46:06.814 INFO:teuthology.orchestra.run.smithi090.stdout:648.out 2023-06-09T04:46:06.815 INFO:teuthology.orchestra.run.smithi090.stdout:649 2023-06-09T04:46:06.815 INFO:teuthology.orchestra.run.smithi090.stdout:649.out 2023-06-09T04:46:06.815 INFO:teuthology.orchestra.run.smithi090.stdout:650 2023-06-09T04:46:06.815 INFO:teuthology.orchestra.run.smithi090.stdout:650.out 2023-06-09T04:46:06.815 INFO:teuthology.orchestra.run.smithi090.stdout:651 2023-06-09T04:46:06.815 INFO:teuthology.orchestra.run.smithi090.stdout:651.out 2023-06-09T04:46:06.815 INFO:teuthology.orchestra.run.smithi090.stdout:652 2023-06-09T04:46:06.815 INFO:teuthology.orchestra.run.smithi090.stdout:652.out 2023-06-09T04:46:06.816 INFO:teuthology.orchestra.run.smithi090.stdout:653 2023-06-09T04:46:06.816 INFO:teuthology.orchestra.run.smithi090.stdout:653.out 2023-06-09T04:46:06.816 INFO:teuthology.orchestra.run.smithi090.stdout:654 2023-06-09T04:46:06.816 INFO:teuthology.orchestra.run.smithi090.stdout:654.out 2023-06-09T04:46:06.816 INFO:teuthology.orchestra.run.smithi090.stdout:655 2023-06-09T04:46:06.816 INFO:teuthology.orchestra.run.smithi090.stdout:655.out 2023-06-09T04:46:06.816 INFO:teuthology.orchestra.run.smithi090.stdout:656 2023-06-09T04:46:06.816 INFO:teuthology.orchestra.run.smithi090.stdout:656.out 2023-06-09T04:46:06.817 INFO:teuthology.orchestra.run.smithi090.stdout:657 2023-06-09T04:46:06.817 INFO:teuthology.orchestra.run.smithi090.stdout:657.out 2023-06-09T04:46:06.817 INFO:teuthology.orchestra.run.smithi090.stdout:658 2023-06-09T04:46:06.817 INFO:teuthology.orchestra.run.smithi090.stdout:658.out 2023-06-09T04:46:06.817 INFO:teuthology.orchestra.run.smithi090.stdout:659 2023-06-09T04:46:06.817 INFO:teuthology.orchestra.run.smithi090.stdout:659.out 2023-06-09T04:46:06.817 INFO:teuthology.orchestra.run.smithi090.stdout:660 2023-06-09T04:46:06.817 INFO:teuthology.orchestra.run.smithi090.stdout:660.out 2023-06-09T04:46:06.818 INFO:teuthology.orchestra.run.smithi090.stdout:661 2023-06-09T04:46:06.818 INFO:teuthology.orchestra.run.smithi090.stdout:661.out 2023-06-09T04:46:06.818 INFO:teuthology.orchestra.run.smithi090.stdout:662 2023-06-09T04:46:06.818 INFO:teuthology.orchestra.run.smithi090.stdout:662.out 2023-06-09T04:46:06.818 INFO:teuthology.orchestra.run.smithi090.stdout:663 2023-06-09T04:46:06.818 INFO:teuthology.orchestra.run.smithi090.stdout:663.out 2023-06-09T04:46:06.818 INFO:teuthology.orchestra.run.smithi090.stdout:664 2023-06-09T04:46:06.819 INFO:teuthology.orchestra.run.smithi090.stdout:664.out 2023-06-09T04:46:06.819 INFO:teuthology.orchestra.run.smithi090.stdout:665 2023-06-09T04:46:06.819 INFO:teuthology.orchestra.run.smithi090.stdout:665.out 2023-06-09T04:46:06.819 INFO:teuthology.orchestra.run.smithi090.stdout:666 2023-06-09T04:46:06.819 INFO:teuthology.orchestra.run.smithi090.stdout:666.out 2023-06-09T04:46:06.819 INFO:teuthology.orchestra.run.smithi090.stdout:667 2023-06-09T04:46:06.819 INFO:teuthology.orchestra.run.smithi090.stdout:667.out 2023-06-09T04:46:06.820 INFO:teuthology.orchestra.run.smithi090.stdout:668 2023-06-09T04:46:06.820 INFO:teuthology.orchestra.run.smithi090.stdout:668.out 2023-06-09T04:46:06.820 INFO:teuthology.orchestra.run.smithi090.stdout:669 2023-06-09T04:46:06.820 INFO:teuthology.orchestra.run.smithi090.stdout:669.out 2023-06-09T04:46:06.820 INFO:teuthology.orchestra.run.smithi090.stdout:670 2023-06-09T04:46:06.820 INFO:teuthology.orchestra.run.smithi090.stdout:670.out 2023-06-09T04:46:06.820 INFO:teuthology.orchestra.run.smithi090.stdout:671 2023-06-09T04:46:06.820 INFO:teuthology.orchestra.run.smithi090.stdout:671.out 2023-06-09T04:46:06.821 INFO:teuthology.orchestra.run.smithi090.stdout:672 2023-06-09T04:46:06.821 INFO:teuthology.orchestra.run.smithi090.stdout:672.out 2023-06-09T04:46:06.821 INFO:teuthology.orchestra.run.smithi090.stdout:673 2023-06-09T04:46:06.821 INFO:teuthology.orchestra.run.smithi090.stdout:673.out 2023-06-09T04:46:06.821 INFO:teuthology.orchestra.run.smithi090.stdout:674 2023-06-09T04:46:06.821 INFO:teuthology.orchestra.run.smithi090.stdout:674.out 2023-06-09T04:46:06.821 INFO:teuthology.orchestra.run.smithi090.stdout:675 2023-06-09T04:46:06.821 INFO:teuthology.orchestra.run.smithi090.stdout:675.out 2023-06-09T04:46:06.822 INFO:teuthology.orchestra.run.smithi090.stdout:676 2023-06-09T04:46:06.822 INFO:teuthology.orchestra.run.smithi090.stdout:676.out 2023-06-09T04:46:06.822 INFO:teuthology.orchestra.run.smithi090.stdout:677 2023-06-09T04:46:06.822 INFO:teuthology.orchestra.run.smithi090.stdout:677.out 2023-06-09T04:46:06.822 INFO:teuthology.orchestra.run.smithi090.stdout:678 2023-06-09T04:46:06.822 INFO:teuthology.orchestra.run.smithi090.stdout:678.out 2023-06-09T04:46:06.822 INFO:teuthology.orchestra.run.smithi090.stdout:679 2023-06-09T04:46:06.822 INFO:teuthology.orchestra.run.smithi090.stdout:679.out 2023-06-09T04:46:06.823 INFO:teuthology.orchestra.run.smithi090.stdout:680 2023-06-09T04:46:06.823 INFO:teuthology.orchestra.run.smithi090.stdout:680.out 2023-06-09T04:46:06.823 INFO:teuthology.orchestra.run.smithi090.stdout:681 2023-06-09T04:46:06.823 INFO:teuthology.orchestra.run.smithi090.stdout:681.out 2023-06-09T04:46:06.823 INFO:teuthology.orchestra.run.smithi090.stdout:682 2023-06-09T04:46:06.823 INFO:teuthology.orchestra.run.smithi090.stdout:682.out 2023-06-09T04:46:06.823 INFO:teuthology.orchestra.run.smithi090.stdout:683 2023-06-09T04:46:06.823 INFO:teuthology.orchestra.run.smithi090.stdout:683.out 2023-06-09T04:46:06.824 INFO:teuthology.orchestra.run.smithi090.stdout:684 2023-06-09T04:46:06.824 INFO:teuthology.orchestra.run.smithi090.stdout:684.out 2023-06-09T04:46:06.824 INFO:teuthology.orchestra.run.smithi090.stdout:685 2023-06-09T04:46:06.824 INFO:teuthology.orchestra.run.smithi090.stdout:685.out 2023-06-09T04:46:06.824 INFO:teuthology.orchestra.run.smithi090.stdout:686 2023-06-09T04:46:06.824 INFO:teuthology.orchestra.run.smithi090.stdout:686.out 2023-06-09T04:46:06.824 INFO:teuthology.orchestra.run.smithi090.stdout:687 2023-06-09T04:46:06.825 INFO:teuthology.orchestra.run.smithi090.stdout:687.out 2023-06-09T04:46:06.825 INFO:teuthology.orchestra.run.smithi090.stdout:688 2023-06-09T04:46:06.825 INFO:teuthology.orchestra.run.smithi090.stdout:688.out 2023-06-09T04:46:06.825 INFO:teuthology.orchestra.run.smithi090.stdout:689 2023-06-09T04:46:06.825 INFO:teuthology.orchestra.run.smithi090.stdout:689.out 2023-06-09T04:46:06.825 INFO:teuthology.orchestra.run.smithi090.stdout:690 2023-06-09T04:46:06.825 INFO:teuthology.orchestra.run.smithi090.stdout:690.out 2023-06-09T04:46:06.825 INFO:teuthology.orchestra.run.smithi090.stdout:691 2023-06-09T04:46:06.826 INFO:teuthology.orchestra.run.smithi090.stdout:691.out 2023-06-09T04:46:06.826 INFO:teuthology.orchestra.run.smithi090.stdout:692 2023-06-09T04:46:06.826 INFO:teuthology.orchestra.run.smithi090.stdout:692.out 2023-06-09T04:46:06.826 INFO:teuthology.orchestra.run.smithi090.stdout:693 2023-06-09T04:46:06.826 INFO:teuthology.orchestra.run.smithi090.stdout:693.out 2023-06-09T04:46:06.826 INFO:teuthology.orchestra.run.smithi090.stdout:694 2023-06-09T04:46:06.826 INFO:teuthology.orchestra.run.smithi090.stdout:694.out 2023-06-09T04:46:06.826 INFO:teuthology.orchestra.run.smithi090.stdout:695 2023-06-09T04:46:06.827 INFO:teuthology.orchestra.run.smithi090.stdout:695.out 2023-06-09T04:46:06.827 INFO:teuthology.orchestra.run.smithi090.stdout:696 2023-06-09T04:46:06.827 INFO:teuthology.orchestra.run.smithi090.stdout:696.out 2023-06-09T04:46:06.827 INFO:teuthology.orchestra.run.smithi090.stdout:697 2023-06-09T04:46:06.827 INFO:teuthology.orchestra.run.smithi090.stdout:697.out 2023-06-09T04:46:06.827 INFO:teuthology.orchestra.run.smithi090.stdout:698 2023-06-09T04:46:06.827 INFO:teuthology.orchestra.run.smithi090.stdout:698.out 2023-06-09T04:46:06.828 INFO:teuthology.orchestra.run.smithi090.stdout:699 2023-06-09T04:46:06.828 INFO:teuthology.orchestra.run.smithi090.stdout:699.out 2023-06-09T04:46:06.828 INFO:teuthology.orchestra.run.smithi090.stdout:700 2023-06-09T04:46:06.828 INFO:teuthology.orchestra.run.smithi090.stdout:700.out 2023-06-09T04:46:06.828 INFO:teuthology.orchestra.run.smithi090.stdout:701 2023-06-09T04:46:06.828 INFO:teuthology.orchestra.run.smithi090.stdout:701.out 2023-06-09T04:46:06.828 INFO:teuthology.orchestra.run.smithi090.stdout:702 2023-06-09T04:46:06.828 INFO:teuthology.orchestra.run.smithi090.stdout:702.out 2023-06-09T04:46:06.829 INFO:teuthology.orchestra.run.smithi090.stdout:703 2023-06-09T04:46:06.829 INFO:teuthology.orchestra.run.smithi090.stdout:703.out 2023-06-09T04:46:06.829 INFO:teuthology.orchestra.run.smithi090.stdout:704 2023-06-09T04:46:06.829 INFO:teuthology.orchestra.run.smithi090.stdout:704.out 2023-06-09T04:46:06.829 INFO:teuthology.orchestra.run.smithi090.stdout:705 2023-06-09T04:46:06.829 INFO:teuthology.orchestra.run.smithi090.stdout:705.out 2023-06-09T04:46:06.829 INFO:teuthology.orchestra.run.smithi090.stdout:706 2023-06-09T04:46:06.829 INFO:teuthology.orchestra.run.smithi090.stdout:706.out 2023-06-09T04:46:06.830 INFO:teuthology.orchestra.run.smithi090.stdout:707 2023-06-09T04:46:06.830 INFO:teuthology.orchestra.run.smithi090.stdout:707.out 2023-06-09T04:46:06.830 INFO:teuthology.orchestra.run.smithi090.stdout:708 2023-06-09T04:46:06.830 INFO:teuthology.orchestra.run.smithi090.stdout:708.out 2023-06-09T04:46:06.830 INFO:teuthology.orchestra.run.smithi090.stdout:709 2023-06-09T04:46:06.830 INFO:teuthology.orchestra.run.smithi090.stdout:709.out 2023-06-09T04:46:06.830 INFO:teuthology.orchestra.run.smithi090.stdout:710 2023-06-09T04:46:06.830 INFO:teuthology.orchestra.run.smithi090.stdout:710.out 2023-06-09T04:46:06.831 INFO:teuthology.orchestra.run.smithi090.stdout:711 2023-06-09T04:46:06.831 INFO:teuthology.orchestra.run.smithi090.stdout:711.out 2023-06-09T04:46:06.831 INFO:teuthology.orchestra.run.smithi090.stdout:712 2023-06-09T04:46:06.831 INFO:teuthology.orchestra.run.smithi090.stdout:712.out 2023-06-09T04:46:06.831 INFO:teuthology.orchestra.run.smithi090.stdout:713 2023-06-09T04:46:06.831 INFO:teuthology.orchestra.run.smithi090.stdout:713.out 2023-06-09T04:46:06.831 INFO:teuthology.orchestra.run.smithi090.stdout:714 2023-06-09T04:46:06.831 INFO:teuthology.orchestra.run.smithi090.stdout:714.out 2023-06-09T04:46:06.832 INFO:teuthology.orchestra.run.smithi090.stdout:715 2023-06-09T04:46:06.832 INFO:teuthology.orchestra.run.smithi090.stdout:715.out 2023-06-09T04:46:06.832 INFO:teuthology.orchestra.run.smithi090.stdout:716 2023-06-09T04:46:06.832 INFO:teuthology.orchestra.run.smithi090.stdout:716.out 2023-06-09T04:46:06.832 INFO:teuthology.orchestra.run.smithi090.stdout:717 2023-06-09T04:46:06.832 INFO:teuthology.orchestra.run.smithi090.stdout:717.out 2023-06-09T04:46:06.832 INFO:teuthology.orchestra.run.smithi090.stdout:718 2023-06-09T04:46:06.833 INFO:teuthology.orchestra.run.smithi090.stdout:718.out 2023-06-09T04:46:06.833 INFO:teuthology.orchestra.run.smithi090.stdout:719 2023-06-09T04:46:06.833 INFO:teuthology.orchestra.run.smithi090.stdout:719.out 2023-06-09T04:46:06.833 INFO:teuthology.orchestra.run.smithi090.stdout:720 2023-06-09T04:46:06.833 INFO:teuthology.orchestra.run.smithi090.stdout:720.out 2023-06-09T04:46:06.833 INFO:teuthology.orchestra.run.smithi090.stdout:721 2023-06-09T04:46:06.833 INFO:teuthology.orchestra.run.smithi090.stdout:721.out 2023-06-09T04:46:06.833 INFO:teuthology.orchestra.run.smithi090.stdout:722 2023-06-09T04:46:06.834 INFO:teuthology.orchestra.run.smithi090.stdout:722.out 2023-06-09T04:46:06.834 INFO:teuthology.orchestra.run.smithi090.stdout:723 2023-06-09T04:46:06.834 INFO:teuthology.orchestra.run.smithi090.stdout:723.out 2023-06-09T04:46:06.834 INFO:teuthology.orchestra.run.smithi090.stdout:724 2023-06-09T04:46:06.834 INFO:teuthology.orchestra.run.smithi090.stdout:724.out 2023-06-09T04:46:06.834 INFO:teuthology.orchestra.run.smithi090.stdout:725 2023-06-09T04:46:06.834 INFO:teuthology.orchestra.run.smithi090.stdout:725.out 2023-06-09T04:46:06.834 INFO:teuthology.orchestra.run.smithi090.stdout:726 2023-06-09T04:46:06.835 INFO:teuthology.orchestra.run.smithi090.stdout:726.out 2023-06-09T04:46:06.835 INFO:teuthology.orchestra.run.smithi090.stdout:727 2023-06-09T04:46:06.835 INFO:teuthology.orchestra.run.smithi090.stdout:727.out 2023-06-09T04:46:06.835 INFO:teuthology.orchestra.run.smithi090.stdout:group.list 2023-06-09T04:46:06.835 INFO:teuthology.orchestra.run.smithi090.stdout:Makefile 2023-06-09T04:46:06.836 DEBUG:teuthology.orchestra.run.smithi090:> (cd /tmp/tmp.jICg1BPnIbxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/001) 2023-06-09T04:46:07.615 INFO:teuthology.orchestra.run.smithi090.stdout:FSTYP -- ceph 2023-06-09T04:46:07.636 INFO:teuthology.orchestra.run.smithi090.stdout:PLATFORM -- Linux/x86_64 smithi090 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T04:46:07.639 INFO:teuthology.orchestra.run.smithi090.stdout:MKFS_OPTIONS -- 172.21.15.90:6789:/scratch 2023-06-09T04:46:07.643 INFO:teuthology.orchestra.run.smithi090.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBSrYJkdxJcFhAA3pMTvAiq3IjuROLw5ndprg== 172.21.15.90:6789:/scratch /tmp/tmp.dXSIBxNemoscratch 2023-06-09T04:46:07.644 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:46:19.108 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:46:19.112 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:46:19.938 INFO:teuthology.orchestra.run.smithi090.stdout:generic/001 12s 2023-06-09T04:46:19.966 INFO:teuthology.orchestra.run.smithi090.stdout:Ran: generic/001 2023-06-09T04:46:19.966 INFO:teuthology.orchestra.run.smithi090.stdout:Passed all 1 tests 2023-06-09T04:46:19.977 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:46:20.333 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:46:20.333 DEBUG:teuthology.orchestra.run.smithi090:> (cd /tmp/tmp.jICg1BPnIbxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/002) 2023-06-09T04:46:21.109 INFO:teuthology.orchestra.run.smithi090.stdout:FSTYP -- ceph 2023-06-09T04:46:21.128 INFO:teuthology.orchestra.run.smithi090.stdout:PLATFORM -- Linux/x86_64 smithi090 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T04:46:21.131 INFO:teuthology.orchestra.run.smithi090.stdout:MKFS_OPTIONS -- 172.21.15.90:6789:/scratch 2023-06-09T04:46:21.136 INFO:teuthology.orchestra.run.smithi090.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBSrYJkdxJcFhAA3pMTvAiq3IjuROLw5ndprg== 172.21.15.90:6789:/scratch /tmp/tmp.dXSIBxNemoscratch 2023-06-09T04:46:21.136 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:46:22.725 INFO:teuthology.orchestra.run.smithi090.stdout:generic/002 1s 2023-06-09T04:46:22.754 INFO:teuthology.orchestra.run.smithi090.stdout:Ran: generic/002 2023-06-09T04:46:22.754 INFO:teuthology.orchestra.run.smithi090.stdout:Passed all 1 tests 2023-06-09T04:46:22.767 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:46:22.903 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:46:22.903 DEBUG:teuthology.orchestra.run.smithi090:> (cd /tmp/tmp.jICg1BPnIbxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/003) 2023-06-09T04:46:23.612 INFO:teuthology.orchestra.run.smithi090.stdout:FSTYP -- ceph 2023-06-09T04:46:23.632 INFO:teuthology.orchestra.run.smithi090.stdout:PLATFORM -- Linux/x86_64 smithi090 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T04:46:23.635 INFO:teuthology.orchestra.run.smithi090.stdout:MKFS_OPTIONS -- 172.21.15.90:6789:/scratch 2023-06-09T04:46:23.641 INFO:teuthology.orchestra.run.smithi090.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBSrYJkdxJcFhAA3pMTvAiq3IjuROLw5ndprg== 172.21.15.90:6789:/scratch /tmp/tmp.dXSIBxNemoscratch 2023-06-09T04:46:23.641 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:46:24.555 INFO:teuthology.orchestra.run.smithi090.stdout:generic/003 [not run] atime not maintained by ceph 2023-06-09T04:46:24.575 INFO:teuthology.orchestra.run.smithi090.stdout:Ran: generic/003 2023-06-09T04:46:24.576 INFO:teuthology.orchestra.run.smithi090.stdout:Not run: generic/003 2023-06-09T04:46:24.576 INFO:teuthology.orchestra.run.smithi090.stdout:Passed all 1 tests 2023-06-09T04:46:24.589 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:46:24.663 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:46:24.664 DEBUG:teuthology.orchestra.run.smithi090:> (cd /tmp/tmp.jICg1BPnIbxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/004) 2023-06-09T04:46:25.388 INFO:teuthology.orchestra.run.smithi090.stdout:FSTYP -- ceph 2023-06-09T04:46:25.411 INFO:teuthology.orchestra.run.smithi090.stdout:PLATFORM -- Linux/x86_64 smithi090 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T04:46:25.414 INFO:teuthology.orchestra.run.smithi090.stdout:MKFS_OPTIONS -- 172.21.15.90:6789:/scratch 2023-06-09T04:46:25.419 INFO:teuthology.orchestra.run.smithi090.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBSrYJkdxJcFhAA3pMTvAiq3IjuROLw5ndprg== 172.21.15.90:6789:/scratch /tmp/tmp.dXSIBxNemoscratch 2023-06-09T04:46:25.419 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:46:26.374 INFO:teuthology.orchestra.run.smithi090.stdout:generic/004 [not run] O_TMPFILE is not supported 2023-06-09T04:46:26.394 INFO:teuthology.orchestra.run.smithi090.stdout:Ran: generic/004 2023-06-09T04:46:26.394 INFO:teuthology.orchestra.run.smithi090.stdout:Not run: generic/004 2023-06-09T04:46:26.394 INFO:teuthology.orchestra.run.smithi090.stdout:Passed all 1 tests 2023-06-09T04:46:26.408 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:46:26.495 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:46:26.495 DEBUG:teuthology.orchestra.run.smithi090:> (cd /tmp/tmp.jICg1BPnIbxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/005) 2023-06-09T04:46:27.222 INFO:teuthology.orchestra.run.smithi090.stdout:FSTYP -- ceph 2023-06-09T04:46:27.247 INFO:teuthology.orchestra.run.smithi090.stdout:PLATFORM -- Linux/x86_64 smithi090 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T04:46:27.249 INFO:teuthology.orchestra.run.smithi090.stdout:MKFS_OPTIONS -- 172.21.15.90:6789:/scratch 2023-06-09T04:46:27.254 INFO:teuthology.orchestra.run.smithi090.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBSrYJkdxJcFhAA3pMTvAiq3IjuROLw5ndprg== 172.21.15.90:6789:/scratch /tmp/tmp.dXSIBxNemoscratch 2023-06-09T04:46:27.254 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:46:28.635 INFO:teuthology.orchestra.run.smithi090.stdout:generic/005 1s 2023-06-09T04:46:28.662 INFO:teuthology.orchestra.run.smithi090.stdout:Ran: generic/005 2023-06-09T04:46:28.662 INFO:teuthology.orchestra.run.smithi090.stdout:Passed all 1 tests 2023-06-09T04:46:28.674 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:46:28.810 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:46:28.810 DEBUG:teuthology.orchestra.run.smithi090:> (cd /tmp/tmp.jICg1BPnIbxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/006) 2023-06-09T04:46:29.527 INFO:teuthology.orchestra.run.smithi090.stdout:FSTYP -- ceph 2023-06-09T04:46:29.546 INFO:teuthology.orchestra.run.smithi090.stdout:PLATFORM -- Linux/x86_64 smithi090 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T04:46:29.550 INFO:teuthology.orchestra.run.smithi090.stdout:MKFS_OPTIONS -- 172.21.15.90:6789:/scratch 2023-06-09T04:46:29.556 INFO:teuthology.orchestra.run.smithi090.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBSrYJkdxJcFhAA3pMTvAiq3IjuROLw5ndprg== 172.21.15.90:6789:/scratch /tmp/tmp.dXSIBxNemoscratch 2023-06-09T04:46:29.556 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:46:49.236 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:46:49.241 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:46:55.424 INFO:teuthology.orchestra.run.smithi090.stdout:generic/006 26s 2023-06-09T04:46:57.982 INFO:teuthology.orchestra.run.smithi090.stdout:Ran: generic/006 2023-06-09T04:46:57.982 INFO:teuthology.orchestra.run.smithi090.stdout:Passed all 1 tests 2023-06-09T04:46:57.994 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:46:58.138 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:46:58.139 DEBUG:teuthology.orchestra.run.smithi090:> (cd /tmp/tmp.jICg1BPnIbxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/007) 2023-06-09T04:46:58.806 INFO:teuthology.orchestra.run.smithi090.stdout:FSTYP -- ceph 2023-06-09T04:46:58.826 INFO:teuthology.orchestra.run.smithi090.stdout:PLATFORM -- Linux/x86_64 smithi090 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T04:46:58.829 INFO:teuthology.orchestra.run.smithi090.stdout:MKFS_OPTIONS -- 172.21.15.90:6789:/scratch 2023-06-09T04:46:58.835 INFO:teuthology.orchestra.run.smithi090.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBSrYJkdxJcFhAA3pMTvAiq3IjuROLw5ndprg== 172.21.15.90:6789:/scratch /tmp/tmp.dXSIBxNemoscratch 2023-06-09T04:46:58.835 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:47:22.890 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:47:22.895 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:47:52.966 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:47:52.972 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:47:57.306 INFO:teuthology.orchestra.run.smithi090.stdout:generic/007 58s 2023-06-09T04:47:57.329 INFO:teuthology.orchestra.run.smithi090.stdout:Ran: generic/007 2023-06-09T04:47:57.330 INFO:teuthology.orchestra.run.smithi090.stdout:Passed all 1 tests 2023-06-09T04:47:57.342 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:47:57.476 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:47:57.476 DEBUG:teuthology.orchestra.run.smithi090:> (cd /tmp/tmp.jICg1BPnIbxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/008) 2023-06-09T04:47:58.787 INFO:teuthology.orchestra.run.smithi090.stdout:FSTYP -- ceph 2023-06-09T04:47:58.804 INFO:teuthology.orchestra.run.smithi090.stdout:PLATFORM -- Linux/x86_64 smithi090 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T04:47:58.806 INFO:teuthology.orchestra.run.smithi090.stdout:MKFS_OPTIONS -- 172.21.15.90:6789:/scratch 2023-06-09T04:47:58.810 INFO:teuthology.orchestra.run.smithi090.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBSrYJkdxJcFhAA3pMTvAiq3IjuROLw5ndprg== 172.21.15.90:6789:/scratch /tmp/tmp.dXSIBxNemoscratch 2023-06-09T04:47:58.811 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:47:59.773 INFO:teuthology.orchestra.run.smithi090.stdout:generic/008 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-06-09T04:47:59.792 INFO:teuthology.orchestra.run.smithi090.stdout:Ran: generic/008 2023-06-09T04:47:59.792 INFO:teuthology.orchestra.run.smithi090.stdout:Not run: generic/008 2023-06-09T04:47:59.792 INFO:teuthology.orchestra.run.smithi090.stdout:Passed all 1 tests 2023-06-09T04:47:59.803 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:47:59.887 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:47:59.888 DEBUG:teuthology.orchestra.run.smithi090:> (cd /tmp/tmp.jICg1BPnIbxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/009) 2023-06-09T04:48:00.563 INFO:teuthology.orchestra.run.smithi090.stdout:FSTYP -- ceph 2023-06-09T04:48:00.586 INFO:teuthology.orchestra.run.smithi090.stdout:PLATFORM -- Linux/x86_64 smithi090 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T04:48:00.588 INFO:teuthology.orchestra.run.smithi090.stdout:MKFS_OPTIONS -- 172.21.15.90:6789:/scratch 2023-06-09T04:48:00.592 INFO:teuthology.orchestra.run.smithi090.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBSrYJkdxJcFhAA3pMTvAiq3IjuROLw5ndprg== 172.21.15.90:6789:/scratch /tmp/tmp.dXSIBxNemoscratch 2023-06-09T04:48:00.592 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:48:01.565 INFO:teuthology.orchestra.run.smithi090.stdout:generic/009 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-06-09T04:48:01.583 INFO:teuthology.orchestra.run.smithi090.stdout:Ran: generic/009 2023-06-09T04:48:01.583 INFO:teuthology.orchestra.run.smithi090.stdout:Not run: generic/009 2023-06-09T04:48:01.583 INFO:teuthology.orchestra.run.smithi090.stdout:Passed all 1 tests 2023-06-09T04:48:01.594 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:48:01.692 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:48:01.693 DEBUG:teuthology.orchestra.run.smithi090:> (cd /tmp/tmp.jICg1BPnIbxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/010) 2023-06-09T04:48:02.380 INFO:teuthology.orchestra.run.smithi090.stdout:FSTYP -- ceph 2023-06-09T04:48:02.401 INFO:teuthology.orchestra.run.smithi090.stdout:PLATFORM -- Linux/x86_64 smithi090 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T04:48:02.403 INFO:teuthology.orchestra.run.smithi090.stdout:MKFS_OPTIONS -- 172.21.15.90:6789:/scratch 2023-06-09T04:48:02.408 INFO:teuthology.orchestra.run.smithi090.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBSrYJkdxJcFhAA3pMTvAiq3IjuROLw5ndprg== 172.21.15.90:6789:/scratch /tmp/tmp.dXSIBxNemoscratch 2023-06-09T04:48:02.409 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:48:03.491 INFO:teuthology.orchestra.run.smithi090.stdout:generic/010 [not run] /tmp/tmp.jICg1BPnIbxfstests-dev/src/dbtest not built 2023-06-09T04:48:03.509 INFO:teuthology.orchestra.run.smithi090.stdout:Ran: generic/010 2023-06-09T04:48:03.509 INFO:teuthology.orchestra.run.smithi090.stdout:Not run: generic/010 2023-06-09T04:48:03.509 INFO:teuthology.orchestra.run.smithi090.stdout:Passed all 1 tests 2023-06-09T04:48:03.523 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:48:03.623 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:48:03.624 DEBUG:teuthology.orchestra.run.smithi090:> (cd /tmp/tmp.jICg1BPnIbxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/011) 2023-06-09T04:48:04.358 INFO:teuthology.orchestra.run.smithi090.stdout:FSTYP -- ceph 2023-06-09T04:48:04.379 INFO:teuthology.orchestra.run.smithi090.stdout:PLATFORM -- Linux/x86_64 smithi090 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T04:48:04.382 INFO:teuthology.orchestra.run.smithi090.stdout:MKFS_OPTIONS -- 172.21.15.90:6789:/scratch 2023-06-09T04:48:04.388 INFO:teuthology.orchestra.run.smithi090.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBSrYJkdxJcFhAA3pMTvAiq3IjuROLw5ndprg== 172.21.15.90:6789:/scratch /tmp/tmp.dXSIBxNemoscratch 2023-06-09T04:48:04.388 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:48:23.317 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:48:23.322 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:48:47.904 INFO:teuthology.orchestra.run.smithi090.stdout:generic/011 43s 2023-06-09T04:48:47.930 INFO:teuthology.orchestra.run.smithi090.stdout:Ran: generic/011 2023-06-09T04:48:47.931 INFO:teuthology.orchestra.run.smithi090.stdout:Passed all 1 tests 2023-06-09T04:48:47.942 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:48:48.094 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:48:48.094 DEBUG:teuthology.orchestra.run.smithi090:> (cd /tmp/tmp.jICg1BPnIbxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/012) 2023-06-09T04:48:48.826 INFO:teuthology.orchestra.run.smithi090.stdout:FSTYP -- ceph 2023-06-09T04:48:48.849 INFO:teuthology.orchestra.run.smithi090.stdout:PLATFORM -- Linux/x86_64 smithi090 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T04:48:48.853 INFO:teuthology.orchestra.run.smithi090.stdout:MKFS_OPTIONS -- 172.21.15.90:6789:/scratch 2023-06-09T04:48:48.858 INFO:teuthology.orchestra.run.smithi090.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBSrYJkdxJcFhAA3pMTvAiq3IjuROLw5ndprg== 172.21.15.90:6789:/scratch /tmp/tmp.dXSIBxNemoscratch 2023-06-09T04:48:48.858 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:48:49.991 INFO:teuthology.orchestra.run.smithi090.stdout:generic/012 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-09T04:48:50.009 INFO:teuthology.orchestra.run.smithi090.stdout:Ran: generic/012 2023-06-09T04:48:50.010 INFO:teuthology.orchestra.run.smithi090.stdout:Not run: generic/012 2023-06-09T04:48:50.010 INFO:teuthology.orchestra.run.smithi090.stdout:Passed all 1 tests 2023-06-09T04:48:50.021 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:48:50.130 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:48:50.131 DEBUG:teuthology.orchestra.run.smithi090:> (cd /tmp/tmp.jICg1BPnIbxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/013) 2023-06-09T04:48:50.844 INFO:teuthology.orchestra.run.smithi090.stdout:FSTYP -- ceph 2023-06-09T04:48:50.866 INFO:teuthology.orchestra.run.smithi090.stdout:PLATFORM -- Linux/x86_64 smithi090 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T04:48:50.868 INFO:teuthology.orchestra.run.smithi090.stdout:MKFS_OPTIONS -- 172.21.15.90:6789:/scratch 2023-06-09T04:48:50.873 INFO:teuthology.orchestra.run.smithi090.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBSrYJkdxJcFhAA3pMTvAiq3IjuROLw5ndprg== 172.21.15.90:6789:/scratch /tmp/tmp.dXSIBxNemoscratch 2023-06-09T04:48:50.873 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:48:53.408 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:48:53.413 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:49:23.513 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:49:23.527 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:49:54.315 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:49:54.320 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:50:00.096 INFO:teuthology.orchestra.run.smithi090.stdout:generic/013 69s 2023-06-09T04:50:05.000 INFO:teuthology.orchestra.run.smithi090.stdout:Ran: generic/013 2023-06-09T04:50:05.000 INFO:teuthology.orchestra.run.smithi090.stdout:Passed all 1 tests 2023-06-09T04:50:05.009 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:50:05.120 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:50:05.120 DEBUG:teuthology.orchestra.run.smithi090:> (cd /tmp/tmp.jICg1BPnIbxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/014) 2023-06-09T04:50:05.805 INFO:teuthology.orchestra.run.smithi090.stdout:FSTYP -- ceph 2023-06-09T04:50:05.825 INFO:teuthology.orchestra.run.smithi090.stdout:PLATFORM -- Linux/x86_64 smithi090 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T04:50:05.828 INFO:teuthology.orchestra.run.smithi090.stdout:MKFS_OPTIONS -- 172.21.15.90:6789:/scratch 2023-06-09T04:50:05.838 INFO:teuthology.orchestra.run.smithi090.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBSrYJkdxJcFhAA3pMTvAiq3IjuROLw5ndprg== 172.21.15.90:6789:/scratch /tmp/tmp.dXSIBxNemoscratch 2023-06-09T04:50:05.838 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:50:24.404 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:50:24.409 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:50:54.488 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:50:54.493 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:51:24.568 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:51:24.573 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:51:54.649 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:51:54.654 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:52:24.754 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:52:24.760 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:52:54.844 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:52:54.850 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:53:24.932 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:53:24.936 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:53:55.035 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:53:55.040 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:54:25.143 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:54:25.148 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:54:55.434 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:54:55.439 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:55:09.394 INFO:teuthology.orchestra.run.smithi090.stdout:generic/014 303s 2023-06-09T04:55:10.012 INFO:teuthology.orchestra.run.smithi090.stdout:Ran: generic/014 2023-06-09T04:55:10.012 INFO:teuthology.orchestra.run.smithi090.stdout:Passed all 1 tests 2023-06-09T04:55:10.023 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:55:10.120 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:55:10.121 DEBUG:teuthology.orchestra.run.smithi090:> (cd /tmp/tmp.jICg1BPnIbxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/015) 2023-06-09T04:55:10.742 INFO:teuthology.orchestra.run.smithi090.stdout:FSTYP -- ceph 2023-06-09T04:55:10.760 INFO:teuthology.orchestra.run.smithi090.stdout:PLATFORM -- Linux/x86_64 smithi090 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T04:55:10.762 INFO:teuthology.orchestra.run.smithi090.stdout:MKFS_OPTIONS -- 172.21.15.90:6789:/scratch 2023-06-09T04:55:10.765 INFO:teuthology.orchestra.run.smithi090.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBSrYJkdxJcFhAA3pMTvAiq3IjuROLw5ndprg== 172.21.15.90:6789:/scratch /tmp/tmp.dXSIBxNemoscratch 2023-06-09T04:55:10.765 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:55:11.536 INFO:teuthology.orchestra.run.smithi090.stdout:generic/015 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-06-09T04:55:11.551 INFO:teuthology.orchestra.run.smithi090.stdout:Ran: generic/015 2023-06-09T04:55:11.551 INFO:teuthology.orchestra.run.smithi090.stdout:Not run: generic/015 2023-06-09T04:55:11.551 INFO:teuthology.orchestra.run.smithi090.stdout:Passed all 1 tests 2023-06-09T04:55:11.562 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:55:11.652 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:55:11.652 DEBUG:teuthology.orchestra.run.smithi090:> (cd /tmp/tmp.jICg1BPnIbxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/016) 2023-06-09T04:55:12.264 INFO:teuthology.orchestra.run.smithi090.stdout:FSTYP -- ceph 2023-06-09T04:55:12.284 INFO:teuthology.orchestra.run.smithi090.stdout:PLATFORM -- Linux/x86_64 smithi090 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T04:55:12.285 INFO:teuthology.orchestra.run.smithi090.stdout:MKFS_OPTIONS -- 172.21.15.90:6789:/scratch 2023-06-09T04:55:12.289 INFO:teuthology.orchestra.run.smithi090.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBSrYJkdxJcFhAA3pMTvAiq3IjuROLw5ndprg== 172.21.15.90:6789:/scratch /tmp/tmp.dXSIBxNemoscratch 2023-06-09T04:55:12.290 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:55:13.308 INFO:teuthology.orchestra.run.smithi090.stdout:generic/016 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-09T04:55:13.326 INFO:teuthology.orchestra.run.smithi090.stdout:Ran: generic/016 2023-06-09T04:55:13.326 INFO:teuthology.orchestra.run.smithi090.stdout:Not run: generic/016 2023-06-09T04:55:13.327 INFO:teuthology.orchestra.run.smithi090.stdout:Passed all 1 tests 2023-06-09T04:55:13.334 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:55:13.566 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:55:13.566 DEBUG:teuthology.orchestra.run.smithi090:> (cd /tmp/tmp.jICg1BPnIbxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/017) 2023-06-09T04:55:14.276 INFO:teuthology.orchestra.run.smithi090.stdout:FSTYP -- ceph 2023-06-09T04:55:14.296 INFO:teuthology.orchestra.run.smithi090.stdout:PLATFORM -- Linux/x86_64 smithi090 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T04:55:14.299 INFO:teuthology.orchestra.run.smithi090.stdout:MKFS_OPTIONS -- 172.21.15.90:6789:/scratch 2023-06-09T04:55:14.302 INFO:teuthology.orchestra.run.smithi090.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBSrYJkdxJcFhAA3pMTvAiq3IjuROLw5ndprg== 172.21.15.90:6789:/scratch /tmp/tmp.dXSIBxNemoscratch 2023-06-09T04:55:14.303 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:55:15.532 INFO:teuthology.orchestra.run.smithi090.stdout:generic/017 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-06-09T04:55:15.550 INFO:teuthology.orchestra.run.smithi090.stdout:Ran: generic/017 2023-06-09T04:55:15.550 INFO:teuthology.orchestra.run.smithi090.stdout:Not run: generic/017 2023-06-09T04:55:15.550 INFO:teuthology.orchestra.run.smithi090.stdout:Passed all 1 tests 2023-06-09T04:55:15.561 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:55:15.651 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:55:15.651 DEBUG:teuthology.orchestra.run.smithi090:> (cd /tmp/tmp.jICg1BPnIbxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/018) 2023-06-09T04:55:16.267 INFO:teuthology.orchestra.run.smithi090.stdout:FSTYP -- ceph 2023-06-09T04:55:16.284 INFO:teuthology.orchestra.run.smithi090.stdout:PLATFORM -- Linux/x86_64 smithi090 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T04:55:16.287 INFO:teuthology.orchestra.run.smithi090.stdout:MKFS_OPTIONS -- 172.21.15.90:6789:/scratch 2023-06-09T04:55:16.292 INFO:teuthology.orchestra.run.smithi090.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBSrYJkdxJcFhAA3pMTvAiq3IjuROLw5ndprg== 172.21.15.90:6789:/scratch /tmp/tmp.dXSIBxNemoscratch 2023-06-09T04:55:16.292 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:55:17.269 INFO:teuthology.orchestra.run.smithi090.stdout:generic/018 [not run] defragmentation not supported for fstype "ceph" 2023-06-09T04:55:17.325 INFO:teuthology.orchestra.run.smithi090.stdout:Ran: generic/018 2023-06-09T04:55:17.325 INFO:teuthology.orchestra.run.smithi090.stdout:Not run: generic/018 2023-06-09T04:55:17.325 INFO:teuthology.orchestra.run.smithi090.stdout:Passed all 1 tests 2023-06-09T04:55:17.334 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:55:17.413 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:55:17.413 DEBUG:teuthology.orchestra.run.smithi090:> (cd /tmp/tmp.jICg1BPnIbxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/019) 2023-06-09T04:55:18.071 INFO:teuthology.orchestra.run.smithi090.stdout:FSTYP -- ceph 2023-06-09T04:55:18.086 INFO:teuthology.orchestra.run.smithi090.stdout:PLATFORM -- Linux/x86_64 smithi090 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T04:55:18.089 INFO:teuthology.orchestra.run.smithi090.stdout:MKFS_OPTIONS -- 172.21.15.90:6789:/scratch 2023-06-09T04:55:18.093 INFO:teuthology.orchestra.run.smithi090.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBSrYJkdxJcFhAA3pMTvAiq3IjuROLw5ndprg== 172.21.15.90:6789:/scratch /tmp/tmp.dXSIBxNemoscratch 2023-06-09T04:55:18.093 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:55:18.839 INFO:teuthology.orchestra.run.smithi090.stdout:generic/019 [not run] require 172.21.15.90:6789:/scratch to be valid block disk 2023-06-09T04:55:18.855 INFO:teuthology.orchestra.run.smithi090.stdout:Ran: generic/019 2023-06-09T04:55:18.855 INFO:teuthology.orchestra.run.smithi090.stdout:Not run: generic/019 2023-06-09T04:55:18.855 INFO:teuthology.orchestra.run.smithi090.stdout:Passed all 1 tests 2023-06-09T04:55:18.863 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:55:18.956 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:55:18.956 DEBUG:teuthology.orchestra.run.smithi090:> (cd /tmp/tmp.jICg1BPnIbxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/020) 2023-06-09T04:55:19.589 INFO:teuthology.orchestra.run.smithi090.stdout:FSTYP -- ceph 2023-06-09T04:55:19.605 INFO:teuthology.orchestra.run.smithi090.stdout:PLATFORM -- Linux/x86_64 smithi090 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T04:55:19.607 INFO:teuthology.orchestra.run.smithi090.stdout:MKFS_OPTIONS -- 172.21.15.90:6789:/scratch 2023-06-09T04:55:19.612 INFO:teuthology.orchestra.run.smithi090.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBSrYJkdxJcFhAA3pMTvAiq3IjuROLw5ndprg== 172.21.15.90:6789:/scratch /tmp/tmp.dXSIBxNemoscratch 2023-06-09T04:55:19.612 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:55:25.587 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:55:25.591 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:55:28.669 INFO:teuthology.orchestra.run.smithi090.stdout:generic/020 9s 2023-06-09T04:55:28.690 INFO:teuthology.orchestra.run.smithi090.stdout:Ran: generic/020 2023-06-09T04:55:28.691 INFO:teuthology.orchestra.run.smithi090.stdout:Passed all 1 tests 2023-06-09T04:55:28.700 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:55:29.013 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:55:29.014 DEBUG:teuthology.orchestra.run.smithi090:> (cd /tmp/tmp.jICg1BPnIbxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/021) 2023-06-09T04:55:29.698 INFO:teuthology.orchestra.run.smithi090.stdout:FSTYP -- ceph 2023-06-09T04:55:29.715 INFO:teuthology.orchestra.run.smithi090.stdout:PLATFORM -- Linux/x86_64 smithi090 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T04:55:29.716 INFO:teuthology.orchestra.run.smithi090.stdout:MKFS_OPTIONS -- 172.21.15.90:6789:/scratch 2023-06-09T04:55:29.720 INFO:teuthology.orchestra.run.smithi090.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBSrYJkdxJcFhAA3pMTvAiq3IjuROLw5ndprg== 172.21.15.90:6789:/scratch /tmp/tmp.dXSIBxNemoscratch 2023-06-09T04:55:29.720 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:55:30.751 INFO:teuthology.orchestra.run.smithi090.stdout:generic/021 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-09T04:55:30.767 INFO:teuthology.orchestra.run.smithi090.stdout:Ran: generic/021 2023-06-09T04:55:30.767 INFO:teuthology.orchestra.run.smithi090.stdout:Not run: generic/021 2023-06-09T04:55:30.768 INFO:teuthology.orchestra.run.smithi090.stdout:Passed all 1 tests 2023-06-09T04:55:30.779 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:55:31.074 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:55:31.074 DEBUG:teuthology.orchestra.run.smithi090:> (cd /tmp/tmp.jICg1BPnIbxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/022) 2023-06-09T04:55:31.716 INFO:teuthology.orchestra.run.smithi090.stdout:FSTYP -- ceph 2023-06-09T04:55:31.734 INFO:teuthology.orchestra.run.smithi090.stdout:PLATFORM -- Linux/x86_64 smithi090 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T04:55:31.735 INFO:teuthology.orchestra.run.smithi090.stdout:MKFS_OPTIONS -- 172.21.15.90:6789:/scratch 2023-06-09T04:55:31.739 INFO:teuthology.orchestra.run.smithi090.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBSrYJkdxJcFhAA3pMTvAiq3IjuROLw5ndprg== 172.21.15.90:6789:/scratch /tmp/tmp.dXSIBxNemoscratch 2023-06-09T04:55:31.739 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:55:32.755 INFO:teuthology.orchestra.run.smithi090.stdout:generic/022 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-09T04:55:32.770 INFO:teuthology.orchestra.run.smithi090.stdout:Ran: generic/022 2023-06-09T04:55:32.770 INFO:teuthology.orchestra.run.smithi090.stdout:Not run: generic/022 2023-06-09T04:55:32.771 INFO:teuthology.orchestra.run.smithi090.stdout:Passed all 1 tests 2023-06-09T04:55:32.781 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:55:33.096 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:55:33.097 DEBUG:teuthology.orchestra.run.smithi090:> (cd /tmp/tmp.jICg1BPnIbxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/023) 2023-06-09T04:55:33.747 INFO:teuthology.orchestra.run.smithi090.stdout:FSTYP -- ceph 2023-06-09T04:55:33.763 INFO:teuthology.orchestra.run.smithi090.stdout:PLATFORM -- Linux/x86_64 smithi090 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T04:55:33.765 INFO:teuthology.orchestra.run.smithi090.stdout:MKFS_OPTIONS -- 172.21.15.90:6789:/scratch 2023-06-09T04:55:33.770 INFO:teuthology.orchestra.run.smithi090.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBSrYJkdxJcFhAA3pMTvAiq3IjuROLw5ndprg== 172.21.15.90:6789:/scratch /tmp/tmp.dXSIBxNemoscratch 2023-06-09T04:55:33.770 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:55:55.684 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:55:55.689 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:56:15.244 INFO:teuthology.orchestra.run.smithi090.stdout:generic/023 41s 2023-06-09T04:56:15.267 INFO:teuthology.orchestra.run.smithi090.stdout:Ran: generic/023 2023-06-09T04:56:15.267 INFO:teuthology.orchestra.run.smithi090.stdout:Passed all 1 tests 2023-06-09T04:56:15.276 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:56:15.566 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:56:15.567 DEBUG:teuthology.orchestra.run.smithi090:> (cd /tmp/tmp.jICg1BPnIbxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/024) 2023-06-09T04:56:16.287 INFO:teuthology.orchestra.run.smithi090.stdout:FSTYP -- ceph 2023-06-09T04:56:16.303 INFO:teuthology.orchestra.run.smithi090.stdout:PLATFORM -- Linux/x86_64 smithi090 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T04:56:16.305 INFO:teuthology.orchestra.run.smithi090.stdout:MKFS_OPTIONS -- 172.21.15.90:6789:/scratch 2023-06-09T04:56:16.310 INFO:teuthology.orchestra.run.smithi090.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBSrYJkdxJcFhAA3pMTvAiq3IjuROLw5ndprg== 172.21.15.90:6789:/scratch /tmp/tmp.dXSIBxNemoscratch 2023-06-09T04:56:16.310 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:56:17.115 INFO:teuthology.orchestra.run.smithi090.stdout:generic/024 [not run] kernel doesn't support renameat2 syscall 2023-06-09T04:56:17.131 INFO:teuthology.orchestra.run.smithi090.stdout:Ran: generic/024 2023-06-09T04:56:17.131 INFO:teuthology.orchestra.run.smithi090.stdout:Not run: generic/024 2023-06-09T04:56:17.131 INFO:teuthology.orchestra.run.smithi090.stdout:Passed all 1 tests 2023-06-09T04:56:17.143 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:56:17.441 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:56:17.441 DEBUG:teuthology.orchestra.run.smithi090:> (cd /tmp/tmp.jICg1BPnIbxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/025) 2023-06-09T04:56:18.137 INFO:teuthology.orchestra.run.smithi090.stdout:FSTYP -- ceph 2023-06-09T04:56:18.155 INFO:teuthology.orchestra.run.smithi090.stdout:PLATFORM -- Linux/x86_64 smithi090 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T04:56:18.157 INFO:teuthology.orchestra.run.smithi090.stdout:MKFS_OPTIONS -- 172.21.15.90:6789:/scratch 2023-06-09T04:56:18.160 INFO:teuthology.orchestra.run.smithi090.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBSrYJkdxJcFhAA3pMTvAiq3IjuROLw5ndprg== 172.21.15.90:6789:/scratch /tmp/tmp.dXSIBxNemoscratch 2023-06-09T04:56:18.160 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:56:18.957 INFO:teuthology.orchestra.run.smithi090.stdout:generic/025 [not run] kernel doesn't support renameat2 syscall 2023-06-09T04:56:18.973 INFO:teuthology.orchestra.run.smithi090.stdout:Ran: generic/025 2023-06-09T04:56:18.973 INFO:teuthology.orchestra.run.smithi090.stdout:Not run: generic/025 2023-06-09T04:56:18.973 INFO:teuthology.orchestra.run.smithi090.stdout:Passed all 1 tests 2023-06-09T04:56:18.984 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:56:19.303 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:56:19.303 DEBUG:teuthology.orchestra.run.smithi090:> (cd /tmp/tmp.jICg1BPnIbxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/026) 2023-06-09T04:56:20.013 INFO:teuthology.orchestra.run.smithi090.stdout:FSTYP -- ceph 2023-06-09T04:56:20.030 INFO:teuthology.orchestra.run.smithi090.stdout:PLATFORM -- Linux/x86_64 smithi090 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T04:56:20.033 INFO:teuthology.orchestra.run.smithi090.stdout:MKFS_OPTIONS -- 172.21.15.90:6789:/scratch 2023-06-09T04:56:20.037 INFO:teuthology.orchestra.run.smithi090.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBSrYJkdxJcFhAA3pMTvAiq3IjuROLw5ndprg== 172.21.15.90:6789:/scratch /tmp/tmp.dXSIBxNemoscratch 2023-06-09T04:56:20.038 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:56:21.041 INFO:teuthology.orchestra.run.smithi090.stdout:generic/026 [not run] ceph does not define maximum ACL count 2023-06-09T04:56:21.063 INFO:teuthology.orchestra.run.smithi090.stdout:Ran: generic/026 2023-06-09T04:56:21.064 INFO:teuthology.orchestra.run.smithi090.stdout:Not run: generic/026 2023-06-09T04:56:21.064 INFO:teuthology.orchestra.run.smithi090.stdout:Passed all 1 tests 2023-06-09T04:56:21.076 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:56:21.178 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:56:21.178 DEBUG:teuthology.orchestra.run.smithi090:> (cd /tmp/tmp.jICg1BPnIbxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/027) 2023-06-09T04:56:21.908 INFO:teuthology.orchestra.run.smithi090.stdout:FSTYP -- ceph 2023-06-09T04:56:21.929 INFO:teuthology.orchestra.run.smithi090.stdout:PLATFORM -- Linux/x86_64 smithi090 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T04:56:21.933 INFO:teuthology.orchestra.run.smithi090.stdout:MKFS_OPTIONS -- 172.21.15.90:6789:/scratch 2023-06-09T04:56:21.939 INFO:teuthology.orchestra.run.smithi090.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBSrYJkdxJcFhAA3pMTvAiq3IjuROLw5ndprg== 172.21.15.90:6789:/scratch /tmp/tmp.dXSIBxNemoscratch 2023-06-09T04:56:21.939 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:56:22.804 INFO:teuthology.orchestra.run.smithi090.stdout:generic/027 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-06-09T04:56:22.821 INFO:teuthology.orchestra.run.smithi090.stdout:Ran: generic/027 2023-06-09T04:56:22.821 INFO:teuthology.orchestra.run.smithi090.stdout:Not run: generic/027 2023-06-09T04:56:22.821 INFO:teuthology.orchestra.run.smithi090.stdout:Passed all 1 tests 2023-06-09T04:56:22.832 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:56:22.909 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:56:22.910 DEBUG:teuthology.orchestra.run.smithi090:> (cd /tmp/tmp.jICg1BPnIbxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/028) 2023-06-09T04:56:23.584 INFO:teuthology.orchestra.run.smithi090.stdout:FSTYP -- ceph 2023-06-09T04:56:23.599 INFO:teuthology.orchestra.run.smithi090.stdout:PLATFORM -- Linux/x86_64 smithi090 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T04:56:23.602 INFO:teuthology.orchestra.run.smithi090.stdout:MKFS_OPTIONS -- 172.21.15.90:6789:/scratch 2023-06-09T04:56:23.609 INFO:teuthology.orchestra.run.smithi090.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBSrYJkdxJcFhAA3pMTvAiq3IjuROLw5ndprg== 172.21.15.90:6789:/scratch /tmp/tmp.dXSIBxNemoscratch 2023-06-09T04:56:23.609 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:56:25.799 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:56:25.803 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:56:29.506 INFO:teuthology.orchestra.run.smithi090.stdout:generic/028 6s 2023-06-09T04:56:29.531 INFO:teuthology.orchestra.run.smithi090.stdout:Ran: generic/028 2023-06-09T04:56:29.531 INFO:teuthology.orchestra.run.smithi090.stdout:Passed all 1 tests 2023-06-09T04:56:29.543 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:56:29.645 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:56:29.645 DEBUG:teuthology.orchestra.run.smithi090:> (cd /tmp/tmp.jICg1BPnIbxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/029) 2023-06-09T04:56:30.358 INFO:teuthology.orchestra.run.smithi090.stdout:FSTYP -- ceph 2023-06-09T04:56:30.378 INFO:teuthology.orchestra.run.smithi090.stdout:PLATFORM -- Linux/x86_64 smithi090 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T04:56:30.381 INFO:teuthology.orchestra.run.smithi090.stdout:MKFS_OPTIONS -- 172.21.15.90:6789:/scratch 2023-06-09T04:56:30.386 INFO:teuthology.orchestra.run.smithi090.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBSrYJkdxJcFhAA3pMTvAiq3IjuROLw5ndprg== 172.21.15.90:6789:/scratch /tmp/tmp.dXSIBxNemoscratch 2023-06-09T04:56:30.387 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:56:33.592 INFO:teuthology.orchestra.run.smithi090.stdout:generic/029 3s 2023-06-09T04:56:33.618 INFO:teuthology.orchestra.run.smithi090.stdout:Ran: generic/029 2023-06-09T04:56:33.619 INFO:teuthology.orchestra.run.smithi090.stdout:Passed all 1 tests 2023-06-09T04:56:33.632 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:56:33.673 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:56:33.674 DEBUG:teuthology.orchestra.run.smithi090:> (cd /tmp/tmp.jICg1BPnIbxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/030) 2023-06-09T04:56:34.423 INFO:teuthology.orchestra.run.smithi090.stdout:FSTYP -- ceph 2023-06-09T04:56:34.444 INFO:teuthology.orchestra.run.smithi090.stdout:PLATFORM -- Linux/x86_64 smithi090 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T04:56:34.447 INFO:teuthology.orchestra.run.smithi090.stdout:MKFS_OPTIONS -- 172.21.15.90:6789:/scratch 2023-06-09T04:56:34.454 INFO:teuthology.orchestra.run.smithi090.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBSrYJkdxJcFhAA3pMTvAiq3IjuROLw5ndprg== 172.21.15.90:6789:/scratch /tmp/tmp.dXSIBxNemoscratch 2023-06-09T04:56:34.454 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:56:37.143 INFO:teuthology.orchestra.run.smithi090.stdout:generic/030 3s 2023-06-09T04:56:37.172 INFO:teuthology.orchestra.run.smithi090.stdout:Ran: generic/030 2023-06-09T04:56:37.172 INFO:teuthology.orchestra.run.smithi090.stdout:Passed all 1 tests 2023-06-09T04:56:37.184 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:56:37.223 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:56:37.224 DEBUG:teuthology.orchestra.run.smithi090:> (cd /tmp/tmp.jICg1BPnIbxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/031) 2023-06-09T04:56:37.936 INFO:teuthology.orchestra.run.smithi090.stdout:FSTYP -- ceph 2023-06-09T04:56:37.956 INFO:teuthology.orchestra.run.smithi090.stdout:PLATFORM -- Linux/x86_64 smithi090 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T04:56:37.960 INFO:teuthology.orchestra.run.smithi090.stdout:MKFS_OPTIONS -- 172.21.15.90:6789:/scratch 2023-06-09T04:56:37.965 INFO:teuthology.orchestra.run.smithi090.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBSrYJkdxJcFhAA3pMTvAiq3IjuROLw5ndprg== 172.21.15.90:6789:/scratch /tmp/tmp.dXSIBxNemoscratch 2023-06-09T04:56:37.965 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:56:39.061 INFO:teuthology.orchestra.run.smithi090.stdout:generic/031 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2023-06-09T04:56:39.082 INFO:teuthology.orchestra.run.smithi090.stdout:Ran: generic/031 2023-06-09T04:56:39.082 INFO:teuthology.orchestra.run.smithi090.stdout:Not run: generic/031 2023-06-09T04:56:39.082 INFO:teuthology.orchestra.run.smithi090.stdout:Passed all 1 tests 2023-06-09T04:56:39.096 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:56:39.203 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:56:39.203 DEBUG:teuthology.orchestra.run.smithi090:> (cd /tmp/tmp.jICg1BPnIbxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/032) 2023-06-09T04:56:39.921 INFO:teuthology.orchestra.run.smithi090.stdout:FSTYP -- ceph 2023-06-09T04:56:39.942 INFO:teuthology.orchestra.run.smithi090.stdout:PLATFORM -- Linux/x86_64 smithi090 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T04:56:39.945 INFO:teuthology.orchestra.run.smithi090.stdout:MKFS_OPTIONS -- 172.21.15.90:6789:/scratch 2023-06-09T04:56:39.950 INFO:teuthology.orchestra.run.smithi090.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBSrYJkdxJcFhAA3pMTvAiq3IjuROLw5ndprg== 172.21.15.90:6789:/scratch /tmp/tmp.dXSIBxNemoscratch 2023-06-09T04:56:39.950 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:56:40.875 INFO:teuthology.orchestra.run.smithi090.stdout:generic/032 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-09T04:56:40.896 INFO:teuthology.orchestra.run.smithi090.stdout:Ran: generic/032 2023-06-09T04:56:40.896 INFO:teuthology.orchestra.run.smithi090.stdout:Not run: generic/032 2023-06-09T04:56:40.897 INFO:teuthology.orchestra.run.smithi090.stdout:Passed all 1 tests 2023-06-09T04:56:40.909 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:56:41.014 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:56:41.014 DEBUG:teuthology.orchestra.run.smithi090:> (cd /tmp/tmp.jICg1BPnIbxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/033) 2023-06-09T04:56:41.744 INFO:teuthology.orchestra.run.smithi090.stdout:FSTYP -- ceph 2023-06-09T04:56:41.766 INFO:teuthology.orchestra.run.smithi090.stdout:PLATFORM -- Linux/x86_64 smithi090 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T04:56:41.769 INFO:teuthology.orchestra.run.smithi090.stdout:MKFS_OPTIONS -- 172.21.15.90:6789:/scratch 2023-06-09T04:56:41.774 INFO:teuthology.orchestra.run.smithi090.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBSrYJkdxJcFhAA3pMTvAiq3IjuROLw5ndprg== 172.21.15.90:6789:/scratch /tmp/tmp.dXSIBxNemoscratch 2023-06-09T04:56:41.774 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:56:42.845 INFO:teuthology.orchestra.run.smithi090.stdout:generic/033 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-06-09T04:56:42.863 INFO:teuthology.orchestra.run.smithi090.stdout:Ran: generic/033 2023-06-09T04:56:42.863 INFO:teuthology.orchestra.run.smithi090.stdout:Not run: generic/033 2023-06-09T04:56:42.863 INFO:teuthology.orchestra.run.smithi090.stdout:Passed all 1 tests 2023-06-09T04:56:42.876 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:56:42.987 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:56:42.988 DEBUG:teuthology.orchestra.run.smithi090:> (cd /tmp/tmp.jICg1BPnIbxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/034) 2023-06-09T04:56:43.697 INFO:teuthology.orchestra.run.smithi090.stdout:FSTYP -- ceph 2023-06-09T04:56:43.719 INFO:teuthology.orchestra.run.smithi090.stdout:PLATFORM -- Linux/x86_64 smithi090 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T04:56:43.721 INFO:teuthology.orchestra.run.smithi090.stdout:MKFS_OPTIONS -- 172.21.15.90:6789:/scratch 2023-06-09T04:56:43.727 INFO:teuthology.orchestra.run.smithi090.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBSrYJkdxJcFhAA3pMTvAiq3IjuROLw5ndprg== 172.21.15.90:6789:/scratch /tmp/tmp.dXSIBxNemoscratch 2023-06-09T04:56:43.727 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:56:44.721 INFO:teuthology.orchestra.run.smithi090.stdout:generic/034 [not run] require 172.21.15.90:6789:/scratch to be valid block disk 2023-06-09T04:56:44.739 INFO:teuthology.orchestra.run.smithi090.stdout:Ran: generic/034 2023-06-09T04:56:44.740 INFO:teuthology.orchestra.run.smithi090.stdout:Not run: generic/034 2023-06-09T04:56:44.740 INFO:teuthology.orchestra.run.smithi090.stdout:Passed all 1 tests 2023-06-09T04:56:44.752 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:56:44.841 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:56:44.841 DEBUG:teuthology.orchestra.run.smithi090:> (cd /tmp/tmp.jICg1BPnIbxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/035) 2023-06-09T04:56:45.564 INFO:teuthology.orchestra.run.smithi090.stdout:FSTYP -- ceph 2023-06-09T04:56:45.585 INFO:teuthology.orchestra.run.smithi090.stdout:PLATFORM -- Linux/x86_64 smithi090 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T04:56:45.587 INFO:teuthology.orchestra.run.smithi090.stdout:MKFS_OPTIONS -- 172.21.15.90:6789:/scratch 2023-06-09T04:56:45.593 INFO:teuthology.orchestra.run.smithi090.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBSrYJkdxJcFhAA3pMTvAiq3IjuROLw5ndprg== 172.21.15.90:6789:/scratch /tmp/tmp.dXSIBxNemoscratch 2023-06-09T04:56:45.593 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:56:46.691 INFO:teuthology.orchestra.run.smithi090.stdout:generic/035 1s 2023-06-09T04:56:46.717 INFO:teuthology.orchestra.run.smithi090.stdout:Ran: generic/035 2023-06-09T04:56:46.718 INFO:teuthology.orchestra.run.smithi090.stdout:Passed all 1 tests 2023-06-09T04:56:46.729 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:56:47.070 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:56:47.070 DEBUG:teuthology.orchestra.run.smithi090:> (cd /tmp/tmp.jICg1BPnIbxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/036) 2023-06-09T04:56:47.764 INFO:teuthology.orchestra.run.smithi090.stdout:FSTYP -- ceph 2023-06-09T04:56:47.787 INFO:teuthology.orchestra.run.smithi090.stdout:PLATFORM -- Linux/x86_64 smithi090 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T04:56:47.791 INFO:teuthology.orchestra.run.smithi090.stdout:MKFS_OPTIONS -- 172.21.15.90:6789:/scratch 2023-06-09T04:56:47.797 INFO:teuthology.orchestra.run.smithi090.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBSrYJkdxJcFhAA3pMTvAiq3IjuROLw5ndprg== 172.21.15.90:6789:/scratch /tmp/tmp.dXSIBxNemoscratch 2023-06-09T04:56:47.797 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:56:55.964 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:56:55.970 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:56:59.044 INFO:teuthology.orchestra.run.smithi090.stdout:generic/036 11s 2023-06-09T04:56:59.073 INFO:teuthology.orchestra.run.smithi090.stdout:Ran: generic/036 2023-06-09T04:56:59.073 INFO:teuthology.orchestra.run.smithi090.stdout:Passed all 1 tests 2023-06-09T04:56:59.085 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:56:59.298 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:56:59.298 DEBUG:teuthology.orchestra.run.smithi090:> (cd /tmp/tmp.jICg1BPnIbxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/037) 2023-06-09T04:57:00.065 INFO:teuthology.orchestra.run.smithi090.stdout:FSTYP -- ceph 2023-06-09T04:57:00.084 INFO:teuthology.orchestra.run.smithi090.stdout:PLATFORM -- Linux/x86_64 smithi090 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T04:57:00.087 INFO:teuthology.orchestra.run.smithi090.stdout:MKFS_OPTIONS -- 172.21.15.90:6789:/scratch 2023-06-09T04:57:00.093 INFO:teuthology.orchestra.run.smithi090.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBSrYJkdxJcFhAA3pMTvAiq3IjuROLw5ndprg== 172.21.15.90:6789:/scratch /tmp/tmp.dXSIBxNemoscratch 2023-06-09T04:57:00.093 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:57:10.531 INFO:teuthology.orchestra.run.smithi090.stdout:generic/037 10s 2023-06-09T04:57:10.558 INFO:teuthology.orchestra.run.smithi090.stdout:Ran: generic/037 2023-06-09T04:57:10.558 INFO:teuthology.orchestra.run.smithi090.stdout:Passed all 1 tests 2023-06-09T04:57:10.569 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:57:10.607 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:57:10.608 DEBUG:teuthology.orchestra.run.smithi090:> (cd /tmp/tmp.jICg1BPnIbxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/038) 2023-06-09T04:57:11.339 INFO:teuthology.orchestra.run.smithi090.stdout:FSTYP -- ceph 2023-06-09T04:57:11.360 INFO:teuthology.orchestra.run.smithi090.stdout:PLATFORM -- Linux/x86_64 smithi090 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T04:57:11.363 INFO:teuthology.orchestra.run.smithi090.stdout:MKFS_OPTIONS -- 172.21.15.90:6789:/scratch 2023-06-09T04:57:11.369 INFO:teuthology.orchestra.run.smithi090.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBSrYJkdxJcFhAA3pMTvAiq3IjuROLw5ndprg== 172.21.15.90:6789:/scratch /tmp/tmp.dXSIBxNemoscratch 2023-06-09T04:57:11.369 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:57:12.325 INFO:teuthology.orchestra.run.smithi090.stdout:generic/038 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-09T04:57:12.347 INFO:teuthology.orchestra.run.smithi090.stdout:Ran: generic/038 2023-06-09T04:57:12.347 INFO:teuthology.orchestra.run.smithi090.stdout:Not run: generic/038 2023-06-09T04:57:12.347 INFO:teuthology.orchestra.run.smithi090.stdout:Passed all 1 tests 2023-06-09T04:57:12.360 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:57:12.441 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:57:12.442 DEBUG:teuthology.orchestra.run.smithi090:> (cd /tmp/tmp.jICg1BPnIbxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/039) 2023-06-09T04:57:13.152 INFO:teuthology.orchestra.run.smithi090.stdout:FSTYP -- ceph 2023-06-09T04:57:13.173 INFO:teuthology.orchestra.run.smithi090.stdout:PLATFORM -- Linux/x86_64 smithi090 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T04:57:13.175 INFO:teuthology.orchestra.run.smithi090.stdout:MKFS_OPTIONS -- 172.21.15.90:6789:/scratch 2023-06-09T04:57:13.180 INFO:teuthology.orchestra.run.smithi090.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBSrYJkdxJcFhAA3pMTvAiq3IjuROLw5ndprg== 172.21.15.90:6789:/scratch /tmp/tmp.dXSIBxNemoscratch 2023-06-09T04:57:13.181 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:57:14.130 INFO:teuthology.orchestra.run.smithi090.stdout:generic/039 [not run] require 172.21.15.90:6789:/scratch to be valid block disk 2023-06-09T04:57:14.147 INFO:teuthology.orchestra.run.smithi090.stdout:Ran: generic/039 2023-06-09T04:57:14.148 INFO:teuthology.orchestra.run.smithi090.stdout:Not run: generic/039 2023-06-09T04:57:14.148 INFO:teuthology.orchestra.run.smithi090.stdout:Passed all 1 tests 2023-06-09T04:57:14.160 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:57:14.255 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:57:14.255 DEBUG:teuthology.orchestra.run.smithi090:> (cd /tmp/tmp.jICg1BPnIbxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/040) 2023-06-09T04:57:14.992 INFO:teuthology.orchestra.run.smithi090.stdout:FSTYP -- ceph 2023-06-09T04:57:15.014 INFO:teuthology.orchestra.run.smithi090.stdout:PLATFORM -- Linux/x86_64 smithi090 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T04:57:15.017 INFO:teuthology.orchestra.run.smithi090.stdout:MKFS_OPTIONS -- 172.21.15.90:6789:/scratch 2023-06-09T04:57:15.023 INFO:teuthology.orchestra.run.smithi090.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBSrYJkdxJcFhAA3pMTvAiq3IjuROLw5ndprg== 172.21.15.90:6789:/scratch /tmp/tmp.dXSIBxNemoscratch 2023-06-09T04:57:15.023 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:57:16.010 INFO:teuthology.orchestra.run.smithi090.stdout:generic/040 [not run] require 172.21.15.90:6789:/scratch to be valid block disk 2023-06-09T04:57:16.031 INFO:teuthology.orchestra.run.smithi090.stdout:Ran: generic/040 2023-06-09T04:57:16.031 INFO:teuthology.orchestra.run.smithi090.stdout:Not run: generic/040 2023-06-09T04:57:16.031 INFO:teuthology.orchestra.run.smithi090.stdout:Passed all 1 tests 2023-06-09T04:57:16.045 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:57:16.150 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:57:16.151 DEBUG:teuthology.orchestra.run.smithi090:> (cd /tmp/tmp.jICg1BPnIbxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/041) 2023-06-09T04:57:16.857 INFO:teuthology.orchestra.run.smithi090.stdout:FSTYP -- ceph 2023-06-09T04:57:16.882 INFO:teuthology.orchestra.run.smithi090.stdout:PLATFORM -- Linux/x86_64 smithi090 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T04:57:16.884 INFO:teuthology.orchestra.run.smithi090.stdout:MKFS_OPTIONS -- 172.21.15.90:6789:/scratch 2023-06-09T04:57:16.890 INFO:teuthology.orchestra.run.smithi090.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBSrYJkdxJcFhAA3pMTvAiq3IjuROLw5ndprg== 172.21.15.90:6789:/scratch /tmp/tmp.dXSIBxNemoscratch 2023-06-09T04:57:16.890 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:57:17.896 INFO:teuthology.orchestra.run.smithi090.stdout:generic/041 [not run] require 172.21.15.90:6789:/scratch to be valid block disk 2023-06-09T04:57:17.917 INFO:teuthology.orchestra.run.smithi090.stdout:Ran: generic/041 2023-06-09T04:57:17.918 INFO:teuthology.orchestra.run.smithi090.stdout:Not run: generic/041 2023-06-09T04:57:17.918 INFO:teuthology.orchestra.run.smithi090.stdout:Passed all 1 tests 2023-06-09T04:57:17.929 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:57:18.006 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:57:18.007 DEBUG:teuthology.orchestra.run.smithi090:> (cd /tmp/tmp.jICg1BPnIbxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/042) 2023-06-09T04:57:18.724 INFO:teuthology.orchestra.run.smithi090.stdout:FSTYP -- ceph 2023-06-09T04:57:18.744 INFO:teuthology.orchestra.run.smithi090.stdout:PLATFORM -- Linux/x86_64 smithi090 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T04:57:18.747 INFO:teuthology.orchestra.run.smithi090.stdout:MKFS_OPTIONS -- 172.21.15.90:6789:/scratch 2023-06-09T04:57:18.753 INFO:teuthology.orchestra.run.smithi090.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBSrYJkdxJcFhAA3pMTvAiq3IjuROLw5ndprg== 172.21.15.90:6789:/scratch /tmp/tmp.dXSIBxNemoscratch 2023-06-09T04:57:18.754 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:57:19.883 INFO:teuthology.orchestra.run.smithi090.stdout:generic/042 [not run] ceph does not support shutdown 2023-06-09T04:57:19.940 INFO:teuthology.orchestra.run.smithi090.stdout:Ran: generic/042 2023-06-09T04:57:19.941 INFO:teuthology.orchestra.run.smithi090.stdout:Not run: generic/042 2023-06-09T04:57:19.941 INFO:teuthology.orchestra.run.smithi090.stdout:Passed all 1 tests 2023-06-09T04:57:19.953 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:57:20.042 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:57:20.042 DEBUG:teuthology.orchestra.run.smithi090:> (cd /tmp/tmp.jICg1BPnIbxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/043) 2023-06-09T04:57:20.765 INFO:teuthology.orchestra.run.smithi090.stdout:FSTYP -- ceph 2023-06-09T04:57:20.784 INFO:teuthology.orchestra.run.smithi090.stdout:PLATFORM -- Linux/x86_64 smithi090 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T04:57:20.787 INFO:teuthology.orchestra.run.smithi090.stdout:MKFS_OPTIONS -- 172.21.15.90:6789:/scratch 2023-06-09T04:57:20.793 INFO:teuthology.orchestra.run.smithi090.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBSrYJkdxJcFhAA3pMTvAiq3IjuROLw5ndprg== 172.21.15.90:6789:/scratch /tmp/tmp.dXSIBxNemoscratch 2023-06-09T04:57:20.793 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:57:21.985 INFO:teuthology.orchestra.run.smithi090.stdout:generic/043 [not run] ceph does not support shutdown 2023-06-09T04:57:22.087 INFO:teuthology.orchestra.run.smithi090.stdout:Ran: generic/043 2023-06-09T04:57:22.088 INFO:teuthology.orchestra.run.smithi090.stdout:Not run: generic/043 2023-06-09T04:57:22.088 INFO:teuthology.orchestra.run.smithi090.stdout:Passed all 1 tests 2023-06-09T04:57:22.098 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:57:22.186 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:57:22.186 DEBUG:teuthology.orchestra.run.smithi090:> (cd /tmp/tmp.jICg1BPnIbxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/044) 2023-06-09T04:57:22.902 INFO:teuthology.orchestra.run.smithi090.stdout:FSTYP -- ceph 2023-06-09T04:57:22.922 INFO:teuthology.orchestra.run.smithi090.stdout:PLATFORM -- Linux/x86_64 smithi090 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T04:57:22.925 INFO:teuthology.orchestra.run.smithi090.stdout:MKFS_OPTIONS -- 172.21.15.90:6789:/scratch 2023-06-09T04:57:22.930 INFO:teuthology.orchestra.run.smithi090.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBSrYJkdxJcFhAA3pMTvAiq3IjuROLw5ndprg== 172.21.15.90:6789:/scratch /tmp/tmp.dXSIBxNemoscratch 2023-06-09T04:57:22.930 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:57:24.067 INFO:teuthology.orchestra.run.smithi090.stdout:generic/044 [not run] ceph does not support shutdown 2023-06-09T04:57:24.155 INFO:teuthology.orchestra.run.smithi090.stdout:Ran: generic/044 2023-06-09T04:57:24.156 INFO:teuthology.orchestra.run.smithi090.stdout:Not run: generic/044 2023-06-09T04:57:24.156 INFO:teuthology.orchestra.run.smithi090.stdout:Passed all 1 tests 2023-06-09T04:57:24.169 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:57:24.257 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:57:24.258 DEBUG:teuthology.orchestra.run.smithi090:> (cd /tmp/tmp.jICg1BPnIbxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/045) 2023-06-09T04:57:24.960 INFO:teuthology.orchestra.run.smithi090.stdout:FSTYP -- ceph 2023-06-09T04:57:24.983 INFO:teuthology.orchestra.run.smithi090.stdout:PLATFORM -- Linux/x86_64 smithi090 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T04:57:24.986 INFO:teuthology.orchestra.run.smithi090.stdout:MKFS_OPTIONS -- 172.21.15.90:6789:/scratch 2023-06-09T04:57:24.991 INFO:teuthology.orchestra.run.smithi090.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBSrYJkdxJcFhAA3pMTvAiq3IjuROLw5ndprg== 172.21.15.90:6789:/scratch /tmp/tmp.dXSIBxNemoscratch 2023-06-09T04:57:24.992 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:57:26.085 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:57:26.089 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:57:26.129 INFO:teuthology.orchestra.run.smithi090.stdout:generic/045 [not run] ceph does not support shutdown 2023-06-09T04:57:26.202 INFO:teuthology.orchestra.run.smithi090.stdout:Ran: generic/045 2023-06-09T04:57:26.203 INFO:teuthology.orchestra.run.smithi090.stdout:Not run: generic/045 2023-06-09T04:57:26.203 INFO:teuthology.orchestra.run.smithi090.stdout:Passed all 1 tests 2023-06-09T04:57:26.215 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:57:26.327 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:57:26.328 DEBUG:teuthology.orchestra.run.smithi090:> (cd /tmp/tmp.jICg1BPnIbxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/046) 2023-06-09T04:57:27.069 INFO:teuthology.orchestra.run.smithi090.stdout:FSTYP -- ceph 2023-06-09T04:57:27.092 INFO:teuthology.orchestra.run.smithi090.stdout:PLATFORM -- Linux/x86_64 smithi090 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T04:57:27.094 INFO:teuthology.orchestra.run.smithi090.stdout:MKFS_OPTIONS -- 172.21.15.90:6789:/scratch 2023-06-09T04:57:27.100 INFO:teuthology.orchestra.run.smithi090.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBSrYJkdxJcFhAA3pMTvAiq3IjuROLw5ndprg== 172.21.15.90:6789:/scratch /tmp/tmp.dXSIBxNemoscratch 2023-06-09T04:57:27.100 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:57:28.245 INFO:teuthology.orchestra.run.smithi090.stdout:generic/046 [not run] ceph does not support shutdown 2023-06-09T04:57:28.307 INFO:teuthology.orchestra.run.smithi090.stdout:Ran: generic/046 2023-06-09T04:57:28.307 INFO:teuthology.orchestra.run.smithi090.stdout:Not run: generic/046 2023-06-09T04:57:28.307 INFO:teuthology.orchestra.run.smithi090.stdout:Passed all 1 tests 2023-06-09T04:57:28.322 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:57:28.403 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:57:28.404 DEBUG:teuthology.orchestra.run.smithi090:> (cd /tmp/tmp.jICg1BPnIbxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/047) 2023-06-09T04:57:29.137 INFO:teuthology.orchestra.run.smithi090.stdout:FSTYP -- ceph 2023-06-09T04:57:29.159 INFO:teuthology.orchestra.run.smithi090.stdout:PLATFORM -- Linux/x86_64 smithi090 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T04:57:29.161 INFO:teuthology.orchestra.run.smithi090.stdout:MKFS_OPTIONS -- 172.21.15.90:6789:/scratch 2023-06-09T04:57:29.167 INFO:teuthology.orchestra.run.smithi090.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBSrYJkdxJcFhAA3pMTvAiq3IjuROLw5ndprg== 172.21.15.90:6789:/scratch /tmp/tmp.dXSIBxNemoscratch 2023-06-09T04:57:29.167 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:57:30.294 INFO:teuthology.orchestra.run.smithi090.stdout:generic/047 [not run] ceph does not support shutdown 2023-06-09T04:57:30.367 INFO:teuthology.orchestra.run.smithi090.stdout:Ran: generic/047 2023-06-09T04:57:30.367 INFO:teuthology.orchestra.run.smithi090.stdout:Not run: generic/047 2023-06-09T04:57:30.367 INFO:teuthology.orchestra.run.smithi090.stdout:Passed all 1 tests 2023-06-09T04:57:30.381 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:57:30.464 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:57:30.464 DEBUG:teuthology.orchestra.run.smithi090:> (cd /tmp/tmp.jICg1BPnIbxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/048) 2023-06-09T04:57:31.185 INFO:teuthology.orchestra.run.smithi090.stdout:FSTYP -- ceph 2023-06-09T04:57:31.209 INFO:teuthology.orchestra.run.smithi090.stdout:PLATFORM -- Linux/x86_64 smithi090 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T04:57:31.211 INFO:teuthology.orchestra.run.smithi090.stdout:MKFS_OPTIONS -- 172.21.15.90:6789:/scratch 2023-06-09T04:57:31.217 INFO:teuthology.orchestra.run.smithi090.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBSrYJkdxJcFhAA3pMTvAiq3IjuROLw5ndprg== 172.21.15.90:6789:/scratch /tmp/tmp.dXSIBxNemoscratch 2023-06-09T04:57:31.217 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:57:32.363 INFO:teuthology.orchestra.run.smithi090.stdout:generic/048 [not run] ceph does not support shutdown 2023-06-09T04:57:32.436 INFO:teuthology.orchestra.run.smithi090.stdout:Ran: generic/048 2023-06-09T04:57:32.437 INFO:teuthology.orchestra.run.smithi090.stdout:Not run: generic/048 2023-06-09T04:57:32.437 INFO:teuthology.orchestra.run.smithi090.stdout:Passed all 1 tests 2023-06-09T04:57:32.450 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:57:32.533 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:57:32.533 DEBUG:teuthology.orchestra.run.smithi090:> (cd /tmp/tmp.jICg1BPnIbxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/049) 2023-06-09T04:57:33.216 INFO:teuthology.orchestra.run.smithi090.stdout:FSTYP -- ceph 2023-06-09T04:57:33.234 INFO:teuthology.orchestra.run.smithi090.stdout:PLATFORM -- Linux/x86_64 smithi090 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T04:57:33.236 INFO:teuthology.orchestra.run.smithi090.stdout:MKFS_OPTIONS -- 172.21.15.90:6789:/scratch 2023-06-09T04:57:33.241 INFO:teuthology.orchestra.run.smithi090.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBSrYJkdxJcFhAA3pMTvAiq3IjuROLw5ndprg== 172.21.15.90:6789:/scratch /tmp/tmp.dXSIBxNemoscratch 2023-06-09T04:57:33.241 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:57:34.392 INFO:teuthology.orchestra.run.smithi090.stdout:generic/049 [not run] ceph does not support shutdown 2023-06-09T04:57:34.461 INFO:teuthology.orchestra.run.smithi090.stdout:Ran: generic/049 2023-06-09T04:57:34.461 INFO:teuthology.orchestra.run.smithi090.stdout:Not run: generic/049 2023-06-09T04:57:34.462 INFO:teuthology.orchestra.run.smithi090.stdout:Passed all 1 tests 2023-06-09T04:57:34.473 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:57:34.544 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:57:34.544 DEBUG:teuthology.orchestra.run.smithi090:> (cd /tmp/tmp.jICg1BPnIbxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/050) 2023-06-09T04:57:35.275 INFO:teuthology.orchestra.run.smithi090.stdout:FSTYP -- ceph 2023-06-09T04:57:35.296 INFO:teuthology.orchestra.run.smithi090.stdout:PLATFORM -- Linux/x86_64 smithi090 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T04:57:35.298 INFO:teuthology.orchestra.run.smithi090.stdout:MKFS_OPTIONS -- 172.21.15.90:6789:/scratch 2023-06-09T04:57:35.304 INFO:teuthology.orchestra.run.smithi090.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBSrYJkdxJcFhAA3pMTvAiq3IjuROLw5ndprg== 172.21.15.90:6789:/scratch /tmp/tmp.dXSIBxNemoscratch 2023-06-09T04:57:35.304 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:57:36.442 INFO:teuthology.orchestra.run.smithi090.stdout:generic/050 [not run] ceph does not support shutdown 2023-06-09T04:57:36.522 INFO:teuthology.orchestra.run.smithi090.stdout:Ran: generic/050 2023-06-09T04:57:36.522 INFO:teuthology.orchestra.run.smithi090.stdout:Not run: generic/050 2023-06-09T04:57:36.523 INFO:teuthology.orchestra.run.smithi090.stdout:Passed all 1 tests 2023-06-09T04:57:36.536 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:57:36.653 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:57:36.654 DEBUG:teuthology.orchestra.run.smithi090:> (cd /tmp/tmp.jICg1BPnIbxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/051) 2023-06-09T04:57:37.377 INFO:teuthology.orchestra.run.smithi090.stdout:FSTYP -- ceph 2023-06-09T04:57:37.399 INFO:teuthology.orchestra.run.smithi090.stdout:PLATFORM -- Linux/x86_64 smithi090 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T04:57:37.402 INFO:teuthology.orchestra.run.smithi090.stdout:MKFS_OPTIONS -- 172.21.15.90:6789:/scratch 2023-06-09T04:57:37.408 INFO:teuthology.orchestra.run.smithi090.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBSrYJkdxJcFhAA3pMTvAiq3IjuROLw5ndprg== 172.21.15.90:6789:/scratch /tmp/tmp.dXSIBxNemoscratch 2023-06-09T04:57:37.408 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:57:38.592 INFO:teuthology.orchestra.run.smithi090.stdout:generic/051 [not run] ceph does not support shutdown 2023-06-09T04:57:38.614 INFO:teuthology.orchestra.run.smithi090.stdout:Ran: generic/051 2023-06-09T04:57:38.615 INFO:teuthology.orchestra.run.smithi090.stdout:Not run: generic/051 2023-06-09T04:57:38.615 INFO:teuthology.orchestra.run.smithi090.stdout:Passed all 1 tests 2023-06-09T04:57:38.629 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:57:38.710 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:57:38.710 DEBUG:teuthology.orchestra.run.smithi090:> (cd /tmp/tmp.jICg1BPnIbxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/052) 2023-06-09T04:57:39.464 INFO:teuthology.orchestra.run.smithi090.stdout:FSTYP -- ceph 2023-06-09T04:57:39.486 INFO:teuthology.orchestra.run.smithi090.stdout:PLATFORM -- Linux/x86_64 smithi090 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T04:57:39.489 INFO:teuthology.orchestra.run.smithi090.stdout:MKFS_OPTIONS -- 172.21.15.90:6789:/scratch 2023-06-09T04:57:39.494 INFO:teuthology.orchestra.run.smithi090.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBSrYJkdxJcFhAA3pMTvAiq3IjuROLw5ndprg== 172.21.15.90:6789:/scratch /tmp/tmp.dXSIBxNemoscratch 2023-06-09T04:57:39.494 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:57:40.687 INFO:teuthology.orchestra.run.smithi090.stdout:generic/052 [not run] ceph does not support shutdown 2023-06-09T04:57:40.749 INFO:teuthology.orchestra.run.smithi090.stdout:Ran: generic/052 2023-06-09T04:57:40.749 INFO:teuthology.orchestra.run.smithi090.stdout:Not run: generic/052 2023-06-09T04:57:40.750 INFO:teuthology.orchestra.run.smithi090.stdout:Passed all 1 tests 2023-06-09T04:57:40.761 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:57:40.846 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:57:40.846 DEBUG:teuthology.orchestra.run.smithi090:> (cd /tmp/tmp.jICg1BPnIbxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/053) 2023-06-09T04:57:41.550 INFO:teuthology.orchestra.run.smithi090.stdout:FSTYP -- ceph 2023-06-09T04:57:41.574 INFO:teuthology.orchestra.run.smithi090.stdout:PLATFORM -- Linux/x86_64 smithi090 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T04:57:41.577 INFO:teuthology.orchestra.run.smithi090.stdout:MKFS_OPTIONS -- 172.21.15.90:6789:/scratch 2023-06-09T04:57:41.582 INFO:teuthology.orchestra.run.smithi090.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBSrYJkdxJcFhAA3pMTvAiq3IjuROLw5ndprg== 172.21.15.90:6789:/scratch /tmp/tmp.dXSIBxNemoscratch 2023-06-09T04:57:41.582 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:57:43.637 INFO:teuthology.orchestra.run.smithi090.stdout:generic/053 2s 2023-06-09T04:57:43.659 INFO:teuthology.orchestra.run.smithi090.stdout:Ran: generic/053 2023-06-09T04:57:43.660 INFO:teuthology.orchestra.run.smithi090.stdout:Passed all 1 tests 2023-06-09T04:57:43.668 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:57:43.697 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:57:43.697 DEBUG:teuthology.orchestra.run.smithi090:> (cd /tmp/tmp.jICg1BPnIbxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/054) 2023-06-09T04:57:44.391 INFO:teuthology.orchestra.run.smithi090.stdout:FSTYP -- ceph 2023-06-09T04:57:44.414 INFO:teuthology.orchestra.run.smithi090.stdout:PLATFORM -- Linux/x86_64 smithi090 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T04:57:44.416 INFO:teuthology.orchestra.run.smithi090.stdout:MKFS_OPTIONS -- 172.21.15.90:6789:/scratch 2023-06-09T04:57:44.421 INFO:teuthology.orchestra.run.smithi090.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBSrYJkdxJcFhAA3pMTvAiq3IjuROLw5ndprg== 172.21.15.90:6789:/scratch /tmp/tmp.dXSIBxNemoscratch 2023-06-09T04:57:44.422 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:57:45.558 INFO:teuthology.orchestra.run.smithi090.stdout:generic/054 [not run] ceph does not support shutdown 2023-06-09T04:57:45.611 INFO:teuthology.orchestra.run.smithi090.stdout:Ran: generic/054 2023-06-09T04:57:45.611 INFO:teuthology.orchestra.run.smithi090.stdout:Not run: generic/054 2023-06-09T04:57:45.611 INFO:teuthology.orchestra.run.smithi090.stdout:Passed all 1 tests 2023-06-09T04:57:45.624 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:57:45.697 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:57:45.697 DEBUG:teuthology.orchestra.run.smithi090:> (cd /tmp/tmp.jICg1BPnIbxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/055) 2023-06-09T04:57:46.411 INFO:teuthology.orchestra.run.smithi090.stdout:FSTYP -- ceph 2023-06-09T04:57:46.432 INFO:teuthology.orchestra.run.smithi090.stdout:PLATFORM -- Linux/x86_64 smithi090 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T04:57:46.434 INFO:teuthology.orchestra.run.smithi090.stdout:MKFS_OPTIONS -- 172.21.15.90:6789:/scratch 2023-06-09T04:57:46.440 INFO:teuthology.orchestra.run.smithi090.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBSrYJkdxJcFhAA3pMTvAiq3IjuROLw5ndprg== 172.21.15.90:6789:/scratch /tmp/tmp.dXSIBxNemoscratch 2023-06-09T04:57:46.440 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:57:47.578 INFO:teuthology.orchestra.run.smithi090.stdout:generic/055 [not run] ceph does not support shutdown 2023-06-09T04:57:47.643 INFO:teuthology.orchestra.run.smithi090.stdout:Ran: generic/055 2023-06-09T04:57:47.643 INFO:teuthology.orchestra.run.smithi090.stdout:Not run: generic/055 2023-06-09T04:57:47.643 INFO:teuthology.orchestra.run.smithi090.stdout:Passed all 1 tests 2023-06-09T04:57:47.656 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:57:47.745 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:57:47.745 DEBUG:teuthology.orchestra.run.smithi090:> (cd /tmp/tmp.jICg1BPnIbxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/056) 2023-06-09T04:57:48.485 INFO:teuthology.orchestra.run.smithi090.stdout:FSTYP -- ceph 2023-06-09T04:57:48.507 INFO:teuthology.orchestra.run.smithi090.stdout:PLATFORM -- Linux/x86_64 smithi090 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T04:57:48.509 INFO:teuthology.orchestra.run.smithi090.stdout:MKFS_OPTIONS -- 172.21.15.90:6789:/scratch 2023-06-09T04:57:48.514 INFO:teuthology.orchestra.run.smithi090.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBSrYJkdxJcFhAA3pMTvAiq3IjuROLw5ndprg== 172.21.15.90:6789:/scratch /tmp/tmp.dXSIBxNemoscratch 2023-06-09T04:57:48.514 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:57:49.499 INFO:teuthology.orchestra.run.smithi090.stdout:generic/056 [not run] require 172.21.15.90:6789:/scratch to be valid block disk 2023-06-09T04:57:49.518 INFO:teuthology.orchestra.run.smithi090.stdout:Ran: generic/056 2023-06-09T04:57:49.519 INFO:teuthology.orchestra.run.smithi090.stdout:Not run: generic/056 2023-06-09T04:57:49.519 INFO:teuthology.orchestra.run.smithi090.stdout:Passed all 1 tests 2023-06-09T04:57:49.531 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:57:49.623 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:57:49.623 DEBUG:teuthology.orchestra.run.smithi090:> (cd /tmp/tmp.jICg1BPnIbxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/057) 2023-06-09T04:57:50.342 INFO:teuthology.orchestra.run.smithi090.stdout:FSTYP -- ceph 2023-06-09T04:57:50.365 INFO:teuthology.orchestra.run.smithi090.stdout:PLATFORM -- Linux/x86_64 smithi090 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T04:57:50.367 INFO:teuthology.orchestra.run.smithi090.stdout:MKFS_OPTIONS -- 172.21.15.90:6789:/scratch 2023-06-09T04:57:50.371 INFO:teuthology.orchestra.run.smithi090.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBSrYJkdxJcFhAA3pMTvAiq3IjuROLw5ndprg== 172.21.15.90:6789:/scratch /tmp/tmp.dXSIBxNemoscratch 2023-06-09T04:57:50.371 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:57:51.341 INFO:teuthology.orchestra.run.smithi090.stdout:generic/057 [not run] require 172.21.15.90:6789:/scratch to be valid block disk 2023-06-09T04:57:51.362 INFO:teuthology.orchestra.run.smithi090.stdout:Ran: generic/057 2023-06-09T04:57:51.363 INFO:teuthology.orchestra.run.smithi090.stdout:Not run: generic/057 2023-06-09T04:57:51.363 INFO:teuthology.orchestra.run.smithi090.stdout:Passed all 1 tests 2023-06-09T04:57:51.377 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:57:51.455 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:57:51.455 DEBUG:teuthology.orchestra.run.smithi090:> (cd /tmp/tmp.jICg1BPnIbxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/058) 2023-06-09T04:57:52.172 INFO:teuthology.orchestra.run.smithi090.stdout:FSTYP -- ceph 2023-06-09T04:57:52.195 INFO:teuthology.orchestra.run.smithi090.stdout:PLATFORM -- Linux/x86_64 smithi090 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T04:57:52.198 INFO:teuthology.orchestra.run.smithi090.stdout:MKFS_OPTIONS -- 172.21.15.90:6789:/scratch 2023-06-09T04:57:52.203 INFO:teuthology.orchestra.run.smithi090.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBSrYJkdxJcFhAA3pMTvAiq3IjuROLw5ndprg== 172.21.15.90:6789:/scratch /tmp/tmp.dXSIBxNemoscratch 2023-06-09T04:57:52.203 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:57:53.341 INFO:teuthology.orchestra.run.smithi090.stdout:generic/058 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-09T04:57:53.359 INFO:teuthology.orchestra.run.smithi090.stdout:Ran: generic/058 2023-06-09T04:57:53.359 INFO:teuthology.orchestra.run.smithi090.stdout:Not run: generic/058 2023-06-09T04:57:53.359 INFO:teuthology.orchestra.run.smithi090.stdout:Passed all 1 tests 2023-06-09T04:57:53.369 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:57:53.545 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:57:53.545 DEBUG:teuthology.orchestra.run.smithi090:> (cd /tmp/tmp.jICg1BPnIbxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/059) 2023-06-09T04:57:54.314 INFO:teuthology.orchestra.run.smithi090.stdout:FSTYP -- ceph 2023-06-09T04:57:54.335 INFO:teuthology.orchestra.run.smithi090.stdout:PLATFORM -- Linux/x86_64 smithi090 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T04:57:54.339 INFO:teuthology.orchestra.run.smithi090.stdout:MKFS_OPTIONS -- 172.21.15.90:6789:/scratch 2023-06-09T04:57:54.344 INFO:teuthology.orchestra.run.smithi090.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBSrYJkdxJcFhAA3pMTvAiq3IjuROLw5ndprg== 172.21.15.90:6789:/scratch /tmp/tmp.dXSIBxNemoscratch 2023-06-09T04:57:54.344 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:57:55.333 INFO:teuthology.orchestra.run.smithi090.stdout:generic/059 [not run] require 172.21.15.90:6789:/scratch to be valid block disk 2023-06-09T04:57:55.352 INFO:teuthology.orchestra.run.smithi090.stdout:Ran: generic/059 2023-06-09T04:57:55.353 INFO:teuthology.orchestra.run.smithi090.stdout:Not run: generic/059 2023-06-09T04:57:55.353 INFO:teuthology.orchestra.run.smithi090.stdout:Passed all 1 tests 2023-06-09T04:57:55.363 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:57:55.439 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:57:55.439 DEBUG:teuthology.orchestra.run.smithi090:> (cd /tmp/tmp.jICg1BPnIbxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/060) 2023-06-09T04:57:56.175 INFO:teuthology.orchestra.run.smithi090.stdout:FSTYP -- ceph 2023-06-09T04:57:56.196 INFO:teuthology.orchestra.run.smithi090.stdout:PLATFORM -- Linux/x86_64 smithi090 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T04:57:56.199 INFO:teuthology.orchestra.run.smithi090.stdout:MKFS_OPTIONS -- 172.21.15.90:6789:/scratch 2023-06-09T04:57:56.206 INFO:teuthology.orchestra.run.smithi090.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBSrYJkdxJcFhAA3pMTvAiq3IjuROLw5ndprg== 172.21.15.90:6789:/scratch /tmp/tmp.dXSIBxNemoscratch 2023-06-09T04:57:56.206 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:57:56.232 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:57:56.237 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:57:57.346 INFO:teuthology.orchestra.run.smithi090.stdout:generic/060 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-09T04:57:57.366 INFO:teuthology.orchestra.run.smithi090.stdout:Ran: generic/060 2023-06-09T04:57:57.366 INFO:teuthology.orchestra.run.smithi090.stdout:Not run: generic/060 2023-06-09T04:57:57.366 INFO:teuthology.orchestra.run.smithi090.stdout:Passed all 1 tests 2023-06-09T04:57:57.377 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:57:57.615 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:57:57.615 DEBUG:teuthology.orchestra.run.smithi090:> (cd /tmp/tmp.jICg1BPnIbxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/061) 2023-06-09T04:57:58.345 INFO:teuthology.orchestra.run.smithi090.stdout:FSTYP -- ceph 2023-06-09T04:57:58.367 INFO:teuthology.orchestra.run.smithi090.stdout:PLATFORM -- Linux/x86_64 smithi090 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T04:57:58.369 INFO:teuthology.orchestra.run.smithi090.stdout:MKFS_OPTIONS -- 172.21.15.90:6789:/scratch 2023-06-09T04:57:58.374 INFO:teuthology.orchestra.run.smithi090.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBSrYJkdxJcFhAA3pMTvAiq3IjuROLw5ndprg== 172.21.15.90:6789:/scratch /tmp/tmp.dXSIBxNemoscratch 2023-06-09T04:57:58.375 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:57:59.525 INFO:teuthology.orchestra.run.smithi090.stdout:generic/061 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-09T04:57:59.545 INFO:teuthology.orchestra.run.smithi090.stdout:Ran: generic/061 2023-06-09T04:57:59.546 INFO:teuthology.orchestra.run.smithi090.stdout:Not run: generic/061 2023-06-09T04:57:59.546 INFO:teuthology.orchestra.run.smithi090.stdout:Passed all 1 tests 2023-06-09T04:57:59.558 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:57:59.741 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:57:59.742 DEBUG:teuthology.orchestra.run.smithi090:> (cd /tmp/tmp.jICg1BPnIbxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/062) 2023-06-09T04:58:00.553 INFO:teuthology.orchestra.run.smithi090.stdout:FSTYP -- ceph 2023-06-09T04:58:00.571 INFO:teuthology.orchestra.run.smithi090.stdout:PLATFORM -- Linux/x86_64 smithi090 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T04:58:00.574 INFO:teuthology.orchestra.run.smithi090.stdout:MKFS_OPTIONS -- 172.21.15.90:6789:/scratch 2023-06-09T04:58:00.580 INFO:teuthology.orchestra.run.smithi090.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBSrYJkdxJcFhAA3pMTvAiq3IjuROLw5ndprg== 172.21.15.90:6789:/scratch /tmp/tmp.dXSIBxNemoscratch 2023-06-09T04:58:00.580 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:58:05.055 INFO:teuthology.orchestra.run.smithi090.stdout:generic/062 4s 2023-06-09T04:58:05.104 INFO:teuthology.orchestra.run.smithi090.stdout:Ran: generic/062 2023-06-09T04:58:05.104 INFO:teuthology.orchestra.run.smithi090.stdout:Passed all 1 tests 2023-06-09T04:58:05.115 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:58:05.152 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:58:05.153 DEBUG:teuthology.orchestra.run.smithi090:> (cd /tmp/tmp.jICg1BPnIbxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/063) 2023-06-09T04:58:05.829 INFO:teuthology.orchestra.run.smithi090.stdout:FSTYP -- ceph 2023-06-09T04:58:05.852 INFO:teuthology.orchestra.run.smithi090.stdout:PLATFORM -- Linux/x86_64 smithi090 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T04:58:05.856 INFO:teuthology.orchestra.run.smithi090.stdout:MKFS_OPTIONS -- 172.21.15.90:6789:/scratch 2023-06-09T04:58:05.861 INFO:teuthology.orchestra.run.smithi090.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBSrYJkdxJcFhAA3pMTvAiq3IjuROLw5ndprg== 172.21.15.90:6789:/scratch /tmp/tmp.dXSIBxNemoscratch 2023-06-09T04:58:05.861 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:58:07.041 INFO:teuthology.orchestra.run.smithi090.stdout:generic/063 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-09T04:58:07.060 INFO:teuthology.orchestra.run.smithi090.stdout:Ran: generic/063 2023-06-09T04:58:07.060 INFO:teuthology.orchestra.run.smithi090.stdout:Not run: generic/063 2023-06-09T04:58:07.060 INFO:teuthology.orchestra.run.smithi090.stdout:Passed all 1 tests 2023-06-09T04:58:07.072 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:58:07.408 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:58:07.409 DEBUG:teuthology.orchestra.run.smithi090:> (cd /tmp/tmp.jICg1BPnIbxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/064) 2023-06-09T04:58:08.080 INFO:teuthology.orchestra.run.smithi090.stdout:FSTYP -- ceph 2023-06-09T04:58:08.102 INFO:teuthology.orchestra.run.smithi090.stdout:PLATFORM -- Linux/x86_64 smithi090 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T04:58:08.105 INFO:teuthology.orchestra.run.smithi090.stdout:MKFS_OPTIONS -- 172.21.15.90:6789:/scratch 2023-06-09T04:58:08.110 INFO:teuthology.orchestra.run.smithi090.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBSrYJkdxJcFhAA3pMTvAiq3IjuROLw5ndprg== 172.21.15.90:6789:/scratch /tmp/tmp.dXSIBxNemoscratch 2023-06-09T04:58:08.110 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:58:09.057 INFO:teuthology.orchestra.run.smithi090.stdout:generic/064 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-06-09T04:58:09.077 INFO:teuthology.orchestra.run.smithi090.stdout:Ran: generic/064 2023-06-09T04:58:09.077 INFO:teuthology.orchestra.run.smithi090.stdout:Not run: generic/064 2023-06-09T04:58:09.077 INFO:teuthology.orchestra.run.smithi090.stdout:Passed all 1 tests 2023-06-09T04:58:09.090 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:58:09.187 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:58:09.188 DEBUG:teuthology.orchestra.run.smithi090:> (cd /tmp/tmp.jICg1BPnIbxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/065) 2023-06-09T04:58:09.901 INFO:teuthology.orchestra.run.smithi090.stdout:FSTYP -- ceph 2023-06-09T04:58:09.923 INFO:teuthology.orchestra.run.smithi090.stdout:PLATFORM -- Linux/x86_64 smithi090 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T04:58:09.926 INFO:teuthology.orchestra.run.smithi090.stdout:MKFS_OPTIONS -- 172.21.15.90:6789:/scratch 2023-06-09T04:58:09.931 INFO:teuthology.orchestra.run.smithi090.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBSrYJkdxJcFhAA3pMTvAiq3IjuROLw5ndprg== 172.21.15.90:6789:/scratch /tmp/tmp.dXSIBxNemoscratch 2023-06-09T04:58:09.931 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:58:10.949 INFO:teuthology.orchestra.run.smithi090.stdout:generic/065 [not run] require 172.21.15.90:6789:/scratch to be valid block disk 2023-06-09T04:58:10.968 INFO:teuthology.orchestra.run.smithi090.stdout:Ran: generic/065 2023-06-09T04:58:10.968 INFO:teuthology.orchestra.run.smithi090.stdout:Not run: generic/065 2023-06-09T04:58:10.968 INFO:teuthology.orchestra.run.smithi090.stdout:Passed all 1 tests 2023-06-09T04:58:10.981 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:58:11.073 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:58:11.073 DEBUG:teuthology.orchestra.run.smithi090:> (cd /tmp/tmp.jICg1BPnIbxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/066) 2023-06-09T04:58:11.784 INFO:teuthology.orchestra.run.smithi090.stdout:FSTYP -- ceph 2023-06-09T04:58:11.807 INFO:teuthology.orchestra.run.smithi090.stdout:PLATFORM -- Linux/x86_64 smithi090 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T04:58:11.810 INFO:teuthology.orchestra.run.smithi090.stdout:MKFS_OPTIONS -- 172.21.15.90:6789:/scratch 2023-06-09T04:58:11.815 INFO:teuthology.orchestra.run.smithi090.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBSrYJkdxJcFhAA3pMTvAiq3IjuROLw5ndprg== 172.21.15.90:6789:/scratch /tmp/tmp.dXSIBxNemoscratch 2023-06-09T04:58:11.815 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:58:12.796 INFO:teuthology.orchestra.run.smithi090.stdout:generic/066 [not run] require 172.21.15.90:6789:/scratch to be valid block disk 2023-06-09T04:58:12.815 INFO:teuthology.orchestra.run.smithi090.stdout:Ran: generic/066 2023-06-09T04:58:12.816 INFO:teuthology.orchestra.run.smithi090.stdout:Not run: generic/066 2023-06-09T04:58:12.816 INFO:teuthology.orchestra.run.smithi090.stdout:Passed all 1 tests 2023-06-09T04:58:12.828 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:58:12.903 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:58:12.904 DEBUG:teuthology.orchestra.run.smithi090:> (cd /tmp/tmp.jICg1BPnIbxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/067) 2023-06-09T04:58:13.632 INFO:teuthology.orchestra.run.smithi090.stdout:FSTYP -- ceph 2023-06-09T04:58:13.654 INFO:teuthology.orchestra.run.smithi090.stdout:PLATFORM -- Linux/x86_64 smithi090 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T04:58:13.657 INFO:teuthology.orchestra.run.smithi090.stdout:MKFS_OPTIONS -- 172.21.15.90:6789:/scratch 2023-06-09T04:58:13.663 INFO:teuthology.orchestra.run.smithi090.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBSrYJkdxJcFhAA3pMTvAiq3IjuROLw5ndprg== 172.21.15.90:6789:/scratch /tmp/tmp.dXSIBxNemoscratch 2023-06-09T04:58:13.664 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:58:14.658 INFO:teuthology.orchestra.run.smithi090.stdout:generic/067 [not run] require 172.21.15.90:6789:/scratch to be valid block disk 2023-06-09T04:58:14.677 INFO:teuthology.orchestra.run.smithi090.stdout:Ran: generic/067 2023-06-09T04:58:14.677 INFO:teuthology.orchestra.run.smithi090.stdout:Not run: generic/067 2023-06-09T04:58:14.677 INFO:teuthology.orchestra.run.smithi090.stdout:Passed all 1 tests 2023-06-09T04:58:14.691 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:58:14.787 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:58:14.787 DEBUG:teuthology.orchestra.run.smithi090:> (cd /tmp/tmp.jICg1BPnIbxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/068) 2023-06-09T04:58:15.506 INFO:teuthology.orchestra.run.smithi090.stdout:FSTYP -- ceph 2023-06-09T04:58:15.527 INFO:teuthology.orchestra.run.smithi090.stdout:PLATFORM -- Linux/x86_64 smithi090 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T04:58:15.529 INFO:teuthology.orchestra.run.smithi090.stdout:MKFS_OPTIONS -- 172.21.15.90:6789:/scratch 2023-06-09T04:58:15.536 INFO:teuthology.orchestra.run.smithi090.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBSrYJkdxJcFhAA3pMTvAiq3IjuROLw5ndprg== 172.21.15.90:6789:/scratch /tmp/tmp.dXSIBxNemoscratch 2023-06-09T04:58:15.536 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:58:16.521 INFO:teuthology.orchestra.run.smithi090.stdout:generic/068 [not run] ceph does not support freezing 2023-06-09T04:58:16.542 INFO:teuthology.orchestra.run.smithi090.stdout:Ran: generic/068 2023-06-09T04:58:16.543 INFO:teuthology.orchestra.run.smithi090.stdout:Not run: generic/068 2023-06-09T04:58:16.543 INFO:teuthology.orchestra.run.smithi090.stdout:Passed all 1 tests 2023-06-09T04:58:16.555 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:58:16.642 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:58:16.642 DEBUG:teuthology.orchestra.run.smithi090:> (cd /tmp/tmp.jICg1BPnIbxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/069) 2023-06-09T04:58:17.384 INFO:teuthology.orchestra.run.smithi090.stdout:FSTYP -- ceph 2023-06-09T04:58:17.406 INFO:teuthology.orchestra.run.smithi090.stdout:PLATFORM -- Linux/x86_64 smithi090 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T04:58:17.409 INFO:teuthology.orchestra.run.smithi090.stdout:MKFS_OPTIONS -- 172.21.15.90:6789:/scratch 2023-06-09T04:58:17.415 INFO:teuthology.orchestra.run.smithi090.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBSrYJkdxJcFhAA3pMTvAiq3IjuROLw5ndprg== 172.21.15.90:6789:/scratch /tmp/tmp.dXSIBxNemoscratch 2023-06-09T04:58:17.415 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:58:26.364 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:58:26.371 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:58:38.759 INFO:teuthology.orchestra.run.smithi090.stdout:generic/069 21s 2023-06-09T04:58:38.779 INFO:teuthology.orchestra.run.smithi090.stdout:Ran: generic/069 2023-06-09T04:58:38.779 INFO:teuthology.orchestra.run.smithi090.stdout:Passed all 1 tests 2023-06-09T04:58:38.789 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:58:38.819 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:58:38.819 DEBUG:teuthology.orchestra.run.smithi090:> (cd /tmp/tmp.jICg1BPnIbxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/070) 2023-06-09T04:58:39.508 INFO:teuthology.orchestra.run.smithi090.stdout:FSTYP -- ceph 2023-06-09T04:58:39.530 INFO:teuthology.orchestra.run.smithi090.stdout:PLATFORM -- Linux/x86_64 smithi090 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T04:58:39.533 INFO:teuthology.orchestra.run.smithi090.stdout:MKFS_OPTIONS -- 172.21.15.90:6789:/scratch 2023-06-09T04:58:39.538 INFO:teuthology.orchestra.run.smithi090.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBSrYJkdxJcFhAA3pMTvAiq3IjuROLw5ndprg== 172.21.15.90:6789:/scratch /tmp/tmp.dXSIBxNemoscratch 2023-06-09T04:58:39.538 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:58:56.526 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:58:56.532 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:59:11.705 INFO:teuthology.orchestra.run.smithi090.stdout:generic/070 32s 2023-06-09T04:59:11.728 INFO:teuthology.orchestra.run.smithi090.stdout:Ran: generic/070 2023-06-09T04:59:11.728 INFO:teuthology.orchestra.run.smithi090.stdout:Passed all 1 tests 2023-06-09T04:59:11.737 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:59:12.187 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:59:12.187 DEBUG:teuthology.orchestra.run.smithi090:> (cd /tmp/tmp.jICg1BPnIbxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/071) 2023-06-09T04:59:12.906 INFO:teuthology.orchestra.run.smithi090.stdout:FSTYP -- ceph 2023-06-09T04:59:12.923 INFO:teuthology.orchestra.run.smithi090.stdout:PLATFORM -- Linux/x86_64 smithi090 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T04:59:12.925 INFO:teuthology.orchestra.run.smithi090.stdout:MKFS_OPTIONS -- 172.21.15.90:6789:/scratch 2023-06-09T04:59:12.929 INFO:teuthology.orchestra.run.smithi090.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBSrYJkdxJcFhAA3pMTvAiq3IjuROLw5ndprg== 172.21.15.90:6789:/scratch /tmp/tmp.dXSIBxNemoscratch 2023-06-09T04:59:12.929 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:59:13.755 INFO:teuthology.orchestra.run.smithi090.stdout:generic/071 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-06-09T04:59:13.772 INFO:teuthology.orchestra.run.smithi090.stdout:Ran: generic/071 2023-06-09T04:59:13.772 INFO:teuthology.orchestra.run.smithi090.stdout:Not run: generic/071 2023-06-09T04:59:13.773 INFO:teuthology.orchestra.run.smithi090.stdout:Passed all 1 tests 2023-06-09T04:59:13.781 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:59:13.870 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:59:13.871 DEBUG:teuthology.orchestra.run.smithi090:> (cd /tmp/tmp.jICg1BPnIbxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/072) 2023-06-09T04:59:14.522 INFO:teuthology.orchestra.run.smithi090.stdout:FSTYP -- ceph 2023-06-09T04:59:14.540 INFO:teuthology.orchestra.run.smithi090.stdout:PLATFORM -- Linux/x86_64 smithi090 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T04:59:14.543 INFO:teuthology.orchestra.run.smithi090.stdout:MKFS_OPTIONS -- 172.21.15.90:6789:/scratch 2023-06-09T04:59:14.547 INFO:teuthology.orchestra.run.smithi090.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBSrYJkdxJcFhAA3pMTvAiq3IjuROLw5ndprg== 172.21.15.90:6789:/scratch /tmp/tmp.dXSIBxNemoscratch 2023-06-09T04:59:14.547 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:59:15.548 INFO:teuthology.orchestra.run.smithi090.stdout:generic/072 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2023-06-09T04:59:15.565 INFO:teuthology.orchestra.run.smithi090.stdout:Ran: generic/072 2023-06-09T04:59:15.565 INFO:teuthology.orchestra.run.smithi090.stdout:Not run: generic/072 2023-06-09T04:59:15.566 INFO:teuthology.orchestra.run.smithi090.stdout:Passed all 1 tests 2023-06-09T04:59:15.577 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:59:15.671 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:59:15.671 DEBUG:teuthology.orchestra.run.smithi090:> (cd /tmp/tmp.jICg1BPnIbxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/073) 2023-06-09T04:59:16.286 INFO:teuthology.orchestra.run.smithi090.stdout:FSTYP -- ceph 2023-06-09T04:59:16.304 INFO:teuthology.orchestra.run.smithi090.stdout:PLATFORM -- Linux/x86_64 smithi090 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T04:59:16.306 INFO:teuthology.orchestra.run.smithi090.stdout:MKFS_OPTIONS -- 172.21.15.90:6789:/scratch 2023-06-09T04:59:16.309 INFO:teuthology.orchestra.run.smithi090.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBSrYJkdxJcFhAA3pMTvAiq3IjuROLw5ndprg== 172.21.15.90:6789:/scratch /tmp/tmp.dXSIBxNemoscratch 2023-06-09T04:59:16.310 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:59:17.100 INFO:teuthology.orchestra.run.smithi090.stdout:generic/073 [not run] require 172.21.15.90:6789:/scratch to be valid block disk 2023-06-09T04:59:17.121 INFO:teuthology.orchestra.run.smithi090.stdout:Ran: generic/073 2023-06-09T04:59:17.121 INFO:teuthology.orchestra.run.smithi090.stdout:Not run: generic/073 2023-06-09T04:59:17.121 INFO:teuthology.orchestra.run.smithi090.stdout:Passed all 1 tests 2023-06-09T04:59:17.133 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:59:17.201 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:59:17.202 DEBUG:teuthology.orchestra.run.smithi090:> (cd /tmp/tmp.jICg1BPnIbxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/074) 2023-06-09T04:59:17.826 INFO:teuthology.orchestra.run.smithi090.stdout:FSTYP -- ceph 2023-06-09T04:59:17.840 INFO:teuthology.orchestra.run.smithi090.stdout:PLATFORM -- Linux/x86_64 smithi090 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T04:59:17.842 INFO:teuthology.orchestra.run.smithi090.stdout:MKFS_OPTIONS -- 172.21.15.90:6789:/scratch 2023-06-09T04:59:17.846 INFO:teuthology.orchestra.run.smithi090.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBSrYJkdxJcFhAA3pMTvAiq3IjuROLw5ndprg== 172.21.15.90:6789:/scratch /tmp/tmp.dXSIBxNemoscratch 2023-06-09T04:59:17.846 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T04:59:26.737 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:59:26.744 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:59:26.806 INFO:tasks.ceph.mds.a.smithi090.stderr:2023-06-09T04:59:26.796+0000 7f7c0ce37700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 125714) UID: 0 2023-06-09T04:59:26.807 INFO:tasks.ceph.mds.c.smithi090.stderr:2023-06-09T04:59:26.796+0000 7f457c5d5700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 125714) UID: 0 2023-06-09T05:00:03.093 INFO:teuthology.orchestra.run.smithi090.stdout:generic/074 45s 2023-06-09T05:00:03.246 INFO:teuthology.orchestra.run.smithi090.stdout:Ran: generic/074 2023-06-09T05:00:03.246 INFO:teuthology.orchestra.run.smithi090.stdout:Passed all 1 tests 2023-06-09T05:00:03.260 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T05:00:04.251 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:00:04.252 DEBUG:teuthology.orchestra.run.smithi090:> (cd /tmp/tmp.jICg1BPnIbxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/075) 2023-06-09T05:00:04.999 INFO:teuthology.orchestra.run.smithi090.stdout:FSTYP -- ceph 2023-06-09T05:00:05.012 INFO:teuthology.orchestra.run.smithi090.stdout:PLATFORM -- Linux/x86_64 smithi090 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T05:00:05.014 INFO:teuthology.orchestra.run.smithi090.stdout:MKFS_OPTIONS -- 172.21.15.90:6789:/scratch 2023-06-09T05:00:05.018 INFO:teuthology.orchestra.run.smithi090.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBSrYJkdxJcFhAA3pMTvAiq3IjuROLw5ndprg== 172.21.15.90:6789:/scratch /tmp/tmp.dXSIBxNemoscratch 2023-06-09T05:00:05.019 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T05:00:39.691 INFO:teuthology.orchestra.run.smithi090.stdout:generic/075 34s 2023-06-09T05:00:39.719 INFO:teuthology.orchestra.run.smithi090.stdout:Ran: generic/075 2023-06-09T05:00:39.719 INFO:teuthology.orchestra.run.smithi090.stdout:Passed all 1 tests 2023-06-09T05:00:39.732 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T05:00:40.084 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:00:40.085 DEBUG:teuthology.orchestra.run.smithi090:> (cd /tmp/tmp.jICg1BPnIbxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/076) 2023-06-09T05:00:40.792 INFO:teuthology.orchestra.run.smithi090.stdout:FSTYP -- ceph 2023-06-09T05:00:40.814 INFO:teuthology.orchestra.run.smithi090.stdout:PLATFORM -- Linux/x86_64 smithi090 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T05:00:40.816 INFO:teuthology.orchestra.run.smithi090.stdout:MKFS_OPTIONS -- 172.21.15.90:6789:/scratch 2023-06-09T05:00:40.820 INFO:teuthology.orchestra.run.smithi090.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBSrYJkdxJcFhAA3pMTvAiq3IjuROLw5ndprg== 172.21.15.90:6789:/scratch /tmp/tmp.dXSIBxNemoscratch 2023-06-09T05:00:40.820 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T05:00:41.622 INFO:teuthology.orchestra.run.smithi090.stdout:generic/076 [not run] require 172.21.15.90:6789:/scratch to be local device 2023-06-09T05:00:41.637 INFO:teuthology.orchestra.run.smithi090.stdout:Ran: generic/076 2023-06-09T05:00:41.638 INFO:teuthology.orchestra.run.smithi090.stdout:Not run: generic/076 2023-06-09T05:00:41.638 INFO:teuthology.orchestra.run.smithi090.stdout:Passed all 1 tests 2023-06-09T05:00:41.647 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T05:00:41.724 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:00:41.724 DEBUG:teuthology.orchestra.run.smithi090:> (cd /tmp/tmp.jICg1BPnIbxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/077) 2023-06-09T05:00:42.379 INFO:teuthology.orchestra.run.smithi090.stdout:FSTYP -- ceph 2023-06-09T05:00:42.404 INFO:teuthology.orchestra.run.smithi090.stdout:PLATFORM -- Linux/x86_64 smithi090 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T05:00:42.406 INFO:teuthology.orchestra.run.smithi090.stdout:MKFS_OPTIONS -- 172.21.15.90:6789:/scratch 2023-06-09T05:00:42.410 INFO:teuthology.orchestra.run.smithi090.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBSrYJkdxJcFhAA3pMTvAiq3IjuROLw5ndprg== 172.21.15.90:6789:/scratch /tmp/tmp.dXSIBxNemoscratch 2023-06-09T05:00:42.410 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T05:00:44.375 INFO:teuthology.orchestra.run.smithi090.stdout:generic/077 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-06-09T05:00:44.389 INFO:teuthology.orchestra.run.smithi090.stdout:Ran: generic/077 2023-06-09T05:00:44.389 INFO:teuthology.orchestra.run.smithi090.stdout:Not run: generic/077 2023-06-09T05:00:44.389 INFO:teuthology.orchestra.run.smithi090.stdout:Passed all 1 tests 2023-06-09T05:00:44.398 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T05:00:44.648 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:00:44.649 DEBUG:teuthology.orchestra.run.smithi090:> (cd /tmp/tmp.jICg1BPnIbxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/078) 2023-06-09T05:00:45.469 INFO:teuthology.orchestra.run.smithi090.stdout:FSTYP -- ceph 2023-06-09T05:00:45.488 INFO:teuthology.orchestra.run.smithi090.stdout:PLATFORM -- Linux/x86_64 smithi090 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T05:00:45.496 INFO:teuthology.orchestra.run.smithi090.stdout:MKFS_OPTIONS -- 172.21.15.90:6789:/scratch 2023-06-09T05:00:45.500 INFO:teuthology.orchestra.run.smithi090.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBSrYJkdxJcFhAA3pMTvAiq3IjuROLw5ndprg== 172.21.15.90:6789:/scratch /tmp/tmp.dXSIBxNemoscratch 2023-06-09T05:00:45.501 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T05:00:46.353 INFO:teuthology.orchestra.run.smithi090.stdout:generic/078 [not run] kernel doesn't support renameat2 syscall 2023-06-09T05:00:46.366 INFO:teuthology.orchestra.run.smithi090.stdout:Ran: generic/078 2023-06-09T05:00:46.367 INFO:teuthology.orchestra.run.smithi090.stdout:Not run: generic/078 2023-06-09T05:00:46.367 INFO:teuthology.orchestra.run.smithi090.stdout:Passed all 1 tests 2023-06-09T05:00:46.381 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T05:00:46.562 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:00:46.562 DEBUG:teuthology.orchestra.run.smithi090:> (cd /tmp/tmp.jICg1BPnIbxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/079) 2023-06-09T05:00:47.336 INFO:teuthology.orchestra.run.smithi090.stdout:FSTYP -- ceph 2023-06-09T05:00:47.356 INFO:teuthology.orchestra.run.smithi090.stdout:PLATFORM -- Linux/x86_64 smithi090 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T05:00:47.359 INFO:teuthology.orchestra.run.smithi090.stdout:MKFS_OPTIONS -- 172.21.15.90:6789:/scratch 2023-06-09T05:00:47.364 INFO:teuthology.orchestra.run.smithi090.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBSrYJkdxJcFhAA3pMTvAiq3IjuROLw5ndprg== 172.21.15.90:6789:/scratch /tmp/tmp.dXSIBxNemoscratch 2023-06-09T05:00:47.364 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T05:00:48.145 INFO:teuthology.orchestra.run.smithi090.stdout:generic/079 [not run] file system doesn't support chattr +ia 2023-06-09T05:00:48.159 INFO:teuthology.orchestra.run.smithi090.stdout:Ran: generic/079 2023-06-09T05:00:48.159 INFO:teuthology.orchestra.run.smithi090.stdout:Not run: generic/079 2023-06-09T05:00:48.160 INFO:teuthology.orchestra.run.smithi090.stdout:Passed all 1 tests 2023-06-09T05:00:48.172 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T05:00:48.260 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:00:48.261 DEBUG:teuthology.orchestra.run.smithi090:> (cd /tmp/tmp.jICg1BPnIbxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/080) 2023-06-09T05:00:48.953 INFO:teuthology.orchestra.run.smithi090.stdout:FSTYP -- ceph 2023-06-09T05:00:48.971 INFO:teuthology.orchestra.run.smithi090.stdout:PLATFORM -- Linux/x86_64 smithi090 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T05:00:48.973 INFO:teuthology.orchestra.run.smithi090.stdout:MKFS_OPTIONS -- 172.21.15.90:6789:/scratch 2023-06-09T05:00:48.977 INFO:teuthology.orchestra.run.smithi090.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBSrYJkdxJcFhAA3pMTvAiq3IjuROLw5ndprg== 172.21.15.90:6789:/scratch /tmp/tmp.dXSIBxNemoscratch 2023-06-09T05:00:48.977 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T05:00:51.906 INFO:teuthology.orchestra.run.smithi090.stdout:generic/080 2s 2023-06-09T05:00:51.931 INFO:teuthology.orchestra.run.smithi090.stdout:Ran: generic/080 2023-06-09T05:00:51.931 INFO:teuthology.orchestra.run.smithi090.stdout:Passed all 1 tests 2023-06-09T05:00:51.940 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T05:00:52.032 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:00:52.032 DEBUG:teuthology.orchestra.run.smithi090:> (cd /tmp/tmp.jICg1BPnIbxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/081) 2023-06-09T05:00:52.757 INFO:teuthology.orchestra.run.smithi090.stdout:FSTYP -- ceph 2023-06-09T05:00:52.774 INFO:teuthology.orchestra.run.smithi090.stdout:PLATFORM -- Linux/x86_64 smithi090 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T05:00:52.777 INFO:teuthology.orchestra.run.smithi090.stdout:MKFS_OPTIONS -- 172.21.15.90:6789:/scratch 2023-06-09T05:00:52.781 INFO:teuthology.orchestra.run.smithi090.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBSrYJkdxJcFhAA3pMTvAiq3IjuROLw5ndprg== 172.21.15.90:6789:/scratch /tmp/tmp.dXSIBxNemoscratch 2023-06-09T05:00:52.781 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T05:00:53.712 INFO:teuthology.orchestra.run.smithi090.stdout:generic/081 [not run] require 172.21.15.90:6789:/scratch to be valid block disk 2023-06-09T05:00:53.729 INFO:teuthology.orchestra.run.smithi090.stdout:Ran: generic/081 2023-06-09T05:00:53.729 INFO:teuthology.orchestra.run.smithi090.stdout:Not run: generic/081 2023-06-09T05:00:53.729 INFO:teuthology.orchestra.run.smithi090.stdout:Passed all 1 tests 2023-06-09T05:00:53.738 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T05:00:53.812 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:00:53.813 DEBUG:teuthology.orchestra.run.smithi090:> (cd /tmp/tmp.jICg1BPnIbxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/082) 2023-06-09T05:00:54.547 INFO:teuthology.orchestra.run.smithi090.stdout:FSTYP -- ceph 2023-06-09T05:00:54.564 INFO:teuthology.orchestra.run.smithi090.stdout:PLATFORM -- Linux/x86_64 smithi090 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T05:00:54.565 INFO:teuthology.orchestra.run.smithi090.stdout:MKFS_OPTIONS -- 172.21.15.90:6789:/scratch 2023-06-09T05:00:54.568 INFO:teuthology.orchestra.run.smithi090.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBSrYJkdxJcFhAA3pMTvAiq3IjuROLw5ndprg== 172.21.15.90:6789:/scratch /tmp/tmp.dXSIBxNemoscratch 2023-06-09T05:00:54.568 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T05:00:55.380 INFO:teuthology.orchestra.run.smithi090.stdout:generic/082 [not run] disk quotas not supported by this filesystem type: ceph 2023-06-09T05:00:55.398 INFO:teuthology.orchestra.run.smithi090.stdout:Ran: generic/082 2023-06-09T05:00:55.399 INFO:teuthology.orchestra.run.smithi090.stdout:Not run: generic/082 2023-06-09T05:00:55.399 INFO:teuthology.orchestra.run.smithi090.stdout:Passed all 1 tests 2023-06-09T05:00:55.410 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T05:00:55.484 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:00:55.484 DEBUG:teuthology.orchestra.run.smithi090:> (cd /tmp/tmp.jICg1BPnIbxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/083) 2023-06-09T05:00:56.144 INFO:teuthology.orchestra.run.smithi090.stdout:FSTYP -- ceph 2023-06-09T05:00:56.159 INFO:teuthology.orchestra.run.smithi090.stdout:PLATFORM -- Linux/x86_64 smithi090 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T05:00:56.162 INFO:teuthology.orchestra.run.smithi090.stdout:MKFS_OPTIONS -- 172.21.15.90:6789:/scratch 2023-06-09T05:00:56.166 INFO:teuthology.orchestra.run.smithi090.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBSrYJkdxJcFhAA3pMTvAiq3IjuROLw5ndprg== 172.21.15.90:6789:/scratch /tmp/tmp.dXSIBxNemoscratch 2023-06-09T05:00:56.166 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T05:00:56.984 INFO:teuthology.orchestra.run.smithi090.stdout:generic/083 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-06-09T05:00:57.005 INFO:teuthology.orchestra.run.smithi090.stdout:Ran: generic/083 2023-06-09T05:00:57.005 INFO:teuthology.orchestra.run.smithi090.stdout:Not run: generic/083 2023-06-09T05:00:57.005 INFO:teuthology.orchestra.run.smithi090.stdout:Passed all 1 tests 2023-06-09T05:00:57.013 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T05:00:57.092 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:00:57.093 DEBUG:teuthology.orchestra.run.smithi090:> (cd /tmp/tmp.jICg1BPnIbxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/084) 2023-06-09T05:00:57.794 INFO:teuthology.orchestra.run.smithi090.stdout:FSTYP -- ceph 2023-06-09T05:00:57.819 INFO:teuthology.orchestra.run.smithi090.stdout:PLATFORM -- Linux/x86_64 smithi090 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T05:00:57.822 INFO:teuthology.orchestra.run.smithi090.stdout:MKFS_OPTIONS -- 172.21.15.90:6789:/scratch 2023-06-09T05:00:57.826 INFO:teuthology.orchestra.run.smithi090.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBSrYJkdxJcFhAA3pMTvAiq3IjuROLw5ndprg== 172.21.15.90:6789:/scratch /tmp/tmp.dXSIBxNemoscratch 2023-06-09T05:00:57.826 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T05:01:01.507 INFO:tasks.ceph.mds.c.smithi090.stderr:/build/ceph-18.0.0-4313-ga02638f8/src/mds/SimpleLock.h: In function 'void SimpleLock::put_xlock()' thread 7f4574dc6700 time 2023-06-09T05:01:01.502513+0000 2023-06-09T05:01:01.508 INFO:tasks.ceph.mds.c.smithi090.stderr:/build/ceph-18.0.0-4313-ga02638f8/src/mds/SimpleLock.h: 417: FAILED ceph_assert(state == LOCK_XLOCK || state == LOCK_XLOCKDONE || state == LOCK_XLOCKSNAP || state == LOCK_LOCK_XLOCK || state == LOCK_LOCK || is_locallock()) 2023-06-09T05:01:01.510 INFO:tasks.ceph.mds.c.smithi090.stderr: ceph version 18.0.0-4313-ga02638f8 (a02638f808b8fe11bccdd01222c0e6e2eb71120b) reef (dev) 2023-06-09T05:01:01.510 INFO:tasks.ceph.mds.c.smithi090.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x128) [0x7f458111e257] 2023-06-09T05:01:01.510 INFO:tasks.ceph.mds.c.smithi090.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x31e413) [0x7f458111e413] 2023-06-09T05:01:01.510 INFO:tasks.ceph.mds.c.smithi090.stderr: 3: (SimpleLock::put_xlock()+0x332) [0x557835df91d2] 2023-06-09T05:01:01.510 INFO:tasks.ceph.mds.c.smithi090.stderr: 4: (Locker::xlock_finish(std::_Rb_tree_const_iterator const&, MutationImpl*, bool*)+0x8c) [0x557835de2a4c] 2023-06-09T05:01:01.510 INFO:tasks.ceph.mds.c.smithi090.stderr: 5: (Locker::_drop_locks(MutationImpl*, std::set, std::allocator >*, bool)+0x3f0) [0x557835de32b0] 2023-06-09T05:01:01.511 INFO:tasks.ceph.mds.c.smithi090.stderr: 6: (Locker::drop_non_rdlocks(MutationImpl*, std::set, std::allocator >*)+0x5f) [0x557835de3d0f] 2023-06-09T05:01:01.511 INFO:tasks.ceph.mds.c.smithi090.stderr: 7: (Server::reply_client_request(boost::intrusive_ptr&, boost::intrusive_ptr const&)+0x48d) [0x557835c4ec9d] 2023-06-09T05:01:01.511 INFO:tasks.ceph.mds.c.smithi090.stderr: 8: (Server::respond_to_request(boost::intrusive_ptr&, int)+0x350) [0x557835c4fae0] 2023-06-09T05:01:01.511 INFO:tasks.ceph.mds.c.smithi090.stderr: 9: (Server::_link_local_finish(boost::intrusive_ptr&, CDentry*, CInode*, unsigned long, unsigned long, bool)+0xf5) [0x557835c51915] 2023-06-09T05:01:01.511 INFO:tasks.ceph.mds.c.smithi090.stderr: 10: (C_MDS_link_local_finish::finish(int)+0x35) [0x557835ccd8e5] 2023-06-09T05:01:01.511 INFO:tasks.ceph.mds.c.smithi090.stderr: 11: (MDSContext::complete(int)+0x5f) [0x557835f239df] 2023-06-09T05:01:01.511 INFO:tasks.ceph.mds.c.smithi090.stderr: 12: (MDSIOContextBase::complete(int)+0x514) [0x557835f24144] 2023-06-09T05:01:01.512 INFO:tasks.ceph.mds.c.smithi090.stderr: 13: (MDSLogContextBase::complete(int)+0x5b) [0x557835f244db] 2023-06-09T05:01:01.512 INFO:tasks.ceph.mds.c.smithi090.stderr: 14: (Finisher::finisher_thread_entry()+0x18d) [0x7f45811c4dbd] 2023-06-09T05:01:01.512 INFO:tasks.ceph.mds.c.smithi090.stderr: 15: /lib/x86_64-linux-gnu/libpthread.so.0(+0x8609) [0x7f4581c15609] 2023-06-09T05:01:01.512 INFO:tasks.ceph.mds.c.smithi090.stderr: 16: clone() 2023-06-09T05:01:01.512 INFO:tasks.ceph.mds.c.smithi090.stderr:*** Caught signal (Aborted) ** 2023-06-09T05:01:01.512 INFO:tasks.ceph.mds.c.smithi090.stderr: in thread 7f4574dc6700 thread_name:MR_Finisher 2023-06-09T05:01:01.513 INFO:tasks.ceph.mds.c.smithi090.stderr:2023-06-09T05:01:01.502+0000 7f4574dc6700 -1 /build/ceph-18.0.0-4313-ga02638f8/src/mds/SimpleLock.h: In function 'void SimpleLock::put_xlock()' thread 7f4574dc6700 time 2023-06-09T05:01:01.502513+0000 2023-06-09T05:01:01.513 INFO:tasks.ceph.mds.c.smithi090.stderr:/build/ceph-18.0.0-4313-ga02638f8/src/mds/SimpleLock.h: 417: FAILED ceph_assert(state == LOCK_XLOCK || state == LOCK_XLOCKDONE || state == LOCK_XLOCKSNAP || state == LOCK_LOCK_XLOCK || state == LOCK_LOCK || is_locallock()) 2023-06-09T05:01:01.513 INFO:tasks.ceph.mds.c.smithi090.stderr: 2023-06-09T05:01:01.513 INFO:tasks.ceph.mds.c.smithi090.stderr: ceph version 18.0.0-4313-ga02638f8 (a02638f808b8fe11bccdd01222c0e6e2eb71120b) reef (dev) 2023-06-09T05:01:01.513 INFO:tasks.ceph.mds.c.smithi090.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x128) [0x7f458111e257] 2023-06-09T05:01:01.513 INFO:tasks.ceph.mds.c.smithi090.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x31e413) [0x7f458111e413] 2023-06-09T05:01:01.513 INFO:tasks.ceph.mds.c.smithi090.stderr: 3: (SimpleLock::put_xlock()+0x332) [0x557835df91d2] 2023-06-09T05:01:01.513 INFO:tasks.ceph.mds.c.smithi090.stderr: 4: (Locker::xlock_finish(std::_Rb_tree_const_iterator const&, MutationImpl*, bool*)+0x8c) [0x557835de2a4c] 2023-06-09T05:01:01.514 INFO:tasks.ceph.mds.c.smithi090.stderr: 5: (Locker::_drop_locks(MutationImpl*, std::set, std::allocator >*, bool)+0x3f0) [0x557835de32b0] 2023-06-09T05:01:01.514 INFO:tasks.ceph.mds.c.smithi090.stderr: 6: (Locker::drop_non_rdlocks(MutationImpl*, std::set, std::allocator >*)+0x5f) [0x557835de3d0f] 2023-06-09T05:01:01.514 INFO:tasks.ceph.mds.c.smithi090.stderr: 7: (Server::reply_client_request(boost::intrusive_ptr&, boost::intrusive_ptr const&)+0x48d) [0x557835c4ec9d] 2023-06-09T05:01:01.514 INFO:tasks.ceph.mds.c.smithi090.stderr: 8: (Server::respond_to_request(boost::intrusive_ptr&, int)+0x350) [0x557835c4fae0] 2023-06-09T05:01:01.514 INFO:tasks.ceph.mds.c.smithi090.stderr: 9: (Server::_link_local_finish(boost::intrusive_ptr&, CDentry*, CInode*, unsigned long, unsigned long, bool)+0xf5) [0x557835c51915] 2023-06-09T05:01:01.514 INFO:tasks.ceph.mds.c.smithi090.stderr: 10: (C_MDS_link_local_finish::finish(int)+0x35) [0x557835ccd8e5] 2023-06-09T05:01:01.514 INFO:tasks.ceph.mds.c.smithi090.stderr: 11: (MDSContext::complete(int)+0x5f) [0x557835f239df] 2023-06-09T05:01:01.515 INFO:tasks.ceph.mds.c.smithi090.stderr: 12: (MDSIOContextBase::complete(int)+0x514) [0x557835f24144] 2023-06-09T05:01:01.515 INFO:tasks.ceph.mds.c.smithi090.stderr: 13: (MDSLogContextBase::complete(int)+0x5b) [0x557835f244db] 2023-06-09T05:01:01.515 INFO:tasks.ceph.mds.c.smithi090.stderr: 14: (Finisher::finisher_thread_entry()+0x18d) [0x7f45811c4dbd] 2023-06-09T05:01:01.515 INFO:tasks.ceph.mds.c.smithi090.stderr: 15: /lib/x86_64-linux-gnu/libpthread.so.0(+0x8609) [0x7f4581c15609] 2023-06-09T05:01:01.515 INFO:tasks.ceph.mds.c.smithi090.stderr: 16: clone() 2023-06-09T05:01:01.515 INFO:tasks.ceph.mds.c.smithi090.stderr: 2023-06-09T05:01:01.516 INFO:tasks.ceph.mds.c.smithi090.stderr: ceph version 18.0.0-4313-ga02638f8 (a02638f808b8fe11bccdd01222c0e6e2eb71120b) reef (dev) 2023-06-09T05:01:01.516 INFO:tasks.ceph.mds.c.smithi090.stderr: 1: /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420) [0x7f4581c21420] 2023-06-09T05:01:01.516 INFO:tasks.ceph.mds.c.smithi090.stderr: 2: gsignal() 2023-06-09T05:01:01.516 INFO:tasks.ceph.mds.c.smithi090.stderr: 3: abort() 2023-06-09T05:01:01.516 INFO:tasks.ceph.mds.c.smithi090.stderr: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x182) [0x7f458111e2b1] 2023-06-09T05:01:01.517 INFO:tasks.ceph.mds.c.smithi090.stderr: 5: /usr/lib/ceph/libceph-common.so.2(+0x31e413) [0x7f458111e413] 2023-06-09T05:01:01.517 INFO:tasks.ceph.mds.c.smithi090.stderr: 6: (SimpleLock::put_xlock()+0x332) [0x557835df91d2] 2023-06-09T05:01:01.517 INFO:tasks.ceph.mds.c.smithi090.stderr: 7: (Locker::xlock_finish(std::_Rb_tree_const_iterator const&, MutationImpl*, bool*)+0x8c) [0x557835de2a4c] 2023-06-09T05:01:01.517 INFO:tasks.ceph.mds.c.smithi090.stderr: 8: (Locker::_drop_locks(MutationImpl*, std::set, std::allocator >*, bool)+0x3f0) [0x557835de32b0] 2023-06-09T05:01:01.517 INFO:tasks.ceph.mds.c.smithi090.stderr: 9: (Locker::drop_non_rdlocks(MutationImpl*, std::set, std::allocator >*)+0x5f) [0x557835de3d0f] 2023-06-09T05:01:01.517 INFO:tasks.ceph.mds.c.smithi090.stderr: 10: (Server::reply_client_request(boost::intrusive_ptr&, boost::intrusive_ptr const&)+0x48d) [0x557835c4ec9d] 2023-06-09T05:01:01.517 INFO:tasks.ceph.mds.c.smithi090.stderr: 11: (Server::respond_to_request(boost::intrusive_ptr&, int)+0x350) [0x557835c4fae0] 2023-06-09T05:01:01.518 INFO:tasks.ceph.mds.c.smithi090.stderr: 12: (Server::_link_local_finish(boost::intrusive_ptr&, CDentry*, CInode*, unsigned long, unsigned long, bool)+0xf5) [0x557835c51915] 2023-06-09T05:01:01.518 INFO:tasks.ceph.mds.c.smithi090.stderr: 13: (C_MDS_link_local_finish::finish(int)+0x35) [0x557835ccd8e5] 2023-06-09T05:01:01.518 INFO:tasks.ceph.mds.c.smithi090.stderr: 14: (MDSContext::complete(int)+0x5f) [0x557835f239df] 2023-06-09T05:01:01.518 INFO:tasks.ceph.mds.c.smithi090.stderr: 15: (MDSIOContextBase::complete(int)+0x514) [0x557835f24144] 2023-06-09T05:01:01.518 INFO:tasks.ceph.mds.c.smithi090.stderr: 16: (MDSLogContextBase::complete(int)+0x5b) [0x557835f244db] 2023-06-09T05:01:01.518 INFO:tasks.ceph.mds.c.smithi090.stderr: 17: (Finisher::finisher_thread_entry()+0x18d) [0x7f45811c4dbd] 2023-06-09T05:01:01.519 INFO:tasks.ceph.mds.c.smithi090.stderr: 18: /lib/x86_64-linux-gnu/libpthread.so.0(+0x8609) [0x7f4581c15609] 2023-06-09T05:01:01.519 INFO:tasks.ceph.mds.c.smithi090.stderr: 19: clone() 2023-06-09T05:01:01.519 INFO:tasks.ceph.mds.c.smithi090.stderr:2023-06-09T05:01:01.502+0000 7f4574dc6700 -1 *** Caught signal (Aborted) ** 2023-06-09T05:01:01.519 INFO:tasks.ceph.mds.c.smithi090.stderr: in thread 7f4574dc6700 thread_name:MR_Finisher 2023-06-09T05:01:01.519 INFO:tasks.ceph.mds.c.smithi090.stderr: 2023-06-09T05:01:01.519 INFO:tasks.ceph.mds.c.smithi090.stderr: ceph version 18.0.0-4313-ga02638f8 (a02638f808b8fe11bccdd01222c0e6e2eb71120b) reef (dev) 2023-06-09T05:01:01.519 INFO:tasks.ceph.mds.c.smithi090.stderr: 1: /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420) [0x7f4581c21420] 2023-06-09T05:01:01.519 INFO:tasks.ceph.mds.c.smithi090.stderr: 2: gsignal() 2023-06-09T05:01:01.520 INFO:tasks.ceph.mds.c.smithi090.stderr: 3: abort() 2023-06-09T05:01:01.520 INFO:tasks.ceph.mds.c.smithi090.stderr: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x182) [0x7f458111e2b1] 2023-06-09T05:01:01.520 INFO:tasks.ceph.mds.c.smithi090.stderr: 5: /usr/lib/ceph/libceph-common.so.2(+0x31e413) [0x7f458111e413] 2023-06-09T05:01:01.520 INFO:tasks.ceph.mds.c.smithi090.stderr: 6: (SimpleLock::put_xlock()+0x332) [0x557835df91d2] 2023-06-09T05:01:01.520 INFO:tasks.ceph.mds.c.smithi090.stderr: 7: (Locker::xlock_finish(std::_Rb_tree_const_iterator const&, MutationImpl*, bool*)+0x8c) [0x557835de2a4c] 2023-06-09T05:01:01.520 INFO:tasks.ceph.mds.c.smithi090.stderr: 8: (Locker::_drop_locks(MutationImpl*, std::set, std::allocator >*, bool)+0x3f0) [0x557835de32b0] 2023-06-09T05:01:01.520 INFO:tasks.ceph.mds.c.smithi090.stderr: 9: (Locker::drop_non_rdlocks(MutationImpl*, std::set, std::allocator >*)+0x5f) [0x557835de3d0f] 2023-06-09T05:01:01.521 INFO:tasks.ceph.mds.c.smithi090.stderr: 10: (Server::reply_client_request(boost::intrusive_ptr&, boost::intrusive_ptr const&)+0x48d) [0x557835c4ec9d] 2023-06-09T05:01:01.521 INFO:tasks.ceph.mds.c.smithi090.stderr: 11: (Server::respond_to_request(boost::intrusive_ptr&, int)+0x350) [0x557835c4fae0] 2023-06-09T05:01:01.521 INFO:tasks.ceph.mds.c.smithi090.stderr: 12: (Server::_link_local_finish(boost::intrusive_ptr&, CDentry*, CInode*, unsigned long, unsigned long, bool)+0xf5) [0x557835c51915] 2023-06-09T05:01:01.521 INFO:tasks.ceph.mds.c.smithi090.stderr: 13: (C_MDS_link_local_finish::finish(int)+0x35) [0x557835ccd8e5] 2023-06-09T05:01:01.521 INFO:tasks.ceph.mds.c.smithi090.stderr: 14: (MDSContext::complete(int)+0x5f) [0x557835f239df] 2023-06-09T05:01:01.521 INFO:tasks.ceph.mds.c.smithi090.stderr: 15: (MDSIOContextBase::complete(int)+0x514) [0x557835f24144] 2023-06-09T05:01:01.521 INFO:tasks.ceph.mds.c.smithi090.stderr: 16: (MDSLogContextBase::complete(int)+0x5b) [0x557835f244db] 2023-06-09T05:01:01.522 INFO:tasks.ceph.mds.c.smithi090.stderr: 17: (Finisher::finisher_thread_entry()+0x18d) [0x7f45811c4dbd] 2023-06-09T05:01:01.522 INFO:tasks.ceph.mds.c.smithi090.stderr: 18: /lib/x86_64-linux-gnu/libpthread.so.0(+0x8609) [0x7f4581c15609] 2023-06-09T05:01:01.522 INFO:tasks.ceph.mds.c.smithi090.stderr: 19: clone() 2023-06-09T05:01:01.522 INFO:tasks.ceph.mds.c.smithi090.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-06-09T05:01:01.522 INFO:tasks.ceph.mds.c.smithi090.stderr: 2023-06-09T05:01:01.556 INFO:tasks.ceph.mds.c.smithi090.stderr: -9> 2023-06-09T05:01:01.502+0000 7f4574dc6700 -1 /build/ceph-18.0.0-4313-ga02638f8/src/mds/SimpleLock.h: In function 'void SimpleLock::put_xlock()' thread 7f4574dc6700 time 2023-06-09T05:01:01.502513+0000 2023-06-09T05:01:01.556 INFO:tasks.ceph.mds.c.smithi090.stderr:/build/ceph-18.0.0-4313-ga02638f8/src/mds/SimpleLock.h: 417: FAILED ceph_assert(state == LOCK_XLOCK || state == LOCK_XLOCKDONE || state == LOCK_XLOCKSNAP || state == LOCK_LOCK_XLOCK || state == LOCK_LOCK || is_locallock()) 2023-06-09T05:01:01.556 INFO:tasks.ceph.mds.c.smithi090.stderr: 2023-06-09T05:01:01.556 INFO:tasks.ceph.mds.c.smithi090.stderr: ceph version 18.0.0-4313-ga02638f8 (a02638f808b8fe11bccdd01222c0e6e2eb71120b) reef (dev) 2023-06-09T05:01:01.557 INFO:tasks.ceph.mds.c.smithi090.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x128) [0x7f458111e257] 2023-06-09T05:01:01.557 INFO:tasks.ceph.mds.c.smithi090.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x31e413) [0x7f458111e413] 2023-06-09T05:01:01.557 INFO:tasks.ceph.mds.c.smithi090.stderr: 3: (SimpleLock::put_xlock()+0x332) [0x557835df91d2] 2023-06-09T05:01:01.557 INFO:tasks.ceph.mds.c.smithi090.stderr: 4: (Locker::xlock_finish(std::_Rb_tree_const_iterator const&, MutationImpl*, bool*)+0x8c) [0x557835de2a4c] 2023-06-09T05:01:01.557 INFO:tasks.ceph.mds.c.smithi090.stderr: 5: (Locker::_drop_locks(MutationImpl*, std::set, std::allocator >*, bool)+0x3f0) [0x557835de32b0] 2023-06-09T05:01:01.557 INFO:tasks.ceph.mds.c.smithi090.stderr: 6: (Locker::drop_non_rdlocks(MutationImpl*, std::set, std::allocator >*)+0x5f) [0x557835de3d0f] 2023-06-09T05:01:01.557 INFO:tasks.ceph.mds.c.smithi090.stderr: 7: (Server::reply_client_request(boost::intrusive_ptr&, boost::intrusive_ptr const&)+0x48d) [0x557835c4ec9d] 2023-06-09T05:01:01.558 INFO:tasks.ceph.mds.c.smithi090.stderr: 8: (Server::respond_to_request(boost::intrusive_ptr&, int)+0x350) [0x557835c4fae0] 2023-06-09T05:01:01.558 INFO:tasks.ceph.mds.c.smithi090.stderr: 9: (Server::_link_local_finish(boost::intrusive_ptr&, CDentry*, CInode*, unsigned long, unsigned long, bool)+0xf5) [0x557835c51915] 2023-06-09T05:01:01.558 INFO:tasks.ceph.mds.c.smithi090.stderr: 10: (C_MDS_link_local_finish::finish(int)+0x35) [0x557835ccd8e5] 2023-06-09T05:01:01.558 INFO:tasks.ceph.mds.c.smithi090.stderr: 11: (MDSContext::complete(int)+0x5f) [0x557835f239df] 2023-06-09T05:01:01.558 INFO:tasks.ceph.mds.c.smithi090.stderr: 12: (MDSIOContextBase::complete(int)+0x514) [0x557835f24144] 2023-06-09T05:01:01.558 INFO:tasks.ceph.mds.c.smithi090.stderr: 13: (MDSLogContextBase::complete(int)+0x5b) [0x557835f244db] 2023-06-09T05:01:01.558 INFO:tasks.ceph.mds.c.smithi090.stderr: 14: (Finisher::finisher_thread_entry()+0x18d) [0x7f45811c4dbd] 2023-06-09T05:01:01.558 INFO:tasks.ceph.mds.c.smithi090.stderr: 15: /lib/x86_64-linux-gnu/libpthread.so.0(+0x8609) [0x7f4581c15609] 2023-06-09T05:01:01.559 INFO:tasks.ceph.mds.c.smithi090.stderr: 16: clone() 2023-06-09T05:01:01.559 INFO:tasks.ceph.mds.c.smithi090.stderr: 2023-06-09T05:01:01.559 INFO:tasks.ceph.mds.c.smithi090.stderr: 0> 2023-06-09T05:01:01.502+0000 7f4574dc6700 -1 *** Caught signal (Aborted) ** 2023-06-09T05:01:01.559 INFO:tasks.ceph.mds.c.smithi090.stderr: in thread 7f4574dc6700 thread_name:MR_Finisher 2023-06-09T05:01:01.559 INFO:tasks.ceph.mds.c.smithi090.stderr: 2023-06-09T05:01:01.559 INFO:tasks.ceph.mds.c.smithi090.stderr: ceph version 18.0.0-4313-ga02638f8 (a02638f808b8fe11bccdd01222c0e6e2eb71120b) reef (dev) 2023-06-09T05:01:01.559 INFO:tasks.ceph.mds.c.smithi090.stderr: 1: /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420) [0x7f4581c21420] 2023-06-09T05:01:01.559 INFO:tasks.ceph.mds.c.smithi090.stderr: 2: gsignal() 2023-06-09T05:01:01.560 INFO:tasks.ceph.mds.c.smithi090.stderr: 3: abort() 2023-06-09T05:01:01.560 INFO:tasks.ceph.mds.c.smithi090.stderr: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x182) [0x7f458111e2b1] 2023-06-09T05:01:01.560 INFO:tasks.ceph.mds.c.smithi090.stderr: 5: /usr/lib/ceph/libceph-common.so.2(+0x31e413) [0x7f458111e413] 2023-06-09T05:01:01.560 INFO:tasks.ceph.mds.c.smithi090.stderr: 6: (SimpleLock::put_xlock()+0x332) [0x557835df91d2] 2023-06-09T05:01:01.560 INFO:tasks.ceph.mds.c.smithi090.stderr: 7: (Locker::xlock_finish(std::_Rb_tree_const_iterator const&, MutationImpl*, bool*)+0x8c) [0x557835de2a4c] 2023-06-09T05:01:01.560 INFO:tasks.ceph.mds.c.smithi090.stderr: 8: (Locker::_drop_locks(MutationImpl*, std::set, std::allocator >*, bool)+0x3f0) [0x557835de32b0] 2023-06-09T05:01:01.560 INFO:tasks.ceph.mds.c.smithi090.stderr: 9: (Locker::drop_non_rdlocks(MutationImpl*, std::set, std::allocator >*)+0x5f) [0x557835de3d0f] 2023-06-09T05:01:01.561 INFO:tasks.ceph.mds.c.smithi090.stderr: 10: (Server::reply_client_request(boost::intrusive_ptr&, boost::intrusive_ptr const&)+0x48d) [0x557835c4ec9d] 2023-06-09T05:01:01.561 INFO:tasks.ceph.mds.c.smithi090.stderr: 11: (Server::respond_to_request(boost::intrusive_ptr&, int)+0x350) [0x557835c4fae0] 2023-06-09T05:01:01.561 INFO:tasks.ceph.mds.c.smithi090.stderr: 12: (Server::_link_local_finish(boost::intrusive_ptr&, CDentry*, CInode*, unsigned long, unsigned long, bool)+0xf5) [0x557835c51915] 2023-06-09T05:01:01.561 INFO:tasks.ceph.mds.c.smithi090.stderr: 13: (C_MDS_link_local_finish::finish(int)+0x35) [0x557835ccd8e5] 2023-06-09T05:01:01.561 INFO:tasks.ceph.mds.c.smithi090.stderr: 14: (MDSContext::complete(int)+0x5f) [0x557835f239df] 2023-06-09T05:01:01.561 INFO:tasks.ceph.mds.c.smithi090.stderr: 15: (MDSIOContextBase::complete(int)+0x514) [0x557835f24144] 2023-06-09T05:01:01.561 INFO:tasks.ceph.mds.c.smithi090.stderr: 16: (MDSLogContextBase::complete(int)+0x5b) [0x557835f244db] 2023-06-09T05:01:01.561 INFO:tasks.ceph.mds.c.smithi090.stderr: 17: (Finisher::finisher_thread_entry()+0x18d) [0x7f45811c4dbd] 2023-06-09T05:01:01.562 INFO:tasks.ceph.mds.c.smithi090.stderr: 18: /lib/x86_64-linux-gnu/libpthread.so.0(+0x8609) [0x7f4581c15609] 2023-06-09T05:01:01.562 INFO:tasks.ceph.mds.c.smithi090.stderr: 19: clone() 2023-06-09T05:01:01.562 INFO:tasks.ceph.mds.c.smithi090.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-06-09T05:01:01.562 INFO:tasks.ceph.mds.c.smithi090.stderr: 2023-06-09T05:01:01.575 INFO:tasks.ceph.mds.c.smithi090.stderr: -61> 2023-06-09T05:01:01.502+0000 7f4574dc6700 -1 /build/ceph-18.0.0-4313-ga02638f8/src/mds/SimpleLock.h: In function 'void SimpleLock::put_xlock()' thread 7f4574dc6700 time 2023-06-09T05:01:01.502513+0000 2023-06-09T05:01:01.575 INFO:tasks.ceph.mds.c.smithi090.stderr:/build/ceph-18.0.0-4313-ga02638f8/src/mds/SimpleLock.h: 417: FAILED ceph_assert(state == LOCK_XLOCK || state == LOCK_XLOCKDONE || state == LOCK_XLOCKSNAP || state == LOCK_LOCK_XLOCK || state == LOCK_LOCK || is_locallock()) 2023-06-09T05:01:01.576 INFO:tasks.ceph.mds.c.smithi090.stderr: 2023-06-09T05:01:01.576 INFO:tasks.ceph.mds.c.smithi090.stderr: ceph version 18.0.0-4313-ga02638f8 (a02638f808b8fe11bccdd01222c0e6e2eb71120b) reef (dev) 2023-06-09T05:01:01.576 INFO:tasks.ceph.mds.c.smithi090.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x128) [0x7f458111e257] 2023-06-09T05:01:01.576 INFO:tasks.ceph.mds.c.smithi090.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x31e413) [0x7f458111e413] 2023-06-09T05:01:01.576 INFO:tasks.ceph.mds.c.smithi090.stderr: 3: (SimpleLock::put_xlock()+0x332) [0x557835df91d2] 2023-06-09T05:01:01.576 INFO:tasks.ceph.mds.c.smithi090.stderr: 4: (Locker::xlock_finish(std::_Rb_tree_const_iterator const&, MutationImpl*, bool*)+0x8c) [0x557835de2a4c] 2023-06-09T05:01:01.576 INFO:tasks.ceph.mds.c.smithi090.stderr: 5: (Locker::_drop_locks(MutationImpl*, std::set, std::allocator >*, bool)+0x3f0) [0x557835de32b0] 2023-06-09T05:01:01.577 INFO:tasks.ceph.mds.c.smithi090.stderr: 6: (Locker::drop_non_rdlocks(MutationImpl*, std::set, std::allocator >*)+0x5f) [0x557835de3d0f] 2023-06-09T05:01:01.577 INFO:tasks.ceph.mds.c.smithi090.stderr: 7: (Server::reply_client_request(boost::intrusive_ptr&, boost::intrusive_ptr const&)+0x48d) [0x557835c4ec9d] 2023-06-09T05:01:01.577 INFO:tasks.ceph.mds.c.smithi090.stderr: 8: (Server::respond_to_request(boost::intrusive_ptr&, int)+0x350) [0x557835c4fae0] 2023-06-09T05:01:01.577 INFO:tasks.ceph.mds.c.smithi090.stderr: 9: (Server::_link_local_finish(boost::intrusive_ptr&, CDentry*, CInode*, unsigned long, unsigned long, bool)+0xf5) [0x557835c51915] 2023-06-09T05:01:01.577 INFO:tasks.ceph.mds.c.smithi090.stderr: 10: (C_MDS_link_local_finish::finish(int)+0x35) [0x557835ccd8e5] 2023-06-09T05:01:01.577 INFO:tasks.ceph.mds.c.smithi090.stderr: 11: (MDSContext::complete(int)+0x5f) [0x557835f239df] 2023-06-09T05:01:01.577 INFO:tasks.ceph.mds.c.smithi090.stderr: 12: (MDSIOContextBase::complete(int)+0x514) [0x557835f24144] 2023-06-09T05:01:01.578 INFO:tasks.ceph.mds.c.smithi090.stderr: 13: (MDSLogContextBase::complete(int)+0x5b) [0x557835f244db] 2023-06-09T05:01:01.578 INFO:tasks.ceph.mds.c.smithi090.stderr: 14: (Finisher::finisher_thread_entry()+0x18d) [0x7f45811c4dbd] 2023-06-09T05:01:01.578 INFO:tasks.ceph.mds.c.smithi090.stderr: 15: /lib/x86_64-linux-gnu/libpthread.so.0(+0x8609) [0x7f4581c15609] 2023-06-09T05:01:01.578 INFO:tasks.ceph.mds.c.smithi090.stderr: 16: clone() 2023-06-09T05:01:01.578 INFO:tasks.ceph.mds.c.smithi090.stderr: 2023-06-09T05:01:01.578 INFO:tasks.ceph.mds.c.smithi090.stderr: -52> 2023-06-09T05:01:01.502+0000 7f4574dc6700 -1 *** Caught signal (Aborted) ** 2023-06-09T05:01:01.578 INFO:tasks.ceph.mds.c.smithi090.stderr: in thread 7f4574dc6700 thread_name:MR_Finisher 2023-06-09T05:01:01.578 INFO:tasks.ceph.mds.c.smithi090.stderr: 2023-06-09T05:01:01.579 INFO:tasks.ceph.mds.c.smithi090.stderr: ceph version 18.0.0-4313-ga02638f8 (a02638f808b8fe11bccdd01222c0e6e2eb71120b) reef (dev) 2023-06-09T05:01:01.579 INFO:tasks.ceph.mds.c.smithi090.stderr: 1: /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420) [0x7f4581c21420] 2023-06-09T05:01:01.579 INFO:tasks.ceph.mds.c.smithi090.stderr: 2: gsignal() 2023-06-09T05:01:01.579 INFO:tasks.ceph.mds.c.smithi090.stderr: 3: abort() 2023-06-09T05:01:01.579 INFO:tasks.ceph.mds.c.smithi090.stderr: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x182) [0x7f458111e2b1] 2023-06-09T05:01:01.579 INFO:tasks.ceph.mds.c.smithi090.stderr: 5: /usr/lib/ceph/libceph-common.so.2(+0x31e413) [0x7f458111e413] 2023-06-09T05:01:01.579 INFO:tasks.ceph.mds.c.smithi090.stderr: 6: (SimpleLock::put_xlock()+0x332) [0x557835df91d2] 2023-06-09T05:01:01.579 INFO:tasks.ceph.mds.c.smithi090.stderr: 7: (Locker::xlock_finish(std::_Rb_tree_const_iterator const&, MutationImpl*, bool*)+0x8c) [0x557835de2a4c] 2023-06-09T05:01:01.580 INFO:tasks.ceph.mds.c.smithi090.stderr: 8: (Locker::_drop_locks(MutationImpl*, std::set, std::allocator >*, bool)+0x3f0) [0x557835de32b0] 2023-06-09T05:01:01.580 INFO:tasks.ceph.mds.c.smithi090.stderr: 9: (Locker::drop_non_rdlocks(MutationImpl*, std::set, std::allocator >*)+0x5f) [0x557835de3d0f] 2023-06-09T05:01:01.580 INFO:tasks.ceph.mds.c.smithi090.stderr: 10: (Server::reply_client_request(boost::intrusive_ptr&, boost::intrusive_ptr const&)+0x48d) [0x557835c4ec9d] 2023-06-09T05:01:01.580 INFO:tasks.ceph.mds.c.smithi090.stderr: 11: (Server::respond_to_request(boost::intrusive_ptr&, int)+0x350) [0x557835c4fae0] 2023-06-09T05:01:01.580 INFO:tasks.ceph.mds.c.smithi090.stderr: 12: (Server::_link_local_finish(boost::intrusive_ptr&, CDentry*, CInode*, unsigned long, unsigned long, bool)+0xf5) [0x557835c51915] 2023-06-09T05:01:01.580 INFO:tasks.ceph.mds.c.smithi090.stderr: 13: (C_MDS_link_local_finish::finish(int)+0x35) [0x557835ccd8e5] 2023-06-09T05:01:01.580 INFO:tasks.ceph.mds.c.smithi090.stderr: 14: (MDSContext::complete(int)+0x5f) [0x557835f239df] 2023-06-09T05:01:01.581 INFO:tasks.ceph.mds.c.smithi090.stderr: 15: (MDSIOContextBase::complete(int)+0x514) [0x557835f24144] 2023-06-09T05:01:01.581 INFO:tasks.ceph.mds.c.smithi090.stderr: 16: (MDSLogContextBase::complete(int)+0x5b) [0x557835f244db] 2023-06-09T05:01:01.581 INFO:tasks.ceph.mds.c.smithi090.stderr: 17: (Finisher::finisher_thread_entry()+0x18d) [0x7f45811c4dbd] 2023-06-09T05:01:01.581 INFO:tasks.ceph.mds.c.smithi090.stderr: 18: /lib/x86_64-linux-gnu/libpthread.so.0(+0x8609) [0x7f4581c15609] 2023-06-09T05:01:01.581 INFO:tasks.ceph.mds.c.smithi090.stderr: 19: clone() 2023-06-09T05:01:01.581 INFO:tasks.ceph.mds.c.smithi090.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-06-09T05:01:01.581 INFO:tasks.ceph.mds.c.smithi090.stderr: 2023-06-09T05:01:02.671 INFO:tasks.ceph.mds.c.smithi090.stderr:daemon-helper: command crashed with signal 6 2023-06-09T05:01:08.005 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~0s 2023-06-09T05:01:14.612 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~7s 2023-06-09T05:01:21.220 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~13s 2023-06-09T05:01:24.775 INFO:teuthology.orchestra.run.smithi090.stdout:generic/084 26s 2023-06-09T05:01:24.796 INFO:teuthology.orchestra.run.smithi090.stdout:Ran: generic/084 2023-06-09T05:01:24.796 INFO:teuthology.orchestra.run.smithi090.stdout:Passed all 1 tests 2023-06-09T05:01:24.808 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T05:01:24.847 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:01:24.848 DEBUG:teuthology.orchestra.run.smithi090:> (cd /tmp/tmp.jICg1BPnIbxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/085) 2023-06-09T05:01:25.515 INFO:teuthology.orchestra.run.smithi090.stdout:FSTYP -- ceph 2023-06-09T05:01:25.529 INFO:teuthology.orchestra.run.smithi090.stdout:PLATFORM -- Linux/x86_64 smithi090 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T05:01:25.530 INFO:teuthology.orchestra.run.smithi090.stdout:MKFS_OPTIONS -- 172.21.15.90:6789:/scratch 2023-06-09T05:01:25.535 INFO:teuthology.orchestra.run.smithi090.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBSrYJkdxJcFhAA3pMTvAiq3IjuROLw5ndprg== 172.21.15.90:6789:/scratch /tmp/tmp.dXSIBxNemoscratch 2023-06-09T05:01:25.536 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T05:01:26.390 INFO:teuthology.orchestra.run.smithi090.stdout:generic/085 [not run] require 172.21.15.90:6789:/scratch to be valid block disk 2023-06-09T05:01:26.404 INFO:teuthology.orchestra.run.smithi090.stdout:Ran: generic/085 2023-06-09T05:01:26.404 INFO:teuthology.orchestra.run.smithi090.stdout:Not run: generic/085 2023-06-09T05:01:26.404 INFO:teuthology.orchestra.run.smithi090.stdout:Passed all 1 tests 2023-06-09T05:01:26.415 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T05:01:26.490 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:01:26.490 DEBUG:teuthology.orchestra.run.smithi090:> (cd /tmp/tmp.jICg1BPnIbxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/086) 2023-06-09T05:01:27.222 INFO:teuthology.orchestra.run.smithi090.stdout:FSTYP -- ceph 2023-06-09T05:01:27.242 INFO:teuthology.orchestra.run.smithi090.stdout:PLATFORM -- Linux/x86_64 smithi090 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T05:01:27.244 INFO:teuthology.orchestra.run.smithi090.stdout:MKFS_OPTIONS -- 172.21.15.90:6789:/scratch 2023-06-09T05:01:27.254 INFO:teuthology.orchestra.run.smithi090.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBSrYJkdxJcFhAA3pMTvAiq3IjuROLw5ndprg== 172.21.15.90:6789:/scratch /tmp/tmp.dXSIBxNemoscratch 2023-06-09T05:01:27.254 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T05:01:27.829 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~20s 2023-06-09T05:01:28.114 INFO:teuthology.orchestra.run.smithi090.stdout:generic/086 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-09T05:01:28.129 INFO:teuthology.orchestra.run.smithi090.stdout:Ran: generic/086 2023-06-09T05:01:28.129 INFO:teuthology.orchestra.run.smithi090.stdout:Not run: generic/086 2023-06-09T05:01:28.129 INFO:teuthology.orchestra.run.smithi090.stdout:Passed all 1 tests 2023-06-09T05:01:28.140 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T05:01:28.211 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:01:28.211 DEBUG:teuthology.orchestra.run.smithi090:> (cd /tmp/tmp.jICg1BPnIbxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/087) 2023-06-09T05:01:28.902 INFO:teuthology.orchestra.run.smithi090.stdout:FSTYP -- ceph 2023-06-09T05:01:28.926 INFO:teuthology.orchestra.run.smithi090.stdout:PLATFORM -- Linux/x86_64 smithi090 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T05:01:28.929 INFO:teuthology.orchestra.run.smithi090.stdout:MKFS_OPTIONS -- 172.21.15.90:6789:/scratch 2023-06-09T05:01:28.933 INFO:teuthology.orchestra.run.smithi090.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBSrYJkdxJcFhAA3pMTvAiq3IjuROLw5ndprg== 172.21.15.90:6789:/scratch /tmp/tmp.dXSIBxNemoscratch 2023-06-09T05:01:28.933 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T05:01:29.969 INFO:teuthology.orchestra.run.smithi090.stdout:generic/087 0s 2023-06-09T05:01:29.991 INFO:teuthology.orchestra.run.smithi090.stdout:Ran: generic/087 2023-06-09T05:01:29.992 INFO:teuthology.orchestra.run.smithi090.stdout:Passed all 1 tests 2023-06-09T05:01:30.002 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T05:01:30.352 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:01:30.353 DEBUG:teuthology.orchestra.run.smithi090:> (cd /tmp/tmp.jICg1BPnIbxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/088) 2023-06-09T05:01:31.118 INFO:teuthology.orchestra.run.smithi090.stdout:FSTYP -- ceph 2023-06-09T05:01:31.137 INFO:teuthology.orchestra.run.smithi090.stdout:PLATFORM -- Linux/x86_64 smithi090 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T05:01:31.140 INFO:teuthology.orchestra.run.smithi090.stdout:MKFS_OPTIONS -- 172.21.15.90:6789:/scratch 2023-06-09T05:01:31.151 INFO:teuthology.orchestra.run.smithi090.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBSrYJkdxJcFhAA3pMTvAiq3IjuROLw5ndprg== 172.21.15.90:6789:/scratch /tmp/tmp.dXSIBxNemoscratch 2023-06-09T05:01:31.152 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T05:01:32.104 INFO:teuthology.orchestra.run.smithi090.stdout:generic/088 1s 2023-06-09T05:01:32.133 INFO:teuthology.orchestra.run.smithi090.stdout:Ran: generic/088 2023-06-09T05:01:32.133 INFO:teuthology.orchestra.run.smithi090.stdout:Passed all 1 tests 2023-06-09T05:01:32.147 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T05:01:32.449 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:01:32.450 DEBUG:teuthology.orchestra.run.smithi090:> (cd /tmp/tmp.jICg1BPnIbxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/089) 2023-06-09T05:01:33.237 INFO:teuthology.orchestra.run.smithi090.stdout:FSTYP -- ceph 2023-06-09T05:01:33.252 INFO:teuthology.orchestra.run.smithi090.stdout:PLATFORM -- Linux/x86_64 smithi090 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T05:01:33.258 INFO:teuthology.orchestra.run.smithi090.stdout:MKFS_OPTIONS -- 172.21.15.90:6789:/scratch 2023-06-09T05:01:33.262 INFO:teuthology.orchestra.run.smithi090.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBSrYJkdxJcFhAA3pMTvAiq3IjuROLw5ndprg== 172.21.15.90:6789:/scratch /tmp/tmp.dXSIBxNemoscratch 2023-06-09T05:01:33.262 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T05:01:34.437 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~26s 2023-06-09T05:01:41.045 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~33s 2023-06-09T05:01:47.653 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~40s 2023-06-09T05:01:54.261 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~46s 2023-06-09T05:02:00.869 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~53s 2023-06-09T05:02:07.476 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~59s 2023-06-09T05:02:14.082 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~66s 2023-06-09T05:02:20.689 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~73s 2023-06-09T05:02:27.297 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~79s 2023-06-09T05:02:33.905 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~86s 2023-06-09T05:02:40.512 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~93s 2023-06-09T05:02:46.372 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:02:46.378 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:02:47.121 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~99s 2023-06-09T05:02:53.728 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~106s 2023-06-09T05:03:00.336 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~112s 2023-06-09T05:03:06.943 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~119s 2023-06-09T05:03:13.551 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~126s 2023-06-09T05:03:16.568 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:03:16.574 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:03:20.159 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~132s 2023-06-09T05:03:26.766 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~139s 2023-06-09T05:03:33.374 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~145s 2023-06-09T05:03:39.982 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~152s 2023-06-09T05:03:46.588 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~159s 2023-06-09T05:03:46.644 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:03:46.650 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:03:53.198 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~165s 2023-06-09T05:03:59.807 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~172s 2023-06-09T05:04:06.413 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~178s 2023-06-09T05:04:13.021 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~185s 2023-06-09T05:04:16.748 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:04:16.754 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:04:19.629 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~192s 2023-06-09T05:04:26.237 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~198s 2023-06-09T05:04:32.845 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~205s 2023-06-09T05:04:39.453 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~211s 2023-06-09T05:04:46.060 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~218s 2023-06-09T05:04:46.879 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:04:46.884 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:04:52.669 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~225s 2023-06-09T05:04:59.276 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~231s 2023-06-09T05:05:05.883 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~238s 2023-06-09T05:05:12.490 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~244s 2023-06-09T05:05:17.052 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:05:17.057 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:05:19.098 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~251s 2023-06-09T05:05:25.705 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~258s 2023-06-09T05:05:32.313 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~264s 2023-06-09T05:05:38.922 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~271s 2023-06-09T05:05:45.529 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~278s 2023-06-09T05:05:47.215 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:05:47.223 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:05:52.137 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~284s 2023-06-09T05:05:58.744 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~291s 2023-06-09T05:06:05.352 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~297s 2023-06-09T05:06:11.960 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~304s 2023-06-09T05:06:11.960 INFO:tasks.daemonwatchdog.daemon_watchdog:BARK! unmounting mounts and killing all daemons 2023-06-09T05:06:11.961 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2023-06-09T05:06:11.961 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-09T05:06:11.983 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2023-06-09T05:06:11.983 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-09T05:06:12.042 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T05:06:12.378 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:12.370+0000 7ffbe108c700 1 Processor -- start 2023-06-09T05:06:12.379 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:12.370+0000 7ffbe108c700 1 -- start start 2023-06-09T05:06:12.380 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:12.370+0000 7ffbe108c700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ffbdc0cc0f0 0x7ffbdc0cd750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T05:06:12.381 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:12.370+0000 7ffbe108c700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbdc0cc6b0 con 0x7ffbdc15bf60 2023-06-09T05:06:12.381 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:12.370+0000 7ffbe108c700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbdc0cc990 con 0x7ffbdc0cdc90 2023-06-09T05:06:12.381 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:12.370+0000 7ffbe108c700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbdc0ccc70 con 0x7ffbdc0cc0f0 2023-06-09T05:06:12.381 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:12.374+0000 7ffbdbfff700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7ffbdc15bf60 0x7ffbdc06f960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:35094/0 (socket says 172.21.15.90:35094) 2023-06-09T05:06:12.381 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:12.374+0000 7ffbdbfff700 1 -- 172.21.15.90:0/3999845145 learned_addr learned my addr 172.21.15.90:0/3999845145 (peer_addr_for_me v1:172.21.15.90:0/0) 2023-06-09T05:06:12.382 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:12.374+0000 7ffbdb7fe700 1 --2- 172.21.15.90:0/3999845145 >> v2:172.21.15.174:3300/0 conn(0x7ffbdc0cc0f0 0x7ffbdc0cd750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T05:06:12.382 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:12.374+0000 7ffbdaffd700 1 -- 172.21.15.90:0/3999845145 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3033488666 0 0) 0x7ffbdc0cc6b0 con 0x7ffbdc15bf60 2023-06-09T05:06:12.382 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:12.374+0000 7ffbdaffd700 1 -- 172.21.15.90:0/3999845145 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffbc40035d0 con 0x7ffbdc15bf60 2023-06-09T05:06:12.382 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:12.374+0000 7ffbdb7fe700 1 -- 172.21.15.90:0/3999845145 >> v1:172.21.15.174:6789/0 conn(0x7ffbdc0cdc90 legacy=0x7ffbdc0ab890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T05:06:12.383 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:12.374+0000 7ffbdb7fe700 1 -- 172.21.15.90:0/3999845145 >> v1:172.21.15.90:6789/0 conn(0x7ffbdc15bf60 legacy=0x7ffbdc06f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T05:06:12.383 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:12.374+0000 7ffbdb7fe700 1 -- 172.21.15.90:0/3999845145 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbdc0ccf50 con 0x7ffbdc0cc0f0 2023-06-09T05:06:12.383 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:12.374+0000 7ffbdb7fe700 1 --2- 172.21.15.90:0/3999845145 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffbdc0cc0f0 0x7ffbdc0cd750 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ffbd0009850 tx=0x7ffbd0009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=39fd1627457f5cb3 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T05:06:12.384 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:12.374+0000 7ffbdaffd700 1 -- 172.21.15.90:0/3999845145 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbd0011830 con 0x7ffbdc0cc0f0 2023-06-09T05:06:12.384 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:12.374+0000 7ffbdaffd700 1 -- 172.21.15.90:0/3999845145 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbd0011990 con 0x7ffbdc0cc0f0 2023-06-09T05:06:12.384 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:12.374+0000 7ffbdaffd700 1 -- 172.21.15.90:0/3999845145 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbd0011d40 con 0x7ffbdc0cc0f0 2023-06-09T05:06:12.384 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:12.374+0000 7ffbe108c700 1 -- 172.21.15.90:0/3999845145 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffbdc0cc0f0 msgr2=0x7ffbdc0cd750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T05:06:12.384 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:12.374+0000 7ffbe108c700 1 --2- 172.21.15.90:0/3999845145 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffbdc0cc0f0 0x7ffbdc0cd750 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ffbd0009850 tx=0x7ffbd0009b60 comp rx=0 tx=0).stop 2023-06-09T05:06:12.384 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:12.374+0000 7ffbe108c700 1 -- 172.21.15.90:0/3999845145 shutdown_connections 2023-06-09T05:06:12.385 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:12.374+0000 7ffbe108c700 1 --2- 172.21.15.90:0/3999845145 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffbdc0cc0f0 0x7ffbdc0cd750 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T05:06:12.385 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:12.374+0000 7ffbe108c700 1 -- 172.21.15.90:0/3999845145 >> 172.21.15.90:0/3999845145 conn(0x7ffbdc06c690 msgr2=0x7ffbdc0aff00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T05:06:12.385 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:12.374+0000 7ffbe108c700 1 -- 172.21.15.90:0/3999845145 shutdown_connections 2023-06-09T05:06:12.385 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:12.374+0000 7ffbe108c700 1 -- 172.21.15.90:0/3999845145 wait complete. 2023-06-09T05:06:12.386 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:12.378+0000 7ffbe108c700 1 Processor -- start 2023-06-09T05:06:12.386 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:12.378+0000 7ffbe108c700 1 -- start start 2023-06-09T05:06:12.388 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:12.378+0000 7ffbe108c700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffbdc0cc0f0 0x7ffbdc1545d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T05:06:12.388 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:12.378+0000 7ffbe108c700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffbdc0cdc90 0x7ffbdc1584e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T05:06:12.389 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:12.378+0000 7ffbe108c700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffbdc15bf60 0x7ffbdc151c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T05:06:12.389 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:12.378+0000 7ffbe108c700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbdc14edd0 con 0x7ffbdc0cdc90 2023-06-09T05:06:12.389 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:12.382+0000 7ffbe108c700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbdc1568c0 con 0x7ffbdc15bf60 2023-06-09T05:06:12.389 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:12.382+0000 7ffbe108c700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbdc154bc0 con 0x7ffbdc0cc0f0 2023-06-09T05:06:12.390 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:12.382+0000 7ffbdb7fe700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffbdc0cdc90 0x7ffbdc1584e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T05:06:12.390 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:12.382+0000 7ffbdbfff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffbdc0cc0f0 0x7ffbdc1545d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T05:06:12.390 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:12.382+0000 7ffbdbfff700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffbdc0cc0f0 0x7ffbdc1545d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.90:39982/0 (socket says 172.21.15.90:39982) 2023-06-09T05:06:12.390 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:12.382+0000 7ffbdbfff700 1 -- 172.21.15.90:0/815669511 learned_addr learned my addr 172.21.15.90:0/815669511 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T05:06:12.390 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:12.382+0000 7ffbe088b700 1 --2- 172.21.15.90:0/815669511 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffbdc15bf60 0x7ffbdc151c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T05:06:12.391 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:12.382+0000 7ffbdb7fe700 1 -- 172.21.15.90:0/815669511 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffbdc0cc0f0 msgr2=0x7ffbdc1545d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T05:06:12.391 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:12.382+0000 7ffbdb7fe700 1 --2- 172.21.15.90:0/815669511 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffbdc0cc0f0 0x7ffbdc1545d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T05:06:12.391 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:12.382+0000 7ffbdb7fe700 1 -- 172.21.15.90:0/815669511 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffbdc15bf60 msgr2=0x7ffbdc151c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T05:06:12.391 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:12.382+0000 7ffbdb7fe700 1 --2- 172.21.15.90:0/815669511 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffbdc15bf60 0x7ffbdc151c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T05:06:12.391 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:12.382+0000 7ffbdb7fe700 1 -- 172.21.15.90:0/815669511 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbd00094b0 con 0x7ffbdc0cdc90 2023-06-09T05:06:12.391 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:12.382+0000 7ffbdbfff700 1 --2- 172.21.15.90:0/815669511 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffbdc0cc0f0 0x7ffbdc1545d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T05:06:12.391 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:12.382+0000 7ffbdb7fe700 1 --2- 172.21.15.90:0/815669511 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffbdc0cdc90 0x7ffbdc1584e0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7ffbd0016000 tx=0x7ffbd0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T05:06:12.392 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:12.382+0000 7ffbd8ff9700 1 -- 172.21.15.90:0/815669511 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbd001a990 con 0x7ffbdc0cdc90 2023-06-09T05:06:12.392 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:12.382+0000 7ffbd8ff9700 1 -- 172.21.15.90:0/815669511 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbd001f070 con 0x7ffbdc0cdc90 2023-06-09T05:06:12.392 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:12.382+0000 7ffbd8ff9700 1 -- 172.21.15.90:0/815669511 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbd001ad30 con 0x7ffbdc0cdc90 2023-06-09T05:06:12.393 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:12.382+0000 7ffbe108c700 1 -- 172.21.15.90:0/815669511 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbdc154ea0 con 0x7ffbdc0cdc90 2023-06-09T05:06:12.393 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:12.382+0000 7ffbe108c700 1 -- 172.21.15.90:0/815669511 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbdc155180 con 0x7ffbdc0cdc90 2023-06-09T05:06:12.393 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:12.382+0000 7ffbe108c700 1 -- 172.21.15.90:0/815669511 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbdc04e380 con 0x7ffbdc0cdc90 2023-06-09T05:06:12.393 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:12.386+0000 7ffbd8ff9700 1 -- 172.21.15.90:0/815669511 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ffbd002e430 con 0x7ffbdc0cdc90 2023-06-09T05:06:12.394 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:12.386+0000 7ffbd8ff9700 1 --2- 172.21.15.90:0/815669511 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7ffbc8066320 0x7ffbc80687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T05:06:12.395 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:12.386+0000 7ffbd8ff9700 1 -- 172.21.15.90:0/815669511 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6177+0+0 (secure 0 0 0) 0x7ffbd0084c80 con 0x7ffbdc0cdc90 2023-06-09T05:06:12.395 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:12.386+0000 7ffbdbfff700 1 --2- 172.21.15.90:0/815669511 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7ffbc8066320 0x7ffbc80687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T05:06:12.396 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:12.390+0000 7ffbdbfff700 1 --2- 172.21.15.90:0/815669511 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7ffbc8066320 0x7ffbc80687d0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ffbcc0011e0 tx=0x7ffbcc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T05:06:12.400 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:12.394+0000 7ffbd8ff9700 1 -- 172.21.15.90:0/815669511 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ffbd0052110 con 0x7ffbdc0cdc90 2023-06-09T05:06:12.602 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:12.594+0000 7ffbe108c700 1 -- 172.21.15.90:0/815669511 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ffbdc06b310 con 0x7ffbdc0cdc90 2023-06-09T05:06:12.605 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:12.598+0000 7ffbd8ff9700 1 -- 172.21.15.90:0/815669511 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+18529 (secure 0 0 0) 0x7ffbd0015090 con 0x7ffbdc0cdc90 2023-06-09T05:06:12.606 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-06-09T05:06:12.606 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":41,"fsid":"700369c0-a111-43b4-9415-844ad1742b70","created":"2023-06-09T04:41:28.180311+0000","modified":"2023-06-09T05:01:13.452396+0000","last_up_change":"2023-06-09T04:41:40.746475+0000","last_in_change":"2023-06-09T04:41:31.262765+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-09T04:41:42.402564+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-09T04:41:47.607323+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-06-09T04:42:55.855674+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-06-09T04:42:56.846984+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"46a4a7c5-babd-4ef3-9830-51487cff5eb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":2780271267},{"type":"v1","addr":"172.21.15.90:6809","nonce":2780271267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":2780271267},{"type":"v1","addr":"172.21.15.90:6811","nonce":2780271267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":2780271267},{"type":"v1","addr":"172.21.15.90:6815","nonce":2780271267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":2780271267},{"type":"v1","addr":"172.21.15.90:6813","nonce":2780271267}]},"public_addr":"172.21.15.90:6809/2780271267","cluster_addr":"172.21.15.90:6811/2780271267","heartbeat_back_addr":"172.21.15.90:6815/2780271267","heartbeat_front_addr":"172.21.15.90:6813/2780271267","state":["exists","up"]},{"osd":1,"uuid":"1543988f-c498-494a-a6f9-fac8413db6ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":3064028136},{"type":"v1","addr":"172.21.15.90:6801","nonce":3064028136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":3064028136},{"type":"v1","addr":"172.21.15.90:6803","nonce":3064028136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":3064028136},{"type":"v1","addr":"172.21.15.90:6807","nonce":3064028136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":3064028136},{"type":"v1","addr":"172.21.15.90:6805","nonce":3064028136}]},"public_addr":"172.21.15.90:6801/3064028136","cluster_addr":"172.21.15.90:6803/3064028136","heartbeat_back_addr":"172.21.15.90:6807/3064028136","heartbeat_front_addr":"172.21.15.90:6805/3064028136","state":["exists","up"]},{"osd":2,"uuid":"79669dd6-ffc8-4197-b9f7-b3b372b2b9b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":3713146326},{"type":"v1","addr":"172.21.15.90:6825","nonce":3713146326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":3713146326},{"type":"v1","addr":"172.21.15.90:6827","nonce":3713146326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":3713146326},{"type":"v1","addr":"172.21.15.90:6831","nonce":3713146326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":3713146326},{"type":"v1","addr":"172.21.15.90:6829","nonce":3713146326}]},"public_addr":"172.21.15.90:6825/3713146326","cluster_addr":"172.21.15.90:6827/3713146326","heartbeat_back_addr":"172.21.15.90:6831/3713146326","heartbeat_front_addr":"172.21.15.90:6829/3713146326","state":["exists","up"]},{"osd":3,"uuid":"4062ab6f-ce40-450a-aa17-b10098766c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":3499839122},{"type":"v1","addr":"172.21.15.90:6817","nonce":3499839122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":3499839122},{"type":"v1","addr":"172.21.15.90:6819","nonce":3499839122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":3499839122},{"type":"v1","addr":"172.21.15.90:6823","nonce":3499839122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":3499839122},{"type":"v1","addr":"172.21.15.90:6821","nonce":3499839122}]},"public_addr":"172.21.15.90:6817/3499839122","cluster_addr":"172.21.15.90:6819/3499839122","heartbeat_back_addr":"172.21.15.90:6823/3499839122","heartbeat_front_addr":"172.21.15.90:6821/3499839122","state":["exists","up"]},{"osd":4,"uuid":"a10820e4-b348-4d92-9796-3b01484ace1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6817","nonce":1138565854},{"type":"v1","addr":"172.21.15.174:6819","nonce":1138565854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6821","nonce":1138565854},{"type":"v1","addr":"172.21.15.174:6823","nonce":1138565854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":1138565854},{"type":"v1","addr":"172.21.15.174:6831","nonce":1138565854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":1138565854},{"type":"v1","addr":"172.21.15.174:6829","nonce":1138565854}]},"public_addr":"172.21.15.174:6819/1138565854","cluster_addr":"172.21.15.174:6823/1138565854","heartbeat_back_addr":"172.21.15.174:6831/1138565854","heartbeat_front_addr":"172.21.15.174:6829/1138565854","state":["exists","up"]},{"osd":5,"uuid":"b4da1c32-be05-420b-9346-90d91aa70569","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":1707702879},{"type":"v1","addr":"172.21.15.174:6818","nonce":1707702879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":1707702879},{"type":"v1","addr":"172.21.15.174:6822","nonce":1707702879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6827","nonce":1707702879},{"type":"v1","addr":"172.21.15.174:6828","nonce":1707702879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":1707702879},{"type":"v1","addr":"172.21.15.174:6825","nonce":1707702879}]},"public_addr":"172.21.15.174:6818/1707702879","cluster_addr":"172.21.15.174:6822/1707702879","heartbeat_back_addr":"172.21.15.174:6828/1707702879","heartbeat_front_addr":"172.21.15.174:6825/1707702879","state":["exists","up"]},{"osd":6,"uuid":"d1b98041-d243-4355-bd0a-e22cf9875b32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":864450534},{"type":"v1","addr":"172.21.15.174:6801","nonce":864450534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":864450534},{"type":"v1","addr":"172.21.15.174:6803","nonce":864450534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":864450534},{"type":"v1","addr":"172.21.15.174:6807","nonce":864450534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":864450534},{"type":"v1","addr":"172.21.15.174:6805","nonce":864450534}]},"public_addr":"172.21.15.174:6801/864450534","cluster_addr":"172.21.15.174:6803/864450534","heartbeat_back_addr":"172.21.15.174:6807/864450534","heartbeat_front_addr":"172.21.15.174:6805/864450534","state":["exists","up"]},{"osd":7,"uuid":"5a207936-f89f-416b-b79b-34ec96f77c8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":2527640659},{"type":"v1","addr":"172.21.15.174:6809","nonce":2527640659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":2527640659},{"type":"v1","addr":"172.21.15.174:6811","nonce":2527640659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":2527640659},{"type":"v1","addr":"172.21.15.174:6815","nonce":2527640659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":2527640659},{"type":"v1","addr":"172.21.15.174:6813","nonce":2527640659}]},"public_addr":"172.21.15.174:6809/2527640659","cluster_addr":"172.21.15.174:6811/2527640659","heartbeat_back_addr":"172.21.15.174:6815/2527640659","heartbeat_front_addr":"172.21.15.174:6813/2527640659","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:36.972152+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:36.984561+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:36.998817+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:37.054944+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:37.085014+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:37.115125+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:36.854608+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:41:36.971685+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.10","mappings":[{"from":5,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.90:6835/1290764843":"2023-06-10T05:01:13.452283+0000","172.21.15.90:6834/1290764843":"2023-06-10T05:01:13.452283+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T05:06:12.608 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:12.598+0000 7ffbe108c700 1 -- 172.21.15.90:0/815669511 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7ffbc8066320 msgr2=0x7ffbc80687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T05:06:12.608 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:12.598+0000 7ffbe108c700 1 --2- 172.21.15.90:0/815669511 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7ffbc8066320 0x7ffbc80687d0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ffbcc0011e0 tx=0x7ffbcc009040 comp rx=0 tx=0).stop 2023-06-09T05:06:12.608 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:12.598+0000 7ffbe108c700 1 -- 172.21.15.90:0/815669511 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffbdc0cdc90 msgr2=0x7ffbdc1584e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T05:06:12.609 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:12.598+0000 7ffbe108c700 1 --2- 172.21.15.90:0/815669511 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffbdc0cdc90 0x7ffbdc1584e0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7ffbd0016000 tx=0x7ffbd0004770 comp rx=0 tx=0).stop 2023-06-09T05:06:12.609 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:12.598+0000 7ffbe108c700 1 -- 172.21.15.90:0/815669511 shutdown_connections 2023-06-09T05:06:12.609 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:12.598+0000 7ffbe108c700 1 --2- 172.21.15.90:0/815669511 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7ffbc8066320 0x7ffbc80687d0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T05:06:12.609 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:12.598+0000 7ffbe108c700 1 --2- 172.21.15.90:0/815669511 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffbdc15bf60 0x7ffbdc151c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T05:06:12.609 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:12.598+0000 7ffbe108c700 1 --2- 172.21.15.90:0/815669511 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffbdc0cdc90 0x7ffbdc1584e0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T05:06:12.609 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:12.598+0000 7ffbe108c700 1 --2- 172.21.15.90:0/815669511 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffbdc0cc0f0 0x7ffbdc1545d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T05:06:12.609 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:12.598+0000 7ffbe108c700 1 -- 172.21.15.90:0/815669511 >> 172.21.15.90:0/815669511 conn(0x7ffbdc06c690 msgr2=0x7ffbdc069820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T05:06:12.610 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:12.602+0000 7ffbe108c700 1 -- 172.21.15.90:0/815669511 shutdown_connections 2023-06-09T05:06:12.610 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:12.602+0000 7ffbe108c700 1 -- 172.21.15.90:0/815669511 wait complete. 2023-06-09T05:06:12.630 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-09T04:41:42.402564+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-09T04:41:47.607323+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-09T04:42:55.855674+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-06-09T04:42:56.846984+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-09T05:06:12.630 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-09T05:06:12.798 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:12.790+0000 7f6695e36700 1 Processor -- start 2023-06-09T05:06:12.799 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:12.790+0000 7f6695e36700 1 -- start start 2023-06-09T05:06:12.800 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:12.790+0000 7f6695e36700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f66900b18d0 0x7f6690160920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T05:06:12.800 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:12.790+0000 7f6695e36700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f66900d2400 0x7f66900d28a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T05:06:12.800 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:12.790+0000 7f6695e36700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f669015c6b0 con 0x7f66900b1ca0 2023-06-09T05:06:12.800 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:12.790+0000 7f6695e36700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66900d2de0 con 0x7f66900b18d0 2023-06-09T05:06:12.800 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:12.790+0000 7f6695e36700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66900cf6a0 con 0x7f66900d2400 2023-06-09T05:06:12.801 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:12.794+0000 7f6694e34700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f66900b18d0 0x7f6690160920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T05:06:12.801 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:12.794+0000 7f6695635700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f66900d2400 0x7f66900d28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T05:06:12.801 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:12.794+0000 7f6687fff700 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f66900b1ca0 0x7f66900cee90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.90:55004/0 (socket says 172.21.15.90:55004) 2023-06-09T05:06:12.801 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:12.794+0000 7f6687fff700 1 -- 172.21.15.90:0/1834218256 learned_addr learned my addr 172.21.15.90:0/1834218256 (peer_addr_for_me v1:172.21.15.90:0/0) 2023-06-09T05:06:12.802 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:12.794+0000 7f66877fe700 1 -- 172.21.15.90:0/1834218256 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1729680017 0 0) 0x7f669015c6b0 con 0x7f66900b1ca0 2023-06-09T05:06:12.802 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:12.794+0000 7f66877fe700 1 -- 172.21.15.90:0/1834218256 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f66780035d0 con 0x7f66900b1ca0 2023-06-09T05:06:12.802 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:12.794+0000 7f6694e34700 1 -- 172.21.15.90:0/1834218256 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f66900d2400 msgr2=0x7f66900d28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T05:06:12.803 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:12.794+0000 7f6694e34700 1 --2- 172.21.15.90:0/1834218256 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f66900d2400 0x7f66900d28a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T05:06:12.803 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:12.794+0000 7f6694e34700 1 -- 172.21.15.90:0/1834218256 >> v1:172.21.15.174:6789/0 conn(0x7f66900b1ca0 legacy=0x7f66900cee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T05:06:12.803 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:12.794+0000 7f6694e34700 1 -- 172.21.15.90:0/1834218256 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66900cf980 con 0x7f66900b18d0 2023-06-09T05:06:12.803 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:12.794+0000 7f6694e34700 1 --2- 172.21.15.90:0/1834218256 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f66900b18d0 0x7f6690160920 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f668c009d80 tx=0x7f668c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87c960e1cccbbc82 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T05:06:12.804 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:12.794+0000 7f66877fe700 1 -- 172.21.15.90:0/1834218256 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f668c00e070 con 0x7f66900b18d0 2023-06-09T05:06:12.804 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:12.794+0000 7f66877fe700 1 -- 172.21.15.90:0/1834218256 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f668c00bb20 con 0x7f66900b18d0 2023-06-09T05:06:12.804 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:12.794+0000 7f66877fe700 1 -- 172.21.15.90:0/1834218256 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f668c00be90 con 0x7f66900b18d0 2023-06-09T05:06:12.804 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:12.794+0000 7f6695e36700 1 -- 172.21.15.90:0/1834218256 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f66900b18d0 msgr2=0x7f6690160920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T05:06:12.804 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:12.794+0000 7f6695e36700 1 --2- 172.21.15.90:0/1834218256 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f66900b18d0 0x7f6690160920 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f668c009d80 tx=0x7f668c00b330 comp rx=0 tx=0).stop 2023-06-09T05:06:12.805 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:12.794+0000 7f6695e36700 1 -- 172.21.15.90:0/1834218256 shutdown_connections 2023-06-09T05:06:12.805 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:12.794+0000 7f6695e36700 1 --2- 172.21.15.90:0/1834218256 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f66900d2400 0x7f66900d28a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T05:06:12.805 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:12.794+0000 7f6695e36700 1 --2- 172.21.15.90:0/1834218256 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f66900b18d0 0x7f6690160920 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T05:06:12.805 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:12.794+0000 7f6695e36700 1 -- 172.21.15.90:0/1834218256 >> 172.21.15.90:0/1834218256 conn(0x7f669009b9b0 msgr2=0x7f66900b55d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T05:06:12.805 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:12.794+0000 7f6695e36700 1 -- 172.21.15.90:0/1834218256 shutdown_connections 2023-06-09T05:06:12.805 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:12.794+0000 7f6695e36700 1 -- 172.21.15.90:0/1834218256 wait complete. 2023-06-09T05:06:12.806 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:12.798+0000 7f6695e36700 1 Processor -- start 2023-06-09T05:06:12.806 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:12.798+0000 7f6695e36700 1 -- start start 2023-06-09T05:06:12.807 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:12.798+0000 7f6695e36700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f66900b18d0 0x7f66900c99c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T05:06:12.807 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:12.798+0000 7f6695e36700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f66900b1ca0 0x7f669015da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T05:06:12.807 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:12.798+0000 7f6695e36700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f66900d2400 0x7f669015df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T05:06:12.807 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:12.798+0000 7f6695e36700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66900b3020 con 0x7f66900d2400 2023-06-09T05:06:12.808 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:12.798+0000 7f6695e36700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66900b29b0 con 0x7f66900b18d0 2023-06-09T05:06:12.808 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:12.798+0000 7f6695e36700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f669015e590 con 0x7f66900b1ca0 2023-06-09T05:06:12.809 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:12.798+0000 7f6695635700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f66900d2400 0x7f669015df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T05:06:12.809 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:12.798+0000 7f6695635700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f66900d2400 0x7f669015df60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:51718/0 (socket says 172.21.15.90:51718) 2023-06-09T05:06:12.809 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:12.798+0000 7f6695635700 1 -- 172.21.15.90:0/2220661248 learned_addr learned my addr 172.21.15.90:0/2220661248 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T05:06:12.809 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:12.798+0000 7f6694e34700 1 --2- 172.21.15.90:0/2220661248 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f66900b18d0 0x7f66900c99c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T05:06:12.810 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:12.798+0000 7f6687fff700 1 --2- 172.21.15.90:0/2220661248 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f66900b1ca0 0x7f669015da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T05:06:12.810 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:12.798+0000 7f6695635700 1 -- 172.21.15.90:0/2220661248 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f66900b1ca0 msgr2=0x7f669015da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T05:06:12.810 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:12.798+0000 7f6695635700 1 --2- 172.21.15.90:0/2220661248 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f66900b1ca0 0x7f669015da20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T05:06:12.810 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:12.798+0000 7f6695635700 1 -- 172.21.15.90:0/2220661248 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f66900b18d0 msgr2=0x7f66900c99c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T05:06:12.810 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:12.798+0000 7f6695635700 1 --2- 172.21.15.90:0/2220661248 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f66900b18d0 0x7f66900c99c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T05:06:12.810 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:12.798+0000 7f6695635700 1 -- 172.21.15.90:0/2220661248 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f668c009a10 con 0x7f66900d2400 2023-06-09T05:06:12.810 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:12.798+0000 7f6694e34700 1 --2- 172.21.15.90:0/2220661248 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f66900b18d0 0x7f66900c99c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T05:06:12.810 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:12.802+0000 7f6695635700 1 --2- 172.21.15.90:0/2220661248 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f66900d2400 0x7f669015df60 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f668800e7f0 tx=0x7f668800ebb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T05:06:12.811 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:12.802+0000 7f66857fa700 1 -- 172.21.15.90:0/2220661248 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66880095c0 con 0x7f66900d2400 2023-06-09T05:06:12.811 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:12.802+0000 7f66857fa700 1 -- 172.21.15.90:0/2220661248 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6688013680 con 0x7f66900d2400 2023-06-09T05:06:12.811 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:12.802+0000 7f6695e36700 1 -- 172.21.15.90:0/2220661248 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f669015e870 con 0x7f66900d2400 2023-06-09T05:06:12.811 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:12.802+0000 7f66857fa700 1 -- 172.21.15.90:0/2220661248 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6688013a10 con 0x7f66900d2400 2023-06-09T05:06:12.811 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:12.802+0000 7f6695e36700 1 -- 172.21.15.90:0/2220661248 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66900b3550 con 0x7f66900d2400 2023-06-09T05:06:12.812 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:12.802+0000 7f6695e36700 1 -- 172.21.15.90:0/2220661248 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66900b3770 con 0x7f66900d2400 2023-06-09T05:06:12.812 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:12.802+0000 7f66857fa700 1 -- 172.21.15.90:0/2220661248 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6688013b70 con 0x7f66900d2400 2023-06-09T05:06:12.813 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:12.806+0000 7f66857fa700 1 --2- 172.21.15.90:0/2220661248 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f667c0662f0 0x7f667c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T05:06:12.814 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:12.806+0000 7f66857fa700 1 -- 172.21.15.90:0/2220661248 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6177+0+0 (secure 0 0 0) 0x7f6688083de0 con 0x7f66900d2400 2023-06-09T05:06:12.814 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:12.806+0000 7f6694e34700 1 --2- 172.21.15.90:0/2220661248 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f667c0662f0 0x7f667c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T05:06:12.815 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:12.806+0000 7f6694e34700 1 --2- 172.21.15.90:0/2220661248 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f667c0662f0 0x7f667c0687a0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f668c014040 tx=0x7f668c011000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T05:06:12.819 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:12.810+0000 7f66857fa700 1 -- 172.21.15.90:0/2220661248 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6688051140 con 0x7f66900d2400 2023-06-09T05:06:12.996 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:12.986+0000 7f6695e36700 1 -- 172.21.15.90:0/2220661248 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f669004e380 con 0x7f66900d2400 2023-06-09T05:06:12.997 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:12.990+0000 7f66857fa700 1 -- 172.21.15.90:0/2220661248 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v41) v1 ==== 93+0+10 (secure 0 0 0) 0x7f66880170a0 con 0x7f66900d2400 2023-06-09T05:06:12.997 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 1 2023-06-09T05:06:13.000 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:12.990+0000 7f6695e36700 1 -- 172.21.15.90:0/2220661248 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f667c0662f0 msgr2=0x7f667c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T05:06:13.000 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:12.990+0000 7f6695e36700 1 --2- 172.21.15.90:0/2220661248 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f667c0662f0 0x7f667c0687a0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f668c014040 tx=0x7f668c011000 comp rx=0 tx=0).stop 2023-06-09T05:06:13.001 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:12.990+0000 7f6695e36700 1 -- 172.21.15.90:0/2220661248 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f66900d2400 msgr2=0x7f669015df60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T05:06:13.001 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:12.990+0000 7f6695e36700 1 --2- 172.21.15.90:0/2220661248 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f66900d2400 0x7f669015df60 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f668800e7f0 tx=0x7f668800ebb0 comp rx=0 tx=0).stop 2023-06-09T05:06:13.001 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:12.990+0000 7f6695e36700 1 -- 172.21.15.90:0/2220661248 shutdown_connections 2023-06-09T05:06:13.001 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:12.990+0000 7f6695e36700 1 --2- 172.21.15.90:0/2220661248 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f667c0662f0 0x7f667c0687a0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T05:06:13.001 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:12.990+0000 7f6695e36700 1 --2- 172.21.15.90:0/2220661248 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f66900d2400 0x7f669015df60 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T05:06:13.001 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:12.990+0000 7f6695e36700 1 --2- 172.21.15.90:0/2220661248 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f66900b1ca0 0x7f669015da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T05:06:13.001 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:12.990+0000 7f6695e36700 1 --2- 172.21.15.90:0/2220661248 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f66900b18d0 0x7f66900c99c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T05:06:13.001 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:12.990+0000 7f6695e36700 1 -- 172.21.15.90:0/2220661248 >> 172.21.15.90:0/2220661248 conn(0x7f669009b9b0 msgr2=0x7f66900afe10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T05:06:13.002 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:12.994+0000 7f6695e36700 1 -- 172.21.15.90:0/2220661248 shutdown_connections 2023-06-09T05:06:13.002 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:12.994+0000 7f6695e36700 1 -- 172.21.15.90:0/2220661248 wait complete. 2023-06-09T05:06:13.023 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-09T05:06:13.194 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:13.186+0000 7face1f15700 1 Processor -- start 2023-06-09T05:06:13.194 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:13.186+0000 7face1f15700 1 -- start start 2023-06-09T05:06:13.195 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:13.186+0000 7face1f15700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7facd40e0750 0x7facd40514c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T05:06:13.196 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:13.186+0000 7face1f15700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7facd400c410 0x7facd400c890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T05:06:13.196 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:13.186+0000 7face1f15700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facd4053470 con 0x7facd4053020 2023-06-09T05:06:13.196 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:13.186+0000 7face1f15700 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facd400cdd0 con 0x7facd400c410 2023-06-09T05:06:13.196 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:13.186+0000 7face1f15700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facd403a460 con 0x7facd40e0750 2023-06-09T05:06:13.197 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:13.186+0000 7face1714700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7facd400c410 0x7facd400c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T05:06:13.197 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:13.186+0000 7face1714700 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7facd400c410 0x7facd400c890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:51720/0 (socket says 172.21.15.90:51720) 2023-06-09T05:06:13.197 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:13.186+0000 7face1714700 1 -- 172.21.15.90:0/3143840730 learned_addr learned my addr 172.21.15.90:0/3143840730 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T05:06:13.197 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:13.186+0000 7face0f13700 1 --2- 172.21.15.90:0/3143840730 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7facd40e0750 0x7facd40514c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T05:06:13.197 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:13.190+0000 7face1714700 1 -- 172.21.15.90:0/3143840730 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7facd40e0750 msgr2=0x7facd40514c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T05:06:13.198 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:13.190+0000 7face1714700 1 --2- 172.21.15.90:0/3143840730 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7facd40e0750 0x7facd40514c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T05:06:13.198 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:13.190+0000 7face1714700 1 -- 172.21.15.90:0/3143840730 >> v1:172.21.15.174:6789/0 conn(0x7facd4053020 legacy=0x7facd4039d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T05:06:13.198 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:13.190+0000 7face1714700 1 -- 172.21.15.90:0/3143840730 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facd40554f0 con 0x7facd400c410 2023-06-09T05:06:13.199 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:13.190+0000 7face1714700 1 --2- 172.21.15.90:0/3143840730 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7facd400c410 0x7facd400c890 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7facdc04ee10 tx=0x7facdc067960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=790326c597c209f6 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T05:06:13.199 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:13.190+0000 7facdb7fe700 1 -- 172.21.15.90:0/3143840730 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facdc067300 con 0x7facd400c410 2023-06-09T05:06:13.199 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:13.190+0000 7facdb7fe700 1 -- 172.21.15.90:0/3143840730 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facdc04e440 con 0x7facd400c410 2023-06-09T05:06:13.199 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:13.190+0000 7facdb7fe700 1 -- 172.21.15.90:0/3143840730 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facdc065b40 con 0x7facd400c410 2023-06-09T05:06:13.199 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:13.190+0000 7face1f15700 1 -- 172.21.15.90:0/3143840730 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7facd400c410 msgr2=0x7facd400c890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T05:06:13.199 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:13.190+0000 7face1f15700 1 --2- 172.21.15.90:0/3143840730 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7facd400c410 0x7facd400c890 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7facdc04ee10 tx=0x7facdc067960 comp rx=0 tx=0).stop 2023-06-09T05:06:13.200 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:13.190+0000 7face1f15700 1 -- 172.21.15.90:0/3143840730 shutdown_connections 2023-06-09T05:06:13.200 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:13.190+0000 7face1f15700 1 --2- 172.21.15.90:0/3143840730 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7facd400c410 0x7facd400c890 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T05:06:13.200 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:13.190+0000 7face1f15700 1 --2- 172.21.15.90:0/3143840730 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7facd40e0750 0x7facd40514c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T05:06:13.200 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:13.190+0000 7face1f15700 1 -- 172.21.15.90:0/3143840730 >> 172.21.15.90:0/3143840730 conn(0x7facd4056f00 msgr2=0x7facd4057300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T05:06:13.200 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:13.190+0000 7face1f15700 1 -- 172.21.15.90:0/3143840730 shutdown_connections 2023-06-09T05:06:13.200 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:13.190+0000 7face1f15700 1 -- 172.21.15.90:0/3143840730 wait complete. 2023-06-09T05:06:13.202 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:13.194+0000 7face1f15700 1 Processor -- start 2023-06-09T05:06:13.202 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:13.194+0000 7face1f15700 1 -- start start 2023-06-09T05:06:13.205 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:13.198+0000 7face1f15700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7facd400c410 0x7facd417a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T05:06:13.205 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:13.198+0000 7face1f15700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7facd4053020 0x7facd404f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T05:06:13.205 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:13.198+0000 7face1f15700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7facd40e0750 0x7facd404f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T05:06:13.205 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:13.198+0000 7face1f15700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facd4179fc0 con 0x7facd4053020 2023-06-09T05:06:13.205 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:13.198+0000 7face1f15700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facd4176170 con 0x7facd400c410 2023-06-09T05:06:13.206 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:13.198+0000 7face1f15700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facd40daae0 con 0x7facd40e0750 2023-06-09T05:06:13.207 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:13.198+0000 7facdbfff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7facd4053020 0x7facd404f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T05:06:13.207 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:13.198+0000 7facdbfff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7facd4053020 0x7facd404f320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:51728/0 (socket says 172.21.15.90:51728) 2023-06-09T05:06:13.207 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:13.198+0000 7facdbfff700 1 -- 172.21.15.90:0/403483262 learned_addr learned my addr 172.21.15.90:0/403483262 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T05:06:13.207 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:13.198+0000 7face0f13700 1 --2- 172.21.15.90:0/403483262 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7facd400c410 0x7facd417a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T05:06:13.207 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:13.198+0000 7facdbfff700 1 -- 172.21.15.90:0/403483262 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7facd40e0750 msgr2=0x7facd404f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T05:06:13.207 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:13.198+0000 7facdbfff700 1 --2- 172.21.15.90:0/403483262 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7facd40e0750 0x7facd404f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T05:06:13.207 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:13.198+0000 7facdbfff700 1 -- 172.21.15.90:0/403483262 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7facd400c410 msgr2=0x7facd417a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T05:06:13.208 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:13.198+0000 7facdbfff700 1 --2- 172.21.15.90:0/403483262 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7facd400c410 0x7facd417a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T05:06:13.208 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:13.198+0000 7facdbfff700 1 -- 172.21.15.90:0/403483262 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facd40d1350 con 0x7facd4053020 2023-06-09T05:06:13.208 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:13.198+0000 7facdbfff700 1 --2- 172.21.15.90:0/403483262 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7facd4053020 0x7facd404f320 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7facc800c530 tx=0x7facc800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T05:06:13.208 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:13.198+0000 7facd97fa700 1 -- 172.21.15.90:0/403483262 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facc80052d0 con 0x7facd4053020 2023-06-09T05:06:13.208 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:13.198+0000 7facd97fa700 1 -- 172.21.15.90:0/403483262 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facc8005430 con 0x7facd4053020 2023-06-09T05:06:13.208 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:13.198+0000 7facd97fa700 1 -- 172.21.15.90:0/403483262 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facc80055a0 con 0x7facd4053020 2023-06-09T05:06:13.208 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:13.198+0000 7face1f15700 1 -- 172.21.15.90:0/403483262 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facd40d1630 con 0x7facd4053020 2023-06-09T05:06:13.209 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:13.198+0000 7face1f15700 1 -- 172.21.15.90:0/403483262 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facd4179be0 con 0x7facd4053020 2023-06-09T05:06:13.209 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:13.198+0000 7face1f15700 1 -- 172.21.15.90:0/403483262 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facd417a100 con 0x7facd4053020 2023-06-09T05:06:13.209 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:13.202+0000 7facd97fa700 1 -- 172.21.15.90:0/403483262 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7facc80036a0 con 0x7facd4053020 2023-06-09T05:06:13.211 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:13.202+0000 7facd97fa700 1 --2- 172.21.15.90:0/403483262 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7facc00662f0 0x7facc00687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T05:06:13.211 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:13.202+0000 7facd97fa700 1 -- 172.21.15.90:0/403483262 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6177+0+0 (secure 0 0 0) 0x7facc8083070 con 0x7facd4053020 2023-06-09T05:06:13.212 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:13.202+0000 7face0f13700 1 --2- 172.21.15.90:0/403483262 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7facc00662f0 0x7facc00687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T05:06:13.213 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:13.206+0000 7face0f13700 1 --2- 172.21.15.90:0/403483262 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7facc00662f0 0x7facc00687a0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7facd0009ae0 tx=0x7facd0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T05:06:13.215 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:13.206+0000 7facd97fa700 1 -- 172.21.15.90:0/403483262 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7facc80b3700 con 0x7facd4053020 2023-06-09T05:06:13.424 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:13.414+0000 7face1f15700 1 -- 172.21.15.90:0/403483262 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7facd4005570 con 0x7facd4053020 2023-06-09T05:06:13.424 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:13.414+0000 7facd97fa700 1 -- 172.21.15.90:0/403483262 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v41) v1 ==== 92+0+10 (secure 0 0 0) 0x7facd417a100 con 0x7facd4053020 2023-06-09T05:06:13.424 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 8 2023-06-09T05:06:13.427 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:13.418+0000 7face1f15700 1 -- 172.21.15.90:0/403483262 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7facc00662f0 msgr2=0x7facc00687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T05:06:13.427 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:13.418+0000 7face1f15700 1 --2- 172.21.15.90:0/403483262 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7facc00662f0 0x7facc00687a0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7facd0009ae0 tx=0x7facd0008040 comp rx=0 tx=0).stop 2023-06-09T05:06:13.428 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:13.418+0000 7face1f15700 1 -- 172.21.15.90:0/403483262 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7facd4053020 msgr2=0x7facd404f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T05:06:13.428 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:13.418+0000 7face1f15700 1 --2- 172.21.15.90:0/403483262 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7facd4053020 0x7facd404f320 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7facc800c530 tx=0x7facc800c8f0 comp rx=0 tx=0).stop 2023-06-09T05:06:13.428 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:13.418+0000 7face1f15700 1 -- 172.21.15.90:0/403483262 shutdown_connections 2023-06-09T05:06:13.428 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:13.418+0000 7face1f15700 1 --2- 172.21.15.90:0/403483262 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7facc00662f0 0x7facc00687a0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T05:06:13.428 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:13.418+0000 7face1f15700 1 --2- 172.21.15.90:0/403483262 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7facd40e0750 0x7facd404f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T05:06:13.428 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:13.418+0000 7face1f15700 1 --2- 172.21.15.90:0/403483262 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7facd4053020 0x7facd404f320 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T05:06:13.428 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:13.418+0000 7face1f15700 1 --2- 172.21.15.90:0/403483262 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7facd400c410 0x7facd417a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T05:06:13.428 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:13.418+0000 7face1f15700 1 -- 172.21.15.90:0/403483262 >> 172.21.15.90:0/403483262 conn(0x7facd4056f00 msgr2=0x7facd4056170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T05:06:13.429 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:13.418+0000 7face1f15700 1 -- 172.21.15.90:0/403483262 shutdown_connections 2023-06-09T05:06:13.429 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:13.418+0000 7face1f15700 1 -- 172.21.15.90:0/403483262 wait complete. 2023-06-09T05:06:13.448 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-09T05:06:13.623 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:13.614+0000 7f24bcb77700 1 Processor -- start 2023-06-09T05:06:13.624 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:13.614+0000 7f24bcb77700 1 -- start start 2023-06-09T05:06:13.626 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:13.618+0000 7f24bcb77700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f24b80d2b10 0x7f24b8160920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T05:06:13.626 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:13.618+0000 7f24bcb77700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24b815c6b0 con 0x7f24b80b1ca0 2023-06-09T05:06:13.627 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:13.618+0000 7f24bcb77700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24b80cf6a0 con 0x7f24b80b18d0 2023-06-09T05:06:13.627 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:13.618+0000 7f24bcb77700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24b80cf980 con 0x7f24b80d2b10 2023-06-09T05:06:13.627 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:13.618+0000 7f24b6ffd700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f24b80b1ca0 0x7f24b80d2400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:35108/0 (socket says 172.21.15.90:35108) 2023-06-09T05:06:13.627 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:13.618+0000 7f24b6ffd700 1 -- 172.21.15.90:0/3621682782 learned_addr learned my addr 172.21.15.90:0/3621682782 (peer_addr_for_me v1:172.21.15.90:0/0) 2023-06-09T05:06:13.627 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:13.618+0000 7f24b7fff700 1 --2- 172.21.15.90:0/3621682782 >> v2:172.21.15.174:3300/0 conn(0x7f24b80d2b10 0x7f24b8160920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T05:06:13.628 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:13.618+0000 7f24b67fc700 1 -- 172.21.15.90:0/3621682782 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2213941738 0 0) 0x7f24b815c6b0 con 0x7f24b80b1ca0 2023-06-09T05:06:13.628 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:13.618+0000 7f24b67fc700 1 -- 172.21.15.90:0/3621682782 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f24a00035d0 con 0x7f24b80b1ca0 2023-06-09T05:06:13.628 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:13.618+0000 7f24b7fff700 1 -- 172.21.15.90:0/3621682782 >> v1:172.21.15.174:6789/0 conn(0x7f24b80b18d0 legacy=0x7f24b80cee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T05:06:13.629 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:13.618+0000 7f24b7fff700 1 -- 172.21.15.90:0/3621682782 >> v1:172.21.15.90:6789/0 conn(0x7f24b80b1ca0 legacy=0x7f24b80d2400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T05:06:13.629 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:13.618+0000 7f24b7fff700 1 -- 172.21.15.90:0/3621682782 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24b80cfc60 con 0x7f24b80d2b10 2023-06-09T05:06:13.629 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:13.618+0000 7f24b7fff700 1 --2- 172.21.15.90:0/3621682782 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f24b80d2b10 0x7f24b8160920 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f24b0009d90 tx=0x7f24b000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b264e995b4b5c9e4 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T05:06:13.629 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:13.622+0000 7f24b67fc700 1 -- 172.21.15.90:0/3621682782 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24b000e070 con 0x7f24b80d2b10 2023-06-09T05:06:13.630 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:13.622+0000 7f24b67fc700 1 -- 172.21.15.90:0/3621682782 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24b000bb20 con 0x7f24b80d2b10 2023-06-09T05:06:13.630 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:13.622+0000 7f24b67fc700 1 -- 172.21.15.90:0/3621682782 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24b0012430 con 0x7f24b80d2b10 2023-06-09T05:06:13.630 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:13.622+0000 7f24bcb77700 1 -- 172.21.15.90:0/3621682782 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f24b80d2b10 msgr2=0x7f24b8160920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T05:06:13.630 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:13.622+0000 7f24bcb77700 1 --2- 172.21.15.90:0/3621682782 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f24b80d2b10 0x7f24b8160920 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f24b0009d90 tx=0x7f24b000b330 comp rx=0 tx=0).stop 2023-06-09T05:06:13.630 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:13.622+0000 7f24bcb77700 1 -- 172.21.15.90:0/3621682782 shutdown_connections 2023-06-09T05:06:13.630 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:13.622+0000 7f24bcb77700 1 --2- 172.21.15.90:0/3621682782 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f24b80d2b10 0x7f24b8160920 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T05:06:13.631 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:13.622+0000 7f24bcb77700 1 -- 172.21.15.90:0/3621682782 >> 172.21.15.90:0/3621682782 conn(0x7f24b809b9b0 msgr2=0x7f24b80b55d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T05:06:13.631 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:13.622+0000 7f24bcb77700 1 -- 172.21.15.90:0/3621682782 shutdown_connections 2023-06-09T05:06:13.631 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:13.622+0000 7f24bcb77700 1 -- 172.21.15.90:0/3621682782 wait complete. 2023-06-09T05:06:13.632 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:13.622+0000 7f24bcb77700 1 Processor -- start 2023-06-09T05:06:13.633 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:13.626+0000 7f24bcb77700 1 -- start start 2023-06-09T05:06:13.635 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:13.626+0000 7f24bcb77700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f24b80b18d0 0x7f24b80ca160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T05:06:13.635 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:13.626+0000 7f24bcb77700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f24b80b1ca0 0x7f24b80cbe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T05:06:13.635 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:13.626+0000 7f24bcb77700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f24b80d2b10 0x7f24b815f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T05:06:13.635 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:13.626+0000 7f24bcb77700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24b80b4360 con 0x7f24b80d2b10 2023-06-09T05:06:13.635 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:13.626+0000 7f24bcb77700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24b80caa20 con 0x7f24b80b18d0 2023-06-09T05:06:13.635 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:13.626+0000 7f24bcb77700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24b80ca740 con 0x7f24b80b1ca0 2023-06-09T05:06:13.636 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:13.626+0000 7f24b7fff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f24b80d2b10 0x7f24b815f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T05:06:13.637 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:13.626+0000 7f24b7fff700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f24b80d2b10 0x7f24b815f0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:51744/0 (socket says 172.21.15.90:51744) 2023-06-09T05:06:13.637 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:13.626+0000 7f24b7fff700 1 -- 172.21.15.90:0/149584573 learned_addr learned my addr 172.21.15.90:0/149584573 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T05:06:13.637 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:13.626+0000 7f24b6ffd700 1 --2- 172.21.15.90:0/149584573 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f24b80b1ca0 0x7f24b80cbe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T05:06:13.637 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:13.626+0000 7f24b77fe700 1 --2- 172.21.15.90:0/149584573 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f24b80b18d0 0x7f24b80ca160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T05:06:13.637 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:13.626+0000 7f24b7fff700 1 -- 172.21.15.90:0/149584573 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f24b80b1ca0 msgr2=0x7f24b80cbe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T05:06:13.637 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:13.626+0000 7f24b7fff700 1 --2- 172.21.15.90:0/149584573 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f24b80b1ca0 0x7f24b80cbe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T05:06:13.637 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:13.626+0000 7f24b7fff700 1 -- 172.21.15.90:0/149584573 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f24b80b18d0 msgr2=0x7f24b80ca160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T05:06:13.638 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:13.626+0000 7f24b7fff700 1 --2- 172.21.15.90:0/149584573 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f24b80b18d0 0x7f24b80ca160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T05:06:13.638 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:13.626+0000 7f24b7fff700 1 -- 172.21.15.90:0/149584573 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24b0009a70 con 0x7f24b80d2b10 2023-06-09T05:06:13.638 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:13.630+0000 7f24b7fff700 1 --2- 172.21.15.90:0/149584573 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f24b80d2b10 0x7f24b815f0b0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f24b80b5270 tx=0x7f24b0004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T05:06:13.638 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:13.630+0000 7f249ffff700 1 -- 172.21.15.90:0/149584573 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24b0012430 con 0x7f24b80d2b10 2023-06-09T05:06:13.639 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:13.630+0000 7f24bcb77700 1 -- 172.21.15.90:0/149584573 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24b80b3ca0 con 0x7f24b80d2b10 2023-06-09T05:06:13.639 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:13.630+0000 7f24bcb77700 1 -- 172.21.15.90:0/149584573 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24b80b4780 con 0x7f24b80d2b10 2023-06-09T05:06:13.639 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:13.630+0000 7f249ffff700 1 -- 172.21.15.90:0/149584573 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24b0020070 con 0x7f24b80d2b10 2023-06-09T05:06:13.639 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:13.630+0000 7f249ffff700 1 -- 172.21.15.90:0/149584573 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24b0004280 con 0x7f24b80d2b10 2023-06-09T05:06:13.639 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:13.630+0000 7f24bcb77700 1 -- 172.21.15.90:0/149584573 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2498005310 con 0x7f24b80d2b10 2023-06-09T05:06:13.641 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:13.634+0000 7f249ffff700 1 -- 172.21.15.90:0/149584573 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f24b00043e0 con 0x7f24b80d2b10 2023-06-09T05:06:13.642 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:13.634+0000 7f249ffff700 1 --2- 172.21.15.90:0/149584573 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f24a40662f0 0x7f24a40687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T05:06:13.642 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:13.634+0000 7f249ffff700 1 -- 172.21.15.90:0/149584573 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6177+0+0 (secure 0 0 0) 0x7f24b0022070 con 0x7f24b80d2b10 2023-06-09T05:06:13.643 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:13.634+0000 7f24b77fe700 1 --2- 172.21.15.90:0/149584573 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f24a40662f0 0x7f24a40687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T05:06:13.644 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:13.634+0000 7f24b77fe700 1 --2- 172.21.15.90:0/149584573 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f24a40662f0 0x7f24a40687a0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f24a8000fd0 tx=0x7f24a8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T05:06:13.647 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:13.638+0000 7f249ffff700 1 -- 172.21.15.90:0/149584573 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f24b0052d40 con 0x7f24b80d2b10 2023-06-09T05:06:13.839 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:13.830+0000 7f24bcb77700 1 -- 172.21.15.90:0/149584573 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2498005b40 con 0x7f24b80d2b10 2023-06-09T05:06:13.840 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:13.830+0000 7f249ffff700 1 -- 172.21.15.90:0/149584573 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v41) v1 ==== 104+0+11 (secure 0 0 0) 0x7f24b0056360 con 0x7f24b80d2b10 2023-06-09T05:06:13.840 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 32 2023-06-09T05:06:13.842 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:13.834+0000 7f24bcb77700 1 -- 172.21.15.90:0/149584573 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f24a40662f0 msgr2=0x7f24a40687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T05:06:13.843 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:13.834+0000 7f24bcb77700 1 --2- 172.21.15.90:0/149584573 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f24a40662f0 0x7f24a40687a0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f24a8000fd0 tx=0x7f24a8009040 comp rx=0 tx=0).stop 2023-06-09T05:06:13.843 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:13.834+0000 7f24bcb77700 1 -- 172.21.15.90:0/149584573 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f24b80d2b10 msgr2=0x7f24b815f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T05:06:13.843 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:13.834+0000 7f24bcb77700 1 --2- 172.21.15.90:0/149584573 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f24b80d2b10 0x7f24b815f0b0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f24b80b5270 tx=0x7f24b0004af0 comp rx=0 tx=0).stop 2023-06-09T05:06:13.843 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:13.834+0000 7f24bcb77700 1 -- 172.21.15.90:0/149584573 shutdown_connections 2023-06-09T05:06:13.843 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:13.834+0000 7f24bcb77700 1 --2- 172.21.15.90:0/149584573 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f24a40662f0 0x7f24a40687a0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T05:06:13.843 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:13.834+0000 7f24bcb77700 1 --2- 172.21.15.90:0/149584573 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f24b80d2b10 0x7f24b815f0b0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T05:06:13.844 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:13.834+0000 7f24bcb77700 1 --2- 172.21.15.90:0/149584573 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f24b80b1ca0 0x7f24b80cbe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T05:06:13.844 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:13.834+0000 7f24bcb77700 1 --2- 172.21.15.90:0/149584573 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f24b80b18d0 0x7f24b80ca160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T05:06:13.844 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:13.834+0000 7f24bcb77700 1 -- 172.21.15.90:0/149584573 >> 172.21.15.90:0/149584573 conn(0x7f24b809b9b0 msgr2=0x7f24b80cd860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T05:06:13.844 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:13.834+0000 7f24bcb77700 1 -- 172.21.15.90:0/149584573 shutdown_connections 2023-06-09T05:06:13.844 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:13.834+0000 7f24bcb77700 1 -- 172.21.15.90:0/149584573 wait complete. 2023-06-09T05:06:13.864 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-09T05:06:14.112 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:14.102+0000 7f4f3759e700 1 Processor -- start 2023-06-09T05:06:14.112 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:14.102+0000 7f4f3759e700 1 -- start start 2023-06-09T05:06:14.112 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:14.102+0000 7f4f3759e700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f4f3815a9f0 0x7f4f380cda20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T05:06:14.113 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:14.106+0000 7f4f3759e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4f380cc350 0x7f4f3806cf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T05:06:14.113 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:14.106+0000 7f4f3759e700 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f3815adc0 con 0x7f4f380c4ea0 2023-06-09T05:06:14.113 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:14.106+0000 7f4f3759e700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f380cbec0 con 0x7f4f3815a9f0 2023-06-09T05:06:14.113 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:14.106+0000 7f4f3759e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f38161880 con 0x7f4f380cc350 2023-06-09T05:06:14.113 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:14.106+0000 7f4f36d9d700 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f4f380c4ea0 0x7f4f380c3170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:35122/0 (socket says 172.21.15.90:35122) 2023-06-09T05:06:14.114 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:14.106+0000 7f4f36d9d700 1 -- 172.21.15.90:0/4108968451 learned_addr learned my addr 172.21.15.90:0/4108968451 (peer_addr_for_me v1:172.21.15.90:0/0) 2023-06-09T05:06:14.114 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:14.106+0000 7f4f3559a700 1 -- 172.21.15.90:0/4108968451 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1791307416 0 0) 0x7f4f2c001110 con 0x7f4f380c4ea0 2023-06-09T05:06:14.114 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:14.106+0000 7f4f3559a700 1 -- 172.21.15.90:0/4108968451 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f200035d0 con 0x7f4f380c4ea0 2023-06-09T05:06:14.115 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:14.106+0000 7f4f3559a700 1 -- 172.21.15.90:0/4108968451 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1790419368 0 0) 0x7f4f200035d0 con 0x7f4f380c4ea0 2023-06-09T05:06:14.115 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:14.106+0000 7f4f3559a700 1 -- 172.21.15.90:0/4108968451 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4f380cc350 msgr2=0x7f4f3806cf60 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-06-09T05:06:14.116 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:14.106+0000 7f4f3559a700 1 --2- 172.21.15.90:0/4108968451 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4f380cc350 0x7f4f3806cf60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T05:06:14.116 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:14.106+0000 7f4f3559a700 1 -- 172.21.15.90:0/4108968451 >> v2:172.21.15.174:3300/0 conn(0x7f4f3815a9f0 msgr2=0x7f4f380cda20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-06-09T05:06:14.116 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:14.106+0000 7f4f3559a700 1 --2- 172.21.15.90:0/4108968451 >> v2:172.21.15.174:3300/0 conn(0x7f4f3815a9f0 0x7f4f380cda20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T05:06:14.116 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:14.106+0000 7f4f3559a700 1 -- 172.21.15.90:0/4108968451 --> v1:172.21.15.90:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f38164bd0 con 0x7f4f380c4ea0 2023-06-09T05:06:14.116 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:14.106+0000 7f4f3559a700 1 -- 172.21.15.90:0/4108968451 <== mon.0 v1:172.21.15.90:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3604404106 0 0) 0x7f4f2c001800 con 0x7f4f380c4ea0 2023-06-09T05:06:14.116 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:14.106+0000 7f4f3559a700 1 -- 172.21.15.90:0/4108968451 >> v1:172.21.15.90:6789/0 conn(0x7f4f380c4ea0 legacy=0x7f4f380c3170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T05:06:14.116 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:14.106+0000 7f4f3559a700 1 --2- 172.21.15.90:0/4108968451 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4f20003a20 0x7f4f20003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T05:06:14.117 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:14.106+0000 7f4f3559a700 1 --2- 172.21.15.90:0/4108968451 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4f20004870 0x7f4f20004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T05:06:14.117 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:14.106+0000 7f4f3559a700 1 --2- 172.21.15.90:0/4108968451 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4f20005270 0x7f4f2000ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T05:06:14.117 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:14.106+0000 7f4f3559a700 1 -- 172.21.15.90:0/4108968451 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f380cbec0 con 0x7f4f20003a20 2023-06-09T05:06:14.117 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:14.106+0000 7f4f3559a700 1 -- 172.21.15.90:0/4108968451 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f38161880 con 0x7f4f20004870 2023-06-09T05:06:14.117 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:14.106+0000 7f4f3559a700 1 -- 172.21.15.90:0/4108968451 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f2000c180 con 0x7f4f20005270 2023-06-09T05:06:14.117 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:14.106+0000 7f4f36d9d700 1 --2- 172.21.15.90:0/4108968451 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4f20005270 0x7f4f2000ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T05:06:14.126 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:14.118+0000 7f4f36d9d700 1 -- 172.21.15.90:0/4108968451 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4f20004870 msgr2=0x7f4f20004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T05:06:14.126 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:14.118+0000 7f4f36d9d700 1 --2- 172.21.15.90:0/4108968451 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4f20004870 0x7f4f20004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T05:06:14.126 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:14.118+0000 7f4f36d9d700 1 -- 172.21.15.90:0/4108968451 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4f20003a20 msgr2=0x7f4f20003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T05:06:14.126 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:14.118+0000 7f4f36d9d700 1 --2- 172.21.15.90:0/4108968451 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4f20003a20 0x7f4f20003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T05:06:14.127 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:14.118+0000 7f4f36d9d700 1 -- 172.21.15.90:0/4108968451 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f38164bd0 con 0x7f4f20005270 2023-06-09T05:06:14.132 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:14.122+0000 7f4f36d9d700 1 --2- 172.21.15.90:0/4108968451 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4f20005270 0x7f4f2000ba30 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4f2c00c3c0 tx=0x7f4f200058a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cb7c2bb9dc4832fb server_cookie=0 in_seq=0 out_seq=0 2023-06-09T05:06:14.132 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:14.126+0000 7f4f3559a700 1 -- 172.21.15.90:0/4108968451 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f2c005980 con 0x7f4f20005270 2023-06-09T05:06:14.132 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:14.126+0000 7f4f3559a700 1 -- 172.21.15.90:0/4108968451 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f2c005b20 con 0x7f4f20005270 2023-06-09T05:06:14.133 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:14.126+0000 7f4f3559a700 1 -- 172.21.15.90:0/4108968451 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f2c007110 con 0x7f4f20005270 2023-06-09T05:06:14.133 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:14.126+0000 7f4f3759e700 1 -- 172.21.15.90:0/4108968451 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4f20005270 msgr2=0x7f4f2000ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T05:06:14.134 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:14.126+0000 7f4f3759e700 1 --2- 172.21.15.90:0/4108968451 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4f20005270 0x7f4f2000ba30 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4f2c00c3c0 tx=0x7f4f200058a0 comp rx=0 tx=0).stop 2023-06-09T05:06:14.134 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:14.126+0000 7f4f36d9d700 1 -- 172.21.15.90:0/4108968451 reap_dead start 2023-06-09T05:06:14.134 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:14.126+0000 7f4f3759e700 1 -- 172.21.15.90:0/4108968451 shutdown_connections 2023-06-09T05:06:14.134 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:14.126+0000 7f4f3759e700 1 -- 172.21.15.90:0/4108968451 >> 172.21.15.90:0/4108968451 conn(0x7f4f380ce2f0 msgr2=0x7f4f380ce6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T05:06:14.135 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:14.126+0000 7f4f3759e700 1 -- 172.21.15.90:0/4108968451 shutdown_connections 2023-06-09T05:06:14.135 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:14.126+0000 7f4f3759e700 1 -- 172.21.15.90:0/4108968451 wait complete. 2023-06-09T05:06:14.137 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:14.130+0000 7f4f3759e700 1 Processor -- start 2023-06-09T05:06:14.137 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:14.130+0000 7f4f3759e700 1 -- start start 2023-06-09T05:06:14.139 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:14.130+0000 7f4f3759e700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4f20005270 0x7f4f38163910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T05:06:14.139 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:14.130+0000 7f4f3759e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4f3814c420 0x7f4f38144cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T05:06:14.139 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:14.130+0000 7f4f3759e700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4f3814b0b0 0x7f4f3814b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T05:06:14.139 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:14.130+0000 7f4f3659c700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4f20005270 0x7f4f38163910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T05:06:14.140 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:14.130+0000 7f4f3659c700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4f20005270 0x7f4f38163910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.90:35294/0 (socket says 172.21.15.90:35294) 2023-06-09T05:06:14.140 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:14.130+0000 7f4f36d9d700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4f3814b0b0 0x7f4f3814b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T05:06:14.140 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:14.130+0000 7f4f36d9d700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4f3814b0b0 0x7f4f3814b520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:51760/0 (socket says 172.21.15.90:51760) 2023-06-09T05:06:14.140 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:14.130+0000 7f4f3759e700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f38145230 con 0x7f4f3814b0b0 2023-06-09T05:06:14.140 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:14.130+0000 7f4f3759e700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f38159d70 con 0x7f4f20005270 2023-06-09T05:06:14.141 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:14.130+0000 7f4f3759e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f3815a050 con 0x7f4f3814c420 2023-06-09T05:06:14.141 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:14.130+0000 7f4f3659c700 1 -- 172.21.15.90:0/2185804095 learned_addr learned my addr 172.21.15.90:0/2185804095 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T05:06:14.141 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:14.130+0000 7f4f36d9d700 1 -- 172.21.15.90:0/2185804095 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4f3814c420 msgr2=0x7f4f38144cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T05:06:14.141 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:14.134+0000 7f4f36d9d700 1 --2- 172.21.15.90:0/2185804095 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4f3814c420 0x7f4f38144cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T05:06:14.141 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:14.134+0000 7f4f36d9d700 1 -- 172.21.15.90:0/2185804095 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4f20005270 msgr2=0x7f4f38163910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T05:06:14.142 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:14.134+0000 7f4f36d9d700 1 --2- 172.21.15.90:0/2185804095 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4f20005270 0x7f4f38163910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T05:06:14.142 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:14.134+0000 7f4f36d9d700 1 -- 172.21.15.90:0/2185804095 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f3814a8b0 con 0x7f4f3814b0b0 2023-06-09T05:06:14.142 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:14.134+0000 7f4f36d9d700 1 --2- 172.21.15.90:0/2185804095 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4f3814b0b0 0x7f4f3814b520 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f4f2c001eb0 tx=0x7f4f2c001b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T05:06:14.144 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:14.134+0000 7f4f26ffd700 1 -- 172.21.15.90:0/2185804095 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f2c005e90 con 0x7f4f3814b0b0 2023-06-09T05:06:14.144 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:14.134+0000 7f4f3759e700 1 -- 172.21.15.90:0/2185804095 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f3814ab90 con 0x7f4f3814b0b0 2023-06-09T05:06:14.146 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:14.134+0000 7f4f3759e700 1 -- 172.21.15.90:0/2185804095 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f38070940 con 0x7f4f3814b0b0 2023-06-09T05:06:14.146 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:14.134+0000 7f4f26ffd700 1 -- 172.21.15.90:0/2185804095 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f2c000e40 con 0x7f4f3814b0b0 2023-06-09T05:06:14.146 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:14.138+0000 7f4f26ffd700 1 -- 172.21.15.90:0/2185804095 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f2c0017e0 con 0x7f4f3814b0b0 2023-06-09T05:06:14.149 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:14.142+0000 7f4f26ffd700 1 -- 172.21.15.90:0/2185804095 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4f2c014420 con 0x7f4f3814b0b0 2023-06-09T05:06:14.149 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:14.138+0000 7f4f24ff9700 1 -- 172.21.15.90:0/2185804095 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f10005310 con 0x7f4f3814b0b0 2023-06-09T05:06:14.152 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:14.142+0000 7f4f26ffd700 1 --2- 172.21.15.90:0/2185804095 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f4f18066370 0x7f4f18068820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T05:06:14.152 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:14.142+0000 7f4f26ffd700 1 -- 172.21.15.90:0/2185804095 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6177+0+0 (secure 0 0 0) 0x7f4f2c084c50 con 0x7f4f3814b0b0 2023-06-09T05:06:14.156 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:14.146+0000 7f4f3659c700 1 --2- 172.21.15.90:0/2185804095 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f4f18066370 0x7f4f18068820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T05:06:14.157 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:14.150+0000 7f4f3659c700 1 --2- 172.21.15.90:0/2185804095 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f4f18066370 0x7f4f18068820 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f4f38156bf0 tx=0x7f4f3000b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T05:06:14.158 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:14.150+0000 7f4f26ffd700 1 -- 172.21.15.90:0/2185804095 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4f2c052110 con 0x7f4f3814b0b0 2023-06-09T05:06:14.341 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:14.334+0000 7f4f24ff9700 1 -- 172.21.15.90:0/2185804095 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4f10005b40 con 0x7f4f3814b0b0 2023-06-09T05:06:14.341 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:14.334+0000 7f4f26ffd700 1 -- 172.21.15.90:0/2185804095 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v41) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4f2c055730 con 0x7f4f3814b0b0 2023-06-09T05:06:14.342 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 64 2023-06-09T05:06:14.344 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:14.338+0000 7f4f24ff9700 1 -- 172.21.15.90:0/2185804095 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f4f18066370 msgr2=0x7f4f18068820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T05:06:14.344 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:14.338+0000 7f4f24ff9700 1 --2- 172.21.15.90:0/2185804095 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f4f18066370 0x7f4f18068820 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f4f38156bf0 tx=0x7f4f3000b040 comp rx=0 tx=0).stop 2023-06-09T05:06:14.345 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:14.338+0000 7f4f24ff9700 1 -- 172.21.15.90:0/2185804095 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4f3814b0b0 msgr2=0x7f4f3814b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T05:06:14.345 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:14.338+0000 7f4f24ff9700 1 --2- 172.21.15.90:0/2185804095 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4f3814b0b0 0x7f4f3814b520 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f4f2c001eb0 tx=0x7f4f2c001b90 comp rx=0 tx=0).stop 2023-06-09T05:06:14.345 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:14.338+0000 7f4f24ff9700 1 -- 172.21.15.90:0/2185804095 shutdown_connections 2023-06-09T05:06:14.346 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:14.338+0000 7f4f24ff9700 1 --2- 172.21.15.90:0/2185804095 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f4f18066370 0x7f4f18068820 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T05:06:14.346 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:14.338+0000 7f4f24ff9700 1 --2- 172.21.15.90:0/2185804095 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4f3814b0b0 0x7f4f3814b520 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T05:06:14.346 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:14.338+0000 7f4f24ff9700 1 --2- 172.21.15.90:0/2185804095 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4f3814c420 0x7f4f38144cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T05:06:14.346 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:14.338+0000 7f4f24ff9700 1 --2- 172.21.15.90:0/2185804095 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4f20005270 0x7f4f38163910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T05:06:14.346 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:14.338+0000 7f4f24ff9700 1 -- 172.21.15.90:0/2185804095 >> 172.21.15.90:0/2185804095 conn(0x7f4f380ce2f0 msgr2=0x7f4f3814d220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T05:06:14.346 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:14.338+0000 7f4f24ff9700 1 -- 172.21.15.90:0/2185804095 shutdown_connections 2023-06-09T05:06:14.346 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:14.338+0000 7f4f24ff9700 1 -- 172.21.15.90:0/2185804095 wait complete. 2023-06-09T05:06:14.365 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-06-09T05:06:14.528 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:14.518+0000 7f962359e700 1 Processor -- start 2023-06-09T05:06:14.529 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:14.522+0000 7f962359e700 1 -- start start 2023-06-09T05:06:14.531 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:14.522+0000 7f962359e700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9624158dc0 0x7f9624070870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T05:06:14.531 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:14.522+0000 7f962359e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9624070db0 0x7f962406a960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T05:06:14.532 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:14.522+0000 7f962359e700 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96240698c0 con 0x7f962406aea0 2023-06-09T05:06:14.532 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:14.522+0000 7f962359e700 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9624069ba0 con 0x7f9624158dc0 2023-06-09T05:06:14.533 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:14.522+0000 7f962359e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9624069e80 con 0x7f9624070db0 2023-06-09T05:06:14.533 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:14.522+0000 7f962259c700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9624158dc0 0x7f9624070870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T05:06:14.533 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:14.522+0000 7f962259c700 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9624158dc0 0x7f9624070870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.90:35310/0 (socket says 172.21.15.90:35310) 2023-06-09T05:06:14.533 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:14.522+0000 7f962259c700 1 -- 172.21.15.90:0/3531598494 learned_addr learned my addr 172.21.15.90:0/3531598494 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T05:06:14.533 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:14.526+0000 7f961bfff700 1 --2- 172.21.15.90:0/3531598494 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9624070db0 0x7f962406a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T05:06:14.534 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:14.526+0000 7f962259c700 1 -- 172.21.15.90:0/3531598494 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9624070db0 msgr2=0x7f962406a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T05:06:14.534 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:14.526+0000 7f962259c700 1 --2- 172.21.15.90:0/3531598494 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9624070db0 0x7f962406a960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T05:06:14.534 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:14.526+0000 7f962259c700 1 -- 172.21.15.90:0/3531598494 >> v1:172.21.15.174:6789/0 conn(0x7f962406aea0 legacy=0x7f96240ccc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T05:06:14.534 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:14.526+0000 7f962259c700 1 -- 172.21.15.90:0/3531598494 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f962406a160 con 0x7f9624158dc0 2023-06-09T05:06:14.534 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:14.526+0000 7f962259c700 1 --2- 172.21.15.90:0/3531598494 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9624158dc0 0x7f9624070870 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f9614009910 tx=0x7f9614009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1cd55791817b23c9 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T05:06:14.534 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:14.526+0000 7f9621d9b700 1 -- 172.21.15.90:0/3531598494 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9614011830 con 0x7f9624158dc0 2023-06-09T05:06:14.535 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:14.526+0000 7f9621d9b700 1 -- 172.21.15.90:0/3531598494 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9614011990 con 0x7f9624158dc0 2023-06-09T05:06:14.535 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:14.526+0000 7f9621d9b700 1 -- 172.21.15.90:0/3531598494 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9614011d40 con 0x7f9624158dc0 2023-06-09T05:06:14.536 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:14.526+0000 7f962359e700 1 -- 172.21.15.90:0/3531598494 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9624158dc0 msgr2=0x7f9624070870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T05:06:14.536 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:14.526+0000 7f962359e700 1 --2- 172.21.15.90:0/3531598494 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9624158dc0 0x7f9624070870 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f9614009910 tx=0x7f9614009c20 comp rx=0 tx=0).stop 2023-06-09T05:06:14.536 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:14.526+0000 7f962359e700 1 -- 172.21.15.90:0/3531598494 shutdown_connections 2023-06-09T05:06:14.536 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:14.526+0000 7f962359e700 1 --2- 172.21.15.90:0/3531598494 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9624070db0 0x7f962406a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T05:06:14.536 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:14.526+0000 7f962359e700 1 --2- 172.21.15.90:0/3531598494 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9624158dc0 0x7f9624070870 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T05:06:14.536 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:14.526+0000 7f962359e700 1 -- 172.21.15.90:0/3531598494 >> 172.21.15.90:0/3531598494 conn(0x7f962406c690 msgr2=0x7f96240aff00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T05:06:14.536 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:14.526+0000 7f962359e700 1 -- 172.21.15.90:0/3531598494 shutdown_connections 2023-06-09T05:06:14.537 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:14.526+0000 7f962359e700 1 -- 172.21.15.90:0/3531598494 wait complete. 2023-06-09T05:06:14.537 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:14.530+0000 7f962359e700 1 Processor -- start 2023-06-09T05:06:14.538 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:14.530+0000 7f962359e700 1 -- start start 2023-06-09T05:06:14.540 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:14.530+0000 7f962359e700 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f962406aea0 0x7f96240b2ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T05:06:14.540 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:14.530+0000 7f962359e700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9624152ee0 0x7f96240ce120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T05:06:14.540 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:14.530+0000 7f962359e700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f96240ce660 0x7f96241f0e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T05:06:14.541 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:14.534+0000 7f962359e700 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96240ceb00 con 0x7f96240ce660 2023-06-09T05:06:14.541 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:14.534+0000 7f962359e700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f962415ae60 con 0x7f9624152ee0 2023-06-09T05:06:14.541 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:14.534+0000 7f962359e700 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f962415a290 con 0x7f962406aea0 2023-06-09T05:06:14.542 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:14.534+0000 7f9622d9d700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f96240ce660 0x7f96241f0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T05:06:14.542 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:14.534+0000 7f9622d9d700 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f96240ce660 0x7f96241f0e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:51772/0 (socket says 172.21.15.90:51772) 2023-06-09T05:06:14.542 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:14.534+0000 7f9622d9d700 1 -- 172.21.15.90:0/3507113248 learned_addr learned my addr 172.21.15.90:0/3507113248 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-06-09T05:06:14.542 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:14.534+0000 7f962259c700 1 --2- 172.21.15.90:0/3507113248 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f962406aea0 0x7f96240b2ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T05:06:14.542 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:14.534+0000 7f961bfff700 1 --2- 172.21.15.90:0/3507113248 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9624152ee0 0x7f96240ce120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T05:06:14.543 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:14.534+0000 7f962259c700 1 -- 172.21.15.90:0/3507113248 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9624152ee0 msgr2=0x7f96240ce120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T05:06:14.543 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:14.534+0000 7f962259c700 1 --2- 172.21.15.90:0/3507113248 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9624152ee0 0x7f96240ce120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T05:06:14.543 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:14.534+0000 7f962259c700 1 -- 172.21.15.90:0/3507113248 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f96240ce660 msgr2=0x7f96241f0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T05:06:14.544 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:14.534+0000 7f962259c700 1 --2- 172.21.15.90:0/3507113248 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f96240ce660 0x7f96241f0e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T05:06:14.544 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:14.534+0000 7f962259c700 1 -- 172.21.15.90:0/3507113248 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9614009570 con 0x7f962406aea0 2023-06-09T05:06:14.544 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:14.534+0000 7f9622d9d700 1 --2- 172.21.15.90:0/3507113248 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f96240ce660 0x7f96241f0e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T05:06:14.544 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:14.534+0000 7f962259c700 1 --2- 172.21.15.90:0/3507113248 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f962406aea0 0x7f96240b2ff0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9614016000 tx=0x7f9614004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T05:06:14.544 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:14.534+0000 7f961affd700 1 -- 172.21.15.90:0/3507113248 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9614004510 con 0x7f962406aea0 2023-06-09T05:06:14.544 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:14.534+0000 7f961affd700 1 -- 172.21.15.90:0/3507113248 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f961401e070 con 0x7f962406aea0 2023-06-09T05:06:14.544 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:14.534+0000 7f962359e700 1 -- 172.21.15.90:0/3507113248 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f962415a530 con 0x7f962406aea0 2023-06-09T05:06:14.544 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:14.534+0000 7f961affd700 1 -- 172.21.15.90:0/3507113248 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9614003900 con 0x7f962406aea0 2023-06-09T05:06:14.545 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:14.534+0000 7f962359e700 1 -- 172.21.15.90:0/3507113248 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f962415aaf0 con 0x7f962406aea0 2023-06-09T05:06:14.545 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:14.538+0000 7f962359e700 1 -- 172.21.15.90:0/3507113248 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f962415ac80 con 0x7f962406aea0 2023-06-09T05:06:14.547 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:14.538+0000 7f961affd700 1 -- 172.21.15.90:0/3507113248 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9614003a60 con 0x7f962406aea0 2023-06-09T05:06:14.549 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:14.542+0000 7f961affd700 1 --2- 172.21.15.90:0/3507113248 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f9604066320 0x7f96040687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T05:06:14.549 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:14.542+0000 7f961affd700 1 -- 172.21.15.90:0/3507113248 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6177+0+0 (secure 0 0 0) 0x7f9614084bf0 con 0x7f962406aea0 2023-06-09T05:06:14.550 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:14.542+0000 7f961bfff700 1 --2- 172.21.15.90:0/3507113248 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f9604066320 0x7f96040687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T05:06:14.551 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:14.542+0000 7f961bfff700 1 --2- 172.21.15.90:0/3507113248 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f9604066320 0x7f96040687d0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f96240c9ea0 tx=0x7f960c009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T05:06:14.557 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:14.550+0000 7f961affd700 1 -- 172.21.15.90:0/3507113248 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9614051fe0 con 0x7f962406aea0 2023-06-09T05:06:14.763 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:14.754+0000 7f962359e700 1 -- 172.21.15.90:0/3507113248 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f962404e380 con 0x7f962406aea0 2023-06-09T05:06:14.764 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:14.754+0000 7f961affd700 1 -- 172.21.15.90:0/3507113248 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v41) v1 ==== 80+0+122 (secure 0 0 0) 0x7f9614055600 con 0x7f962406aea0 2023-06-09T05:06:14.764 INFO:teuthology.orchestra.run.smithi090.stdout:172.21.15.90:6835/1290764843 2023-06-10T05:01:13.452283+0000 2023-06-09T05:06:14.764 INFO:teuthology.orchestra.run.smithi090.stdout:172.21.15.90:6834/1290764843 2023-06-10T05:01:13.452283+0000 2023-06-09T05:06:14.767 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:14.758+0000 7f962359e700 1 -- 172.21.15.90:0/3507113248 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f9604066320 msgr2=0x7f96040687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T05:06:14.768 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:14.758+0000 7f962359e700 1 --2- 172.21.15.90:0/3507113248 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f9604066320 0x7f96040687d0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f96240c9ea0 tx=0x7f960c009240 comp rx=0 tx=0).stop 2023-06-09T05:06:14.768 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:14.758+0000 7f962359e700 1 -- 172.21.15.90:0/3507113248 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f962406aea0 msgr2=0x7f96240b2ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T05:06:14.768 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:14.758+0000 7f962359e700 1 --2- 172.21.15.90:0/3507113248 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f962406aea0 0x7f96240b2ff0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9614016000 tx=0x7f9614004770 comp rx=0 tx=0).stop 2023-06-09T05:06:14.768 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:14.758+0000 7f962359e700 1 -- 172.21.15.90:0/3507113248 shutdown_connections 2023-06-09T05:06:14.768 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:14.758+0000 7f962359e700 1 --2- 172.21.15.90:0/3507113248 >> [v2:172.21.15.174:6832/1389974754,v1:172.21.15.174:6833/1389974754] conn(0x7f9604066320 0x7f96040687d0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T05:06:14.768 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:14.758+0000 7f962359e700 1 --2- 172.21.15.90:0/3507113248 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f96240ce660 0x7f96241f0e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T05:06:14.768 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:14.758+0000 7f962359e700 1 --2- 172.21.15.90:0/3507113248 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9624152ee0 0x7f96240ce120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T05:06:14.769 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:14.758+0000 7f962359e700 1 --2- 172.21.15.90:0/3507113248 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f962406aea0 0x7f96240b2ff0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T05:06:14.769 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:14.758+0000 7f962359e700 1 -- 172.21.15.90:0/3507113248 >> 172.21.15.90:0/3507113248 conn(0x7f962406c690 msgr2=0x7f962415cc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T05:06:14.769 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:14.758+0000 7f962359e700 1 -- 172.21.15.90:0/3507113248 shutdown_connections 2023-06-09T05:06:14.769 INFO:teuthology.orchestra.run.smithi090.stderr:2023-06-09T05:06:14.758+0000 7f962359e700 1 -- 172.21.15.90:0/3507113248 wait complete. 2023-06-09T05:06:14.769 INFO:teuthology.orchestra.run.smithi090.stderr:listed 2 entries 2023-06-09T05:06:14.786 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-06-09T05:06:14.786 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T05:06:14.786 DEBUG:teuthology.orchestra.run.smithi090:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-06-09T05:06:14.861 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi090.front.sepia.ceph.com 2023-06-09T05:06:14.862 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T05:06:14.862 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-06-09T05:06:14.874 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2023-06-09T05:06:14.874 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-09T05:06:14.933 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16352404k,nr_inodes=4088101,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18575 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275376k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 172.21.15.90:6789:/test /tmp/tmp.WhlLVkLGHXtest ceph rw,relatime,name=admin,secret=,fsid=700369c0-a111-43b4-9415-844ad1742b70,acl 0 0 2023-06-09T05:06:14.933 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi090.front.sepia.ceph.com 2023-06-09T05:06:14.933 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T05:06:14.933 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-06-09T05:06:14.990 INFO:teuthology.orchestra.run.smithi090.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-06-09T05:06:14.991 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-09T05:06:14.992 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2023-06-09T05:06:14.992 DEBUG:teuthology.orchestra.run.smithi174:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-09T05:06:15.007 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16352420k,nr_inodes=4088105,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=13174 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-06-09T05:06:15.007 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi174.front.sepia.ceph.com 2023-06-09T05:06:15.007 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T05:06:15.007 DEBUG:teuthology.orchestra.run.smithi174:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-06-09T05:06:15.065 INFO:teuthology.orchestra.run.smithi174.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-06-09T05:06:15.066 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-09T05:06:15.067 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2023-06-09T05:06:15.067 DEBUG:teuthology.orchestra.run.smithi174:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-09T05:06:15.131 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16352420k,nr_inodes=4088105,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=13174 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-06-09T05:06:15.131 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi174.front.sepia.ceph.com 2023-06-09T05:06:15.131 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T05:06:15.131 DEBUG:teuthology.orchestra.run.smithi174:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-06-09T05:06:15.186 INFO:teuthology.orchestra.run.smithi174.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-06-09T05:06:15.187 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-09T05:06:16.793 INFO:tasks.ceph.osd.0:Sent signal 15 2023-06-09T05:06:16.794 INFO:tasks.ceph.osd.1:Sent signal 15 2023-06-09T05:06:16.794 INFO:tasks.ceph.osd.2:Sent signal 15 2023-06-09T05:06:16.794 INFO:tasks.ceph.osd.3:Sent signal 15 2023-06-09T05:06:16.795 INFO:tasks.ceph.osd.4:Sent signal 15 2023-06-09T05:06:16.795 INFO:tasks.ceph.osd.5:Sent signal 15 2023-06-09T05:06:16.795 INFO:tasks.ceph.osd.6:Sent signal 15 2023-06-09T05:06:16.796 INFO:tasks.ceph.osd.7:Sent signal 15 2023-06-09T05:06:16.796 INFO:tasks.ceph.mds.a:Sent signal 15 2023-06-09T05:06:16.796 INFO:tasks.ceph.mds.b:Sent signal 15 2023-06-09T05:06:16.796 INFO:tasks.ceph.mds.d:Sent signal 15 2023-06-09T05:06:16.797 INFO:tasks.ceph.mon.a:Sent signal 15 2023-06-09T05:06:16.797 INFO:tasks.ceph.mon.b:Sent signal 15 2023-06-09T05:06:16.797 INFO:tasks.ceph.mon.c:Sent signal 15 2023-06-09T05:06:16.798 INFO:tasks.ceph.mgr.y:Sent signal 15 2023-06-09T05:06:16.798 INFO:tasks.ceph.mgr.x:Sent signal 15 2023-06-09T05:06:16.798 INFO:tasks.ceph.osd.4.smithi174.stderr:2023-06-09T05:06:16.788+0000 7f3824ec0700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 34628) UID: 0 2023-06-09T05:06:16.799 INFO:tasks.ceph.osd.4.smithi174.stderr:2023-06-09T05:06:16.788+0000 7f3824ec0700 -1 osd.4 41 *** Got signal Terminated *** 2023-06-09T05:06:16.799 INFO:tasks.ceph.osd.4.smithi174.stderr:2023-06-09T05:06:16.788+0000 7f3824ec0700 -1 osd.4 41 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-06-09T05:06:16.799 INFO:tasks.ceph.osd.5.smithi174.stderr:2023-06-09T05:06:16.788+0000 7fa7cbaaa700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 34631) UID: 0 2023-06-09T05:06:16.799 INFO:tasks.ceph.osd.5.smithi174.stderr:2023-06-09T05:06:16.788+0000 7fa7cbaaa700 -1 osd.5 41 *** Got signal Terminated *** 2023-06-09T05:06:16.799 INFO:tasks.ceph.osd.5.smithi174.stderr:2023-06-09T05:06:16.788+0000 7fa7cbaaa700 -1 osd.5 41 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-06-09T05:06:16.800 INFO:tasks.ceph.osd.6.smithi174.stderr:2023-06-09T05:06:16.788+0000 7f4e4e3f5700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 34630) UID: 0 2023-06-09T05:06:16.800 INFO:tasks.ceph.osd.6.smithi174.stderr:2023-06-09T05:06:16.788+0000 7f4e4e3f5700 -1 osd.6 41 *** Got signal Terminated *** 2023-06-09T05:06:16.800 INFO:tasks.ceph.osd.6.smithi174.stderr:2023-06-09T05:06:16.788+0000 7f4e4e3f5700 -1 osd.6 41 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-06-09T05:06:16.800 INFO:tasks.ceph.osd.7.smithi174.stderr:2023-06-09T05:06:16.788+0000 7fc93a5b6700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 34634) UID: 0 2023-06-09T05:06:16.801 INFO:tasks.ceph.osd.7.smithi174.stderr:2023-06-09T05:06:16.788+0000 7fc93a5b6700 -1 osd.7 41 *** Got signal Terminated *** 2023-06-09T05:06:16.801 INFO:tasks.ceph.osd.7.smithi174.stderr:2023-06-09T05:06:16.788+0000 7fc93a5b6700 -1 osd.7 41 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-06-09T05:06:16.801 INFO:tasks.ceph.mds.b.smithi174.stderr:2023-06-09T05:06:16.788+0000 7f3993dda700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-mds -f --cluster ceph -i b (PID: 40148) UID: 0 2023-06-09T05:06:16.801 INFO:tasks.ceph.mds.b.smithi174.stderr:2023-06-09T05:06:16.788+0000 7f3993dda700 -1 mds.b *** got signal Terminated *** 2023-06-09T05:06:16.802 INFO:tasks.ceph.mds.d.smithi174.stderr:2023-06-09T05:06:16.788+0000 7f4bd0409700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-mds -f --cluster ceph -i d (PID: 40149) UID: 0 2023-06-09T05:06:16.802 INFO:tasks.ceph.mds.d.smithi174.stderr:2023-06-09T05:06:16.788+0000 7f4bd0409700 -1 mds.d *** got signal Terminated *** 2023-06-09T05:06:16.802 INFO:tasks.ceph.mon.b.smithi174.stderr:2023-06-09T05:06:16.788+0000 7fdbf35ff700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-mon -f --cluster ceph -i b (PID: 34290) UID: 0 2023-06-09T05:06:16.802 INFO:tasks.ceph.mon.b.smithi174.stderr:2023-06-09T05:06:16.788+0000 7fdbf35ff700 -1 mon.b@1(peon) e1 *** Got Signal Terminated *** 2023-06-09T05:06:16.803 INFO:tasks.ceph.mon.c.smithi174.stderr:2023-06-09T05:06:16.788+0000 7efcd1dff700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-mon -f --cluster ceph -i c (PID: 34292) UID: 0 2023-06-09T05:06:16.803 INFO:tasks.ceph.mon.c.smithi174.stderr:2023-06-09T05:06:16.788+0000 7efcd1dff700 -1 mon.c@2(peon) e1 *** Got Signal Terminated *** 2023-06-09T05:06:16.803 INFO:tasks.ceph.mgr.x.smithi174.stderr:2023-06-09T05:06:16.788+0000 7fc8feead700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-mgr -f --cluster ceph -i x (PID: 34294) UID: 0 2023-06-09T05:06:16.803 INFO:tasks.ceph.mgr.x.smithi174.stderr:2023-06-09T05:06:16.788+0000 7fc8feead700 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2023-06-09T05:06:16.804 INFO:tasks.ceph.osd.0.smithi090.stderr:2023-06-09T05:06:16.786+0000 7f31c7f3e700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 34406) UID: 0 2023-06-09T05:06:16.804 INFO:tasks.ceph.osd.0.smithi090.stderr:2023-06-09T05:06:16.786+0000 7f31c7f3e700 -1 osd.0 41 *** Got signal Terminated *** 2023-06-09T05:06:16.804 INFO:tasks.ceph.osd.0.smithi090.stderr:2023-06-09T05:06:16.786+0000 7f31c7f3e700 -1 osd.0 41 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-06-09T05:06:16.804 INFO:tasks.ceph.osd.1.smithi090.stderr:2023-06-09T05:06:16.786+0000 7fb26a81e700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 34408) UID: 0 2023-06-09T05:06:16.805 INFO:tasks.ceph.osd.1.smithi090.stderr:2023-06-09T05:06:16.786+0000 7fb26a81e700 -1 osd.1 41 *** Got signal Terminated *** 2023-06-09T05:06:16.805 INFO:tasks.ceph.osd.1.smithi090.stderr:2023-06-09T05:06:16.786+0000 7fb26a81e700 -1 osd.1 41 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-06-09T05:06:16.805 INFO:tasks.ceph.osd.2.smithi090.stderr:2023-06-09T05:06:16.786+0000 7f2d2706a700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 34409) UID: 0 2023-06-09T05:06:16.805 INFO:tasks.ceph.osd.2.smithi090.stderr:2023-06-09T05:06:16.786+0000 7f2d2706a700 -1 osd.2 41 *** Got signal Terminated *** 2023-06-09T05:06:16.805 INFO:tasks.ceph.osd.2.smithi090.stderr:2023-06-09T05:06:16.786+0000 7f2d2706a700 -1 osd.2 41 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-06-09T05:06:16.806 INFO:tasks.ceph.osd.3.smithi090.stderr:2023-06-09T05:06:16.786+0000 7f3d29b9b700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 34412) UID: 0 2023-06-09T05:06:16.806 INFO:tasks.ceph.osd.3.smithi090.stderr:2023-06-09T05:06:16.786+0000 7f3d29b9b700 -1 osd.3 41 *** Got signal Terminated *** 2023-06-09T05:06:16.806 INFO:tasks.ceph.osd.3.smithi090.stderr:2023-06-09T05:06:16.786+0000 7f3d29b9b700 -1 osd.3 41 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-06-09T05:06:16.806 INFO:tasks.ceph.mds.a.smithi090.stderr:2023-06-09T05:06:16.790+0000 7f7c0ce37700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-mds -f --cluster ceph -i a (PID: 43277) UID: 0 2023-06-09T05:06:16.807 INFO:tasks.ceph.mds.a.smithi090.stderr:2023-06-09T05:06:16.790+0000 7f7c0ce37700 -1 mds.a *** got signal Terminated *** 2023-06-09T05:06:16.807 INFO:tasks.ceph.mon.a.smithi090.stderr:2023-06-09T05:06:16.790+0000 7fea84fff700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-mon -f --cluster ceph -i a (PID: 34281) UID: 0 2023-06-09T05:06:16.807 INFO:tasks.ceph.mon.a.smithi090.stderr:2023-06-09T05:06:16.790+0000 7fea84fff700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2023-06-09T05:06:16.999 INFO:tasks.ceph.mgr.y.smithi090.stderr:daemon-helper: command crashed with signal 15 2023-06-09T05:06:18.720 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:06:18.727 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:06:24.057 INFO:tasks.ceph.mds.a.smithi090.stderr:2023-06-09T05:06:24.050+0000 7f7c0ce37700 -1 Fail to open '/proc/133713/cmdline' error = (2) No such file or directory 2023-06-09T05:06:24.057 INFO:tasks.ceph.mds.a.smithi090.stderr:2023-06-09T05:06:24.050+0000 7f7c0ce37700 -1 received signal: Hangup from (PID: 133713) UID: 0 2023-06-09T05:08:02.598 INFO:teuthology.orchestra.run.smithi090.stderr:error: Compressing program wrote following message to stderr when compressing log /var/log/ceph/ceph-mds.a.log.1: 2023-06-09T05:08:02.598 INFO:teuthology.orchestra.run.smithi090.stderr:gzip: stdin: file size changed while zipping 2023-06-09T05:08:36.023 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:08:36.030 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:09:06.133 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:09:06.140 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:09:36.212 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:09:36.219 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:10:06.341 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:10:06.349 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:10:36.437 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:10:36.445 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:11:06.583 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:11:06.591 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:11:36.663 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:11:36.670 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:12:06.809 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:12:06.817 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:12:36.888 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:12:36.896 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:13:06.967 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:13:06.974 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:13:37.121 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:13:37.129 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:14:07.284 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:14:07.291 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:14:37.631 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:14:37.638 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:15:07.811 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:15:07.818 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:15:38.099 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:15:38.106 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:16:08.187 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:16:08.194 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:16:38.274 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:16:38.282 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:17:08.353 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:17:08.360 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:17:38.499 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:17:38.507 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:18:08.653 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:18:08.661 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:18:38.817 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:18:38.824 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:19:08.946 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:19:08.954 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:19:39.117 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:19:39.125 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:20:09.196 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:20:09.204 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:20:39.568 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:20:39.575 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:21:09.648 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:21:09.656 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:21:39.785 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:21:39.793 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:22:09.930 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:22:09.938 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:22:40.068 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:22:40.075 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:23:10.213 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:23:10.221 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:23:40.351 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:23:40.359 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:24:10.730 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:24:10.737 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:24:40.877 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:24:40.885 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:25:11.048 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:25:11.054 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:25:41.228 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:25:41.236 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:26:11.381 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:26:11.389 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:26:41.545 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:26:41.553 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:27:11.623 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:27:11.630 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:27:41.771 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:27:41.778 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:28:11.858 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:28:11.865 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:28:42.012 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:28:42.020 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:29:12.151 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:29:12.159 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:29:42.313 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:29:42.321 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:30:12.492 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:30:12.500 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:30:42.788 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:30:42.796 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:31:12.983 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:31:12.991 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:31:43.051 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:31:43.059 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:32:13.209 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:32:13.217 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:32:43.365 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:32:43.372 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:33:13.509 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:33:13.517 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:33:43.655 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:33:43.663 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:34:13.794 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:34:13.801 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:34:43.940 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:34:43.948 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:35:14.095 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:35:14.102 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:35:44.283 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:35:44.290 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:36:14.454 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:36:14.461 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:36:44.623 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:36:44.631 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:37:14.770 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:37:14.778 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:37:44.917 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:37:44.925 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:38:15.072 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:38:15.079 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:38:45.225 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:38:45.233 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:39:15.423 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:39:15.431 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:39:45.576 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:39:45.584 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:40:15.739 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:40:15.747 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:40:45.835 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:40:45.843 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:41:15.909 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:41:15.916 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:41:46.068 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:41:46.076 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:42:16.214 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:42:16.222 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:42:46.344 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:42:46.352 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:43:16.490 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:43:16.498 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:43:46.619 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:43:46.627 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:44:16.748 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:44:16.756 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:44:46.885 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:44:46.893 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:45:17.024 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:45:17.032 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:45:47.353 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:45:47.361 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:46:17.517 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:46:17.524 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:46:47.670 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:46:47.678 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:47:17.816 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:47:17.823 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:47:47.970 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:47:47.978 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:48:18.117 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:48:18.125 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:48:48.254 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:48:48.262 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:49:18.393 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:49:18.401 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:49:48.555 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:49:48.562 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:50:18.701 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:50:18.708 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:50:48.905 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:50:48.913 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:51:19.051 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:51:19.059 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:51:49.197 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:51:49.204 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:52:19.335 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:52:19.342 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:52:49.497 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:52:49.504 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:53:19.644 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:53:19.651 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:53:49.806 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:53:49.813 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:54:19.952 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:54:19.960 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:54:50.115 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:54:50.122 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:55:20.193 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:55:20.201 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:55:50.398 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:55:50.406 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:56:20.501 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:56:20.509 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:56:50.639 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:56:50.647 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:57:20.777 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:57:20.785 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:57:50.908 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:57:50.916 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:58:21.070 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:58:21.078 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:58:51.208 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:58:51.216 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:59:21.529 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:59:21.537 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:59:51.666 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:59:51.674 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:00:21.804 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:00:21.812 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:00:51.941 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:00:51.949 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:01:22.071 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:01:22.078 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:01:52.217 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:01:52.224 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:02:22.362 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:02:22.370 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:02:52.508 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:02:52.515 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:03:22.655 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:03:22.663 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:03:52.793 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:03:52.800 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:04:22.965 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:04:22.972 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:04:53.039 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:04:53.047 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:05:23.172 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:05:23.180 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:05:53.268 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:05:53.276 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:06:23.356 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:06:23.364 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:06:53.444 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:06:53.452 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:07:23.532 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:07:23.539 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:07:53.678 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:07:53.685 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:08:23.832 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:08:23.839 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:08:53.979 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:08:53.987 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:09:24.115 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:09:24.123 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:09:54.261 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:09:54.269 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:10:24.425 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:10:24.433 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:10:54.521 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:10:54.529 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:11:24.676 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:11:24.684 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:11:54.831 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:11:54.840 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:12:24.985 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:12:24.992 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:12:55.156 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:12:55.163 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:13:25.293 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:13:25.301 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:13:55.439 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:13:55.446 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:14:25.596 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:14:25.604 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:14:55.675 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:14:55.683 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:15:25.813 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:15:25.821 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:15:56.201 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:15:56.208 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:16:26.281 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:16:26.288 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:16:56.366 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:16:56.374 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:17:26.488 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:17:26.496 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:17:56.643 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:17:56.651 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:18:26.787 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:18:26.794 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:18:56.925 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:18:56.933 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:19:27.072 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:19:27.080 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:19:57.226 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:19:57.233 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:20:27.372 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:20:27.380 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:20:57.552 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:20:57.560 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:21:27.723 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:21:27.731 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:21:58.002 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:21:58.010 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:22:28.090 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:22:28.097 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:22:58.243 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:22:58.251 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:23:28.391 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:23:28.398 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:23:58.561 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:23:58.569 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:24:28.716 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:24:28.724 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:24:58.878 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:24:58.885 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:25:29.015 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:25:29.023 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:25:59.147 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:25:59.155 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:26:29.309 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:26:29.316 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:26:59.564 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:26:59.572 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:27:29.726 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:27:29.733 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:27:59.881 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:27:59.888 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:28:30.060 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:28:30.067 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:29:00.215 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:29:00.222 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:29:30.369 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:29:30.376 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:30:00.523 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:30:00.531 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:30:30.667 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:30:30.675 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:31:00.756 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:31:00.764 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:31:30.988 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:31:30.996 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:32:01.123 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:32:01.131 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:32:31.269 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:32:31.277 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:33:01.440 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:33:01.447 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:33:31.577 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:33:31.585 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:34:01.724 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:34:01.732 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:34:31.879 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:34:31.886 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:35:02.149 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:35:02.156 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:35:32.295 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:35:32.303 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:36:02.499 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:36:02.507 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:36:32.654 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:36:32.661 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:37:02.792 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:37:02.799 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:37:32.929 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:37:32.937 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:38:03.075 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:38:03.082 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:38:33.221 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:38:33.228 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:39:03.368 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:39:03.376 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:39:33.564 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:39:33.571 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:40:03.734 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:40:03.741 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:40:33.872 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:40:33.884 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:41:03.984 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:41:03.992 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:41:34.113 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:41:34.120 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:42:04.251 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:42:04.258 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:42:34.397 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:42:34.404 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:43:04.560 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:43:04.567 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:43:34.697 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:43:34.704 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:44:04.836 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:44:04.843 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:44:34.998 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:44:35.006 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:45:05.160 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:45:05.168 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:45:35.248 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:45:35.256 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:46:05.570 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:46:05.577 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:46:35.649 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:46:35.656 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:47:05.787 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:47:05.794 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:47:35.958 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:47:35.965 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:48:06.111 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:48:06.119 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:48:36.249 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:48:36.257 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:49:06.394 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:49:06.402 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:49:36.475 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:49:36.482 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:50:06.546 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:50:06.554 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:50:36.625 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:50:36.632 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:51:06.788 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:51:06.796 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:51:36.867 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:51:36.875 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:52:07.011 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:52:07.019 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:52:37.101 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:52:37.108 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:53:07.270 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:53:07.277 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:53:37.610 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:53:37.617 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:54:07.696 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:54:07.703 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:54:37.891 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:54:37.898 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:55:08.045 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:55:08.053 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:55:38.208 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:55:38.215 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:56:08.339 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:56:08.347 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:56:38.502 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:56:38.510 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:57:08.708 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:57:08.715 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:57:38.836 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:57:38.843 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:58:08.990 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:58:08.998 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:58:39.143 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:58:39.151 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:59:09.291 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:59:09.298 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:59:39.437 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:59:39.444 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:00:09.599 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:00:09.607 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:00:39.735 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:00:39.743 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:01:09.940 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:01:09.948 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:01:40.028 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:01:40.036 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:02:10.116 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:02:10.124 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:02:40.280 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:02:40.287 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:03:10.460 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:03:10.492 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:03:40.638 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:03:40.646 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:04:10.793 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:04:10.801 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:04:40.947 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:04:40.955 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:05:11.084 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:05:11.092 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:05:41.254 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:05:41.261 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:06:11.385 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:06:11.392 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:06:41.463 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:06:41.470 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:07:11.541 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:07:11.549 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:07:41.696 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:07:41.704 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:08:11.860 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:08:11.867 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:08:42.023 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:08:42.031 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:09:12.101 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:09:12.109 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:09:42.255 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:09:42.263 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:10:12.412 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:10:12.419 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:10:42.549 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:10:42.557 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:11:12.895 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:11:12.902 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:11:42.973 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:11:42.981 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:12:13.111 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:12:13.118 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:12:43.274 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:12:43.282 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:13:13.421 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:13:13.428 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:13:43.566 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:13:43.573 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:14:13.711 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:14:13.718 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:14:43.850 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:14:43.857 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:15:14.003 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:15:14.007 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:15:44.159 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:15:44.166 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:16:14.324 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:16:14.331 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:16:44.410 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:16:44.417 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:17:14.563 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:17:14.570 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:17:44.719 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:17:44.727 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:18:14.857 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:18:14.864 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:18:44.993 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:18:45.001 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:19:15.148 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:19:15.155 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:19:45.278 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:19:45.285 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:20:15.414 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:20:15.421 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:20:45.577 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:20:45.584 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:21:15.899 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:21:15.906 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:21:46.027 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:21:46.035 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:22:16.190 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:22:16.198 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:22:46.321 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:22:46.328 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:23:16.475 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:23:16.483 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:23:46.621 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:23:46.629 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:24:16.759 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:24:16.767 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:24:46.905 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:24:46.913 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:25:17.051 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:25:17.059 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:25:47.189 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:25:47.196 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:26:17.385 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:26:17.393 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:26:47.473 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:26:47.481 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:27:17.618 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:27:17.626 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:27:47.764 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:27:47.771 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:28:17.909 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:28:17.917 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:28:48.064 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:28:48.072 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:29:18.203 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:29:18.211 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:29:48.349 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:29:48.356 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:30:18.512 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:30:18.520 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:30:48.655 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:30:48.663 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:31:18.744 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:31:18.752 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:31:48.833 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:31:48.841 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:32:18.912 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:32:18.920 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:32:49.065 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:32:49.073 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:33:19.230 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:33:19.237 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:33:49.384 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:33:49.391 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:34:19.521 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:34:19.529 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:34:49.658 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:34:49.666 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:35:19.796 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:35:19.803 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:35:49.951 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:35:49.959 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:36:20.281 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:36:20.288 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:36:50.416 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:36:50.423 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:37:20.547 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:37:20.554 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:37:50.702 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:37:50.710 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:38:20.856 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:38:20.864 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:38:51.002 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:38:51.010 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:39:21.155 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:39:21.163 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:39:51.319 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:39:51.327 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:40:21.473 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:40:21.481 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:40:51.609 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:40:51.616 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:41:21.771 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:41:21.779 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:41:51.902 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:41:51.909 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:42:22.057 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:42:22.064 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:42:52.202 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:42:52.210 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:43:22.349 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:43:22.356 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:43:52.510 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:43:52.518 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:44:22.648 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:44:22.655 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:44:52.802 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:44:52.810 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:45:22.966 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:45:22.973 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:45:53.102 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:45:53.109 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:46:23.201 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:46:23.208 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:46:53.287 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:46:53.294 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:47:23.367 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:47:23.375 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:47:53.537 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:47:53.544 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:48:23.616 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:48:23.624 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:48:53.696 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:48:53.704 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:49:23.859 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:49:23.866 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:49:54.005 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:49:54.012 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:50:24.168 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:50:24.175 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:50:54.322 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:50:54.329 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:51:24.418 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:51:24.425 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:51:54.488 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:51:54.496 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:52:24.705 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:52:24.713 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:52:54.840 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:52:54.848 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:53:25.011 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:53:25.018 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:53:55.139 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:53:55.147 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:54:25.309 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:54:25.317 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:54:55.456 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:54:55.463 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:55:25.611 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:55:25.618 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:55:55.765 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:55:55.773 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:56:26.061 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:56:26.068 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:56:56.207 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:56:56.215 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:57:26.345 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:57:26.352 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:57:56.498 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:57:56.506 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:58:26.646 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:58:26.653 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:58:56.725 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:58:56.732 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:59:26.862 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:59:26.869 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:59:57.008 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:59:57.015 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:00:27.162 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:00:27.169 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:00:57.323 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:00:57.330 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:01:27.488 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:01:27.496 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:01:57.624 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:01:57.632 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:02:27.780 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:02:27.787 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:02:57.932 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:02:57.940 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:03:28.079 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:03:28.086 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:03:58.234 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:03:58.241 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:04:28.379 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:04:28.387 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:04:58.525 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:04:58.533 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:05:28.672 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:05:28.679 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:05:58.817 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:05:58.825 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:06:29.064 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:06:29.072 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:06:59.210 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:06:59.217 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:07:29.356 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:07:29.364 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:07:59.502 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:07:59.509 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:08:29.647 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:08:29.655 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:08:59.860 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:08:59.867 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:09:30.014 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:09:30.018 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:10:00.168 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:10:00.176 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:10:30.288 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:10:30.295 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:11:00.427 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:11:00.433 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:11:30.581 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:11:30.588 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:12:00.753 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:12:00.761 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:12:30.915 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:12:30.923 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:13:01.037 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:13:01.044 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:13:31.189 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:13:31.196 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:14:01.345 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:14:01.352 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:14:31.474 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:14:31.482 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:15:01.628 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:15:01.635 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:15:31.783 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:15:31.790 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:16:01.921 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:16:01.928 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:16:32.150 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:16:32.157 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:17:02.229 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:17:02.237 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:17:32.375 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:17:32.383 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:18:02.529 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:18:02.537 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:18:32.625 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:18:32.633 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:19:02.771 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:19:02.778 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:19:32.925 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:19:32.933 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:20:03.088 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:20:03.095 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:20:33.170 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:20:33.178 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:21:03.347 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:21:03.355 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:21:33.584 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:21:33.592 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:22:03.747 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:22:03.754 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:22:33.884 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:22:33.892 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:23:04.047 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:23:04.055 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:23:34.192 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:23:34.200 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:24:04.363 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:24:04.371 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:24:34.510 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:24:34.517 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:25:04.588 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:25:04.595 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:25:34.718 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:25:34.726 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:26:04.872 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:26:04.880 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:26:35.052 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:26:35.060 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:27:05.182 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:27:05.189 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:27:35.344 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:27:35.352 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:28:05.507 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:28:05.514 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:28:35.661 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:28:35.668 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:29:05.740 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:29:05.748 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:29:35.819 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:29:35.827 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:30:05.973 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:30:05.980 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:30:36.136 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:30:36.144 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:31:06.273 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:31:06.281 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:31:36.629 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:31:36.637 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:32:06.784 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:32:06.791 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:32:36.862 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:32:36.869 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:33:07.017 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:33:07.022 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:33:37.170 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:33:37.178 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:34:07.325 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:34:07.332 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:34:37.471 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:34:37.479 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:35:07.633 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:35:07.641 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:35:37.779 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:35:37.787 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:36:07.858 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:36:07.866 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:36:37.946 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:36:37.954 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:37:08.026 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:37:08.034 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:37:38.172 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:37:38.180 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:38:08.335 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:38:08.342 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:38:38.480 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:38:38.488 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:39:08.627 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:39:08.634 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:39:38.773 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:39:38.780 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:40:08.919 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:40:08.926 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:40:39.048 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:40:39.055 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:41:09.202 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:41:09.209 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:41:39.540 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:41:39.548 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:42:09.676 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:42:09.684 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:42:39.765 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:42:39.772 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:43:09.912 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:43:09.919 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:43:40.050 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:43:40.057 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:44:10.203 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:44:10.211 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:44:40.341 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:44:40.348 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:45:10.487 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:45:10.494 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:45:40.617 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:45:40.625 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:46:10.729 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:46:10.737 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:46:40.925 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:46:40.933 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:47:11.004 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:47:11.012 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:47:41.117 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:47:41.125 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:48:11.262 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:48:11.270 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:48:41.409 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:48:41.416 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:49:11.546 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:49:11.554 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:49:41.693 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:49:41.700 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:50:11.846 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:50:11.854 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:50:41.993 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:50:42.000 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:51:12.130 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:51:12.138 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:51:42.219 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:51:42.226 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:52:12.289 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:52:12.296 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:52:42.364 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:52:42.371 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:53:12.524 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:53:12.532 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:53:42.677 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:53:42.685 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:54:12.832 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:54:12.840 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:54:42.995 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:54:43.003 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:55:13.141 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:55:13.148 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:55:43.303 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:55:43.311 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:56:13.441 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:56:13.449 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:56:43.537 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:56:43.545 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:57:13.708 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:57:13.716 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:57:43.879 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:57:43.887 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:58:14.025 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:58:14.033 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:58:44.171 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:58:44.179 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:59:14.317 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:59:14.325 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:59:44.454 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:59:44.462 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:00:14.592 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:00:14.600 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:00:44.755 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:00:44.762 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:01:14.901 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:01:14.908 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:01:44.996 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:01:45.004 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:02:15.076 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:02:15.084 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:02:45.155 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:02:45.163 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:03:15.292 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:03:15.300 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:03:45.464 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:03:45.472 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:04:15.627 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:04:15.635 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:04:45.781 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:04:45.789 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:05:15.951 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:05:15.959 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:05:46.107 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:05:46.115 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:06:16.244 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:06:16.251 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:06:46.573 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:06:46.581 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:07:16.719 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:07:16.727 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:07:46.874 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:07:46.881 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:08:17.020 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:08:17.027 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:08:47.158 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:08:47.165 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:09:17.312 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:09:17.319 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:09:47.458 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:09:47.466 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:10:17.613 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:10:17.621 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:10:47.784 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:10:47.792 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:11:17.930 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:11:17.938 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:11:48.075 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:11:48.082 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:12:18.229 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:12:18.237 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:12:48.384 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:12:48.391 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:13:18.530 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:13:18.538 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:13:48.676 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:13:48.684 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:14:18.805 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:14:18.814 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:14:48.960 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:14:48.968 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:15:19.123 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:15:19.130 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:15:49.276 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:15:49.284 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:16:19.406 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:16:19.414 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:16:49.561 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:16:49.568 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:17:19.715 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:17:19.722 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:17:49.861 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:17:49.868 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:18:20.007 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:18:20.015 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:18:50.160 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:18:50.168 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:19:20.315 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:19:20.322 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:19:50.444 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:19:50.452 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:20:20.599 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:20:20.607 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:20:50.746 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:20:50.753 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:21:20.892 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:21:20.899 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:21:51.073 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:21:51.081 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:22:21.219 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:22:21.226 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:22:51.373 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:22:51.381 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:23:21.519 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:23:21.527 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:23:51.598 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:23:51.606 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:24:21.744 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:24:21.751 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:24:51.822 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:24:51.829 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:25:21.978 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:25:21.986 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:25:52.132 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:25:52.139 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:26:22.211 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:26:22.219 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:26:52.558 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:26:52.566 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:27:22.645 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:27:22.652 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:27:52.799 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:27:52.807 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:28:22.945 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:28:22.953 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:28:53.108 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:28:53.115 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:29:23.466 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:29:23.474 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:29:53.618 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:29:53.625 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:30:23.764 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:30:23.772 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:30:53.928 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:30:53.936 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:31:24.065 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:31:24.072 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:31:54.237 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:31:54.245 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:32:24.365 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:32:24.372 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:32:54.512 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:32:54.520 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:33:24.658 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:33:24.666 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:33:54.829 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:33:54.836 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:34:24.976 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:34:24.983 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:34:55.113 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:34:55.120 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:35:25.250 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:35:25.258 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:35:55.397 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:35:55.404 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:36:25.543 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:36:25.551 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:36:55.738 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:36:55.746 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:37:26.118 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:37:26.126 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:37:56.273 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:37:56.280 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:38:26.351 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:38:26.359 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:38:56.514 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:38:56.522 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:39:26.676 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:39:26.684 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:39:56.832 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:39:56.839 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:40:26.969 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:40:26.977 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:40:57.115 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:40:57.123 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:41:27.277 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:41:27.285 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:41:57.415 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:41:57.422 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:42:27.493 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:42:27.500 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:42:57.751 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:42:57.759 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:43:27.885 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:43:27.892 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:43:58.023 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:43:58.031 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:44:28.186 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:44:28.194 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:44:58.333 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:44:58.340 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:45:28.486 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:45:28.494 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:45:58.633 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:45:58.641 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:46:28.795 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:46:28.803 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:46:58.900 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:46:58.908 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:47:29.062 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:47:29.070 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:47:59.217 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:47:59.224 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:48:29.379 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:48:29.387 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:48:59.550 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:48:59.557 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:49:29.637 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:49:29.645 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:49:59.800 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:49:59.807 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:50:29.952 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:50:29.960 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:51:00.091 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:51:00.098 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:51:30.170 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:51:30.178 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:52:00.268 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:52:00.276 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:52:30.347 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:52:30.354 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:53:00.492 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:53:00.499 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:53:30.637 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:53:30.645 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:54:00.793 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:54:00.800 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:54:30.947 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:54:30.954 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:55:01.026 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:55:01.034 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:55:31.172 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:55:31.180 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:56:01.318 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:56:01.325 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:56:31.473 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:56:31.480 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:57:01.819 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:57:01.826 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:57:31.964 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:57:31.971 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:58:02.110 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:58:02.117 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:58:32.274 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:58:32.281 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:59:02.436 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:59:02.443 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:59:32.580 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:59:32.588 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:00:02.651 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:00:02.658 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:00:32.816 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:00:32.823 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:01:02.960 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:01:02.968 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:01:33.106 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:01:33.113 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:02:03.269 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:02:03.276 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:02:33.440 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:02:33.448 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:03:03.586 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:03:03.594 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:03:33.731 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:03:33.739 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:04:03.818 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:04:03.825 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:04:33.965 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:04:33.973 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:05:04.128 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:05:04.135 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:05:34.265 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:05:34.273 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:06:04.438 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:06:04.445 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:06:34.600 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:06:34.608 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:07:04.987 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:07:04.995 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:07:35.150 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:07:35.158 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:08:05.296 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:08:05.303 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:08:35.450 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:08:35.458 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:09:05.528 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:09:05.535 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:09:35.676 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:09:35.681 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:10:05.821 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:10:05.828 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:10:35.958 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:10:35.965 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:11:06.104 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:11:06.112 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:11:36.210 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:11:36.218 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:12:06.413 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:12:06.420 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:12:36.494 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:12:36.502 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:13:06.639 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:13:06.646 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:13:36.713 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:13:36.721 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:14:06.788 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:14:06.796 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:14:36.868 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:14:36.875 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:15:07.023 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:15:07.030 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:15:37.110 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:15:37.118 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:16:07.257 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:16:07.265 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:16:37.570 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:16:37.578 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:17:07.958 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:17:07.965 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:17:38.112 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:17:38.120 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:18:08.277 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:18:08.285 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:18:38.421 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:18:38.429 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:19:08.491 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:19:08.499 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:19:38.646 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:19:38.654 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:20:08.792 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:20:08.800 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:20:38.946 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:20:38.952 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:21:09.084 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:21:09.091 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:21:39.230 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:21:39.237 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:22:09.393 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:22:09.401 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:22:39.538 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:22:39.546 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:23:09.627 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:23:09.634 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:23:39.713 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:23:39.721 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:24:09.885 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:24:09.892 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:24:40.022 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:24:40.030 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:25:10.169 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:25:10.177 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:25:40.323 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:25:40.331 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:26:10.478 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:26:10.486 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:26:40.565 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:26:40.573 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:27:10.895 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:27:10.903 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:27:41.039 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:27:41.047 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:28:11.187 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:28:11.195 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:28:41.342 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:28:41.350 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:29:11.421 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:29:11.429 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:29:41.523 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:29:41.530 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:30:11.593 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:30:11.601 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:30:41.673 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:30:41.681 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:31:11.811 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:31:11.819 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:31:41.965 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:31:41.972 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:32:12.061 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:32:12.068 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:32:42.149 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:32:42.157 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:33:12.279 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:33:12.286 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:33:42.415 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:33:42.423 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:34:12.570 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:34:12.578 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:34:42.716 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:34:42.724 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:35:12.863 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:35:12.870 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:35:43.016 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:35:43.024 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:36:13.162 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:36:13.166 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:36:43.325 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:36:43.332 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:37:13.555 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:37:13.561 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:37:43.684 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:37:43.692 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:38:13.839 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:38:13.847 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:38:43.993 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:38:44.001 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:39:14.081 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:39:14.089 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:39:44.219 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:39:44.226 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:40:14.346 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:40:14.354 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:40:44.545 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:40:44.553 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:41:14.632 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:41:14.640 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:41:44.778 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:41:44.786 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:42:15.040 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:42:15.045 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:42:45.177 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:42:45.185 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:43:15.323 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:43:15.331 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:43:45.469 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:43:45.477 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:44:15.623 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:44:15.631 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:44:45.778 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:44:45.786 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:45:15.866 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:45:15.873 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:45:45.945 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:45:45.952 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:46:16.108 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:46:16.116 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:46:46.254 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:46:46.261 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:47:16.525 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:47:16.533 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:47:46.680 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:47:46.688 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:48:16.842 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:48:16.850 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:48:47.007 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:48:47.017 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:49:17.176 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:49:17.183 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:49:47.322 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:49:47.330 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:50:17.476 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:50:17.484 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:50:47.622 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:50:47.630 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:51:17.785 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:51:17.792 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:51:47.939 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:51:47.947 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:52:18.093 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:52:18.101 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:52:48.255 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:52:48.264 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:53:18.420 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:53:18.428 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:53:48.573 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:53:48.582 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:54:18.720 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:54:18.727 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:54:48.866 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:54:48.874 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:55:19.027 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:55:19.034 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:55:49.165 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:55:49.173 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:56:19.303 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:56:19.311 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:56:49.440 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:56:49.448 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:57:19.670 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:57:19.679 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:57:49.825 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:57:49.832 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:58:19.979 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:58:19.987 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:58:50.140 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:58:50.148 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:59:20.220 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:59:20.228 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:59:50.375 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:59:50.382 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:00:20.521 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:00:20.530 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:00:50.650 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:00:50.659 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:01:20.804 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:01:20.813 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:01:50.951 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:01:50.959 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:02:21.147 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:02:21.156 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:02:51.310 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:02:51.318 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:03:21.440 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:03:21.448 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:03:51.601 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:03:51.608 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:04:21.749 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:04:21.757 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:04:51.918 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:04:51.926 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:05:22.057 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:05:22.064 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:05:52.202 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:05:52.210 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:06:22.357 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:06:22.365 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:06:52.503 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:06:52.510 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:07:22.658 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:07:22.665 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:07:52.787 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:07:52.794 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:08:22.958 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:08:22.965 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:08:53.115 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:08:53.123 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:09:23.194 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:09:23.202 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:09:53.336 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:09:53.343 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:10:23.500 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:10:23.507 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:10:53.585 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:10:53.594 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:11:23.738 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:11:23.745 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:11:53.877 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:11:53.885 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:12:24.176 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:12:24.184 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:12:54.322 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:12:54.330 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:13:24.462 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:13:24.470 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:13:54.627 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:13:54.634 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:14:24.699 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:14:24.707 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:14:54.835 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:14:54.843 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:15:25.015 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:15:25.023 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:15:55.144 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:15:55.152 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:16:25.318 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:16:25.326 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:16:55.462 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:16:55.471 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:17:25.657 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:17:25.665 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:17:55.745 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:17:55.753 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:18:25.874 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:18:25.881 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:18:55.954 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:18:55.961 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:19:26.042 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:19:26.049 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:19:56.120 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:19:56.128 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:20:26.277 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:20:26.283 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:20:56.421 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:20:56.429 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:21:26.567 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:21:26.574 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:21:56.714 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:21:56.721 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:22:26.809 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:22:26.817 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:22:56.898 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:22:56.906 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:23:27.069 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:23:27.076 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:23:57.207 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:23:57.214 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:24:27.352 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:24:27.359 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:24:57.497 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:24:57.505 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:25:27.628 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:25:27.636 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:25:57.781 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:25:57.789 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:26:27.935 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:26:27.942 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:26:58.089 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:26:58.096 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:27:28.336 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:27:28.343 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:27:58.499 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:27:58.506 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:28:28.586 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:28:28.594 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:28:58.716 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:28:58.723 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:29:28.860 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:29:28.867 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:29:58.998 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:29:59.006 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:30:29.135 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:30:29.143 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:30:59.258 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:30:59.266 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:31:29.403 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:31:29.411 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:31:59.599 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:31:59.607 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:32:29.904 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:32:29.912 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:33:00.042 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:33:00.049 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:33:30.169 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:33:30.177 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:34:00.324 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:34:00.331 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:34:30.453 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:34:30.461 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:35:00.583 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:35:00.590 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:35:30.703 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:35:30.711 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:36:00.842 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:36:00.850 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:36:30.970 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:36:30.978 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:37:01.117 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:37:01.124 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:37:31.221 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:37:31.229 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:38:01.375 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:38:01.383 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:38:31.522 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:38:31.529 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:39:01.668 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:39:01.675 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:39:31.805 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:39:31.813 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:40:01.900 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:40:01.907 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:40:32.055 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:40:32.062 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:41:02.201 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:41:02.208 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:41:32.355 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:41:32.362 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:42:02.484 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:42:02.491 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:42:32.578 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:42:32.586 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:43:02.735 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:43:02.743 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:43:32.888 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:43:32.897 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:44:03.059 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:44:03.067 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:44:33.221 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:44:33.229 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:45:03.293 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:45:03.301 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:45:33.430 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:45:33.438 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:46:03.568 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:46:03.577 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:46:33.730 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:46:33.738 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:47:03.885 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:47:03.892 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:47:34.081 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:47:34.088 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:48:04.218 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:48:04.226 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:48:34.355 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:48:34.363 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:49:04.443 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:49:04.451 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:49:34.596 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:49:34.604 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:50:04.751 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:50:04.759 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:50:34.889 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:50:34.897 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:51:05.043 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:51:05.051 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:51:35.229 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:51:35.237 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:52:05.369 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:52:05.377 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:52:35.464 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:52:35.471 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:53:05.552 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:53:05.560 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:53:35.697 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:53:35.705 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:54:05.827 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:54:05.834 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:54:35.982 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:54:35.990 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:55:06.145 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:55:06.152 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:55:36.217 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:55:36.224 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:56:06.286 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:56:06.293 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:56:36.366 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:56:36.373 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:57:06.511 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:57:06.519 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:57:36.607 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:57:36.615 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:58:06.752 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:58:06.759 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:58:36.830 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:58:36.838 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:59:06.911 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:59:06.916 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:59:36.990 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:59:36.998 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:00:07.071 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:00:07.078 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:00:37.149 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:00:37.157 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:01:07.287 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:01:07.295 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:01:37.375 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:01:37.383 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:02:07.538 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:02:07.547 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:02:37.634 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:02:37.642 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:03:07.779 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:03:07.787 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:03:37.984 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:03:37.992 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:04:08.121 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:04:08.129 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:04:38.259 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:04:38.266 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:05:08.397 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:05:08.404 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:05:38.528 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:05:38.536 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:06:08.607 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:06:08.615 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:06:38.762 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:06:38.770 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:07:08.841 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:07:08.848 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:07:38.935 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:07:38.943 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:08:09.024 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:08:09.032 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:08:39.112 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:08:39.119 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:09:09.267 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:09:09.274 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:09:39.404 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:09:39.411 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:10:09.643 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:10:09.651 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:10:39.805 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:10:39.812 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:11:09.942 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:11:09.950 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:11:40.105 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:11:40.113 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:12:10.234 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:12:10.242 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:12:40.589 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:12:40.596 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:13:10.742 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:13:10.750 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:13:40.906 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:13:40.914 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:14:11.060 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:14:11.068 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:14:41.206 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:14:41.213 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:15:11.377 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:15:11.384 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:15:41.539 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:15:41.547 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:16:11.711 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:16:11.719 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:16:42.066 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:16:42.073 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:17:12.211 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:17:12.219 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:17:42.299 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:17:42.307 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:18:12.461 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:18:12.469 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:18:42.600 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:18:42.608 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:19:12.746 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:19:12.754 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:19:42.899 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:19:42.907 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:20:13.071 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:20:13.078 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:20:43.158 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:20:43.166 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:21:13.246 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:21:13.253 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:21:43.400 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:21:43.408 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:22:13.633 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:22:13.641 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:22:43.734 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:22:43.742 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:23:13.813 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:23:13.821 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:23:43.943 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:23:43.951 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:24:14.089 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:24:14.097 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:24:44.234 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:24:44.242 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:25:14.406 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:25:14.413 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:25:44.560 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:25:44.568 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:26:14.721 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:26:14.729 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:26:44.877 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:26:44.884 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:27:15.039 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:27:15.047 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:27:45.353 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:27:45.361 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:28:15.507 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:28:15.514 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:28:45.652 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:28:45.660 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:29:15.816 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:29:15.824 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:29:45.977 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:29:45.985 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:30:16.149 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:30:16.157 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:30:46.270 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:30:46.277 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:31:16.440 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:31:16.448 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:31:46.520 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:31:46.528 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:32:16.657 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:32:16.665 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:32:46.954 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:32:46.963 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:33:17.108 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:33:17.116 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:33:47.271 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:33:47.278 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:34:17.434 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:34:17.442 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:34:47.603 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:34:47.611 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:35:17.758 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:35:17.765 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:35:47.930 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:35:47.938 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:36:18.059 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:36:18.066 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:36:48.222 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:36:48.229 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:37:18.342 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:37:18.350 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:37:48.497 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:37:48.504 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:38:18.668 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:38:18.676 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:38:48.815 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:38:48.822 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:39:18.969 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:39:18.977 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:39:49.257 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:39:49.264 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:40:19.394 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:40:19.401 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:40:49.540 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:40:49.548 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:41:19.685 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:41:19.693 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:41:49.823 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:41:49.831 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:42:19.960 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:42:19.967 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:42:50.090 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:42:50.097 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:43:20.353 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:43:20.360 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:43:50.482 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:43:50.490 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:44:20.637 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:44:20.644 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:44:50.807 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:44:50.815 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:45:20.970 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:45:20.978 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:45:51.141 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:45:51.149 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:46:21.288 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:46:21.296 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:46:51.441 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:46:51.449 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:47:21.605 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:47:21.612 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:47:51.699 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:47:51.707 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:48:21.779 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:48:21.787 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:48:51.859 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:48:51.866 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:49:22.022 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:49:22.029 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:49:52.159 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:49:52.168 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:50:22.306 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:50:22.313 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:50:52.442 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:50:52.450 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:51:22.606 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:51:22.614 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:51:52.769 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:51:52.777 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:52:22.913 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:52:22.921 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:52:53.011 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:52:53.018 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:53:23.098 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:53:23.105 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:53:53.183 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:53:53.191 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:54:23.330 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:54:23.337 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:54:53.475 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:54:53.483 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:55:23.631 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:55:23.639 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:55:53.777 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:55:53.784 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:56:23.915 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:56:23.922 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:56:54.087 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:56:54.094 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:57:24.248 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:57:24.256 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:57:54.345 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:57:54.352 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:58:24.425 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:58:24.432 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:58:54.512 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:58:54.520 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:59:24.638 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:59:24.645 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:59:54.728 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:59:54.735 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:00:24.808 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:00:24.816 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:00:54.897 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:00:54.904 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:01:24.983 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:01:24.991 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:01:55.136 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:01:55.144 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:02:25.300 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:02:25.307 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:02:55.397 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:02:55.404 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:03:25.484 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:03:25.492 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:03:55.571 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:03:55.579 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:04:25.743 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:04:25.750 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:04:55.872 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:04:55.879 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:05:26.043 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:05:26.050 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:05:56.173 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:05:56.181 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:06:26.327 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:06:26.335 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:06:56.490 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:06:56.498 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:07:26.653 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:07:26.660 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:07:56.747 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:07:56.755 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:08:26.895 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:08:26.902 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:08:57.038 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:08:57.045 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:09:27.193 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:09:27.201 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:09:57.349 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:09:57.356 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:10:27.519 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:10:27.526 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:10:57.665 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:10:57.673 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:11:27.812 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:11:27.820 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:11:57.966 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:11:57.974 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:12:28.137 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:12:28.145 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:12:58.316 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:12:58.324 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:13:28.452 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:13:28.460 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:13:58.590 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:13:58.598 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:14:28.745 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:14:28.753 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:14:58.900 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:14:58.907 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:15:29.062 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:15:29.070 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:15:59.223 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:15:59.231 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:16:29.370 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:16:29.377 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:16:59.541 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:16:59.546 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:17:29.688 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:17:29.695 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:17:59.959 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:17:59.967 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:18:30.087 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:18:30.093 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:19:00.251 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:19:00.258 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:19:30.413 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:19:30.420 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:20:00.549 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:20:00.556 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:20:30.695 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:20:30.702 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:21:00.851 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:21:00.858 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:21:31.021 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:21:31.029 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:22:01.176 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:22:01.184 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:22:31.321 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:22:31.329 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:23:01.650 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:23:01.658 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:23:31.738 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:23:31.746 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:24:01.818 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:24:01.826 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:24:31.981 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:24:31.989 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:25:02.118 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:25:02.126 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:25:32.273 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:25:32.280 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:26:02.442 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:26:02.449 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:26:32.589 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:26:32.597 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:27:02.736 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:27:02.744 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:27:32.879 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:27:32.887 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:28:03.219 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:28:03.226 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:28:33.357 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:28:33.364 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:29:03.500 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:29:03.508 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:29:33.657 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:29:33.664 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:30:03.803 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:30:03.810 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:30:33.957 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:30:33.964 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:31:04.051 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:31:04.058 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:31:34.140 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:31:34.148 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:32:04.278 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:32:04.285 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:32:34.441 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:32:34.448 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:33:04.545 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:33:04.552 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:33:34.624 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:33:34.631 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:34:04.703 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:34:04.711 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:34:34.883 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:34:34.890 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:35:05.036 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:35:05.044 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:35:35.183 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:35:35.191 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:36:05.347 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:36:05.354 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:36:35.508 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:36:35.516 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:37:05.644 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:37:05.651 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:37:35.725 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:37:35.732 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:38:06.013 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:38:06.020 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:38:36.091 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:38:36.099 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:39:06.288 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:39:06.295 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:39:36.364 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:39:36.372 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:40:06.438 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:40:06.446 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:40:36.516 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:40:36.524 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:41:06.597 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:41:06.604 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:41:36.672 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:41:36.680 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:42:06.749 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:42:06.756 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:42:36.828 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:42:36.836 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:43:06.923 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:43:06.931 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:43:36.995 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:43:37.003 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:44:07.075 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:44:07.083 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:44:37.149 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:44:37.156 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:45:07.225 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:45:07.233 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:45:37.300 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:45:37.307 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:46:07.366 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:46:07.373 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:46:37.437 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:46:37.445 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:47:07.517 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:47:07.524 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:47:37.596 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:47:37.604 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:48:07.684 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:48:07.692 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:48:37.772 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:48:37.780 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:49:07.842 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:49:07.849 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:49:37.929 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:49:37.936 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:50:08.009 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:50:08.016 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:50:38.086 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:50:38.094 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:51:08.161 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:51:08.169 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:51:38.238 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:51:38.245 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:52:08.322 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:52:08.329 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:52:38.396 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:52:38.403 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:53:08.493 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:53:08.501 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:53:38.564 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:53:38.571 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:54:08.644 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:54:08.652 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:54:38.789 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:54:38.797 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:55:08.944 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:55:08.952 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:55:39.096 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:55:39.104 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:56:09.251 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:56:09.259 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:56:39.332 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:56:39.340 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:57:09.409 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:57:09.417 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:57:39.490 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:57:39.498 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:58:09.579 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:58:09.587 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:58:39.660 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:58:39.668 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:59:09.746 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:59:09.753 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:59:39.900 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:59:39.907 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:00:10.053 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:00:10.060 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:00:40.200 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:00:40.207 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:01:10.346 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:01:10.354 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:01:40.507 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:01:40.515 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:02:10.646 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:02:10.654 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:02:40.727 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:02:40.735 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:03:10.825 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:03:10.833 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:03:40.898 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:03:40.905 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:04:10.988 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:04:10.996 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:04:41.067 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:04:41.074 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:05:11.139 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:05:11.147 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:05:41.212 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:05:41.219 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:06:11.286 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:06:11.293 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:06:41.357 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:06:41.365 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:07:11.431 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:07:11.438 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:07:41.512 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:07:41.520 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:08:11.599 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:08:11.607 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:08:41.671 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:08:41.678 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:09:11.748 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:09:11.756 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:09:41.822 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:09:41.830 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:10:11.898 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:10:11.905 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:10:41.977 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:10:42.155 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:11:12.215 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:11:12.224 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:11:42.293 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:11:42.300 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:12:12.364 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:12:12.372 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:12:42.437 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:12:42.445 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:13:12.523 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:13:12.531 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:13:42.604 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:13:42.612 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:14:12.675 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:14:12.683 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:14:42.754 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:14:42.762 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:15:12.833 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:15:12.841 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:15:42.913 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:15:42.921 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:16:12.984 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:16:12.992 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:16:43.058 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:16:43.066 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:17:13.135 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:17:13.142 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:17:43.212 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:17:43.219 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:18:13.301 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:18:13.308 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:18:43.380 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:18:43.388 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:19:13.450 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:19:13.458 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:19:43.522 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:19:43.529 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:20:13.601 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:20:13.608 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:20:43.680 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:20:43.687 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:21:13.750 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:21:13.758 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:21:43.863 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:21:43.871 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:22:13.944 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:22:13.952 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:22:44.023 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:22:44.031 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:23:14.120 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:23:14.127 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:23:44.191 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:23:44.199 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:24:14.268 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:24:14.275 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:24:44.341 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:24:44.349 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:25:14.412 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:25:14.420 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:25:44.484 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:25:44.491 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:26:14.562 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:26:14.570 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:26:44.641 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:26:44.648 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:27:14.721 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:27:14.728 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:27:44.866 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:27:44.874 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:28:14.954 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:28:14.962 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:28:45.042 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:28:45.049 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:29:15.121 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:29:15.129 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:29:45.199 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:29:45.207 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:30:15.280 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:30:15.287 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:30:45.375 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:30:45.382 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:31:15.447 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:31:15.454 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:31:45.584 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:31:45.591 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:32:15.747 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:32:15.754 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:32:45.885 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:32:45.892 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:33:15.962 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:33:15.969 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:33:46.092 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:33:46.100 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:34:16.231 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:34:16.239 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:34:46.410 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:34:46.418 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:35:16.572 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:35:16.580 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:35:46.727 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:35:46.735 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:36:16.864 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:36:16.871 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:36:47.011 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:36:47.018 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:37:17.089 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:37:17.096 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:37:47.160 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:37:47.168 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:38:17.257 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:38:17.264 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:38:47.328 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:38:47.336 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:39:17.397 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:39:17.404 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:39:47.469 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:39:47.476 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:40:17.616 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:40:17.623 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:40:47.770 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:40:47.778 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:41:17.927 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:41:17.934 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:41:48.079 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:41:48.087 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:42:18.225 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:42:18.233 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:42:48.362 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:42:48.370 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:43:18.458 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:43:18.467 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:43:48.530 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:43:48.541 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:44:18.608 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:44:18.616 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:44:48.712 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:44:48.720 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:45:18.793 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:45:18.798 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:45:48.867 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:45:48.881 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:46:18.951 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:46:18.962 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:46:49.032 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:46:49.040 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:47:19.112 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:47:19.125 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:47:49.198 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:47:49.206 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:48:19.287 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:48:19.296 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:48:49.381 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:48:49.389 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:49:19.467 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:49:19.476 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:49:49.554 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:49:49.562 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:50:19.627 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:50:19.634 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:50:49.706 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:50:49.710 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:51:19.778 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:51:19.786 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:51:49.866 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:51:49.873 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:52:19.941 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:52:19.949 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:52:50.016 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:52:50.024 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:53:20.100 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:53:20.107 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:53:50.196 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:53:50.204 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:54:20.343 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:54:20.351 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:54:50.489 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:54:50.496 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:55:20.653 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:55:20.661 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:55:50.812 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:55:50.820 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:56:20.967 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:56:20.975 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:56:51.131 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:56:51.139 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:57:21.269 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:57:21.277 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:57:51.399 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:57:51.407 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:58:21.563 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:58:21.571 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:58:51.642 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:58:51.650 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:59:21.713 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:59:21.721 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:59:51.794 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:59:51.801 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:00:21.874 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:00:21.882 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:00:51.960 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:00:51.968 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:01:22.042 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:01:22.050 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:01:52.131 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:01:52.139 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:02:22.206 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:02:22.213 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:02:52.280 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:02:52.288 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:03:22.369 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:03:22.377 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:03:52.447 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:03:52.455 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:04:22.520 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:04:22.528 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:04:52.599 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:04:52.607 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:05:22.672 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:05:22.679 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:05:52.751 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:05:52.759 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:06:22.832 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:06:22.840 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:06:52.920 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:06:52.925 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:07:22.989 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:07:22.997 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:07:53.081 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:07:53.089 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:08:23.161 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:08:23.168 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:08:53.318 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:08:53.326 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:09:23.455 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:09:23.463 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:09:53.585 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:09:53.593 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:10:23.740 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:10:23.748 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:10:53.880 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:10:53.888 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:11:24.017 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:11:24.025 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:11:54.155 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:11:54.163 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:12:24.320 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:12:24.328 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:12:54.466 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:12:54.474 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:13:24.779 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:13:24.786 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:13:54.944 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:13:54.951 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:14:25.022 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:14:25.030 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:14:55.098 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:14:55.106 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:15:25.175 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:15:25.184 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:15:55.248 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:15:55.256 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:16:25.325 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:16:25.333 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:16:55.399 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:16:55.406 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:17:25.473 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:17:25.480 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:17:55.552 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:17:55.560 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:18:25.641 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:18:25.649 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:18:55.712 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:18:55.720 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:19:25.782 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:19:25.790 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:19:55.854 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:19:55.861 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:20:25.926 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:20:25.934 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:20:56.013 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:20:56.021 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:21:26.086 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:21:26.094 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:21:56.175 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:21:56.182 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:22:26.322 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:22:26.330 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:22:56.483 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:22:56.490 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:23:26.573 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:23:26.580 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:23:56.693 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:23:56.701 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:24:26.858 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:24:26.866 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:24:57.022 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:24:57.029 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:25:27.194 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:25:27.202 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:25:57.301 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:25:57.309 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:26:27.395 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:26:27.403 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:26:57.476 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:26:57.484 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:27:27.548 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:27:27.555 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:27:57.622 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:27:57.630 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:28:27.708 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:28:27.716 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:28:57.781 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:28:57.788 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:29:27.859 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:29:27.867 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:29:57.933 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:29:57.940 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:30:28.011 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:30:28.019 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:30:58.115 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:30:58.122 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:31:28.194 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:31:28.202 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:31:58.273 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:31:58.281 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:32:28.350 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:32:28.357 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:32:58.432 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:32:58.439 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:33:28.520 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:33:28.528 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:33:58.591 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:33:58.599 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:34:28.663 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:34:28.671 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:34:58.737 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:34:58.745 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:35:28.811 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:35:28.819 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:35:58.891 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:35:58.897 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:36:28.963 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:36:28.970 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:36:59.037 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:36:59.044 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:37:29.110 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:37:29.118 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:37:59.185 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:37:59.193 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:38:29.277 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:38:29.285 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:38:59.365 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:38:59.373 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:39:29.445 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:39:29.453 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:39:59.520 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:39:59.528 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:40:29.609 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:40:29.618 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:40:59.689 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:40:59.697 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:41:29.771 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:41:29.780 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:41:59.851 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:41:59.859 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:42:29.941 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:42:29.949 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:43:00.016 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:43:00.024 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:43:30.105 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:43:30.112 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:44:00.185 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:44:00.193 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:44:30.269 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:44:30.277 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:45:00.341 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:45:00.349 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:45:30.416 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:45:30.423 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:46:00.490 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:46:00.498 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:46:30.568 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:46:30.576 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:47:00.649 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:47:00.657 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:47:30.731 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:47:30.739 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:48:00.811 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:48:00.819 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:48:30.901 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:48:30.909 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:49:00.991 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:49:00.998 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:49:31.072 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:49:31.079 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:50:01.151 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:50:01.158 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:50:31.222 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:50:31.230 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:51:01.296 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:51:01.303 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:51:31.378 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:51:31.386 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:52:01.452 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:52:01.460 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:52:31.539 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:52:31.547 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:53:01.614 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:53:01.622 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:53:31.703 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:53:31.711 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:54:01.792 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:54:01.799 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:54:31.873 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:54:31.881 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:55:02.013 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:55:02.021 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:55:32.160 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:55:32.167 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:56:02.315 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:56:02.322 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:56:32.479 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:56:32.487 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:57:02.651 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:57:02.659 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:57:32.810 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:57:32.817 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:58:02.939 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:58:02.947 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:58:33.254 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:58:33.262 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:59:03.335 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:59:03.342 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:59:33.408 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:59:33.415 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:00:03.487 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:00:03.494 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:00:33.565 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:00:33.573 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:01:03.640 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:01:03.648 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:01:33.733 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:01:33.740 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:02:03.810 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:02:03.818 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:02:33.882 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:02:33.890 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:03:03.963 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:03:03.971 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:03:34.044 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:03:34.052 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:04:04.134 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:04:05.168 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:04:35.239 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:04:35.250 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:05:05.321 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:05:05.329 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:05:35.404 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:05:35.412 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:06:05.492 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:06:05.499 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:06:35.572 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:06:35.580 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:07:05.657 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:07:05.665 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:07:35.733 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:07:35.740 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:08:05.812 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:08:05.820 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:08:35.901 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:08:35.910 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:09:05.984 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:09:05.992 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:09:36.062 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:09:36.072 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:10:06.149 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:10:06.157 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:10:36.231 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:10:36.238 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:11:06.302 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:11:06.310 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:11:36.378 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:11:36.386 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:12:06.455 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:12:06.463 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:12:36.527 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:12:36.535 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:13:06.603 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:13:06.610 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:13:36.687 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:13:36.695 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:14:06.776 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:14:06.784 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:14:36.956 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:14:36.963 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:15:07.036 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:15:07.044 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:15:37.109 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:15:37.117 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:16:07.185 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:16:07.193 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:16:37.262 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:16:37.270 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:17:07.350 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:17:07.358 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:17:37.431 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:17:37.439 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:18:07.513 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:18:07.521 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:18:37.616 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:18:37.624 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:19:07.697 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:19:07.705 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:19:37.776 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:19:37.784 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:20:07.865 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:20:07.873 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:20:37.945 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:20:37.953 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:21:08.025 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:21:08.033 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:21:38.107 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:21:38.115 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:22:08.271 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:22:08.278 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:22:38.420 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:22:38.427 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:23:08.566 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:23:08.573 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:23:38.651 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:23:38.659 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:24:08.724 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:24:08.733 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:24:38.813 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:24:38.821 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:24:52.442 DEBUG:teuthology.exit:Got signal 15; running 1 handler... 2023-06-09T16:24:52.443 DEBUG:teuthology.task.console_log:Killing console logger for smithi090 2023-06-09T16:24:52.443 DEBUG:teuthology.task.console_log:Killing console logger for smithi174 2023-06-09T16:24:52.443 DEBUG:teuthology.exit:Finished running handlers